国产av日韩一区二区三区精品,成人性爱视频在线观看,国产,欧美,日韩,一区,www.成色av久久成人,2222eeee成人天堂

Home System Tutorial Windows Series Hadoop pseudo-distributed cluster construction

Hadoop pseudo-distributed cluster construction

May 07, 2025 pm 04:45 PM
linux centos windows apache hadoop red

Software preparation

I'm using a virtual machine with CentOS-6.6, with the host name repo. Refer to the steps to install a Linux virtual machine in Windows, I installed JDK in that virtual machine, refer to the guide to installing JDK in Linux. In addition, the virtual machine is configured with a key-free login itself, and the settings for configuring key-free login between each virtual machine are referenced. The download address of the Hadoop installation package is: http://m.miracleart.cn/link/8485694bae96aebc7c4fe6119599d0e0 .

  1. Upload the Hadoop installation package to the server and decompress it

     [root@repo ~]# tar zxvf hadoop-2.6.5.tar.gz -C /opt/apps/
  2. Configure environment variables

     # You can directly locate the last line of the file [root@repo hadoop-2.6.5]# vi /etc/profile
    export HADOOP_HOME=/opt/apps/hadoop-2.6.5
    export PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin
    [root@repo hadoop-2.6.5]# . /etc/profile
  3. Modify the three configuration files of hadoop-env.sh, mapred-env.sh, and yarn-env.sh, and add JAVA_HOME

     [root@repo hadoop]# pwd
    /opt/apps/hadoop-2.6.5/etc/hadoop
    [root@repo hadoop]# vi hadoop-env.sh
    export JAVA_HOME=/usr/local/jdk1.8.0_73
    [root@repo hadoop]# vi mapred-env.sh
    export JAVA_HOME=/usr/local/jdk1.8.0_73
    [root@repo hadoop]# vi yarn-env.sh
    export JAVA_HOME=/usr/local/jdk1.8.0_73
  4. Modify the core-site.xml and hdfs-site.xml configuration files to configure pseudo-distributed related content

     [root@repo hadoop]# vi core-site.xml
    <configuration>
    <property>
     <name>fs.defaultFS</name>
     <value>hdfs://repo:9000</value>
    </property>
    <property>
     <name>hadoop.tmp.dir</name>
     <value>/var/hadoop/pseudo</value>
    </property>
    </configuration>
    [root@repo hadoop]# vi hdfs-site.xml
    <configuration>
    <property>
     <name>dfs.replication</name>
     <value>1</value>
    </property>
    <property>
     <name>dfs.namenode.secondary.http-address</name>
     <value>repo:50090</value>
    </property>
    </configuration>
  5. Modify the slaves configuration file and specify the node where the DataNode is located

     [root@repo hadoop]# vi slaves
    repo
  6. Format file system

     [root@repo hadoop]# hadoop namenode --format
    # Success message17/09/16 21:17:11 INFO common.Storage: Storage directory /var/hadoop/pseudo/dfs/name has been successfully formatted.
  7. Start HDFS and YARN

     [root@repo hadoop]# start-dfs.sh
    Starting namesnodes on [repo]
    repo: starting namenode, logging to /opt/apps/hadoop-2.6.5/logs/hadoop-root-namenode-repo.out
    repo: starting datanode, logging to /opt/apps/hadoop-2.6.5/logs/hadoop-root-datanode-repo.out
    Starting secondary namesodes [repo]
    repo: starting secondarynamenode, logging to /opt/apps/hadoop-2.6.5/logs/hadoop-root-secondarynamenode-repo.out
    [root@repo hadoop]# start-yarn.sh
    starting yarn daemons
    starting resourcemanager, logging to /opt/hadoop-2.7.4/logs/yarn-root-resourcemanager-repo.out
    repo: starting nodemanager, logging to /opt/hadoop-2.7.4/logs/yarn-root-nodemanager-repo.out
    [root@repo hadoop]# jps
    4368 Jps
    3957 ResourceManager
    3512 NameNode
    3641 DataNode
    4058 NodeManager
    3805 SecondaryNameNode
  8. Visit the WEB page Hadoop pseudo-distributed cluster constructionHadoop pseudo-distributed cluster construction Build successfully!

The above is the detailed content of Hadoop pseudo-distributed cluster construction. For more information, please follow other related articles on the PHP Chinese website!

Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

Hot AI Tools

Undress AI Tool

Undress AI Tool

Undress images for free

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

Windows stuck on 'undoing changes made to your computer' Windows stuck on 'undoing changes made to your computer' Jul 05, 2025 am 02:51 AM

The computer is stuck in the "Undo Changes made to the computer" interface, which is a common problem after the Windows update fails. It is usually caused by the stuck rollback process and cannot enter the system normally. 1. First of all, you should wait patiently for a long enough time, especially after restarting, it may take more than 30 minutes to complete the rollback, and observe the hard disk light to determine whether it is still running. 2. If there is no progress for a long time, you can force shut down and enter the recovery environment (WinRE) multiple times, and try to start repair or system restore. 3. After entering safe mode, you can uninstall the most recent update records through the control panel. 4. Use the command prompt to execute the bootrec command in the recovery environment to repair the boot file, or run sfc/scannow to check the system file. 5. The last method is to use the "Reset this computer" function

2025 policy strangulation warning: These three types of coins will be cleared out, sell them quickly! 2025 policy strangulation warning: These three types of coins will be cleared out, sell them quickly! Jul 03, 2025 am 10:30 AM

The three types of cryptocurrencies that may be liquidated or restricted by regulators in 2025 include: 1. Privacy currency, which is easily used for illegal activities due to its anonymity and faces restrictions or removal from the shelves caused by the strengthening of global AML/KYC regulations; 2. Unregistered securities tokens may be removed from the exchange or required rectification due to non-compliance with securities regulations; 3. Non-compliant stablecoins may be prohibited from trading due to lack of transparent reserves or regulatory permissions. It is recommended to pay close attention to regulatory trends, diversified investment, pay attention to exchange announcements and consult professionals to deal with policy risks.

How to collect airdrops in the currency circle? Are free tokens risky? Airdrop participation strategy How to collect airdrops in the currency circle? Are free tokens risky? Airdrop participation strategy Jul 07, 2025 pm 10:12 PM

Airdrops in the cryptocurrency field are a marketing promotion method for the project to distribute a certain number of tokens for free to community members or potential users. In this way, the project party hopes to increase the visibility of the tokens and attract more users to participate in the project, thereby expanding the size of the community and increasing the liquidity of the tokens. For users, airdrops provide opportunities to obtain project tokens without initial investment, and are one of the ways to get in touch with and understand new projects in the early stage.

The RPC server is unavailable Windows The RPC server is unavailable Windows Jul 06, 2025 am 12:07 AM

When encountering the "RPCserverisunavailable" problem, first confirm whether it is a local service exception or a network configuration problem. 1. Check and start the RPC service to ensure that its startup type is automatic. If it cannot be started, check the event log; 2. Check the network connection and firewall settings, test the firewall to turn off the firewall, check DNS resolution and network connectivity; 3. Run the sfc/scannow and DISM commands to repair the system files; 4. Check the group policy and domain controller status in the domain environment, and contact the IT department to assist in the processing. Gradually check it in sequence to locate and solve the problem.

How to fix slow right-click context menu in Windows How to fix slow right-click context menu in Windows Jul 04, 2025 am 02:51 AM

The problem of slowing right-click menus is usually caused by extensions or third-party software loaded by the system. Solutions include troubleshooting plug-ins, optimizing settings, and uninstalling suspicious software. 1. Use the ShellExView tool to view and disable non-essential Shell extensions, and gradually test to find plug-ins that slow down the right-click menu; 2. For advanced users, you can lower the menu delay time to 0 or 200 milliseconds by modifying the MenuShowDelay key value in the registry to speed up the response speed, but you need to be careful to backup before operation to avoid causing system abnormalities; 3. Uninstall or update software that may cause conflicts such as old compression tools, screenshot software, antivirus software, etc., and observe whether the right-click menu returns to normal. If the problem is alleviated, it means that it is the performance problem caused by the software.

BlackRock's IBIT: Harnessing the Bitcoin Influx Like a Boss BlackRock's IBIT: Harnessing the Bitcoin Influx Like a Boss Jul 02, 2025 pm 06:18 PM

BlackRock's IBITETF has become the main recipient of Bitcoin capital inflows, and despite the market fluctuations, it still reflects the firm confidence of investors. The new investment product launched by UniCredit Italy also further proves that institutional investors are accelerating the adoption of Bitcoin. BlackRock's IBITETF has performed well in the Bitcoin market, attracting a large amount of capital inflows and consolidating its leading position. Let’s take a look at the specific performance of this financial product. Strong capital inflows from IBIT June was a strong month for spot Bitcoin ETFs, with a total net inflow of $4.6 billion. The most eye-catching one is BlackRock's IBIT, which has its net inflows

How to set up OCSP Stapling in Apache for better SSL performance? How to set up OCSP Stapling in Apache for better SSL performance? Jul 05, 2025 am 12:03 AM

ToenableOCSPstaplinginApache,ensureyoumeettheprerequisitesandconfigurethenecessarydirectives.First,confirmyouareusingApache2.4.1ornewerwithmod_sslenabled,OpenSSL0.9.8hornewer,andhaveavalidSSLcertificateinstalled.Next,edityourApacheSSLvirtualhostconfi

My second monitor is not detected on Windows My second monitor is not detected on Windows Jul 08, 2025 am 02:47 AM

If the second monitor is not recognized by Windows, first check whether the cable and interface are normal, try to replace the HDMI, DP or VGA cable, confirm the plug-in video output port, and test different interfaces to eliminate compatibility issues; then verify the monitor power and input source settings, and connect the monitor separately to test whether it can be recognized; then enter the Windows display settings and click the "Detection" button, or use Win P to switch the display mode, and update the graphics card driver at the same time; finally check the graphics card specifications to confirm whether it supports multi-screen output to avoid exceeding its maximum output capability.

See all articles