? ???? Java Environment Construction, Hadoop ??, ???? ??? ? ? ??? ?? ?? ??? ??? ??? ???? Hadoop ? ?? ??? ???? ??? ?? ??? ?????.

1. Java ?? ??

?? ???? Java 8 ??? ???? ??? ??????. ?? ??? ???? OpenJDK 8? ??????.

 Sudo ??? ????
sudo apt ?? OpenJDK-8-JDK

?? ?? :

 ?? -??

2. Hadoop ???? ? ??

Apache Hadoop ?? ? ????? ?? ??? Hadoop ?? ??? (? : Hadoop 3.3.1)? ?????? ??? ???? (? : /usr/local/hadoop )? ??? ??????.

 wget https://downloads.apache.org/hadoop/common/hadoop-3.3.1/hadoop-3.3.1.tar.gz
tar -xzvf hadoop -3.3.1.tar.gz -c/usr/local/hadoop

3. ?? ?? ??

~/.bashrc ??? ???? ?? ?? ??? ??????.

 java_home =/usr/lib/jvm/jdk-8-openjdk-amd64 ????
Hadoop_home =/usr/local/hadoop ????
???? ?? = $ ?? : $ hadoop_home/bin : $ hadoop_home/sbin

??? ??????.

 ?? ~/.bashrc

4. Hadoop Core ??

Hadoop Core ?? ?? ( core-site.xml , hdfs-site.xml , mapred-site.xml , yarn-site.xml )? ??????. ??? ?? ?????.

core-site.xml :

<configuration>
  <property>
    <name>fs.defaultfs</name>
    <value>hdfs : // namenode : 9000</value>
  </property>
</configuration>

hdfs-site.xml :

<configuration>
  <property>
    <name>dfs.replication</name>
    <value>3</value>
  </property>
  <property>
    <name>dfs.namenode.name.dir</name>
    <value>/usr/local/hadoop/dfs/name</value>
  </property>
  <property>
    <name>dfs.datanode.data.dir</name>
    <value>/usr/local/hadoop/dfs/data</value>
  </property>
</configuration>

mapred-site.xml :

<configuration>
  <property>
    <name>mapreduce.framework.name</name>
    <value>??</value>
  </property>
</configuration>

yarn-site.xml :

<configuration>
  <property>
    <name>yarn.nodemanager.aux-services</name>
    <value>mapreduce_shuff</value>
  </property>
  <property>
    <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
    <value>org.apache.hadoop.mapred.shufflehandler</value>
  </property>
</configuration>

5. HDFS ??

Namenode ???? ?? ??? HDFS ???? ??????.

 HDFS NAMENODE -FORMAT

6. Hadoop ???? ?????

Namenode?? Hadoop ???? ??????.

 start-dfs.sh
start-yarn.sh

7. ?? ??

?? ??? ???? Hadoop? ????? ?????? ??????.

 HDFS DFS -LS /

?? Hadoop ?? ?????? ???????.

8. ???? ?? ? ??

? ???? Ambari ?? Cloudera Manager? ?? ??? ???? ?? ? ???? ??, ?? ?? ??, JVM ?? ?? ???, ?? ?? ?? ?? ? ???? ???? ? ??? ?????.

?? ??? ?? ??? ????? Hadoop ????? ????? ???? ?? ? ? ??????. ?? ??? ?? ?? ?? ??? ??????.

? ??? Debian? Hadoop? ?? ??? ???? ??? ?? ?????. ??? ??? PHP ??? ????? ?? ?? ??? ?????!