Hadoop-2.7.

2 installation Guide

To detete a user:
sudo userdel newuser
sudo rm -rf /home/newuser

Java installation:
1) tar -xvzf jdk-8u73-linux-x64.tar.gz
2) edit ~/.bashrc
JAVA_HOME=/home/jonathan/Downloads/jdk1.8.0_73
PATH=$PATH:$JAVA_HOME/bin
export PATH JAVA_HOME

Hadoop installation:
1) tar -xvzf hadoop-2.7.2.tar.gz
2) cd hadoop-2.7.2/
3) mkdir -p hadoopdata/datanode
4) mkdir -p hadoopdata/namenode
5) cd /etc/hadoop
6) nano hadoop env.sh
(just above java export)
update : JAVA_HOME=/home/jonathan/Downloads/jdk1.8.0_73
7) nano core-site.xml
core-site.xml

=============
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:9000</value>
</property>

8) nano hdfs site.xml

<property>
<name>dfs.replication</name>
<value>1</value>
</property>

<property>
<name>dfs.namenode.name.dir</name>
<value>/home/jonathan/Downloads/hadoop-2.7.2/hadoopdata/namenode</value>
</property>
<property>
<name>dfs.datanode.data.dir</name>
<value>/home/jonathan/Downloads/hadoop-2.7.2/hadoopdata/datanode</value>
</property>
9.) mv mapred-site.xml.template mapred-site.xml
10) nano mapred-site.xml
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>

11) ssh-keygen (Enter 3 times)

12) ssh-copy-id -i ~/.ssh/id_rsa.pub localhost
13 ) ssh localhost (to confirm) exit (to come out)
14 ) Edit ~./bashrc
HADOOP_PREFIX=home/jonathan/Downloads/hadoop-2.7.2/
PATH=$PATH:$HADOOP_PREFIX/bin
export PATH HADOOP_PREFIX
15) Hadoop version

(To check)

16) bin/hadoop namenode -format

(status 0 to success and 1 to fail)
17) sbin/start-dfs.sh
18) sbin/stop-dfs.sh

To setup Yarn:
1) nano yarn-site.xml
=============
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>

<property>
<name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>

2) sbin/start-yarn.sh
3) sbin/stop-yarn.sh

Install Virtual box in ubuntu

3. For those who want to install VBox 5.1 from official Linux repository and receive
future updates via Software Updater. Run the commands below one by one in
terminal:
1 ) sudo sh -c 'echo "deb http://download.virtualbox.org/virtualbox/debian
xenial contrib" >> /etc/apt/sources.list.d/virtualbox.list'
2) wget -q https://www.virtualbox.org/download/oracle_vbox_2016.asc -O- | sudo
apt-key add 3) sudo apt update
4) sudo apt install virtualbox-5.1

According to your Ubuntu codename, replace xenial with wily, trusty, or precise.