Contents

Hadoop 1.x Cluster Setup (MapReduce only)

Purpose

This document describes how to set up and configure a 3-nodes Hadoop 1.x MapReduce cluster.

For HDFS setup Hadoop 1.x Cluster Setup (HDFS only)

Hadoop MapReduce Config

  • config mapred-site.xml
1
2
3
4
5
6
<configuration>
  <property>
    <name>mapred.job.tracker</name>
    <value>node1:9001</value>
  </property>
</configuration>
  • copy configs to slaves
1
2
3
# From node1
scp /home/hadoop-1.2/conf/* root@node2:/home/hadoop-1.2/conf
scp /home/hadoop-1.2/conf/* root@node3:/home/hadoop-1.2/conf
  • start MapReduce
1
/home/hadoop-1.2/bin/start-mapred.sh