         | Did this page help you? Yes No Tell us about it... |
Hadoop Configuration (AMI 1.0)
The following Amazon Elastic MapReduce (Amazon EMR) default configuration settings are appropriate for most workloads.
If your job flow tasks are memory-intensive, you can enhance performance by using fewer tasks per core node and reducing your job tracker heap size. These and other memory-intensive configuration settings are described in Hadoop Memory-Intensive Configuration Settings.
The following tables list the default configuration settings for each Amazon EC2 instance type in job flows launched with Amazon EMR AMI version 1.0. For more information about the AMI versions supported by Amazon EMR, see Specify the Amazon EMR AMI Version.
m1.small
| Parameter | Value |
|---|---|
| HADOOP_JOBTRACKER_HEAPSIZE | 768 |
| HADOOP_NAMENODE_HEAPSIZE | 256 |
| HADOOP_TASKTRACKER_HEAPSIZE | 512 |
| HADOOP_DATANODE_HEAPSIZE | 128 |
| mapred.child.java.opts | -Xmx725m |
| mapred.tasktracker.map.tasks.maximum | 2 |
| mapred.tasktracker.reduce.tasks.maximum | 1 |
m1.large
| Parameter | Value |
|---|---|
| HADOOP_JOBTRACKER_HEAPSIZE | 3072 |
| HADOOP_NAMENODE_HEAPSIZE | 1024 |
| HADOOP_TASKTRACKER_HEAPSIZE | 1536 |
| HADOOP_DATANODE_HEAPSIZE | 256 |
| mapred.child.java.opts | -Xmx1600m |
| mapred.tasktracker.map.tasks.maximum | 4 |
| mapred.tasktracker.reduce.tasks.maximum | 2 |
m1.xlarge
| Parameter | Value |
|---|---|
| HADOOP_JOBTRACKER_HEAPSIZE | 9216 |
| HADOOP_NAMENODE_HEAPSIZE | 3072 |
| HADOOP_TASKTRACKER_HEAPSIZE | 3072 |
| HADOOP_DATANODE_HEAPSIZE | 512 |
| mapred.child.java.opts | -Xmx1600m |
| mapred.tasktracker.map.tasks.maximum | 8 |
| mapred.tasktracker.reduce.tasks.maximum | 4 |
c1.medium
| Parameter | Value |
|---|---|
| HADOOP_JOBTRACKER_HEAPSIZE | 768 |
| HADOOP_NAMENODE_HEAPSIZE | 256 |
| HADOOP_TASKTRACKER_HEAPSIZE | 512 |
| HADOOP_DATANODE_HEAPSIZE | 256 |
| mapred.child.java.opts | -Xmx362m |
| mapred.tasktracker.map.tasks.maximum | 4 |
| mapred.tasktracker.reduce.tasks.maximum | 2 |
c1.xlarge
| Parameter | Value |
|---|---|
| HADOOP_JOBTRACKER_HEAPSIZE | 3072 |
| HADOOP_NAMENODE_HEAPSIZE | 1024 |
| HADOOP_TASKTRACKER_HEAPSIZE | 1536 |
| HADOOP_DATANODE_HEAPSIZE | 512 |
| mapred.child.java.opts | -Xmx747m |
| mapred.tasktracker.map.tasks.maximum | 8 |
| mapred.tasktracker.reduce.tasks.maximum | 4 |
m2.xlarge
| Parameter | Value |
|---|---|
| HADOOP_JOBTRACKER_HEAPSIZE | 12288 |
| HADOOP_NAMENODE_HEAPSIZE | 4096 |
| HADOOP_TASKTRACKER_HEAPSIZE | 3072 |
| HADOOP_DATANODE_HEAPSIZE | 512 |
| mapred.child.java.opts | -Xmx2048m |
| mapred.tasktracker.map.tasks.maximum | 4 |
| mapred.tasktracker.reduce.tasks.maximum | 2 |
m2.2xlarge
| Parameter | Value |
|---|---|
| HADOOP_JOBTRACKER_HEAPSIZE | 24576 |
| HADOOP_NAMENODE_HEAPSIZE | 8192 |
| HADOOP_TASKTRACKER_HEAPSIZE | 3072 |
| HADOOP_DATANODE_HEAPSIZE | 1024 |
| mapred.child.java.opts | -Xmx3200m |
| mapred.tasktracker.map.tasks.maximum | 8 |
| mapred.tasktracker.reduce.tasks.maximum | 4 |
m2.4xlarge
| Parameter | Value |
|---|---|
| HADOOP_JOBTRACKER_HEAPSIZE | 49152 |
| HADOOP_NAMENODE_HEAPSIZE | 16384 |
| HADOOP_TASKTRACKER_HEAPSIZE | 3072 |
| HADOOP_DATANODE_HEAPSIZE | 2048 |
| mapred.child.java.opts | -Xmx3733m |
| mapred.tasktracker.map.tasks.maximum | 16 |
| mapred.tasktracker.reduce.tasks.maximum | 8 |
cc1.4xlarge
| Parameter | Value |
|---|---|
| HADOOP_JOBTRACKER_HEAPSIZE | 10240 |
| HADOOP_NAMENODE_HEAPSIZE | 5120 |
| HADOOP_TASKTRACKER_HEAPSIZE | 512 |
| HADOOP_DATANODE_HEAPSIZE | 512 |
| mapred.child.java.opts | -Xmx1024m |
| mapred.tasktracker.map.tasks.maximum | 12 |
| mapred.tasktracker.reduce.tasks.maximum | 3 |
cg1.4xlarge
| Parameter | Value |
|---|---|
| HADOOP_JOBTRACKER_HEAPSIZE | 10240 |
| HADOOP_NAMENODE_HEAPSIZE | 5120 |
| HADOOP_TASKTRACKER_HEAPSIZE | 512 |
| HADOOP_DATANODE_HEAPSIZE | 512 |
| mapred.child.java.opts | -Xmx1024m |
| mapred.tasktracker.map.tasks.maximum | 12 |
| mapred.tasktracker.reduce.tasks.maximum | 3 |
