Hadoop Memory-Intensive Configuration Settings

The Amazon Elastic MapReduce (Amazon EMR) default configuration settings are appropriate for most workloads. However, based on your job flow’s specific memory and processing requirements, you might want to modify the configuration settings.

For example, if your job flow tasks are memory-intensive, you can use fewer tasks per core node and reduce your job tracker heap size. A predefined bootstrap action is available to configure your job flow on startup. For more information, see the Configure Memory-Intensive Workloads bootstrap action.

The following tables list the recommended configuration settings for each Amazon EC2 instance type. The default configurations for the cc1.4xlarge, cc2.8xlarge, and cg1.4xlarge instances are sufficient for memory-intensive workloads; therefore, the recommended configuration settings for these instances are not listed.