Amazon Elastic MapReduce
Developer Guide (API Version 2009-11-30)
Print this pageEmail this pageGo to the ForumsView the PDFShare this page on TwitterShare this page on FacebookBookmark this page on DeliciousSubmit this page to RedditSubmit this page to DiggDid this page help you?  Yes  No   Tell us about it...

Hadoop 0.20.205 Patches

The Amazon Elastic MapReduce (Amazon EMR) team has applied the following patches to Hadoop 0.20.205 on the Amazon EMR AMI version 2.0.

PatchDescription
Add hadoop-lzo

Install the hadoop-lzo third-party package. For more information about hadoop-lzo, go to https://github.com/kevinweil/hadoop-lzo

Status: Third-party Package

Fixed in AWS Hadoop Version: 0.20.205

Fixed in Apache Hadoop Version: n/a

Install the hadoop-snappy library

Add the hadoop-snappy library to provide access to the snappy compression. For more information about this library, go to http://code.google.com/p/hadoop-snappy/.

Status: Third-party Library

Fixed in AWS Hadoop Version: 0.20.205

Fixed in Apache Hadoop Version: n/a

MAPREDUCE-1597/2021/2046

Fixes to how CombineFileInputFormat handles split locations and files that can be split. For more information about these patches, go to https://issues.apache.org/jira/browse/MAPREDUCE-1597, https://issues.apache.org/jira/browse/MAPREDUCE-2021, and https://issues.apache.org/jira/browse/MAPREDUCE-2046.

Status: Resolved, Fixed

Fixed in AWS Hadoop Version: 0.20.205

Fixed in Apache Hadoop Version: 0.22.0

HADOOP-6436

Remove the files generated by automake and autoconf of the native build and use the host's automake and autoconf to generate the files instead. For more information about this patch, go to https://issues.apache.org/jira/browse/HADOOP-6436.

Status: Closed, Fixed

Fixed in AWS Hadoop Version: 0.20.205

Fixed in Apache Hadoop Version: 0.22.0,0.23.0

MAPREDUCE-2185

Prevent an infinite loop from occurring when creating splits using CombineFileInputFormat. For more information about this patch, go to https://issues.apache.org/jira/browse/MAPREDUCE-2185.

Status: Closed, Fixed

Fixed in AWS Hadoop Version: 0.20.205

Fixed in Apache Hadoop Version: 0.23.0

HADOOP-7082

Change Configuration.writeXML to not hold a lock while outputting. For more information about this patch, go to https://issues.apache.org/jira/browse/HADOOP-7082.

Status: Resolved, Fixed

Fixed in AWS Hadoop Version: 0.20.205

Fixed in Apache Hadoop Version: 0.22.0

HADOOP-7015

Update RawLocalFileSystem#listStatus to deal with a directory that has changing entries, as in a multi-threaded or multi-process environment. For more information about this patch, go to https://issues.apache.org/jira/browse/HADOOP-7015.

Status: Closed, Fixed

Fixed in AWS Hadoop Version: 0.20.205

Fixed in Apache Hadoop Version: 0.23.0

HADOOP-4675

Update the Ganglia metrics to be compatible with Ganglia 3.1. For more information about this patch go to https://issues.apache.org/jira/browse/HADOOP-4675.

Status: Resolved, Fixed

Fixed in AWS Hadoop Version: 0.20.205

Fixed in Apache Hadoop Version: 0.22.0