Amazon Elastic MapReduce (Amazon EMR)

EMR analyze and process vast amounts of data by distributing the computational work across a cluster of virtual servers running in the Amazon cloud.

Hadoop

  • The cluster is managed using an open-source framework Hadoop.
  • Hadoop uses a distributed processing architecture called MapReduce in which a task is mapped to a set of servers for processing. The results of the computation performed by those servers is then reduced down to a single output set.
  • One node, designated as the master node, controls the distribution of tasks.
  • Hadoop clusters running on Amazon EMR use EC2 instances as virtual Linux servers for the master and slave nodes, Amazon S3 for bulk storage of input and output data, and CloudWatch to monitor cluster performance and raise alarms. All of this is orchestrated by Amazon EMR control software that launches and manages the Hadoop cluster. This process is called an Amazon EMR cluster.

results matching ""

    No results matching ""