Search

What are the main components of Job flow in YARN architecture ?



Mapreduce job flow on YARN involves below components.
    • A Client node, which submits the Mapreduce job.
    • The YARN Resource Manager, which allocates the cluster resources to jobs.
    • The YARN Node Managers, which launch and monitor the tasks of jobs.
    • The MapReduce Application Master, which coordinates the tasks running in the MapReduce job.
    • The HDFS file system  is used for sharing job files between the above entities.
Posted by at
Labels:
  • What are the main components of Mapreduce Job ?
      Main driver class which provides job configuration parameters. Mapper class which must extend org.apache.hadoop.mapredu...
  • TO_CHAR
       This will be used to extract various date formats.     The available date formats as follows.     Syntax: to_char ( date , fo...