Search

Where the output does from Map tasks are stored ?



The mapper’s output (intermediate data) is stored on the Local file system (not on HDFS) of each individual mapper nodes. This is typically a temporary directory location which can be setup in mapreduce.cluster.local.dir configuration property. The intermediate data is deleted after the Hadoop Job completes.
Posted by at
Labels:
  • What are the main components of Mapreduce Job ?
      Main driver class which provides job configuration parameters. Mapper class which must extend org.apache.hadoop.mapredu...
  • TO_CHAR
       This will be used to extract various date formats.     The available date formats as follows.     Syntax: to_char ( date , fo...