Search

What will hadoop do when a task is failed in a list of suppose 50 spawned tasks ?



It will restart the map or reduce task again on some other node manager and only if the task fails more than 4 times then it will kill the job. The default number of maximum attempts for map tasks and reduce tasks can be configured with below properties in mapred-site.xml file.
mapreduce.map.maxattempts
mapreduce.reduce.maxattempts
The default value for the above two properties is 4 only.
Posted by at
Labels:
  • What are the main components of Mapreduce Job ?
      Main driver class which provides job configuration parameters. Mapper class which must extend org.apache.hadoop.mapredu...
  • TO_CHAR
       This will be used to extract various date formats.     The available date formats as follows.     Syntax: to_char ( date , fo...