Search

How do we set a configuration property to be unique/constant across the cluster nodes and no slave nodes should override this?



A) We can achive this by defining this property in core/hdfs/mapred/yarn-site.xml file on namenode with final tag as shown below.
<name>mapreduce.task.io.sort.mb</name>
<value>512</value>
<final>true</final>
Posted by at
Labels:
  • What are the main components of Mapreduce Job ?
      Main driver class which provides job configuration parameters. Mapper class which must extend org.apache.hadoop.mapredu...
  • TO_CHAR
       This will be used to extract various date formats.     The available date formats as follows.     Syntax: to_char ( date , fo...