...
NOTE: For all supported hadoop distributions except MapR, add the yarn user on the cluster to the group defined by dfs.permissions.superusergroup property. The dfs.permissions.superusergroup property can be found in hdfs-site.xml file on your cluster or in the cluster management application.
3. Navigate to the folder that contains the shim, then open the yarn-site.xml file in a text editor. Adjust the following parameters as needed.
Parameter | Values |
|---|
yarn.application.classpath | - HDP 2.2 -
| Code Block |
|---|
<property> <name>yarn.application.classpath</name>
<value>$HADOOP_CONF_DIR,/usr/hdp/current/hadoop-client/*,
/usr/hdp/current/hadoop-client/lib/*,/usr/hdp/current/hadoop-hdfs-client/*,
/usr/hdp/current/hadoop-hdfs-client/lib/*,/usr/hdp/current/hadoop-yarn-client/*,
/usr/hdp/current/hadoop-yarn-client/lib/*</value>
</property>
|
- MapR 4.0.1 Windows Client -
| Code Block |
|---|
<property>
<name>yarn.application.classpath</name>
<value>$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/share/hadoop/common/*
:$HADOOP_COMMON_HOME/share/hadoop/common/lib/*:$HADOOP_HDFS_HOME/share/hadoop/hdfs/*
:$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*:$HADOOP_YARN_HOME/share/hadoop/yarn/*
:$HADOOP_YARN_HOME/share/hadoop/yarn/lib/*:/usr/share/aws/emr/emrfs/lib/*
:/usr/share/aws/emr/lib/*:/usr/share/aws/emr/auxlib/*:$PWD/*:%PWD%/*
</value>
</property>
|
- All other shims - Classpaths needed to execute YARN applications. Separate paths with a comma.
|
yarn.resourcemanger.hostname | - CDH 5.x - Update the hostname in your environment or use the default: clouderamanager.cdh5.test
- HDP 2.x - Update the hostname in your environment or use the default: sandbox.hortonworks.com
- All other shims: Hostname in your environment.
|
yarn.resourcemanager.address | - All shims: Update hostname and port to match your environment.
|
yarn.resourcemanager.admin.address | - All shims: Update hostname and port to match your environment.
|
...