Fixed Issues in Apache YARN

Review the list of YARN issues that are resolved in Cloudera Runtime 7.1.6.

OPSAPS-50291: "HADOOP_HOME,PATH,LANG,TZ" are now added by default to the yarn.nodemanager.env-whitelist Yarn configuration option.

This issue is resolved.

OPSAPS-58001: YARN aggregation job is missing YARN metric folders because of timezone issues

Issue is fixed, where YarnUsageAggregation didn't find directories to aggregate in case of IST timezone.

OPSAPS-58146: CM doesn't consider version when creating application links

YarnWorkRelatedLinkGenerator was modified to consider the CDH/CDP version. For CDH releases the UI1 link will be generated, for CDP and later the UI2.

COMPX-4550: Hive On Tez queries fails upon submission to dynamically created pools

When using Hive-on-Tez with application tags, the access control check failed for dynamically created queues. With this change, the ACL settings of the parent is looked up.

YARN-10458

CDPD-17194: Upgrade to Ember.js 2.2.1+ due to CVE-2015-7565

Prior to this upgrade, YARN was pulling in ember.js 2.2.0 which is vulnerable to CVE-2015-7565. This CVE can be avoid by upgrading to ember.js 2.2.1.

COMPX-4291: Config-service startup issues due to host name mismatch

For some custom DNS setup, the hostnames may have an alias of this form:

172.27.175.194 yarn-llukpp-dw-master0.yarn-2rj.svbr-nqvp.int.cldr.work yarn-llukpp-dw-master0 

The basic setup is usually of this form:

172.27.175.194  yarn-llukpp-dw-master0 

Since Config-service was using InetAddress.getLocalHost().getHostName() it does not always returns FQDN (which is used in the keytabs). The fix is made in Config Service code to use getCanonicalHostName() which will always return an FQDN if present.

This will ensure that the principal name formed by config-service is in line with the DNS setup.

CDPD-17194: Upgrade to Ember.js 2.2.1+ due to CVE-2015-7565

Prior to this upgrade, YARN was pulling in ember.js 2.2.0 which is vulnerable to CVE-2015-7565. This CVE can be avoid by upgrading to ember.js 2.2.1.