To successfully upgrade to HDP 2.3.6, you must change the value of hadoop.rpc.protection to authentication in core-site.xml:
<property> <name>hadoop.rpc.protection</name> <value>authentication</value> </property>