HDP-2.3.6 Release Notes
Also available as:
PDF

Falcon

In addition to any Apache patches ported over from the 2.4.x core, HDP 2.3.6 provides Falcon 0.6.1 and the following Apache patches:

  • FALCON-1372 Retention does not work in corner cases.

  • FALCON-1595 In secure cluster, Falcon server loses ability to communicate with HDFS over time.

  • FALCON-1647 Unable to create feed: FilePermission error under cluster staging directory.

  • FALCON-1877 Falcon webUI returns 413 (Full head - Request entity too large) error when TLS is enabled in a secure cluster with AD integration.

HDP 2.3.6 provides Falcon 0.6.1 and ports no additional Apache patches from the 2.4.x core.

HDP 2.3.4.7 provided Falcon 0.6.1 with no additional Apache patches.

HDP 2.3.2 provided Falcon 0.6.1 and the following Apache patches:

NEW FEATURES

IMPROVEMENTS

  • FALCON-1060 Handle transaction failures in Lineage.

  • FALCON-1147 Allow _ in the names for name value pair.

  • FALCON-1174 Ability to disable Oozie dryrun while scheduling or updating the Falcon entity.

  • FALCON-1186 Add filtering capability to result of instance summary.

  • FALCON-1204 Expose default configs for feed late data handling in runtime.properties.

  • FALCON-1317 Inconsistent JSON serialization.

  • FALCON-1322 Add prefix in runtime.properties.

  • FALCON-1324 Pagination API breaks backward compatibility.

  • FALCON-1359 Improve output format for Feed Instance Listing.

  • FALCON-1361 Default end date should be now.

  • FALCON-1368 Improve Falcon server restart time.

  • FALCON-1374 Remove the cap on numResults.

  • FALCON-1378 Falcon documentation lacks information on how to run Falcon on standalone Oozie/Hadoop setup.

  • FALCON-668 FeedReplicator improvement to include more DistCP options.

  • FALCON-676 Enable metrics for Titan.

  • FALCON-75 Falcon CLI for deleting entities should inform user if entity does not exist.

BUG FIXES

  • FALCON-1038 Log mover fails for map-reduce action.

  • FALCON-1101 Cluster submission in Falcon does not create an owned-by edge.

  • FALCON-1104 Exception while adding process instance to graphdb when feed has partition expression.

  • FALCON-1121 Backend support for free-text entity search.

  • FALCON-1129 In a secure cluster, feed replication fails because of Authentication issues.

  • FALCON-1141 Reverse Lookup for feed in prism fails with BadRequest.

  • FALCON-1143 Correcting order of entities on reload.

  • FALCON-1144 Dynamic partitions not getting registered in Hcat.

  • FALCON-1146 feed retention policy deleted everything all the way up to the root.

  • FALCON-1153 Instance kill fails intermittently.

  • FALCON-1162 Cluster submit succeeds when staging HDFS dir does not have 777.

  • FALCON-1165 Falcon restart failed, if defined service in cluster entity is unreachable.

  • FALCON-1244 numResults query param in listInstances is ignored when start and end params are not specified.

  • FALCON-1252 The parameter "tagkey" should be "tagkeys" in EntityList and FalconCLI twiki.

  • FALCON-1260 Instance dependency API produces incorrect results.

  • FALCON-1268 Instance Dependency API failure message is not intuitive in distributed mode.

  • FALCON-1282 Incorrect HDFS servers property for feed replication in secured environment.

  • FALCON-1310 Falcon build fails with Oozie-4.2.0.

  • FALCON-1311 Instance dependency API produces inconsistent results in some scenarios.

  • FALCON-1312 Falcon post processing action should use Oozie prepared configuration.

  • FALCON-1323 Reverse lookup of feeds causes NPE.

  • FALCON-1325 Triage API on prism, for an instance at which a process does not exist sends incorrect message.

  • FALCON-1327 When using triage on a server for a process which does not exist on that server, a NullPointerException is encountered.

  • FALCON-1328 Error in Triage documentation.

  • FALCON-1329 Falcon's idempotent behaviour breaks in some cases.

  • FALCON-1344 EntityGraph returns null in list of dependent entities.

  • FALCON-1363 Fix retry policy example in documentation.

  • FALCON-1398 CrossEntityValidations contains incorrect validations.

  • FALCON-1399 Property for default number of results is not loaded dynamically.

  • FALCON-1409 Update API throws NullPointerException.

  • FALCON-1412 Process waits indefinitely and finally timed out even though missing dependencies are met.

  • FALCON-1487 In secure cluster setup Hcat process/feed scheduling or replication fails.

  • FALCON-954 Secure Kerberos setup: Falcon should periodically revalidate auth token.

  • FALCON-99 Adding late data to process doesn't create new coord.

HDP 2.3.0 provided Falcon 0.6.1 and the following Apache patches:

NEW FEATURES

  • FALCON-1039 Add instance dependency API in Falcon

  • FALCON-1188 Falcon support for Hive Replication

  • FALCON-790 Falcon UI to enable entity/process/feed edits and management

  • FALCON-796 Enable users to triage data processing issues through Falcon

IMPROVEMENTS

  • FALCON-1060 Handle transaction failures in Lineage

  • FALCON-1147 Allow _ in the names for name value pair

  • FALCON-1174 Ability to disable Oozie dryrun while scheduling or updating the Falcon entity

  • FALCON-1186 Add filtering capability to result of instance summary

  • FALCON-1204 Expose default configs for feed late data handling in runtime.properties

  • FALCON-1317 Inconsistent JSON serialization

  • FALCON-1322 Add prefix in runtime.properties

  • FALCON-1324 Pagination API breaks backward compatibility.

  • FALCON-1359 Improve output format for Feed Instance Listing

  • FALCON-1361 Default end date should be now

  • FALCON-1368 Improve Falcon server restart time

  • FALCON-1374 Remove the cap on numResults

  • FALCON-1378 Falcon documentation lacks information on how to run Falcon on standalone Oozie/Hadoop setup

  • FALCON-668 FeedReplicator improvement to include more DistCP options

  • FALCON-676 Enable metrics for Titan

  • FALCON-75 Falcon CLI for deleting entities should inform user if entity does not exist

BUG FIXES

  • FALCON-1101 Cluster submission in Falcon does not create an owned-by edge

  • FALCON-1104 Exception while adding process instance to graphdb when feed has partition expression

  • FALCON-1121 Backend support for free-text entity search

  • FALCON-1129 In a secure cluster, feed replication fails because of Authentication issues

  • FALCON-1141 Reverse Lookup for feed in prism fails with BadRequest

  • FALCON-1143 Correcting order of entities on reload

  • FALCON-1144 Dynamic partitions not getting registered in Hcat

  • FALCON-1146 feed retention policy deleted everything all the way up to the root

  • FALCON-1153 Instance kill fails intermittently

  • FALCON-1162 Cluster submit succeeds when staging HDFS dir does not have 777

  • FALCON-1165 Falcon restart failed, if defined service in cluster entity is unreachable

  • FALCON-1244 numResults query param in listInstances is ignored when start and end params are not specified

  • FALCON-1252 The parameter "tagkey" should be "tagkeys" in EntityList and FalconCLI twiki

  • FALCON-1260 Instance dependency API produces incorrect results

  • FALCON-1268 Instance Dependency API failure message is not intuitive in distributed mode

  • FALCON-1282 Incorrect HDFS servers property for feed replication in secured environment

  • FALCON-1310 Falcon build fails with Oozie-4.2.0

  • FALCON-1311 Instance dependency API produces inconsistent results in some scenarios

  • FALCON-1312 Falcon post processing action should use Oozie prepared configuration

  • FALCON-1323 Reverse lookup of feeds causes NPE

  • FALCON-1325 Triage API on prism, for an instance at which a process does not exist sends incorrect message

  • FALCON-1327 When using triage on a server for a process which does not exist on that server, a NullPointerException is encountered

  • FALCON-1328 Error in Triage documentation

  • FALCON-1329 Falcon's idempotent behaviour breaks in some cases

  • FALCON-1344 EntityGraph returns null in list of dependent entities

  • FALCON-1363 Fix retry policy example in documentation

  • FALCON-1398 CrossEntityValidations contains incorrect validations

  • FALCON-1399 Property for default number of results is not loaded dynamically

  • FALCON-1409 Update API throws NullPointerException

  • FALCON-1412 Process waits indefinitely and finally timed out even though missing dependencies are met

  • FALCON-1487 In secure cluster setup Hcat process/feed scheduling or replication fails

  • FALCON-954 Secure Kerberos setup : Falcon should periodically revalidate auth token

  • FALCON-99 Adding late data to process doesn't create new coordFALCON-1038 Log mover fails for map-reduce action