Cloudera Docs » 3.0.2 » Release Notes
Release Notes
Also available as:
PDF

​Chapter 1. Hortonworks DataFlow 3.0.2 Release Notes

This document provides you with the latest information about the HDF 3.0.2 release and its product documentation.

​Component Support

HDF 3.0.2 includes the following components:

  • Apache Ambari 2.6.0

  • Apache Kafka 0.10.2.1

  • Apache NiFi 1.2.0

  • Apache Ranger 0.7.0

  • Apache Storm 1.1.0

  • Apache ZooKeeper 3.4.6

  • Apache MiNiFi Java Agent 0.2.0

  • Apache MiNiFi C++ Technical Preview

  • Hortonworks Schema Registry 0.3.0

  • Hortonworks Streaming Analytics Manager 0.5.0

​Component Availability in HDF

Previous HDF releases shipped with the following components versions.

 NiFiStormKafkaZooKeeperAmbariRangerMiNiFi Java AgentMiNiFi C++Streaming Analytics ManagerSchema Registry
HDF 3.0.21.2.01.1.0`0.10.2.13.4.62.6.00.7.00.2.0TP0.5.00.3.0
HDF 3.0.11.2.01.1.00.10.2.1 3.4.62.5.10.7.00.2.0TP0.5.00.3.0
HDF 3.0.01.2.01.1.00.10.2.1 3.4.62.5.10.7.00.2.0TP0.5.00.3.0
HDF 2.1.41.1.01.0.21.10.13.4.62.4.2.00.6.20.1.0TPN/AN/A
HDF 2.1.21.1.01.0.20.10.13.4.62.4.2.00.6.20.1.0TPN/AN/A
HDF 2.1.11.1.01.0.20.10.13.4.62.4.2.00.6.20.1.0TPN/AN/A
HDF 2.1.01.1.01.0.20.10.13.4.62.4.2.00.6.20.1.0TPN/AN/A
HDF 2.0.21.0.01.0.10.10.0.13.4.62.4.1.00.6.00.0.1TPN/AN/A
HDF 2.0.11.0.01.0.10.10.0.13.4.62.4.1.00.6.00.0.1TPN/AN/A
HDF 2.0.01.0.01.0.10.10.0.13.4.62.4.0.10.6.00.0.1TPN/AN/A
HDF 1.2.10.6.10.10.00.9.0.13.4.6N/AN/AN/AN/AN/AN/A
HDF 1.2.0.10.6.10.10.00.9.0.13.4.6N/AN/AN/AN/AN/AN/A
HDF 1.2.00.6.00.10.00.9.0.13.4.6N/AN/AN/AN/AN/AN/A
HDF 1.1.00.4.0N/AN/AN/AN/AN/AN/AN/AN/AN/A
HDF 1.00.3.0N/AN/AN/AN/AN/AN/AN/AN/AN/A

​What's New in HDF 3.0.2

HDF 3.0.2 is a maintenance release that includes the following improvements and bug fixes:

NiFi bug fixes and improvements

  • BUG-91298 – NiFi is not starting after encrypting config files using Encrypt-Config tool

  • BUG-90950 – NiFi Content Viewer URL not accessible from behind proxy

  • BUG-90899 – Viewing content does not work when request made from proxy to a NiFi cluster

  • BUG-90862 – Unable to manage Controller Service with large number of components referencing it

  • BUG-90223 – Cannot view content of flow file when nifi is being accessed via knox

  • BUG-90024 – NiFi Certificate authority fails to start as run_ca.sh cannot be executed when the umask is 0027

  • BUG-89737 – FetchSFTP fails to move files in remote dir and fails with FileNotFound exception

  • BUG-89318 – No enum constant org.wali.UpdateType.CONTENTMISSING

  • BUG-89314 – PR needed in the HDF mpack

  • BUG-89227 – WriteAheadProvenanceRepository fails often to cleanup provenance files filling up disks

  • BUG-88466 – OOM in ConfigEncryptTool

  • BUG-88335 – ListSFTP fails to retrieve user home directory for certain user accounts

  • BUG-88152 – FetchSFTP - Ensure connection is closed

  • BUG-87842 – ConsumeKafka 0.9 and 0.10 can cause consumer rebalance when backpressure is engaged

  • BUG-87690 – Improved JAXB/XML Handling

  • BUG-87034 – Cannot install HDF-3.0.2 Nifi on windows platform

  • BUG-87033 – SFTPTransfer should specify connection timeout

  • BUG-86455 – ElasticsearchHttp processors should support dynamic properties as query parameters

  • BUG-86185 – Node failed to join cluster due to NullPointerException

  • BUG-86109 – o.a.n.p.index.lucene.LuceneEventIndex Failed to retrieve Provenance Events from store

  • BUG-86108 – WriteAheadProvenanceRepository indexing and query failure under high rate stress testing

  • BUG-85763 – Allow specifying timestamp in PutHBase processors

  • BUG-85668 – add useLocalUser option to the NIFI windows MSI

  • BUG-85534 – MergeContent throws FlowFileHandlingException: not the most recent version of this FlowFile within this session

  • BUG-85400 – GenerateTableFetch processor: add support for Oracle 12+

  • BUG-84369 – GenerateTableFetch should allow you to specify an initial Max Value

  • BUG-83756 – Issue with the MergeContent Processor when processing Avro files

  • BUG-72912 – putHdfs processor not creating the directories with correct group write permissions

MiNiFi bug fixes and improvements

  • BUG-89544 – Unable to start FetchDistributedMapCache/PutDistributedMapCache in Minifi

  • BUG-84442 – Duplication of offset segments for TailFile on Windows

SAM bug fixes and improvements

  • BUG-91072 – Remove findbugs-ant 1.3.2

  • BUG-90892 – Streamline unable to kill topologies

  • BUG-90890 – Streamline topology unable to write data to HBase

  • BUG-90870 – Stack advisor error in HDF 3.0.2

  • BUG-90700 – SAM fails during setup with table already exists error when using blueprints

  • BUG-90641 – Streamline failed to come up because was not found

  • BUG-90594 – SAM deployment fails while renaming table "widget_datasource_mapping" while using blueprints

  • BUG-90520 – Backport Oracle Database support changes for SAM/Registry to 3.0.2

  • BUG-88587 – Cherry pick STORM-2489 into HDF-3.0-maint and 2.6-maint

  • BUG-88442 – SAM Processors/Sinks/Rules need to update when its upstream components are updated

  • BUG-88239 – Specific SAM and Storm changes into HDF 3.0.2

  • BUG-88235 – Bring required changes into 3.0-maint

  • BUG-81109 – Add Select All to most to processor where applicable

Schema Registry bug fixes and improvements

  • BUG-91075 – Remove Mariadb-java-client 1.5.5

  • BUG-91074 – Remove Findbug-Annotations 2.0.1

  • BUG-91073 – Remove findbugs-ant 1.3.2

  • BUG-90800 – Add Registry StackFeatures to HDP StackFeatures

  • BUG-90523 – Registry startup fails when mpack upgraded from 3.0.x to 3.1 and stack is not upgraded

  • BUG-90520 – Backport Oracle Database support changes for SAM/Registry to 3.0.2

  • BUG-90485 – registry start failed during EU from 3.0.1 to 3.0.2

  • BUG-89879 – During Express Upgrade there are no service checks for SAM and registry

  • BUG-89753 – SchemaRegistry urls have got extra api at the beginning

  • BUG-87747 – Schema registry client fails to convert the response with Unrecognized field "schemaMetadataId"

Kafka bug fixes and improvements

  • BUG-90963 – Storm and Kafka services fail to start with wrong ZK configs when using BP

  • BUG-89261 – Bring ByteArrayConverter into HDF-3.0-maint branch

  • BUG-89085 – Port security related changes to 2.6 branch for ConsumerGroupCommand (support for PLAINTEXTSASL and SASL_PLAINTEXT)

Storm bug fixes and improvements

  • BUG-90963 – Storm and Kafka services fail to start with wrong ZK configs when using BP

  • BUG-90574 – CLONE - kafka lag monitor in Storm UI fails with error "java.lang.NoSuchFieldError: PLAINTEXTSASL" even in non-secure cluster

  • BUG-90203 – Storm slider client installation failed after wire encryption on a HDP HDF integration cluster

  • BUG-87759 – ExecutorService in WaterMarkEventGenerator never shutdown

  • BUG-87400 – STORM-2598 is missing which is needed for proxy artifact fetch on SAM

  • BUG-85515 – potential execution of code as the wrong user in Apache Storm

Ambari bug fixes and improvements

  • BUG-90299 – Metrics collector fails to stop/start after WE in a HDP + HDF integration on SLES12

  • BUG-90086 – HDP + HDF integration fails as some symlinks could not be created

  • BUG-89639 – Stopping Schema Registry and Streamline services fail during EU from HDF-3.0.1.1 -> HDF-3.0.2.0

  • BUG-89599 – Ambari Metrics fails to start during HDP + HDF integration due to Configuration parameter 'hdfs-site' was not found

  • BUG-89400 – Ambari to support Oracle database configurations for SAM/Registry

  • BUG-89034 – Streamline and registry installation is failing due to looped symbolic links

  • BUG-88670 – HDP + HDF integration fails as it is not able to download the nifi package in HDF 3.0.2

  • BUG-88518 – NiFi fails to install during HDP + HDF integration due to missing configuration parameter

  • BUG-88396 – HDF EU fails while upgrading from 2.x to 3.0.2.0 while trying to "Update Target Stack"

  • BUG-87929 – Get HDF 3.0.2 working with Ambari 2.6.0

  • BUG-87914 – Registry service start fails with circular link

  • BUG-87635 – HDF 3.0.2.0 deployment fails with Ambari 2.5.2.0 with infra solr client install failures

  • BUG-85321 – remove unsupported OS versions from repoinfo.xml in the HDF mpack

For complete information about the HDF 3.0.x release, see the following Release Notes:

​Unsupported Features

Some features exist within HDF 3.0.2, but Hortonworks does not currently support these capabilities.

​Technical Preview Features

The following features are available within HDF 3.0.2 but are not ready for production deployment. Hortonworks encourages you to explore these technical preview features in non-production environments and provide feedback on your experiences through the Hortonworks Community Forums.

​

Table 1.1. Technical Previews

ComponentFeature
NiFiKnox proxy integration

MiNiFi

MiNiFi C++
Streaming Analytics Manager

  • SAM Stream Insights module (Druid and Apache Superset)

  • Sinks

    • Cassandra

    • OpenTSDB

    • Solr

  • Sources

    • HDFS


​Community Driven Features

The following features are developed and tested by the Hortonworks community but are not officially supported by Hortonworks. These features are excluded for a variety of reasons, including insufficient reliability or incomplete test case coverage, declaration of non-production readiness by the community at large, and feature deviation from Hortonworks best practices. Do not use these features in your production environments.

Community Driven Kafka features

  • Kafka Connect

  • Kafka Streams

Community Driven NiFi Tools and Services

  • Embedded ZooKeeper

  • Sensitive key migration toolkit

  • Docker image for Apache NiFi

Community Driven NiFi Processors

  • AttributeRollingWindow

  • AWSCredentialsProviderControllerService

  • CompareFuzzyHash

  • ConsumeEWS

  • ConsumeIMAP

  • ConsumePOP3

  • ConvertExcelToCSVProcessor

  • DebugFlow

  • DeleteDynamoDB

  • DeleteGCSObject

  • DeleteHDFS

  • ExtractCCDAAttributes

  • ExtractEmailAttachments

  • ExtractEmailHeaders

  • ExtractMediaMetadata

  • ExtractTNEFAttachments

  • FetchAzureBlobStorage

  • FetchGCSObject

  • FuzzyHashContent

  • GetDynamoDB

  • GetHDFSEvents

  • GetSNMP

  • ISPEnrichIP

  • InferAvroSchema

  • ListenBeats

  • ListenLumberjack

  • ListenSMTP

  • ListAzureBlobStorage

  • ListGCSBucket

  • ListS3

  • ModifyBytes

  • OrcFormatConversion

  • PutAzureBlobStorage

  • PutDynamoDB

  • PutGCSObject

  • PutIgniteCache

  • PutKinesisFirehose

  • PutKinesisStream

  • PutLambda

  • PutSlack

  • PutTCP

  • PutUDP

  • QueryDNS

  • SetSNMP

  • SpringContextProcessor

  • StoreInKiteDataset

Community Driven NiFi Controller Services

  • AWSCredentialsProviderControllerService

  • GCPCredentialsControllerService

Community Driven NiFi Reporting Tasks

  • SiteToSiteBulletinReportingTask

  • SiteToSiteStatusReportingTask

  • DataDogReportingTask

​Unsupported Customizations

Hortonworks cannot guarantee that default NiFi processors are compatible with proprietary protocol implementations or proprietary interface extensions. For example, we support interfaces like JMS and JDBC that are built around standards, specifications, or open protocols. But we do not support customizations of those interfaces, or proprietary extensions built on top of those interfaces.

​Deprecated Technologies

This section points out any technology from previous releases that has been deprecated or removed from this release (operating systems, Java versions, databases, product features). Use this section as a guide for your implementation plans.

Deprecated

Technology that Hortonworks is removing in a future release. Deprecated items are supported until they are removed; deprecation gives you time to plan for removal.

Removed

Technology that Hortonworks has removed from production and is no longer supported.

​

Table 1.2. Deprecated Operating Systems

Operating System

Release DeprecatedRelease Removed
Debian 6HDF 2.1.2HDF 3.0.0
Ubuntu 12HDF 3.0.0HDF 3.0.0

​

Table 1.3. Deprecated NiFi Processors

Processor

Release Deprecated
ConvertCSVToAvroHDF 3.0.0
ConvertJSONToAvroHDF 3.0.0
GetKafka HDF 2.0.0
PutKafkaHDF 2.0.0
EvaluateRegularExpressionHDF 1.0.0

​HDF Repository Locations

Use the following table to identify the HDF 3.0.2 repository location for your operating system and operational objectives. HDF 3.0.2 supports the following operating systems:

​

Table 1.4. RHEL/Oracle Linux/CentOS 6 HDF repository & additional download locations

OS FormatDownload location
RHEL/Oracle Linux/CentOS 6 (64-bit):HDF Base URL http://public-repo-1.hortonworks.com/HDF/centos6/3.x/updates/3.0.2.0
HDF Repohttps://s3.amazonaws.com/public-repo-1.hortonworks.com/HDF/centos6/3.x/updates/3.0.2.0/hdf.repo
RPM tarballhttps://s3.amazonaws.com/public-repo-1.hortonworks.com/HDF/centos6/3.x/updates/3.0.2.0/HDF-3.0.2.0-centos6-rpm.tar.gz
Tars tarballhttps://s3.amazonaws.com/public-repo-1.hortonworks.com/HDF/centos6/3.x/updates/3.0.2.0/HDF-3.0.2.0-centos6-tars-tarball.tar.gz
HDF Management Packhttps://s3.amazonaws.com/public-repo-1.hortonworks.com/HDF/centos6/3.x/updates/3.0.2.0/tars/hdf_ambari_mp/hdf-ambari-mpack-3.0.2.0-76.tar.gz
HDP and Ambari Repositories
Ambarihttp://public-repo-1.hortonworks.com/ambari/centos6/2.x/updates/2.6.0.0/ambari.repo
HDP http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.6.3.0/hdp.repo
OS Agnostic Downloads
NiFi only
NiFi Toolkit
MiNiFi Java Agent
MiNiFi Toolkit

​

Table 1.5. RHEL/Oracle Linux/CentOS 7 HDF repository & additional download locations

OS FormatDownload location
RHEL/Oracle Linux/CentOS 7 (64-bit):HDF Base URLhttp://public-repo-1.hortonworks.com/HDF/centos7/3.x/updates/3.0.2.0
HDF Repohttps://s3.amazonaws.com/public-repo-1.hortonworks.com/HDF/centos7/3.x/updates/3.0.2.0/hdf.repo
RPM tarballhttps://s3.amazonaws.com/public-repo-1.hortonworks.com/HDF/centos7/3.x/updates/3.0.2.0/HDF-3.0.2.0-centos7-rpm.tar.gz
Tars tarballhttps://s3.amazonaws.com/public-repo-1.hortonworks.com/HDF/centos7/3.x/updates/3.0.2.0/HDF-3.0.2.0-centos7-tars-tarball.tar.gz
HDF Management Packhttps://s3.amazonaws.com/public-repo-1.hortonworks.com/HDF/centos7/3.x/updates/3.0.2.0/tars/hdf_ambari_mp/hdf-ambari-mpack-3.0.2.0-76.tar.gz
MiNiFi C++ Agenthttps://s3.amazonaws.com/public-repo-1.hortonworks.com/HDF/centos7/3.x/updates/3.0.2.0/tars/nifi-minifi-cpp/nifi-minifi-cpp-0.3.0-bin.tar.gz
HDP and Ambari Repositories
Ambari http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.6.0.0/ambari.repo
HDP http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.3.0/hdp.repo
OS Agnostic Downloads
NiFi only
NiFi Toolkit
MiNiFi Java Agent
MiNiFi Toolkit

​

Table 1.6. SLES 11 SP3/SP4 HDF repository & additional download locations

OS FormatDownload location
SUSE Enterprise Linux 11 SP3, SP4 HDF Base URLhttp://public-repo-1.hortonworks.com/HDF/suse11sp3/3.x/updates/3.0.2.0
Repohttp://public-repo-1.hortonworks.com/HDF/suse11sp3/3.x/updates/3.0.2.0/hdf.repo
RPM tarballhttps://public-repo-1.hortonworks.com/HDF/suse11sp3/3.x/updates/3.0.2.0/HDF-3.0.2.0-suse11sp3-rpm.tar.gz
Tars tarballhttps://public-repo-1.hortonworks.com/HDF/suse11sp3/3.x/updates/3.0.2.0/HDF-3.0.2.0-suse11sp3-tars-tarball.tar.gz
HDF Management Packhttps://public-repo-1.hortonworks.com/HDF/suse11sp3/3.x/updates/3.0.2.0/tars/hdf_ambari_mp/hdf-ambari-mpack-3.0.2.0-76.tar.gz
HDP and Ambari Repositories
Ambari http://public-repo-1.hortonworks.com/ambari/suse11/2.x/updates/2.6.0.0/ambari.repo
HDP http://public-repo-1.hortonworks.com/HDP/suse11sp3/2.x/updates/2.6.3.0/hdp.repo
OS Agnostic Downloads
NiFi only
NiFi Toolkit
MiNiFi Java Agent
MiNiFi Toolkit

​

Table 1.7. SLES 12 HDF repository & additional download locations

OS FormatDownload location
SUSE Linux Enterprise Server (SLES) v12 SP1HDF Base URLhttp://public-repo-1.hortonworks.com/HDF/sles12/3.x/updates/3.0.2.0
Repohttps://s3.amazonaws.com/public-repo-1.hortonworks.com/HDF/sles12/3.x/updates/3.0.2.0/hdf.repo
RPM tarballhttps://s3.amazonaws.com/public-repo-1.hortonworks.com/HDF/sles12/3.x/updates/3.0.2.0/HDF-3.0.2.0-sles12-rpm.tar.gz
Tars tarballhttps://s3.amazonaws.com/public-repo-1.hortonworks.com/HDF/sles12/3.x/updates/3.0.2.0/HDF-3.0.2.0-sles12-tars-tarball.tar.gz
HDF Management Packhttps://s3.amazonaws.com/public-repo-1.hortonworks.com/HDF/sles12/3.x/updates/3.0.2.0/tars/hdf_ambari_mp/hdf-ambari-mpack-3.0.2.0-76.tar.gz
HDP and Ambari Repositories
Ambari http://public-repo-1.hortonworks.com/ambari/sles12/2.x/updates/2.6.0.0
HDP http://public-repo-1.hortonworks.com/HDP/sles12/2.x/updates/2.6.3.0/hdp.repo
OS Agnostic Downloads
NiFi only
NiFi Toolkit
MiNiFi Java Agent
MiNiFi Toolkit

​

Table 1.8. Ubuntu 14 HDF repository & additional download locations

OS FormatDownload location
Ubuntu Trusty (14.04) (64-bit)HDF Base URLhttp://public-repo-1.hortonworks.com/HDF/ubuntu14/3.x/updates/3.0.2.0
Repohttps://s3.amazonaws.com/public-repo-1.hortonworks.com/HDF/ubuntu14/3.x/updates/3.0.2.0/hdf.list
Deb tarballhttps://s3.amazonaws.com/public-repo-1.hortonworks.com/HDF/ubuntu14/3.x/updates/3.0.2.0/HDF-3.0.2.0-ubuntu14-deb.tar.gz
Tars tarballhttps://s3.amazonaws.com/public-repo-1.hortonworks.com/HDF/ubuntu14/3.x/updates/3.0.2.0/HDF-3.0.2.0-ubuntu14-tars-tarball.tar.gz
HDF Management Packhttps://s3.amazonaws.com/public-repo-1.hortonworks.com/HDF/ubuntu14/3.x/updates/3.0.2.0/tars/hdf_ambari_mp/hdf-ambari-mpack-3.0.2.0-76.tar.gz
MiNiFi C++ Agenthttps://s3.amazonaws.com/public-repo-1.hortonworks.com/HDF/ubuntu14/3.x/updates/3.0.2.0/tars/nifi-minifi-cpp/nifi-minifi-cpp-0.3.0-bin.tar.gz
HDP and Ambari Repositories
Ambarihttp://public-repo-1.hortonworks.com/ambari/ubuntu14/2.x/updates/2.6.0.0/ambari.list
HDP http://public-repo-1.hortonworks.com/HDP/ubuntu14/2.x/updates/2.6.3.0/hdp.list
OS Agnostic Downloads
NiFi only
NiFi Toolkit
MiNiFi Java Agent
MiNiFi Toolkit

​

Table 1.9. Debian 7 HDF repository & additional download locations

OS FormatDownload location
Debian 7HDF Base URL http://public-repo-1.hortonworks.com/HDF/debian7/3.x/updates/3.0.2.0
Repohttps://s3.amazonaws.com/public-repo-1.hortonworks.com/HDF/debian7/3.x/updates/3.0.2.0/hdf.list
Deb tarballhttps://s3.amazonaws.com/public-repo-1.hortonworks.com/HDF/debian7/3.x/updates/3.0.2.0/HDF-3.0.2.0-debian7-deb.tar.gz
Tars tarballhttps://s3.amazonaws.com/public-repo-1.hortonworks.com/HDF/debian7/3.x/updates/3.0.2.0/HDF-3.0.2.0-debian7-tars-tarball.tar.gz
HDF Management Packhttps://s3.amazonaws.com/public-repo-1.hortonworks.com/HDF/debian7/3.x/updates/3.0.2.0/tars/hdf_ambari_mp/hdf-ambari-mpack-3.0.2.0-76.tar.gz
HDP and Ambari Respositories
Ambari http://public-repo-1.hortonworks.com/ambari/debian7/2.x/updates/2.6.0.0/ambari.list
HDPhttp://public-repo-1.hortonworks.com/HDP/debian7/2.x/updates/2.6.3.0/hdp.list
OS Agnostic Downloads
NiFi only
NiFi Toolkit
MiNiFi Java Agent
MiNiFi Toolkit

​Common Vulnerabilities and Exposures

The following CVEs have been fixed in HDF 3.0.2.

​CVE-2017-12623

Summary: Apache NiFi XXE issue in template XML upload
Severity: Medium
Versions Affected: Apache NiFi 1.0.0 - 1.3.0; HDF 2.x, 3.0.0 - 3.0.1.1
Impact: An authorized user could upload a template which contained malicious code and accessed sensitive files via an XML External Entity (XXE) attack.
Recommended Action: The fix to properly handle XML External Entities was applied on the Apache NiFi 1.4.0 release. Users running a prior 1.x release should upgrade to the appropriate release. HDF users should upgrade to HDF 3.0.2.

​Known Issues

Hortonworks Bug ID

Apache JIRA

Component

Summary

BUG-83893NIFI-4771NiFi

Issue: NiFi may fail to start.

Description: When starting NiFi, NiFi may fail to execute scripts located in /var/lib/ambari-agent/cache/common-services/NIFI/1.0.0 due to an issue with permissions on umask 027 environments with non-root Ambari agents.

Workaround: To work around this issue, apply the following permission changes:

chmod -R 755 /var/lib/ambari-agent/cache/common-services/NIFI
BUG-87353 SAM/Kafka/Ambari

Issue: If you are upgrading from HDF 3.0.0, SAM may be unable to configure Kafka sources.

Result: SAM displays the following error message:

Output stream fields cannot be blank

Workaround: To work around this issue manually upgrade the Kafka bundle using the following steps:

curl -i --negotiate -u:anyUser -b /tmp/cookiejar.txt -c /tmp/cookiejar.txt -sS -i HOST:8080/api/v1/catalog/streams/componentbundles/SOURCE?subType=KAFKA
Get the value of "Id" from the above request.

Check if /usr/hdf/current/streamline/bootstrap/components/sources/kafka-source-topology-component.json has the field "readerSchemaVersion"

curl -i --negotiate -u:anyUser -b /tmp/cookiejar.txt -c /tmp/cookiejar.txt -sS -X PUT -i -F topologyComponentBundle=@/usr/hdf/current/streamline/bootstrap/components/sources/kafka-source-topology-component.json HOST:8080/api/v1/catalog/streams/componentbundles/SOURCE/
{ID from the earlier curl command}
 KNOX-1108NiFi/Knox

Issue: NiFi/Knox integration does not support HA.

In NiFiHaDispatch, executeRequest is overridden and does not have the try/catch block in DefaultHaDispatch's executeRequest method which is used to catch exceptions and begin the failover process.

Workaround: There is no workaround for this issue.

BUG-90903 NiFi/Knox

Issue: Knox HA failover for NiFi is not supported.

Workaround: There is no workaround for this issue.

​Third-Party Licenses

HDF 3.0.2 deploys numerous third-party licenses and dependencies, all of which are compatible with the Apache software license. For complete third-party license information, see the licenses and notice files contained within the distribution.

© 2012–2020, Cloudera, Inc.
Document licensed under the Creative Commons Attribution ShareAlike 4.0 License.
Cloudera.com | Documentation | Support | Community