Cloudera Docs

Fixed issues

Review the list of resolved issues.

Issues fixed in CFM 2.1.6 SP1

  • NIFI-12827: Upgraded PostgreSQL JDBC test driver from 42.6.0 to 42.7.2
  • NIFI-12745: Fixed AvroReader silently dropping malformed records
  • NIFI-12732: ListS3 resets its tracking state after configuration change
  • NIFI-12731: Ensure state is updated in GetHBase whenever the session is committed
  • NIFI-12705: Updated metrics-jvm to 4.2.25 Additionally update metrics-graphite and metrics-core to 4.2.22
  • NIFI-12682: Fixed MiNiFi agent manifest hash swaps
  • NIFI-12677: Removed documentation of non-existent strategy for ExcelReader
  • NIFI-12650: Upgraded json-path from 2.8.0 to 2.9.0
  • NIFI-12612: In asn1 bundle handle OBJECT IDENTIFIER type as string.
  • NIFI-12596: PutIceberg is missing case-insensitive Record type handling in List and Map types
  • NIFI-12594: ListS3 - observe min/max object age when entity state tracking is used
  • NIFI-12592: Upgraded Apache Curator from 5.5.0 to 5.6.0
  • NIFI-12567: Prevent NPE in CuratorLeaderElectionManager.getLeadershipChangeCount
  • NIFI-12562: Upgraded json-schema-validator from 1.0.87 to 1.1.0
  • NIFI-12561: Fixed MergeContent DELIMITER_STRATEGY_NONE Handling
  • NIFI-12559: Upgraded SSHJ from 0.37.0 to 0.38.0
  • NIFI-12535: Fixed documentation for 'PadRight Examples' table name in the Expression Language Guide as well as the last example in the table
  • NIFI-12526: Fixed handling of Fetch Size in QueryCassandra, added fragment attributes
  • NIFI-12520: ExtractHL7Attributes processor ignores repeatable field values
  • NIFI-12517: Updated isJson function to improve space handling
  • NIFI-12516: Corrected Cluster Replicated Response Headers for HTTP/2
  • NIFI-12506: Added Threading for Status Analytics Retrieval
  • NIFI-12481: Filtering out unauthorized registry clients to avoid unhandled error
  • NIFI-12470: Fixed forEach callback for usage with Object.entries() to address layout issue in Status History
  • NIFI-12462: Upgraded Logback from 1.3.13 to 1.3.14
  • NIFI-12441: Added No Tracking Strategy to ListS3
  • NIFI-12438: Upgraded Logback from 1.3.11 to 1.3.13
  • NIFI-12418: Corrected Provider Groups Missing in Refreshed Tokens
  • NIFI-12416: Relocated the additionalDetails.html to the appropriate bundle in order for it to be seen when generating the documentation.
  • NIFI-12412: Support Proxies for Blob Checkpoints in ConsumeAzureEventHub
  • NIFI-12403: Improved Jolt UI Parameter Processing
  • NIFI-12387: Initialize Controller Service Comments with Empty String
  • NIFI-12383: Replication client should handle accept encoding with lowercase
  • NIFI-12376: Fixed logic error with bitwise operator in AvroReader
  • NIFI-12373: Added LICENSE and NOTICE for nifi-standard-shared-nar
  • NIFI-12370: Fixed Distributed Map Cache Client Service Shutdown
  • NIFI-12368: Clear versionedComponentId for copied Snippets
  • NIFI-12363: Upgraded JLine from 3.23.0 to 3.24.1
  • NIFI-12358: Fixed NPE in HostHeaderHandler
  • NIFI-12355: Upgraded AMQP Client from 5.19.0 to 5.20.0
  • NIFI-12346: Upgraded Apache Calcite from 1.35.0 to 1.36.0
  • NIFI-12323: Removed String Length Limits from JSON Flow Configuration
  • NIFI-12319: Upgraded ActiveMQ to 5.15.16
  • NIFI-12318: Fixed byte array generation in GenerateRecord
  • NIFI-12314: Fixed EL for SQL Query Property in QueryNiFiReportingTask
  • NIFI-12276: Addressed Dependency Check Findings
  • NIFI-12273: Fixed command.argument references in ExecuteStreamCommand docs
  • NIFI-12271: Fixed PutAzureBlobStorage_v12 rollback on failure with FileResourceService
  • NIFI-12265: Fixed OpenPGP Hexadecimal Key Formatting with leading 0
  • NIFI-12254: Clarified Bulk operation header documentation for PutElasticsearchRecord and PutElasticsearchJson processors
  • NIFI-12238: Fixed SplitText endline trimming with max fragment size
  • NIFI-12237: Changed label height and width from POSITION to SIZE difference
  • NIFI-12232: Corrected Group Component ID Handling for Clustered Flows
  • NIFI-12228: This closes #7882. Fixed issue with FlowFile Concucrrency that can occasionally bring in more data than it should
  • NIFI-12222: Fixed StandardVersionedComponentSynchronizerTest for support branch
  • NIFI-12222: Protect against missing parameter context when syncing a PG in component synchronizer
  • NIFI-12207: Upgraded Netty from 4.1.99 to 4.1.100
  • NIFI-12194: Added Yield on Exceptions in Kafka Processors
  • NIFI-12170: Upgraded snappy-java to 1.1.10.5
  • NIFI-12165: Changed the properties "Custom Transformation Class Name" and "Custom Module Directory" to depend on the "Jolt Transformation DSL" property when its value is "Custom"
  • NIFI-12160: Kafka Connect Check for NAR unpacking before starting
  • NIFI-12158: MockProcessSession write methods preserves attributes
  • NIFI-12154: Upgraded Apache Avro from 1.11.2 to 1.11.3
  • NIFI-12151: Fixed StandardPrivateKeyService fails due to missing BouncyCastleProvider
  • NIFI-12134: Disable Directory Listing property is duplicated on PutSFTP processor
  • NIFI-12127: Allow Jackson's max string length to be configured on SplitJson and EvaluateJsonPath
  • NIFI-12126: Downgrade snowflake-jdbc to 3.13.33 snowflake-ingest-sdk:2.0.3 is not compatible with snowflake-jdbc:3.14.x
  • NIFI-12122: Fixed persistence of Parameter Context descriptions
  • NIFI-12118: Refactored RemoveRecordPath member variable that was caching values, and improve performance with Pattern.matcher().find() instead of .match().
  • NIFI-12117: Allow configuring Jackson's max string length in JoltTransformJSON
  • NIFI-12107: Fixed sorting in the cluster table
  • NIFI-12089: Fixed typo in additionalDetails of CSVReader
  • NIFI-12084: Fixed per Process Group logging
  • NIFI-12083: Upgraded Jetty from 9.4.51 to 9.4.52
  • NIFI-12067: mock process session keeps track of flowfiles created during the session and removes them on rollback rather than putting them on the input queue
  • NIFI-12063: Clarified Elasticsearch Query Documentation
  • NIFI-12037: Changed List.of to Collections.singletonList for Java 8
  • NIFI-12037: Updated AzureUserGroupProvider to allow configuration of the graph endpoint and API scope to support regional clouds
  • NIFI-12034: Upgraded Apache Commons Compress from 1.23.0 to 1.24.0
  • NIFI-12019: Improved reliability of TestSynchronousFileWatcher
  • NIFI-12019: Bugfix for SynchronousFileWatcher time check interval
  • NIFI-12014: NullPointerException in PutSQL when adding error attributes
  • NIFI-12010: Handle auto-commit and commit based on driver capabilities in SQL components
  • NIFI-11987: Set read buffer size in PutAzureBlobStorage_v12
  • NIFI-11981: PublishGCPubSub failure / Record-based processing / AVRO
  • NIFI-11980: Bump org.apache.ivy:ivy from 2.5.1 to 2.5.2
  • NIFI-11976: Removed error log check in TestListenTCPRecord
  • NIFI-11959: Corrected single-line comment handling for Jolt JSON
  • NIFI-11909: Cleared Password field after login
  • NIFI-11899: Corrected Bulletin Metrics Registry to return latest Bulletins
  • NIFI-11782: Resolved NPE when moving snippet with label to process group
  • NIFI-11739: Added ability to ignore missing fields in PutIceberg
  • NIFI-11677: Removed non required yield in DeleteHDFS
  • NIFI-11595: Backported StateMap.getStateVersion() for StateProviders
  • NIFI-11595: StateProvider.replace() supports creating the initial state
  • NIFI-11519: Fixed DBCPConnectionPool Sensitive Dynamic Properties
  • NIFI-11389: Fixed controller services's link to referencing controller
  • NIFI-11288: Added AWS STS dependency for AssumeRoleWithWebIdentity method
  • NIFI-11177: Added defensive code for null values for Iceberg
  • NIFI-9677: Fixed issue that an empty JSON array causes flow file to be considered unmatched even though it should be considered as a match.
  • NIFI-9464: Fixed race condition between "Timer-Driven" threads when running SiteToSiteProvenanceReportingTask.onTrigger and "Compress Provenance Log" threads running EventFileCompressos.run that can cause the SiteToSiteProvenanceReportingTask.onTrigger to pair an already compressed .prov.gz file with a .toc file that corresponds to the uncompressed .prov file.
  • NIFI-8135: Allow CHOICE data types in conversion of Records to Java Maps
  • NIFI-5137: Fixed the path to Controller Service grid item's state
  • CFM-3775:
    • Updated scala-library version to 2.13.12 to mitigate CVE-2022-36944 and Reactor Netty client to 1.0.34 to mitigate CVE-2023-34062
    • Removed support for old Postgres versions
    • Updated org.json:json version to 20231013 to mitigate CVE-2023-5072
    • Updated snappy-java to 1.1.10.5 (CVE-2023-43642) excluded bcprov-ext references (CVE-2018-1000180, CVE-2018-1000613) updated snakeyaml to 2.2 (CVE-2017-18640)
    • Updated commons-fileupload to 1.5 and graal-sdk to 23.1.2 to fix CVE-2023-24998 and CVE-2024-20932
    • Updated jetty.version to 9.4.54.v20240208 to mitigate CVE-2023-36478
    • Updated box-java-sdk to 4.6.1 and reactor-netty-http to 1.1.15
  • CFM-3687: Updated Commons-text-1.9.jar in nifi-cdf-iceberg-nar

Issues fixed in CFM 2.1.6

CFM 2.1.6 uses Apache NiFi 1.23.1 with additional commits on top of it. It includes all fixed issues of this Apache NiFi release as well as the below list:

  • CFM-1822: Added nifi-cdf-grpc-nar to assembly
  • CFM-1822: Added ARM64 protoc binaries in nifi-cdf-grpc-bundle
  • CFM-2853: Added CyberarkConjurParameterProvider
  • CFM-3022: Excluded Content-Type header in custom S3 signer
  • CFM-3088: Added PostgreSQLConnectionPool
  • CFM-3159: Added registry client for Cloudera Flow Library
  • CFM-3159: Fixed StringUtils dependency in nifi-cdf-flow-library modules
  • CFM-3168: Added EBCDICRecordReader
  • CFM-3239: ClouderaSchemaRegistry controller service
  • CFM-3325: Redshift controller service
  • CFM-3328: Added ListenNetFlow Processor
  • CFM-3328: Added nifi-cdf-netflow-nar to nifi-assembly
  • CFM-3329: CML Lookup Service
  • CFM-3335: PutIcebergCDC processor
  • CFM-3378: Automatic nar delivery should not die, if 404 happens
  • CFM-3425: Created AzureServiceBusJMSConnectionFactoryProvider
  • CFM-3471: Allowing ClouderFlowLibraryClient to work with unknown fields
  • CFM-3488: Corrected padding handling for ListenNetFlow Options Templates
  • NIFI-11817: Fixed ListCDPObjectStore after ListHDFS refactor
  • NIFI-11889: Added Record-oriented Transmission to PutTCP
  • NIFI-11916: Iceberg processor extensibility improvement
  • NIFI-11971: Ensured that if no bytes are written to a file after calling ProcessSession.write() that content claim's length is set to 0 when closing OutputStream
  • NIFI-11971: Ensured that when creating a new content claim that an existing claim length of -1 is always treated as 0 to ensure that -1 is never added to the offset

For a summary of improvements, bug fixes and new features delivered with Apache NiFi, see the following release notes: