Fixed issues

Review the list of resolved issues.

Issues fixed in CFM 2.1.5 SP3

  • NIFI-11560 Bulletin causes UI to think it cannot refresh

Issues fixed in CFM 2.1.5 SP2

  • NIFI-12010 Handle auto-commit and commit based on driver capabilities in SQL components

  • NIFI-11898 Handle commit based on driver capabilities in PutDatabaseRecord

  • NIFI-11672 Adjusted ListSFTP to handle incomplete File Types

  • NIFI-11987 Set read buffer size in PutAzureBlobStorage_v12

  • NIFI-11981 PublishGCPubSub failure / Record-based processing / AVRO

  • NIFI-11926 Added proxy handling in Azure Storage Credentials Services

  • NIFI-11586 Added AzureStorageCredentialsControllerServiceLookup_v12

  • NIFI-11585 Added ADLSCredentialsControllerServiceLookup

  • NIFI-11325 Upgraded Mockito from 3.12.4 to 4.11.0

  • NIFI-11758 Added FileResourceService and used it in PutAzure*Storage processors for local file upload

  • NIFI-11360 Switched Optional.isEmpty to Optional.isPresent for Java 8

  • NIFI-11360 Added Client-Side Encryption for Azure Blob v12 Processors

  • NIFI-10721 Avoid querying properties after Azure Blob upload

  • NIFI-10491 Added Conflict Resolution Strategy to PutAzureBlobStorage_v12

  • NIFI-11779 Override endpoint in PutBigQuery

  • NIFI-11338 Upgraded Spring Vault Core from 2.3.2 to 2.3.3

  • NIFI-11478 Upgraded Spring Framework from 5.3.26 to 5.3.27

  • NIFI-11320 Upgraded Spring Framework from 5.3.24 to 5.3.26

  • NIFI-11553 Add Record handling and more Properties for GCP PubSub

  • NIFI-10887 Addressed performance concerned, use String.indexOf() instead of Pattern.matcher() when using Literal Replace

  • NIFI-11584 Improved MergeContent stream handling

  • NIFI-11557 Fixed error with Java 11 code

  • NIFI-11557 Avoid using the expensive and unnecessary Files.walkFileTree

  • NIFI-5151 Add UPSERT support for Apache Phoenix

  • NIFI-10780 Improved Event Server to avoid dropping messages

  • NIFI-11439 Corrected GCS Transit URI for custom Storage API URL

  • NIFI-11439 Corrected Checkstyle violation on GCS Property

  • NIFI-11439 Added Storage API URL property to GCS Processors

  • NIFI-11408 Enable user to disable gzip compression with PutGCSObject

  • NIFI-11461 Improve User and Group Tenants Search

  • NIFI-11920 Improved JDBC and JNDI JMS Connection URL Validation

  • NIFI-11744 Added Required Permission to Reference Remote Resources

  • NIFI-12034 Upgraded Apache Commons Compress from 1.23.0 to 1.24.0

  • NIFI-12083 Upgraded Jetty from 9.4.51 to 9.4.52

  • NIFI-11376 Upgraded Jetty from 9.4.50 to 9.4.51

  • NIFI-10995 Update Jetty to 9.4.50.v20221201

  • NIFI-12063 Clarified Elasticsearch Query Documentation

  • NIFI-12037 Changed List.of to Collections.singletonList for Java 8

  • NIFI-12037 Update AzureUserGroupProvider to allow configuration of the graph endpoint and API scope to support regional clouds

  • NIFI-11944 Removed validation warning from ExecuteStreamCommand

  • NIFI-11524 Improved ExecuteStreamCommand documentation and configuration

  • NIFI-11896 Corrected backported changes for QuestDB 6

  • NIFI-11896 Corrected QuestDB Status Repository Shutdown handling

  • NIFI-11853 Changed Embedded QuestDB Tests to use JUnit5 TempDir

  • NIFI-10877 Converted more nifi-framework-core tests from JUnit 4 to 5

  • NIFI-11587 Update questdb to 6.7

  • NIFI-11902 Fix ListHDFS closes FileSystem in first run

  • NIFI-11817 Improve ListHDFS extensibility

  • NIFI-11178 Improve ListHDFS performance, incremental loading refactor

  • NIFI-11845 Added support for migrating H2 2.1 and 1.4 to 2.2

  • NIFI-8128 Added Sentinel Password to Redis Service

  • NIFI-11536 Corrected Keystore and Truststore auto-reloading

  • NIFI-11761 Fixed MiNiFi restart issue when graceful shutdown period expires. MiNiFi restart sends bootstrap to background

  • NIFI-10729 Added Cassandra testcontainers.

  • NIFI-11430 PaginatedJsonQueryElasticsearch processors improvements

  • NIFI-11034 Restore image viewer to nifi-assembly

  • NIFI-10865 Allow RecordPath's unescapeJson to convert de-serialised JSON Objects into Records

  • NIFI-10970 Added a count RecordPath function

  • NIFI-11483 Correctly use DescribedValue for JsonQueryElasticsearch

  • NIFI-10844 Allow _source only output for GetElasticsearch and JsonQueryElasticsearch

  • NIFI-5642 QueryCassandra processor improvements

  • NIFI-12019 bugfix for SynchronousFileWatcher time check interval

  • NIFI-11519 Fixed DBCPConnectionPool Sensitive Dynamic Properties

  • NIFI-11976 Removed error log check in TestListenTCPRecord

  • NIFI-11971 Ensure that when creating a new content claim that an existing claim length of -1 is always treated as 0, to ensure never ato dd -1 to offset

  • NIFI-11922 Honor catalog/schema field in UpdateDatabaseTable

  • NIFI-11918 Used java.security.cert in ListenGRPC

  • NIFI-11913 Added enum handling to StandardSchemaValidator

  • NIFI-11823 Fix NUMERIC support in PutBigQuery

  • NIFI-11899 Correct Bulletin Metrics Registry to return latest Bulletins

  • NIFI-11900 Catch RuntimeException in ResizeImage failures

  • NIFI-11860 fixed bug in ResultSetRecordSet affecting decimalScale when resultSetScale was zero

  • NIFI-11828 Confluent Schema Encoding Access Strategy - Schema ID versus Schema Version ID

  • NIFI-11854 Boolean formatting in ConvertExcelToCSV

  • NIFI-11837 When a queue starts swapping out data, it never stops

  • NIFI-11783 Fixed a bug in which a FlowFile split into multiple and then removed did not properly handle retries when one of the outputs was retried

  • NIFI-11814 Optimized Cluster Replication Component status evaluation

  • NIFI-11825 Fixed QueryRecord closing of resources

  • NIFI-11794 Fix NPE + configure max attempts for Redis State Provider

  • NIFI-11434 Added support for optionally allowing zip entries with data descriptors

  • NIFI-11741 Added Guava dependency to Ranger assembly includes

  • NIFI-7016 Fix Groovy File functions available for FlowFile in ExecuteGroovyScript

  • NIFI-11682 Correct Quoting for UPSERT and INSERT_IGNORE keys in PutDatabaseRecord

  • NIFI-11699 Fixed dynamic properties in SnowflakeComputingConnectionPool

  • NIFI-11691 Support VARBINARY and LONGVARBINARY in PutDatabaseRecord

  • NIFI-11680 Corrected Buffer Size Calculation for Connection Balancing

  • NIFI-11681 Terminate Process Sessions before interrupting processor threads

  • NIFI-11670 Refactored Content Repo OutputStream to create new Claim per FlowFile

  • NIFI-11667 Provide default NiFi version when building dockerhub image

  • NIFI-11647 Support UUID type in DataTypeUtils.getSQLTypeValue

  • NIFI-11653 Added Connection URL Validation for Database Services

  • NIFI-11593 Fixed hiding logic for properties

  • NIFI-11464 Improvements for importing nested versioned flows

  • NIFI-11628 Fixed Object[] and Throwable argument substitution in SimpleProcessLogger

  • NIFI-11636 Do not buffer Parquet content into memory unnecessarily

  • NIFI-11560 Bulletin causes UI to think it cannot refresh

  • NIFI-11538 Fix primitive type conversion for PutIceberg

  • NIFI-11614 Improved Validation for JndiJmsConnectionFactoryProvider

  • NIFI-11591 Added additional logging for DynamicallyModifyClasspath system test

  • NIFI-11591 Improved stability of DynamicallyClassPath and AsyncCommitCallback tests

  • NIFI-11591 Corrected intermittent system test failures

  • NIFI-11621 Inferring schema for JSON fails when there's a CHOICE of different ARRAY types

  • NIFI-11608 Fixed Expression Language Evaluation in PutBigQuery

  • NIFI-11596 Adjusting Swagger contract to cover RegistryClients as possible reference type for Controller Services

  • NIFI-11615 Logging fixes in AMQP bundle

  • NIFI-11369 Fixed Defragment strategy with optional fragment.count attribute in MergeContent

  • NIFI-11392 NiFi does not stop gracefully when using CRON scheduling

  • NIFI-11590 Missing Enum data type handling in FlowFileTable

  • NIFI-11580 Use daemon threads in DistributedCacheClient for clean shutdown

  • NIFI-11109 Allow registry client's class in flow.xml/json to not change

  • NIFI-8326 Send records as individual messages in Kafka RecordSinks

  • NIFI-11563 Allowing source connectables to be restarted on new connections in the StandardVersionedComponentSynchronizer

  • NIFI-11566 Adding updateTimeout argument to parameter commands in CLI

  • NIFI-11547 Fixed DBCPConnectionPool verification

  • NIFI-11535 Transfer ConnectWebsocket connection configuration FlowFile to relationships

  • NIFI-11544 Fixed REL_FAILURE usage in AbstractIcebergProcessor

  • NIFI-11545 Fixed test-all-dbs for Registry integration tests

  • NIFI-10756 Generate error message when processor and/or controller service is unable to transition to start and/or enabled state

  • NIFI-11287 UI - Dependent properties are not detected for parameters

  • NIFI-11493 Defaulted dynamically modified classpath fix

  • NIFI-11523 Refining schema handling for ScriptedTransfromRecord

  • NIFI-11436 Fix NPE during updateFlow when called from a replace request for a PG that is not under version control

  • NIFI-11224 Refactor and FF attribute support in WHERE in QuerySalesforceObject.

  • NIFI-11472 Check working directory after making directory in PutFTP

  • NIFI-11475 Fixed missing jackson-dataformat-xml in nifi-azure-services-api

  • NIFI-11402 PutBigQuery fix for case sensitivity and error handling

  • NIFI-11437 Switched to StreamUtils.fillBuffer() for buffer, Improved EncryptContentPGP Content Type Detection

  • NIFI-11422 Fixed stateless-assembly README typo

  • NIFI-11342 HDFS processors fail to get ClassloaderIsolationKey at startup

  • NIFI-10017 Increase JVM heap size for tls-toolkit

  • NIFI-11301 Fixed typos in ISPEnrichIP and DistributeLoad

  • NIFI-11817 Fix ListCDPObjectStore after ListHDFS refactor

  • CFM-3328 Added nifi-cdf-netflow-nar to nifi-assembly

  • CFM-3488 Correct padding handling for ListenNetFlow Options Templates

  • CFM-3328 Add ListenNetFlow Processor

  • CFM-1822 Added ARM64 protoc binaries in nifi-cdf-grpc-bundle

  • CFM-1822 Added nifi-cdf-grpc-nar to assembly

  • CFM-3449 Add property with text field value to edit logback.xml via CM UI

  • CFM-3385 Compare CSD and Parcel versions during NiFi start, in case CSD version is lower throw an error

  • CFM-3441 Replace all 'echo' with 'log' function in CSD code

  • CFM-3432 NiFi Registry start fails in case NIFi Registry installed on host with NiFi

  • CFM-3241 CM alert on NiFI registry OOM

Issues fixed in CFM 2.1.5 SP1

  • NIFI-11367 Database DATE value displayed incorrectly in record output if timezone is GMT-X

  • NIFI-11157 Doc update for scheduling strategy for MergeContent/Record

  • NIFI-11363 Fixed precision number handling in Flow Encryption Commands

  • NIFI-7190 CaptureChangeMySQL processor remove comments from normalized query

  • NIFI-11356 Upgraded Nimbus JOSE JWT to 9.31

  • NIFI-11347 Upgraded OWASP Dependency Check from 8.0.2 to 8.2.1

  • NIFI-11329 Updated NAR Plugin to 1.5.0 and Commons Compress to 1.23.0

  • NIFI-10580 Upgraded SLF4J from 1.7.36 to 2.0.6

  • NIFI-11024 Update iceberg.version to 1.1.0

  • NIFI-10796 Upgraded Apache Iceberg from 0.14.0 to 1.0.0

  • NIFI-10651 Upgraded Iceberg transitive dependencies

  • NIFI-11251 Fixed Nifi Registry Client with Nested PG - sync issue

  • NIFI-11341 Fixed OutputStream.close() handling for Content Claims

  • NIFI-11232 Fixed buffer handling in ContentClaimInputStream

  • NIFI-10888 Improved performance of Record Readers when inferring schema of small FlowFiles

  • NIFI-11332 Close Stream from Files.lines in StandardRuntimeManifestService

  • NIFI-10915 Added field to runtime manifest to indicate presence of additionalDetails information

  • NIFI-11291 Ensuring exceptional EventIterators are closed in PartitionedEventStore

  • NIFI-11302 Corrected Registry version retrieval

  • NIFI-11312 Rationalised Registry Docker scripts in one location

  • NIFI-10978 Added LDAP_REFERRAL_STRATEGY to NiFi Docker

  • NIFI-10923 Upgraded Apache SSHD to 2.9.2

  • NIFI-11337 Update PutDatabaseRecord's Max Batch Size property documentation to reflect actual behavior

  • NIFI-9196 Corrected FetchSFTP Move File destination formatting

  • NIFI-11330 Restarting service referenced by parameter only when service is active

  • NIFI-10917 Upgraded Spring Framework from 5.3.23 to 5.3.24

  • NIFI-10934 Added uniqueness check for Registry Client creation

  • NIFI-10744 Changed HashSet to LinkedHashSet in SegmentContent for deterministic handling

  • NIFI-10901 PublishKafka headers not sent in ProducerRecord

  • NIFI-10637 Deterministic TestGenerateTableFetch testMultipleColumnTypeMissing

  • NIFI-9437 Flowfile Expiration cannot exceed 24 days

  • NIFI-11290 Run Component Primary Node State changes in background thread

  • NIFI-10332 Selected OIDC Logout method using Discovery URLs

  • NIFI-11151 Improving code reusability of DBCP services

  • NIFI-10949 Updated MongoDB components using current driver

  • NIFI-10562 Moved MongoDB to testcontainers for integration-tests

  • NIFI-10781 Made the MongoDB controller service implement VerifiableControllerService.

  • NIFI-10718 Update mongo.driver.version to 4.7.2

  • NIFI-11022 Added DecryptContent Compatibility Processors

  • NIFI-10234 Added PutIoTDBRecord Processor

  • NIFI-8111 Added JSLTTransformJSON Processor

  • NIFI-11149 Added PutRedisHashRecord Processor

  • NIFI-11263 Added case-insensitive and order independent field mapping to PutIceberg record converter

  • NIFI-10677 Added Choice data type handling to Iceberg record converter

  • NIFI-11296 Improved code reusability of GRPC modules

  • NIFI-11260 Added STS SSL Context Service for AWS Credentials Provider

  • NIFI-11011 Updated AWS SDK versions to 1.12.371 and 2.17.295

  • NIFI-10792 Replaced PrintStream with OutputStream for Java 8

  • NIFI-10792 Updated ConvertExcelToCSV to handle files over 10 MB

  • NIFI-11085 Updated graphics2d to 0.42

  • NIFI-10921 Upgraded Apache POI from 5.2.2 to 5.2.3

  • NIFI-11305 Fixed out-of-order handling of binlog client shutdown in CaptureChangeMySQL

  • NIFI-6501 Refactored CaptureChangeMySQL with bounded queue of 1000

  • NIFI-11279 Allow event stream processing to continue in CaptureChangeMySQL after sync issue

  • NIFI-11094 Allow CaptureChangeMySQL to send multiple events per FlowFile

  • NIFI-10899 Added SameSite Policy to Application Cookies

  • NIFI-10897 Replaced Spring Security Base64 with java.util.Base64

  • NIFI-7823 Added groups mapping from OIDC token claim

  • NIFI-11190 Added provenance events to GetHubSpot and GetShopify

  • NIFI-10711 Made the script runner more debuggable.

  • NIFI-11158 PutSalesforceObject processor improvements

  • NIFI-11123 Fixed default value and update docs

  • NIFI-11107 In ConsumeIMAP and ConsumePOP3 added support for OAUTH based authorization.

  • NIFI-11150 Added Service Account JSON credentials support to Google Pub/Sub Lite processors

  • NIFI-11210 Removed unused import from TestDistributedMapCacheClientService

  • NIFI-11210 Added read timeout to DistributedMapCacheClientService

  • NIFI-10618 Added Asana connector

  • NIFI-11029 Added Standard XML parsing to ExtractCCDAAttributes

  • NIFI-11036 Added Cluster Summary Metrics to Prometheus endpoint

  • NIFI-11204 Added configurable retry logic for table commits in PutIceberg processor

  • NIFI-10987 Added default implementation of AWS SDK V2 credentials in AWSCredentialsProviderService

  • NIFI-11323 Fixed last modified change detection of dynamicallyModifiesClasspath resources

  • NIFI-11213 Showing version change in older (pre 1.18.0) contained version flows properly

  • NIFI-11269 Added snappy-java to nifi-avro-processors

  • NIFI-11252 Added OIDC Client Secret to sensitive Registry properties

  • NIFI-11289 Avoid obtaining read locks on queues when fetching Group Status, except in those few specific situations where it's needed.

  • NIFI-11285 Unable to build module created by maven archetype plugin

  • NIFI-11274 Only add @timestamp to PutElasticsearchRecord document if not null

  • NIFI-5501 Fixed classloader issue leading to multiple abandoned threads

  • NIFI-11310 Provide appropriate classpath resources to the ReloadComponent when a processor is terminated

  • NIFI-11261 Added Primary Node State handling to GetAzureEventHub

  • NIFI-11234 Fixed RecordWriter NPE in QuerySalesforceObject

  • NIFI-11219 Set Qpid Proton J 0.34.0 for Azure EventHubs

  • NIFI-11141 Upgraded Azure SDK BOM from 1.2.6 to 1.2.9

  • NIFI-11042 Update msal4j to 1.13.3

  • NIFI-11192 Ensured that if ports moved between parent/child group in between flow versions that we can properly handle that

  • NIFI-11189 Restarting NiFi after failing to upgrade flow can cause NiFi to fail startup

  • NIFI-11176 FlowSynchronizationIT System Tests Failing

  • NIFI-11159 Fixed connections with source having reassigned id

  • NIFI-11100 Limiting scope of external controller services during version sync to services outside the versioning context

  • NIFI-10802 Apply bundle updates before properties in component synchronizer

  • NIFI-11117 Removed folder creation from PutGoogleDrive

  • NIFI-11047 Issue when upgrading version of dataflow with external service

  • NIFI-10979 Additional nifi-framework upgrades from JUnit 4 to 5

  • NIFI-10969 Created extension point for Signer Override in AWS S3 processors

  • NIFI-10349 1dd maximum object age property to list s3

  • NIFI-10876 Converted some nifi-framework tests from JUnit 4 to JUnit 5

  • NIFI-11049 Fixed flaky PutDropboxTest, attribute description corrected

  • NIFI-10991 Added AWS MSK IAM support to Kafka processors

  • NIFI-11068 Introduced ConflictResolutionStrategy enum

  • NIFI-11069 PutDropbox: remove upload cancellation, unify conflict resolution naming

  • NIFI-10866 Refactored Kafka 1.0 and 2.0 using nifi-kafka-shared

  • NIFI-11045 Sensitive dynamic property support for parameterized queries in ExecuteSQL and ExecuteSQLRecord

  • NIFI-10965 PutGoogleDrive

  • NIFI-10953 Implement GCP Vision AI processors

  • NIFI-11059 PutBoxFile processor

  • NIFI-10868 PutDropbox processor

  • NIFI-10966 Added option to QuerySalesforceObject to run custom query

  • NIFI-11147 Query all fields in QuerySalesforceObject

  • NIFI-10832 Create PutSalesforceRecord processor

  • NIFI-10980 Corrected ordering of property descriptor allowable values

  • NIFI-10916 Controller Service allowable values dropdown list should be sorted

  • NIFI-11305 Fix logic to correctly stop CaptureChangeMySQL

  • NIFI-10663 Synchronizer should consider stopping Processors that are Starting

  • NIFI-10971 Improved edge case handling while fetching objects using Azure Key Vault Client and added unit tests

  • NIFI-9697 Implemented AzureKeyVaultSecretsParameterProvider and AzureKeyVaultCredentialsService; Implemented unit tests as well as the documentation for the Parameter Provider

  • NIFI-10981 Ensure NarAutoLoader starts after provider retrieves NARs

  • NIFI-10919 Corrected SCRAM SASL Mechanism for Kafka Components

  • NIFI-10819 Restricted JndiLoginModule for Kafka JAAS Config

  • NIFI-10617 Added missing DynamicProperty annotation to processors that use them

  • NIFI-11262 Corrected scope for bcprov-jdk18on in nifi-security-kerberos

  • NIFI-4718 Improved detection of FlowFile V3 in IdentityMimeType

  • NIFI-11247 Using parameterContextName instead of group name when fetching parameters

  • NIFI-11238 Creating missing parameter providers when importing inherited provided contexts

  • NIFI-11134 Added Label auditing to Flow Configuration History

  • NIFI-11209 Include newly-added columns in output for UpdateTable processors when Update Field Names is true

  • NIFI-11156 Updated SchemaValidator to include error message for ValidateXml

  • NIFI-11118 When changing version of a versioned flow, ensure that Version Control Information's StorageLocation is properly set for NiFi Registry client to maintain backward compatibility

  • NIFI-11092 Fixed ConsumeTwitter handling on Primary Node changes

  • NIFI-11133 Updated TLS Toolkit Standalone to set Client Key Password

  • NIFI-10846 Added SMB Dialect and Use Encryption properties in SMB processors

  • NIFI-11122 Corrected provided parameter context inheritance after creation

  • NIFI-11126 Delete dMultiPart files in ListenHTTP after processing

  • NIFI-8005 Added warning message for Excel sheets not found

  • NIFI-11112 Corrected location of additionalDetails for GetZendesk

  • NIFI-9989 Upgraded SSHJ from 0.34.0 to 0.35.0

  • NIFI-10973 Introduced differentiation of comparing embedded versioned flows for UI and synchronization purposes

  • NIFI-11064 Removed unstable TestPutSFTP.testRunTransitUriDifferentHosts and changed TestPutSFTP run iterations based on files queued

  • NIFI-10884 Log target filename

  • NIFI-10967 Corrected TestWriteJsonResult mixed arrays

  • NIFI-11110 Create processor for triggering HMS events

  • NIFI-10791 Added AWS SDK v2 support to AWSCredentialsProviderControllerService

  • NIFI-11124 Added hadoop.file.url attribute to HDFS processors

  • NIFI-6428 Added 'inTransaction' value to state, fix bug

  • NIFI-7190 CaptureChangeMySQL processor remove comments from normalized query

  • NIFI-9920 Fetching all bulletins of a process group on update process group

  • NIFI-10177 Nifi Registry logout via OIDC

  • NIFI-10188 Added jaxws-api for ConsumeEWS on Java 11

  • NIFI-10449 Fixed ScriptedLookupServices reloading

  • NIFI-10576 Added onFinishRecordSet implementation for WriteParquetResult

  • NIFI-10608 Process Group copies include non-processor referenced controller services

  • NIFI-10656 Log ignored event with info instead of warning

  • NIFI-10703 Updated VersionedDataflow to support MaxEventDrivenThreadCount

  • NIFI-10705 Primary keys were not being included in ConvertJSONToSQL UPDATE queries when 'User statement.type Attribute' was used

  • NIFI-10751 Added Username to User and Group CRUD

  • NIFI-10772 Clarify logs on shutdown where controller service and/or processor were unable to properly start

  • NIFI-10812 Removed duplicate record template creation from Iceberg record converter

  • NIFI-10815 Fixed initial internal yield duration when processor created

  • NIFI-10818 Fixed bug in which oldest bin in MergeContent was not being evicted in order to make room for a new bin when using a correlation attribute

  • NIFI-10834 Updated TestPutSplunkHTTP to avoid non-deterministic tests

  • NIFI-10845 JsonQueryElasticsearch processors are not outputting an empty flow file for a combined response with output_no_hits set to true

  • NIFI-10850 Fixed Query Parameters property in InvokeAWSGatewayApi should support FlowFile attributes in EL

  • NIFI-10853 Allow UpdateAttribute dynamic property to validate nifi expressions

  • NIFI-10862 Fix Flaky tests in TestXMLReader

  • NIFI-10873 GenerateFlowFile: flowfiles in a batch are not unique

  • NIFI-10875 Changed TestQuerySolr to check for path elements

  • NIFI-10882 Set credentials for ElasticSearchClientService based on AuthorizationScheme

  • NIFI-10890 Replaced HashMap with LinkedHashMap in JsonRowRecordReader

  • NIFI-10891 Replaced HashMap with LinkedHashMap in BinFiles

  • NIFI-10925 Refactored TestPutSFTP with discrete test methods

  • NIFI-10928 Updated MockFlowFile with LinkedHashMap for attributes

  • NIFI-10932 Changed PKCS12 KeyStore Type Provider to SunJSSE

  • NIFI-10956 Fixed inference issues with mixed arrays

  • NIFI-10958 Adjusted Script Engine handling to avoid exceptions

  • NIFI-10974 Incorrect warning message on memory usage from MonitorMemory

  • NIFI-10988 Fixed ConsumeGCPubSubLite processors delivering incorrect messages

  • NIFI-10989 Removed SHA-1 and MD5 from TestHashContent

  • NIFI-10993 PublishKafkaRecord should use correct record schema

  • NIFI-10997 Ensure auditing of process group / controller service operations

  • NIFI-10998 Fixed SplitJson to always compile new JsonPath when property changes

  • NIFI-11001 Incorrect Local Changes shown when upgrading from 1.18.0 to 1.19.1

  • NIFI-11028 Handle controller service 'Scheduled State' change

  • NIFI-11032 Addressing NPE when retrieving registry client info with unauthorized user

  • NIFI-11048 Added FileNameCompleter to avoid style parsing failures

  • NIFI-11076 Resolving deadlock issue in StandardParameterContext

  • NIFI-11089 Resolving previously resolved parameter providers when possible on version sync

  • NIFI-11096 Added EncodeContent to Processor services definition

  • NIFI-11097 Adjusted RegistryClientIT with unique name for Clients

  • NIFI-11105 When mapping Parameter Context to VersionedParameterContext, don't bother mapping those that have already been mapped, as it is redundant

  • CFM-1822 Handle custom schema in ListenGRPC

  • CFM-2876 Added hadoop-cloud-storage dependency for RAZ and IDBroker

  • CFM-3002 Added JIRA source connector

  • CFM-2876 Added UpdateDeltaLakeTable processor

  • CFM-3022 AWS S3/STS custom signer

  • CFM-3137 Support new AWS SDK

  • CFM-2805 Correcting okhttp client builder read timeout setting

  • CFM-2463 CdpCredentialsProvider and CdpOauth2AccessTokenProvider Controller Services

  • CFM-2462 Added connect and credentials retrieval timeout to AbstractIDBrokerCloudCredentialsProviderControllerService

  • CFM-2512 Ensure cdf-extensions does not use log4j-core < 2.15.0

  • CFM-2115 Setup SSLContext for IDBroker http client from provided configuration xmls

Issues fixed in CFM 2.1.5

CFM 2.1.5 is rebased against Apache NiFi 1.18.0. It includes all fixed issues of this Apache NiFi release as well as the below list:

  • NIFI-10660: When converting Avro GenericRecord to a java Map, check GenericRecord's schema to see if the field exists before calling Record.get().

  • NIFI-10937, NIFI-10938, NIFI-10939: When restoring flow from XML, properly parse XML for registry clients, looking for 'id' tag instead of 'identifier' tag. Fixed typo in error message about Reporting Task for Registry Clients. Updated StandardFlowComparator so that we compare sub-process groups' contents only if the Flow Coordinates are different by more than their version

  • NIFI-10918: When fetching a flow from a Flow Registry, if it references any 'internal versioned flows' instead of requiring that a client is configured for the appropriate URL, attempt to fetch the flow from each client

  • NIFI-10901: PublishKafka headers not sent in ProducerRecord

  • NIFI-10914: Adjusting input check for loading nested versioned flows

  • NIFI-5819: Support SQLServer sql_variant type

  • NIFI-7862: Added UpdateDatabaseTable processor for auto table structure updates

  • NIFI-10760: Added API Key authentication to ElasticSearchClientServiceImpl

  • NIFI-9398: Added verification to ElasticSearchClientService (with integration tests) and Elasticsearch REST API processors

  • NIFI-10801: Fixed hive metastore based tests in Iceberg processors

  • NIFI-10871: Skipped CSRF processing for replicated HTTP requests

  • NIFI-10874: Fixed issue with multiple levels of versioned flows

  • NIFI-10817: Moved the calls in StandardProcessSession to 'resetState()' and 'acknowledgeRecords()' from the outer commit(boolean) to the inner commit(Checkpoint, boolean)

  • NIFI-10814: Display description for selected flow

  • NIFI-10851: Corrected removal of Controller Service references on property updates

  • NIFI-10389: Added mime.type to GetShopify and GetHubSpot

  • NIFI-10828: Adding new REST API endpoint for exposing versioned flow details

  • NIFI-10793: Comment is not populated when process group is created via API

  • NIFI-10762: Ranger Authorizer accepts multiple Ranger Admin Identity property values

  • NIFI-10787: Cannot commit flows to NiFi Registry after updating our NiFi release to 1.18.0

  • NIFI-10370: Create PutSnowflake processor using Snowpipe ingest

  • NIFI-10775: Improve support for DescribedValue in PropertyDescriptor.Builder

  • NIFI-10667: Added Private Key Service interface and implementation

  • NIFI-10659: Extracted DBCP common code to nifi-dbcp-base module for use in Snowflake NAR

  • NIFI-9822: ConsumeKafkaRecord allows writing out Kafka record key

  • NIFI-10737: Corrected ListenBeats buffer handling

  • NIFI-4798: Allow empty value for UpdateAttribute property

  • NIFI-10130: AzureGraphUserGroupProvider handles group with transitive members

  • NIFI-10228: parse json flow using instanceIdentifier as the UUID

  • NIFI-10287: ExecuteScript - Allow python scripts to use external modules

  • NIFI-10637: Simplified Locale validation in ParseCEF

  • NIFI-10675: Corrected SSL support in Neo4j V4 Cypher Service

  • NIFI-10764 :Fixed handling BIT STRING in nifi-asn1-services

  • NIFI-10767: When an empty line is encountered with Syslog Readers, just skip over the empty line instead of throwing an Exception

  • NIFI-10768: Filter empty messages in ListenSyslog

  • NIFI-10771: Add SINGLE_BATCH_PER_NODE to allowable values for flow file concurrency in ProcessGroupDTO

  • NIFI-10783: Switched to LinkedHashMap for CompareFuzzyHash

  • NIFI-10788: Ensure proposed service config is applied when component synchronizer adds a new service

  • NIFI-10702: Clear server list on connection error in SMB processors

  • NIFI-10698: Add filtering options to summary table

  • NIFI-10680: Corrected Bouncy Castle references in optional profiles

  • NIFI-10614: Upgraded Bouncy Castle from 1.70 to 1.71

  • NIFI-10709: Showed log in link on logout complete page

  • NIFI-10317: Taking care of NullPointerException if AMQP header value is null

  • NIFI-9878: Added timeout handling for Cache Client handshaking

  • NIFI-10303: Route GetElasticsearch to failure if _id is blank after attribute evaluation

  • NIFI-10594: Render empty lines in Labels

  • NIFI-10631: Changed HashMap to LinkedHashMap in TestHBase_2_ClientService

  • NIFI-10635: Fixed handling of enums in PutDatabaseRecord

  • NIFI-10641: Resolving typo on ParameterProvider warning message

  • NIFI-10643: Paging secrets in AwsSecretsManagerParameterProvider

  • NIFI-10668: Persist proxy password in remote process group

  • NIFI-10674: Block evaluateELString from reading Parameters

  • NIFI-10682: When determining effective property values, ensure that we always use the up-to-date version of Property Descriptors

  • NIFI-10687: Set Elasticsearch document _id to null if ID attribute evaluated to blank String for PutElasticsearchRecord or PutElasticsearchJson

  • NIFI-10689: Fixed Parameter Provider Name encoding in context dialog

  • NIFI-10700: Only restart ports if their scheduledState is Running

  • NIFI-10693: Removed proxy configuration properties from PutBigQuery

  • NIFI-10673: Copy & paste of a child PG when parent is under Version Control duplicates Versioned Component IDs

  • NIFI-10644: Added Message Demarcator-style processing in PublishMQTT

  • NIFI-10650: Fixed demarcator is appended to the end of the FlowFile's content by ConsumeMQTT

  • NIFI-10628: Added Default Schedule Time and Run Duration to processors

  • NIFI-10567: Corrected Sensitive Dynamic Property handling for flow.xml

  • NIFI-10648: Upgraded Apache Commons Text to 1.10.0

  • NIFI-10442: Created PutIceberg processor

  • NIFI-10602: Fixed GetHubSpot and GetShopify state handling on NiFi restart

  • NIFI-10577: Fixed Sensitive Checkbox rendering for Fetch Parameters

  • NIFI-10586: Prioritized ssh-rsa algorithm in SFTP Processors

  • NIFI-10273: Supported file entries larger than 8.5GB for TAR in MergeContent

  • NIFI-10597: Changed 'App Config File' property to external resource in Box processors

  • NIFI-10543: Support broker failover in MQTT processors

  • NIFI-10587: Missing exclude entry in nifi-registry assembly

  • NIFI-10096: Corrected nested inherited Parameter Context loading