Fixed issues

Review the list of resolved issues.

CFM 2.1.5 is rebased against Apache NiFi 1.18.0. It includes all fixed issues of this Apache NiFi release as well as the below list:

Issues fixed in CFM 2.1.5

  • NIFI-10660: When converting Avro GenericRecord to a java Map, check GenericRecord's schema to see if field exists before calling Record.get().
  • NIFI-10937, NIFI-10938, NIFI-10939: When restoring flow from XML, properly parse XML for registry clients, looking for 'id' tag instead of 'identifier' tag. Fixed typo in error message about Reporting Task for Registry Clients. Updated StandardFlowComparator so that we compare sub-process groups' contents only if the Flow Coordinates are different by more than their version
  • NIFI-10918: When fetching a flow from a Flow Registry, if it references any 'internal versioned flows' instead of requiring that we have a client configured for the appropriate URL, attempt to fetch the flow from each client. We will start with the clients that do report that they can handle the URL but will try others as well. As soon as we successfully fetch the flow, we stop.
  • NIFI-10901: PublishKafka headers not sent in ProducerRecord
  • NIFI-10914: Adjusting input check for loading nested versioned flows
  • NIFI-5819: Support SQLServer sql_variant type
  • NIFI-7862: Add UpdateDatabaseTable processor for auto table structure updates
  • NIFI-10760: Add API Key authentication to ElasticSearchClientServiceImpl
  • NIFI-9398: Add verification to ElasticSearchClientService (with integration tests) and Elasticsearch REST API processors NIFI-9398 processor verification integration-tests for nifi-elasticsearch-restapi-processors using common nifi-elasticsearch-test-utils refactored from nifi-elasticsearch-client-service NIFI-9398 fail index exists verification for Elasticsearch processors whose operations would not create the index if it doesn't already exist
  • NIFI-10801: Fix hive metastore based tests in Iceberg processors
  • NIFI-10871: Skipped CSRF processing for replicated HTTP requests
  • NIFI-10874: Fixed issue with multiple levels of versioned flows
  • NIFI-10817: Moved the calls in StandardProcessSession to 'resetState()' and 'acknowledgeRecords()' from the outer commit(boolean) to the inner commit(Checkpoint, boolean). By moving the call here, the logic of StandardProcessSession is unaffected. But the StatelessProcessSession that inherits from it now has the benefit of having the state cleaned up when calling super.commit(Checkpoint, boolean).
  • NIFI-10814: Display description for selected flow
  • NIFI-10851: Corrected removal of Controller Service references on property updates
  • NIFI-10389: Added mime.type to GetShopify and GetHubSpot
  • NIFI-10828: Adding new REST API endpoint for exposing versioned flow details
  • NIFI-10793: Comment is not populated when process group is created via API
  • NIFI-10762: Ranger Authorizer accepts multiple Ranger Admin Identity property values
  • NIFI-10787: Cannot commit flows to NiFi Registry after updating our NiFi release to 1.18.0 NifiRegistryFlowRegistryClient defines the PropertyDescriptor PROPERTY_URL name as small case "url". The map bases on the name property of the PropertyDescriptor object. Here searching with uppercase value of "URL" causes the map lookup to fail and cause a NPE later on. Therefore, it is changed as "url"
  • NIFI-10370: Create PutSnowflake processor using Snowpipe ingest
  • NIFI-10775: Improve support for DescribedValue in PropertyDescriptor.Builder
  • NIFI-10667: Added Private Key Service interface and implementation
  • NIFI-10659: Extracted DBCP common code to nifi-dbcp-base module for use in Snowflake NAR
  • NIFI-9822: ConsumeKafkaRecord allows writing out Kafka record key
  • NIFI-10737: Corrected ListenBeats buffer handling
  • NIFI-4798: Allow empty value for UpdateAttribute property
  • NIFI-10130: AzureGraphUserGroupProvider handles group with transitive members
  • NIFI-10228: parse json flow using instanceIdentifier as the UUID
  • NIFI-10287: ExecuteScript - Allow python scripts to use external modules
  • NIFI-10637: Simplified Locale validation in ParseCEF
  • NIFI-10675: Corrected SSL support in Neo4j V4 Cypher Service
  • NIFI-10764 :Fixed handling BIT STRING in nifi-asn1-services
  • NIFI-10767: When an empty line is encountered with Syslog Readers, just skip over the empty line instead of throwing an Exception
  • NIFI-10768: Filter empty messages in ListenSyslog
  • NIFI-10771: Add SINGLE_BATCH_PER_NODE to allowable values for flow file concurrency in ProcessGroupDTO
  • NIFI-10783: Switched to LinkedHashMap for CompareFuzzyHash
  • NIFI-10788: Ensure proposed service config is applied when component synchronizer adds a new service
  • NIFI-10702: Clear server list on connection error in SMB processors
  • NIFI-10698: Add filtering options to summary table
  • NIFI-10680: Corrected Bouncy Castle references in optional profiles
  • NIFI-10614: Upgraded Bouncy Castle from 1.70 to 1.71
  • NIFI-10709: Showed log in link on logout complete page
  • NIFI-10317: Taking care of NullPointerException if AMQP header value is null
  • NIFI-9878: Added timeout handling for Cache Client handshaking
  • NIFI-10303: Route GetElasticsearch to failure if _id is blank after attribute evaluation
  • NIFI-10594: Render empty lines in Labels
  • NIFI-10631: Changed HashMap to LinkedHashMap in TestHBase_2_ClientService
  • NIFI-10635: Fix handling of enums in PutDatabaseRecord
  • NIFI-10641: Resolving typo on ParameterProvider warning message
  • NIFI-10643: Paging secrets in AwsSecretsManagerParameterProvider
  • NIFI-10668: Persist proxy password in remote process group
  • NIFI-10674: Block evaluateELString from reading Parameters
  • NIFI-10682: When determining effective property values, ensure that we always use the up-to-date version of Property Descriptors
  • NIFI-10687: Set Elasticsearch document _id to null if ID attribute evaluated to blank String for PutElasticsearchRecord or PutElasticsearchJson; use @timestamp default value if @timestamp record path evaluates to blank String in PutElasticsearchRecord
  • NIFI-10689: Fixed Parameter Provider Name encoding in context dialog
  • NIFI-10700: Only restart ports if their scheduledState is Running
  • NIFI-10693: Remove proxy configuration properties from PutBigQuery
  • NIFI-10673: When a component is added to a ProcessGroup, we had a method called ensureUniqueVersionControlId but the method only took into account in that Process Group. Updated methods to now consider components in any Process Group that is part of the same Versioned Flow. Also added system test to verify the problem and the fix. Added Toolkit clients and additional methods as necessary in order to implement system tests
  • NIFI-10644: Add Message Demarcator-style processing in PublishMQTT
  • NIFI-10650: Fix demarcator is appended to the end of the FlowFile's content by ConsumeMQTT
  • NIFI-10628: Added Default Schedule Time and Run Duration to processors
  • NIFI-10567: Corrected Sensitive Dynamic Property handling for flow.xml
  • NIFI-10648: Upgraded Apache Commons Text to 1.10.0
  • NIFI-10442: Create PutIceberg processor
  • NIFI-10602: Fix GetHubSpot and GetShopify state handling on NiFi restart
  • NIFI-10577: Fix Sensitive Checkbox rendering for Fetch Parameters
  • NIFI-10586: Prioritized ssh-rsa algorithm in SFTP Processors
  • NIFI-10273: Supported file entries larger than 8.5GB for TAR in MergeContent
  • NIFI-10597: Change 'App Config File' property to external resource in Box processors
  • NIFI-10543: Support broker failover in MQTT processors
  • NIFI-10587: Missing exclude entry in nifi-registry assembly
  • NIFI-10096: Corrected nested inherited Parameter Context loading