InsertToMilvus

Description:

Inserts or updates a vector in a Milvus collection. The input data is expected to be a float vector in JSON format (the dimension of the input must match dimension of the collection). Usually used together with EmbedData processor providing the float vector as the input for InsertToMilvus.

Tags:

milvus, vector, vectordb, vectorstore, insert, put, update, insertai, artificial intelligence, ml, machine learning, text, LLM

Properties:

In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.

Display NameAPI NameDefault ValueDescription
Input FormatInput FormatSingle EmbeddingThe format of the input data. It can be either a single embedding content or a JSON document. If the input format is a single embedding content, the flow file content is expected to be a float vector in JSON format. If the input format is a JSON document, the flow file content is expected to be either a single JSON object or an array of JSON objects.
Vector Field NameVector Field NamevectorName of the vector field in the Milvus collection schema. Needs to be defined if the input FlowFile contains a single embedding. Otherwise the vector field name is expected to be listed in the Fields From JSON Objects property.
Supports Expression Language: true (will be evaluated using flow file attributes and Environment variables)
Fields From AttributesFields From AttributesField names or field-attribute name pairs to insert in Milvus. The format is a comma-separated list of field_name:attribute_name pairs or field names if the attribute name is the same. The field name is the field name in the Milvus collection and the attribute name is expected to be a FlowFile attribute. The value of the FlowFile attribute will be inserted in the field.
Supports Expression Language: true (will be evaluated using flow file attributes and Environment variables)
Fields From JSON ObjectsFields From JSON ObjectsField names or field-JSON key pairs to insert in Milvus. At least the vector field name must be defined if the Input Format is JSON Document. The format is a comma-separated list of field_name:json_key pairs or field names if the JSON key is the same. The field name is the field name in the Milvus collection and the JSON key is expected to be a key in every JSON object in the input. The JSON value associated with the specified key will be inserted in the field.
Supports Expression Language: true (will be evaluated using flow file attributes and Environment variables)
Partition NamePartition NameName of the partition to insert or update in Milvus.
Supports Expression Language: true (will be evaluated using flow file attributes and Environment variables)
Collection NameCollection NameName of the collection to query in Milvus.
Supports Expression Language: true (will be evaluated using flow file attributes and Environment variables)
URIURIThe URI of the Milvus instance.
UserUserA valid username used to connect to the specified Milvus instance.
PasswordPasswordA valid password used to connect to the specified Milvus instance.
Sensitive Property: true
DB NameDB NamedefaultThe name of the database to which the target Milvus instance belongs.
TokenTokenA valid access token to access the specified Milvus instance.
Sensitive Property: true