List of required configuration parameters for the ADLS to Milvus [Technical Preview] ReadyFlow

When deploying the ADLS to Milvus [Technical Preview] ReadyFlow, you have to provide the following parameters. Use the information you collected in Prerequisites.

Table 1. ADLS to Milvus [Technical Preview] ReadyFlow configuration parameters
Parameter name Description
CDP Workload User Specify the Cloudera machine user or workload username that you want to use to authenticate to the object stores. Ensure this user has the appropriate access rights to the object store locations in Ranger or IDBroker.
CDP Workload User Password Specify the password of the Cloudera machine user or workload user you are using to authenticate against the object stores.
CDPEnvironment The Cloudera Environment configuration resources.
HuggingFace Embedding Model Specify the HuggingFace model name to use for embedding the data.

The default model is 'all-MiniLM-L12-v2'.

Milvus Access Token Specify the access token for the destination Milvus instance.
Milvus Collection Name Specify the name of the destination Milvus collection.
Milvus Instance URI Specify the URI of the destination Milvus instance.
Source ADLS File System Specify the name of the ADLS data container you want to read from. The full path will be constructed from: abfs://#{Source ADLS File System}@#{Source ADLS Storage Account}.dfs.core.windows.net/#{Source ADLS Path}
Source ADLS Path Specify the path within the ADLS data container where you want to read from without any leading characters. The full path will be constructed from: abfs://#{Source ADLS File System}@#{Source ADLS Storage Account}.dfs.core.windows.net/#{Source ADLS Path}
Source ADLS Storage Account Specify the source ADLS storage account name.