List of required configuration parameters for the S3 to Pinecone [Technical Preview] ReadyFlow
When deploying the S3 to Pinecone [Technical Preview] ReadyFlow, you have to provide the following parameters. Use the information you collected in Prerequisites.
| Parameter name | Description |
|---|---|
| CDP Workload User | Specify the Cloudera machine user or workload username that you want to use to authenticate to the object stores. Ensure this user has the appropriate access rights to the object store locations in Ranger or IDBroker. |
| CDP Workload User Password | Specify the password of the Cloudera machine user or workload user you are using to authenticate against the object stores. |
| CDPEnvironment | The Cloudera Environment configuration resources. |
| OpenAI API Key | Specify the API key used to authenticate to OpenAI. |
| OpenAI Model |
Specify the OpenAI model name to use for embedding the data. The default model is 'text-embedding-ada-002'. |
| Pinecone API Key | Specify the API key used to authenticate to Pinecone. |
| Pinecone Environment | Specify the name of the Pinecone environment. |
| Pinecone Index | Specify the name of the Pinecone index. To ensure correct functionality of this ReadyFlow, make sure your Pinecone index has been created with the same dimension as the 'text-embedding-ada-002' model (1536). |
| Source S3 Bucket | Specify the name of the source S3 bucket you want to read from. |
| Source S3 Path | Specify the path within the source bucket where you want to read files from. |
