ReadyFlow overview: S3 to Qdrant [Technical Preview]
You can use the S3 to Qdrant [Technical Preview] ReadyFlow to consume PDF documents from S3, vectorize them using an OpenAI model and write the results to Qdrant.
This ReadyFlow consumes PDF documents from a source S3 location, partitions the PDFs, chunks the data, vectorizes the data using an OpenAI embedding model, and stores the results in Qdrant vector DB. The default OpenAI model is 'text-embedding-ada-002'. An OpenAI API key and a Qdrant API key are required to run this flow. Define a KPI on the failure_WriteToQdrant connection to monitor failed write operations.
| S3 to Qdrant [Technical Preview] ReadyFlow details | |
|---|---|
| Source | Cloudera on cloud managed Amazon S3 |
| Source Format | |
| Destination | Qdrant |
| Destination Format | Vector DB |
