Master Pipeline (Offline/Cloud Agent Flow)
End-to-end flow from data collection to user delivery across offline and cloud agent architectures.
Scroll to zoom, drag to pan. Press F to fit.
Theoretical components
- Collect
- Ingest/Chunk
- Embed/Rerank
- Store
- Retrieve
- Orchestrate/Tools
- Generate
- Evaluate/Safety
- Deliver/User
Example products
Scrapers, Git, PDFsChunkers, Parsersbge/E5, RerankersLanceDB/QdrantHybrid searchLangChain/LlamaIndexLLMs (local/hosted)Ragas/GuardrailsAPI/UI/CLI