Pillar

Production RAG & MLOps

Retrieval is an infrastructure problem wearing an ML hat.

Chunking and embedding choices are the easy half. The hard half is index freshness, hybrid retrieval tuning, evaluation of retrieval separately from generation, cost per query at scale, and the operational surface — deploys, rollbacks, monitoring, drift — around a system whose output is non-deterministic.