Handling Embedding Service Outages: Fallback In-Memory Encoders and Circuit Breakers
When external vector embedding APIs experience latency spikes or downtime, RAG retrieval pipelines must gracefully degrade to local lexical search (BM25) or embedded lightweight ONNX models without throwing unhandled exceptions to users.