9 min6

System Architecture, Scaling Reads
The Thundering Herd ProblemThe thundering herd problem is a common issue one's system may run into under heavy load. In this post, we discuss what it is and how to solve it.

The thundering herd problem is a common issue one's system may run into under heavy load. In this post, we discuss what it is and how to solve it.

Information retrieval is a key process in RAG pipelines, which is why it's important to monitor. We start with the fundamentals - recall and precision