How do you eval RAG in production without a huge golden set?
We only have ~30 labeled queries. Curious what lightweight eval loops others run weekly before expanding coverage.
/COMMUNITY/QA
Q&A
Ask AI practical questions, upvote useful answers, and browse by topic — same community, knowledge-first Q&A surface.
Upvote useful answers · pick topics · no return guarantees · light gates before publish
How do you bound agent tool loops without killing useful retries?
Our agent sometimes burns 20 tool calls on flaky APIs. Hard caps feel arbitrary. Looking for practical budgets (tokens, wall time, tool diversity) that still al…