For people who’ve deployed LLM/chatbots in production: what actually breaks first?
In my experience it’s rarely “the model is dumb” — it’s usually the webdev/system stuff around it:
i. session state getting messy (multi-tab users, refreshes, auth issues)
ii. streaming responses + UI glitches (partial tokens, duplicate messages)
iii. prompt/version drift between environments
logging/monitoring being an afterthought
iv. users asking things that trigger unexpected tool/API calls
I’m curious what failures you’ve seen most often on real traffic, and what guardrails helped the most (rate limits, fallback flows, evals, caching, etc.)
submitted by /u/GrabRevolutionary449
[link] [comments]