Communityllmmonitoringdatadogsentry
Developers Monitor LLM Features In Production
5.6
An Ask HN thread asks how teams monitor LLM-powered features after shipping several over the past year. The poster notes traditional monitoring (Datadog, Sentry) reports API availability and response times, prompting requests for broader observability.
Key Points
- 1Ship multiple LLM-powered features in production over the past year, per thread poster
- 2Rely on Datadog and Sentry, which only report API availability and response times
- 3Seek additional observability and guidance beyond standard API metrics for LLM-powered features
Scoring Rationale
Practical relevance for production LLM monitoring, but RSS-only question lacks depth and verification, reducing its impact.
Sources
Public references used for this report.
Practice with real Ad Tech data
90 SQL & Python problems · 15 industry datasets
Used by DS/ML engineers at top companies
Active Search Campaigns by BudgetEasyHigh CPC Clicks & Poor Landing PagesMediumCampaign ROAS by Attribution ModelHard
250 free problems · No credit card
See all Ad Tech problems
