Industry Newsagentsclaude codeanthropicexperimentation
Anthropic Runs Silent A/B Tests Degrading Workflow
|
7.1
A paying user discovered that Anthropic is running unannounced A/B tests in Claude Code that modify plan-mode outputs, assigning variants such as "cap" which restricts plans to 40 lines and removes context and prose. The discovery, made by decompiling the binary, shows telemetry logging variant assignments and plan metrics; it implies paying customers are being experimented on without opt-in, disrupting professional workflows.
Scoring Rationale
Reveals significant silent experimentation affecting paid users, providing clear technical evidence, but depends on single-source reverse-engineering.
Practice interview problems based on real data
1,500+ SQL & Python problems across 15 industry datasets — the exact type of data you work with.
Try 250 free problems
