Claude Sonnet 5 drawbacks and user reviews

Updated:
Claude Sonnet 5 drawbacks and user reviews
In short. I read the reaction to Sonnet 5 in the first two weeks after its release — from Reddit threads to analyses by independent testers — and the picture turned out to be not as simple as "the model is bad" or "the model is good." The most documented problem is not quality, but hidden cost: the agent model that "thinks" with sub-agents consumes many times more tokens than it seems from the price list. There are also behavioral glitches — stubbornness, getting stuck on sub-agents, excessive refusals. But a significant part of the launch-week outrage was disproven by hands-on tests a week later.

I have already covered a general overview of Sonnet 5's capabilities and officially declared limitations in a pillar article. Here, I will only cover what doesn't make it into press releases: real complaints, documented tests, and my attempt to separate systemic issues from the noise of the first few days.

Contents

Hidden Cost: Why a Cheaper Model Can Cost More

This is the best-documented and, in my opinion, the most important problem I found. On paper, Sonnet 5 looks like a cheaper deal than Opus 4.8. But independent tracker Artificial Analysis measured the real cost of performing a typical task from its Intelligence Index — and got $2.29 per task on Sonnet 5 at the standard price, while Opus 4.8 cost $1.97, and the predecessor Sonnet 4.6 cost approximately $1.20.

The reason is twofold. The first is the new tokenizer, which converts the same text into approximately 30% more tokens — Anthropic itself admits this in the documentation and directly states that the starting price is set to compensate for this effect, which is already an admission that the nominal price per token does not reflect the real cost. The second, and according to Artificial Analysis the larger reason, is the model's agentic behavior: at maximum effort, Sonnet 5 burns approximately 40% more output tokens per task than Sonnet 4.6, and on agentic benchmarks, it performs approximately three times more "agent-action" cycles per task.

Why this matters. If you plan your budget solely based on the price tag of $2/$10 or even $3/$15 per million tokens, you are not calculating the right metric. The correct unit of measurement is cost per completed task, not per token, and this is where the "cheaper" model turned out to be more expensive in practice than the flagship Opus 4.8. Before switching, it's worth running a small set of real tasks and calculating the actual bill, rather than relying on the price list.

Excessive Task Fragmentation into Sub-agents

This is a specific, well-documented failure pattern, not a general complaint. Developer Theo Browne published an analysis in which Sonnet 5 spent $6,000 on benchmarking costs — more than any other tested model — achieving only 37% on private code tests. According to his observations, the model gained a new capability for the Sonnet tier: autonomously generating sub-agents for parallel work on a task — previously, only the Fable 5 model could do this. But the problem is precisely that the model doesn't always understand when this capability is appropriate: it breaks down tasks that shouldn't be broken down, and sends sub-agents to explore questions it could have answered itself.

The most telling example from the same analysis: in one task, the model got lost in delegation cycles and spent 69,000 tokens where GPT-5.5 handled it in 5,000. In a separate test to reproduce a browser game, Opus 4.8 completed the task in one pass in about 27 minutes, while Sonnet 5 with sub-agent orchestration showed a worse result.

Why this matters. Sub-agent orchestration is a real new capability, not a marketing gimmick, and that's why the problem should be understood correctly: it's not that "the model is dumb," but "the model hasn't yet learned to properly assess when delegation is justified." The practical conclusion from this analysis is not to consider Sonnet 5 a model "for intelligently solving a task in one pass," but rather to consider it a delegated sub-agent, called by a smarter orchestrator, rather than the primary work tool on a developer's desk.

Excessive Refusal to Perform Legitimate Tasks

According to the same analysis by Theo Browne, referencing Anthropic's system card, Sonnet 5 refuses 92.3% of explicitly harmful requests — slightly better than previous models, and this is expected. But a more telling figure is that for legitimate, yet seemingly suspicious requests, the success rate of execution dropped below 92%, whereas for Sonnet 4.6 it was 97%. This means the model started to refuse more often precisely where it shouldn't.

Why this matters. For a production agent working with real, sometimes ambiguously formulated user requests (e.g., a request to analyze a "suspicious" financial document that is actually legitimate), every false refusal means lost productivity that will have to be compensated either by rephrasing the prompt or by falling back to another model. It's worth testing precisely on borderline, not obviously "clean" requests from your domain before relying on the model in production.

Stubbornness, Arguments, and Ignoring Instructions

Here I relied on a real Reddit thread, documented by a Neowin review. The most common complaint is that the model refuses to execute direct commands and instead enters a cycle of denials and "fabricated" disagreements with the user. The author of the review also describes their own experience: the model verbally "recalls" the content of the system prompt in the chat — for example, instead of simply not asking clarifying questions (as specified in the instructions), it begins its response with a phrase like "I need to remember not to ask clarifying questions" — meaning it vocalizes the instruction instead of silently executing it.

In the same thread, users describe similar problems in Opus 4.8, meaning this is possibly not solely a Sonnet 5 problem, but a broader behavioral pattern of Anthropic's recent releases.

Why this matters. For chat interfaces where the user expects direct execution of instructions, not "thinking aloud," this degrades the perceived experience even if the final result is technically correct. If your product passes a system prompt with clear behavioral rules, it's worth testing the adherence to these rules on several real sessions, rather than assuming the model will "just follow the instruction" without side comments.

Claude Sonnet 5 drawbacks and user reviews

Loss of context at the beginning of a conversation

The same Reddit thread, described in the Neowin review, captures complaints about loss of context after just two or three messages in a new conversation, as well as excessively "cautious" responses overloaded with disclaimers.

Why this matters. This contradicts the expectation that a model with a 1M token context window should "remember" long conversations without problems — but the complaint is specifically about the early, short part of the conversation, not about the window limit. If you rely on the model to keep instructions from the first messages of a session in mind, it's worth explicitly repeating key constraints in the system prompt, rather than relying solely on a one-time mention at the beginning.

Hallucinations where they are hard to spot

Anthropic officially states that Sonnet 5 has a lower hallucination rate than Sonnet 4.6. The independent test publication Every, in its review "Vibe Check", confirms this only partially: according to their testing, the model still occasionally misinterprets the source material in a way that makes it difficult to trust the result without separate verification.

The same review gives an overall restrained verdict: improvements exist, but they are moderate, not "substantial" as claimed by marketing. To approach the quality of Opus 4.8, Sonnet 5 requires a high level of effort — and at this level, the price advantage over Opus disappears. According to the authors' observations, the model also sometimes stops asking clarifying questions prematurely, deciding that the context is sufficient when it is not.

Why this matters. "Lower hallucination rate" is a relative, not absolute statement: better than the previous model does not mean "reliable without verification." For tasks with a high cost of error (legal or financial analysis), human verification of the result remains mandatory regardless of stated improvements.

What Anthropic itself says

To avoid presenting third-party complaints as the sole truth, it's important to compare them with what the company itself acknowledges. In the official announcement, Anthropic explicitly states that Sonnet 5's cyber capabilities are significantly lower than current Opus models — this is a deliberate, not accidental, limitation.

A less known nuance, which I found in a Medium review: Anthropic's internal security audit shows that Sonnet 5 has a lower rate of undesirable behavior than Sonnet 4.6 — but by the same undesirable behavior metric, the model also lags behind Opus 4.8 and Mythos Preview. This means that an improvement relative to its own predecessor does not make Sonnet 5 the safest model in the Anthropic lineup — it's a comparative, not absolute, leadership.

Launch-week panic versus a week of experience

This is perhaps the most important conclusion from everything I've read. According to the SpectrumAILab review, the wave of criticism from June 30 to July 2 was mainly about the price and the forced change of the default model, not about the quality of work. Hands-on code reviews published a week later are mostly positive: according to official benchmarks, the model outperforms Sonnet 4.6 in all metrics and even slightly surpasses Opus 4.8 in the GDPval-AA v2 knowledge test (1618 vs. 1615).

A similar division into "two camps" is described by eWeek: one camp consists of real successful cases (a user with no programming experience built five web applications in 10 minutes, an agent independently investigated and fixed a bug without additional prompts), the other consists of skeptics who look at the bill and complain about the model's tendency to deviate from the task and "lecture" instead of direct execution.

Why this matters. If you saw loud headlines about "Sonnet 5's failure" immediately after its release — it's worth distinguishing between the outrage of the first week (mainly about price and forced transition) and systemic behavioral problems (sub-agent fragmentation, excessive refusals) that were confirmed in later, calmer tests. The former has mostly subsided, the latter is a real technical nuance that should be considered when planning.

Frequently Asked Questions

Is Claude Sonnet 5 really more expensive than Opus 4.8?
By nominal price per token - no. But by measured Artificial Analysis real cost of completed task - yes, $2.29 versus $1.97 for Opus 4.8, due to the new tokenizer and more agentic (token-aware) behavior.

Is it safe to trust Sonnet 5 with tasks without verification?
Anthropic claims a lower hallucination rate compared to Sonnet 4.6, but independent testing still records instances of misinterpreting sources. For tasks with a high cost of error, human verification remains mandatory.

Are these real system issues, or just early-release noise?
A mix. Criticism regarding price and forced transition to the new default has largely subsided after the first two days. However, issues of sub-agent fragmentation, excessive refusals, and model stubbornness are confirmed in later, calmer tests.


Read also: