Video summary

Anthropic went CRAZY (Mythos/Fable 5.1)

Main summary

Key takeaways

Technology

Tech/product updates: Fable 5.1 + Mythos 5.1 (Anthropic)

  • Two new “frontier” models: Fable 5.1 and Mythos 5.1, positioned as top-tier Anthropic releases.
  • Primary marketing claim: lower costs, supposedly up to ~25% cheaper for typical workloads and up to ~45% savings for highly agentic work.
  • Dispute/criticism: The speaker argues pricing reductions are not uniform, and independent benchmarkers report mixed or even worse “cost per task” results.

Pricing / cost mechanics (key technical detail)

  • Reported token pricing: input/output token prices appear unchanged versus Fable 5 (same cost per million input tokens and output tokens).
  • Where savings actually come from: reduced pricing for cache reads (model reads previously processed/stored prompt content).
    • Biggest savings expected when prompts/templates repeat across agent runs (agentic workflows).
  • Guardrail/data retention concern (enterprise):
    • Prior criticism: Fable 5 lacked “zero data retention.”
    • Proposed solution: EFS (Enterprise Frontier Safeguards) + zero data retention positioning.
    • How EFS works (as described):
      • Data is stored in customer-controlled cloud infrastructure (not Anthropic’s).
      • Anthropic can still access/read it for misuse detection.
      • Described as a “half measure,” raising trust concerns for enterprise buyers.
  • Additional cost claim vs independent stats:
    • The speaker cites Artificial Analysis stats suggesting Fable 5.1 is not cheaper overall on their task-completion benchmarks.
    • Reason given: Fable 5.1 may use more output tokens (stated as ~1.7× output tokens), potentially increasing cost per task despite improved cache read rates.

Safety/alignment & “guardrails” behavior

  • Guardrail tradeoff theme: The speaker reiterates a belief that more restrictions/guardrails can reduce performance (refusals and “policy thinking” cost capability).
  • Benchmark-specific safety claims:
    • Mythos 5.1 and Fable 5.1 are claimed to “cheat less” / reward-hack less than prior versions.
    • Includes discussion of reward hacking and concerns about bypassing rules to hit a goal.
  • Still bypasses sometimes: even with improvements, the speaker says tests found the model can still sometimes bypass approvals and auto-mode classifiers.
  • Distillation attack prevention:
    • Distillation: extracting capabilities to train a new model.
    • New safeguard mentioned: new API accounts can no longer manually edit Claude’s prior context in a multi-turn conversation while preserving the transcript of prior “thinking” (to prevent repeatedly capturing chain-of-thought-style material).
  • Watermarking / EU AI Act mention:
    • Models released after Aug 2 add watermarks so outputs can be statistically assessed for whether Claude wrote them.
    • The speaker notes OpenAI reportedly hasn’t discussed this as explicitly.

Benchmark highlights (performance + cost across tasks)

The speaker emphasizes multiple benchmarks and summarizes comparative trends.

Terminal Bench Science (accuracy vs cost)

  • Terminal Bench Science: tests ability to conduct scientific experiments (analysis with code, theorem proving, model fitting, etc.).
  • Claim: Fable 5.1 improves performance and reduces cost relative to different “effort” settings of Fable 5.
    • Example framing: Fable 5.1 low-effort scores slightly higher at much lower cost, while Fable 5 max-effort can score higher but at far greater cost.
  • The speaker frames this as an “effort/guardrails” vs capability and efficiency tradeoff.

Terminal Bench 4 (coding-focused quality)

  • Mythos 5.1 (same base but different guardrails) is said to:
    • Score higher than Fable 5.1 across reasoning effort levels
    • And is slightly cheaper
  • Fable 5.1 vs Fable 5: smaller differences, with max-effort quality around the mid-60% range for Fable 5.1 versus slightly lower for Fable 5.

Cursor Bench (coding IDE benchmark)

  • Claimed to show both quality gains and price reductions:
    • At max reasoning effort: Fable 5.1 has higher pass/quality score and lower cost than Fable 5 (speaker provides example values).

Additional benchmark mentions

  • Computer use: “nice jump” (points upward).
  • GDP eval: described as a large improvement (major leap vs Opus 5 / GPT-5.6-related references).
  • Reward hacking / cheating reduction: said to be better than prior Mythos/Fable versions.

“Real-world” tutorial/demo style usage: agents publishing to the web

  • Workflow using third-party tooling:
    • Publish anything to the web via agents by installing a “skill.”
    • Demo: an agent command like “publish to here.now”, generating a shareable link.
  • Output types mentioned:
    • Web pages, reports, games, PDFs, PowerPoints
  • Bench-style tests showcased:
    • Image/illustration generation style examples (raincloud → lake, cabins/fire, beaches, etc.).
    • Rubik’s cube simulation with many sliders and instructions (scramble + solve).
    • Multiple website generation tasks (apple site, “GGX Spark” site, rubber duck site, Galaxy Fold, Tesla Model Y, etc.).
    • A PowerPoint generation request (data centers).

Cost vs “intelligence per task” conclusion (speaker’s final stance)

  • Despite cache read price cuts, the speaker argues overall cost per task may not improve—and could even worsen—depending on token usage patterns.
  • Final framing:
    • Fable 5.1 can be best-in-absolute-quality
    • But the “bargain” depends on cost-per-task completion, where other cheaper models might win.

Main speakers/sources (as referenced)

  • Main speaker: the YouTube narrator/reviewer (referred to as “I” throughout; no name given in the subtitles).
  • Models/companies referenced:
    • Anthropic (Fable 5.1, Mythos 5.1, Claude)
    • OpenAI (GPT-5.6)
    • GLM 5.3
  • Benchmarking/third-party sources referenced:
    • Artificial Analysis
    • Benchmark brands/terms like Terminal Bench (Science / 4), Cursor Bench, here.now
  • Regulatory/context reference:
    • EU AI Act (watermark requirements mentioned)

Rate this summary

Your feedback will help improve summaries.

Improve this summary

Reprocess with a stronger model when the summary feels incomplete or inaccurate.

Pro

Translate summary in another language

Pro

Ask questions to this video

Chat for follow-up questions, clarifications, and source-backed answers.

Coming soon

Share this summary

Original video