How I AI

Claude Opus 5 review: this model is brilliant (but annoying)

· Summarized

Share this episode
Anyone with this link can open it.
Share Link
Start at 0:00

Key takeaways

  • The AI landscape is experiencing a fatigue point where new models are frequently released, but meaningful utility and leverage may be plateauing for most users.
  • Opus 5 demonstrates a highly neurotic personality, showing timidity and dependence that influence its responses, but it still performs exceptionally well on benchmarks and practical tasks.
  • Benchmark evaluations reveal that Opus 5 excels in design, prototyping, and front-end work, often outperforming other models in these domains.
  • Despite frustrations with verbosity and hedging ('Claude Slop'), Opus 5's quality outputs make it a valuable tool for app design, prototyping, and creative projects.
  • The host's honest assessment highlights the importance of personality and behavior of models, not just capability metrics, when considering their real-world utility.

Summary

Overview of AI Model Release Fatigue and Opportunity Overhang

The host expresses a sense of fatigue with the rapid release of new AI models and benchmarks, noting a constant stream of models like GPT-5, Sonnet 5, and others. Despite having extensive hands-on experience with these models, they suggest there is an 'intelligence overhang,' meaning that the market and users are beginning to struggle with effectively leveraging incremental advancements. The episode promises a detailed review of Opus 5, highlighting its personality, performance, and practical utility.

Deep Dive into Opus 5's Personality and Performance

The host provides an honest, in-depth review of Opus 5, emphasizing its personality traits—particularly its neuroticism, timidity, and dependence on human guidance. Through various tests, including comparisons with GPT-5.6 Sol and asking philosophical questions about intelligence and trust, the host uncovers how Opus 5 exhibits a highly cautious, neurotic demeanor that influences its responses and interactions. Despite its personality, Opus 5 performs well on benchmarks and tasks, especially in prototyping and design—areas where it excels when not directly manipulated.

Benchmarking and Practical Use Cases of Opus 5

The host details the methodology of their 'How I AI' benchmarking process, which involves blind testing of several models across tasks like PRD creation, prototyping, bug triage, and coding. The actual performance results show that Opus 5 lands high on the leaderboard, especially excelling at design and front-end tasks, often receiving top scores from the host. The reviewer shares their personal workflow and how they plan to incorporate Opus 5 into their work, despite frustrations with its verbose and hedging outputs—referred to as 'Claude Slop.' Ultimately, the host sees Opus 5 as a valuable tool for app design and prototyping, favoring its output quality over its cumbersome interaction style.

Sponsors

  • Penname.co · Production and marketing by Penname.co. For inquiries about sponsoring the podcast, email jordan@penname.co.

Show notes

I’m tired of new models. Every week there’s a new benchmark, a new frontier intelligence claim, a new thing to test. But here we are, because Opus 5 just dropped and I’ve had real hands-on time with it, so you’re getting the honest version.


This is my full Opus 5 review: personality analysis, live benchmark results from my 7-model How I AI eval, and an actual verdict on whether I’m swapping it in. Spoiler: the answer surprised me.


What you’ll learn:

  1. Why I think we’ve hit an intelligence overhang and what that means for which model variables actually matter now
  2. How Opus 5’s “neurotic” personality showed up in real coding sessions, including a merge conflict it refused to touch
  3. What I learned from asking both Opus 5 and GPT‑5.6 Sol “who’s smarter, you or me?”
  4. Where Opus 5, GPT‑5.6 Sol, Sonnet 5, and Gemini 3.1 Pro actually landed on the HIA benchmark leaderboard
  5. The one use case where Opus 5 earned straight 5s from me
  6. My actual plan for using Opus 5 going forward

—

In this episode, I cover:

(00:00) Opus 5 is here

(03:15) First impressions

(06:12) Opus 5 vs. GPT‑5.6 Sol personality comparison

(14:39) Claude Slop: the verbosity problem and why it makes my blood boil

(16:55) How the How I AI benchmark works (7 models, 6 tasks, blind scoring)

(18:30) Live benchmark results: the leaderboard reveal

(23:25) My verdict and how I’ll actually use Opus 5

—

Tools referenced:

• Claude Opus 5:

• Anthropic blog: https://www.anthropic.com/news

• GPT‑5.6 Sol: https://openai.com/index/previewing-gpt-5-6-sol/

• Sonnet 5: https://www.anthropic.com/news/claude-sonnet-5

• Gemini 3.1 Pro: https://deepmind.google/models/gemini/pro/

—

Where to find Claire Vo:

ChatPRD: https://www.chatprd.ai/

Website: https://clairevo.com/

LinkedIn: https://www.linkedin.com/in/clairevo/

X: https://x.com/clairevo

—

Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email jordan@penname.co.

Follow this show on AudioBrevity and new episodes get summarized for you. Create a free account

Couldn't load the audio. A blocker may be stopping the show's tracking links. Open the file