How I AI

Meta’s new ‘Muse Wonder’ model: good for AI agents, bad for design

· Summarized

Share this episode
Anyone with this link can open it.
Share Link
Start at 0:00

Key takeaways

  • Muse Wonder is best suited for agentic, knowledge-based, and backend work, outperforming competitors in these domains.
  • The model’s active focus mode shows promise for long-term, complex tasks by successfully trying different strategies.
  • Despite claims of state-of-the-art performance, Muse Wonder's creative outputs, especially design and visual content, are currently underwhelming.
  • Its speed benefits make it appealing for quick tasks, but it slows down significantly on longer, more involved employment.
  • The model’s design sensibility and visual output remain boilerplate and outdated, limiting its use in high-quality front-end or creative projects.
  • Claire questions the utility of Muse Code, Meta’s agent coding framework, which she found unremarkable in her testing.
  • Future improvements or skill integrations might enhance Muse Wonder’s creative capabilities, which are presently its weakest area.
  • Overall, Meta’s Muse Wonder model shows promising AI frontier capabilities but still has notable gaps in aesthetic and creative design.

Summary

Introduction to Meta's Muse Wonder and Episode Context

Claire Voe introduces Muse Wonder as Meta's latest frontier intelligence model, available in two versions, Wonder and Wonderful. She explains her intention to evaluate Muse Wonder using her AI benchmark, focusing on applications in coding, knowledge work, and agentic workflows. She notes the model's branding centered on personal and professional agentic activities and mentions its comparison with models like GPT-6 Astra and Quad Opus 5.5, which she currently uses daily. She emphasizes that the review will assess Muse Wonder’s capabilities across a broad set of tasks from her benchmark, which includes nearly 20 different activities, judged via her voice notes and an LLN judge.

Meta's Claims and Capabilities of Muse Wonder

Claire discusses Meta's positioning of Muse Wonder, which claims state-of-the-art intelligence geared toward personal agents and domain-specific professional tasks, such as legal and financial work. She highlights Meta's emphasis on three 'frontier capabilities': domain expertise, active memory, and active focus. The model boasts superior memory for maintaining context over conversations and an 'active focus' mode that helps the model work on challenging goals by trying different approaches. Claire notes evidence from her testing that active focus can outperform on long-running tasks, supporting Meta’s claims.

Technology Access and Testing Methodology

Claire explains the process she used to test Muse Wonder, starting with subscribing to Muse Code, Meta's agent coding harness, which she admits found unimpressive. She downloaded it via an install script and used Claude Code to run it headlessly, avoiding any deep engagement with Muse Code itself. Her overall testing involved running the model through her comprehensive benchmark, covering tasks like coding, prototyping, agent workflows, creative tasks, and more. She describes her testing setup, including voice notes for scoring and the involvement of an LLN judge to evaluate the outputs, aiming for a first-look overview rather than a full benchmark.

Performance Results and Strengths of Muse Wonder

Claire reports that Muse Wonder excelled in agentic work, outperforming on tasks like billing management, inbox triage, and long-term research, making it ideal for knowledge work and as a personal or professional voice agent. It performed well in coding tasks, placing it as a viable choice for backend development and architecture review, though Astra scored slightly lower. However, the model's creative and design outputs were disappointing; it struggled with prototypes, UI designs, and visual outputs, producing boilerplate, often poorly executed designs. Claire emphasizes that Muse Wonder’s speed is a major advantage for quick tasks but notes it slows down on complex, long-term agentic tasks.

Limitations and Creative Task Evaluation

Claire criticizes Muse Wonder’s creative outputs, including web design, SVG illustrations, and short-form videos. She finds its design sensibility outdated, with generic styles and poor execution, especially in high-visual-stakes projects like her Chat Purity website redesign, where it produced ugly, broken, or irrelevant images and layouts. She notes that for creative tasks requiring polish, other models like Opus 55 outperform Muse Wonder significantly. She also mentions that Muse Wonder’s SVGs and video edits are decent but not market-leading, suggesting that its strengths lie more in agentic and backend tasks than in creative design and art.

Overall Conclusions and Future Outlook

Claire summarizes her initial impressions: Muse Wonder is very fast and excels at short, agentic, and backend tasks, but falters considerably in creative design. While promising as an agentic voice and knowledge assistant, it’s not yet suitable for high-fidelity creative roles. She plans to continue testing its application in agent workflows and hopes that future iterations or skill enhancements might improve its creative capabilities. She concludes that Meta's model is progressing well and might become her preferred for specific in-loop tasks, but it is not yet ready to replace specialized creative tools. She encourages others to experiment with Muse Wonder in their workflows.

Sponsors

  • DX · Spend on AI tools has grown 28X over the last year. As teams generate code faster, new friction in code review and validation offsets velocity gains. DX tracks speed, quality, and cost across the software development lifecycle, giving engineering leaders visibility into AI's impact.

Show notes

I put Meta’s new Muse Wonder (and Wonder Full) frontier models through the How I AI bench, which covers nearly 20 tasks across prototyping, agentic workflows, coding, writing, and creative work. I scored everything with an LLM-as-a-judge pass and my own voice notes, then pulled together the first-look results you see here.


What you’ll learn:

  1. ​Why Meta’s “personal and professional agent” framing mostly holds up, and where it doesn’t
  2. ​What active focus mode actually does on long-running tasks, and whether it’s real
  3. ​The three agentic tasks where Muse ranked first, and why those categories matter
  4. ​What Muse’s design output actually looks like (it’s not good)
  5. ​How it compares to Sonnet on voice assistant tasks
  6. ​Where Muse lands on SVG and short-form video versus Opus 5.5, Astra, and Fable
  7. ​Whether I’m actually putting Muse into any of my agent workflows

—

Brought to you by:

DX—Engineering intelligence for the AI era

Jira Product Discovery—Prioritize with insights, build with confidence

—

In this episode, we cover:

(00:00) Intro and what Muse Wonder is

(01:19) Meta's frontier capability claims

(04:36) Muse code

(06:06) Benchmark overview and how the How I AI bench works

(07:51) Overall results and TL;DR verdict

(11:53) Agentic tasks

(13:36) Email writing and voice assistant performance

(14:35) Where Muse falls short

(18:28) SVG illustration results

(19:33) Short-form video editing

(21:18) Fast on one-shot work, slow on agent tasks

(22:15) Final verdict and where I'll use Muse Wonder next

—

Tools referenced:

—

Where to find Claire Vo:

ChatPRD: https://www.chatprd.ai/

Website: https://clairevo.com/

LinkedIn: https://www.linkedin.com/in/clairevo/

X: https://x.com/clairevo

—

Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email jordan@penname.co.

Follow this show on AudioBrevity and new episodes get summarized for you. Create a free account

Couldn't load the audio. A blocker may be stopping the show's tracking links. Open the file