Slightly Caffeinated
Fall Vibes, AI Evals, and Code Review Bots
This episode isn’t summarized yet
Create a free account and summarize it. In a few minutes you’ll have the key takeaways and a section-by-section summary.
Show notes
TJ Miller and Chris Gmyr compare the AI code review bots they are each building at work, from fixture repos of real PRs to requiring a line of code behind every finding. TJ also shares the eval-driven wizard he built to turn source material into learning content, sharing insights on building AI systems you can test and trust.
Links
- Ask a question or suggest a topic
- Podcast: Site | Twitter/X | Bluesky
- Chris: Site | Twitter/X | Bluesky
- TJ: Site | Twitter/X | Bluesky
References Mentioned
- Hive - Chris's orchestration framework
- Gorillaz - the show TJ saw in Detroit
- Deltron 3030 - the opener and TJ's all-time favorite hip hop artist
- Luma Brighter Learning - where TJ is building the learning content wizard and the PR review bot
- Claude Opus 5.5 - the model TJ wants to move the content wizard to, then rerun the evals
- Prism - TJ's Laravel AI package, which needs updates before the model upgrade
- GitHub Copilot - the reviewer that caught real issues TJ's bot missed, and the inline comment style Chris wants to copy
- CodeRabbit - one of the review services both teams passed on in favor of building their own
- Amazon Bedrock - where Chris's reviewer runs to keep code inside their own infrastructure