Get five people talking about your product - iterative feedback with Ben Vinegar

The episode begins with host Kent C. Dodds introducing Ben Vinegar, a seasoned startup engineer and product leader, emphasizing his focus on product engineering. They recount how they met at Space City JavaScript conference and discuss their long-standing acquaintance dating back to around 2017. Ben shares his career journey, starting from early roles at FreshBooks and Disqus, through his time at Century where he grew the team from five to 400 employees, and his various leadership roles including head of product engineering and VP of Merchant Technology. He describes his background as a hybrid product engineer handling both UI and backend, with a focus on creating impactful products. Ben also talks about his current project, Modem, which he founded to streamline how product teams capture and act on user feedback. He emphasizes the importance of rapid iteration, collecting feedback from diverse channels like Slack, Discord, GitHub, and support tools, to better understand user pain points and opportunities. The discussion underscores his advocacy for close-loop feedback and active listening to users to inform product decisions.

Ben explains that Modem aggregates signals from multiple communication platforms such as Slack, Discord, GitHub, and customer support channels to provide a unified view of user feedback. This enables development teams to prioritize issues and features based on historical and real-time data, avoiding the pitfall of missing recurring problems. He shares anecdotes about how the tool surfaces critical feedback, like performance complaints, that can be addressed with quick updates, fostering an iterative development process. The conversation highlights how capturing and analyzing feedback at scale allows teams to respond rapidly and maintain a close connection to user needs. Ben emphasizes that his approach aims to scale the human feedback loop, making it manageable for teams to remain responsive without drowning in noise. He also mentions his personal project, Cody, an AI-oriented MCP server, which is in early testing and benefits immensely from direct user feedback, demonstrating his commitment to continuous improvement and user-informed design.

The hosts discuss methods for eliciting meaningful user feedback, with Ben advocating for kindness and making it easy for users to give input. He suggests that building tools for oneself or mimicking user experiences can be effective in understanding customer pain points. Ben emphasizes the importance of incentives and creating safe, accessible avenues for feedback – like welcoming community spaces or direct outreach – to foster genuine engagement. Ben shares specific tactics, such as offering early access for feedback, and the importance of responding to users with tangible outcomes to close the feedback loop. They talk about how automations and AI can facilitate relationships in support channels, but human connections are still vital for insights and innovation. The conversation also delves into the culture of support, citing FreshBooks’ support rotation and the value of direct conversations, and discusses how to keep that human touch alive even as automation and AI become more prevalent.

A key theme revolves around whether AI and automation might replace human judgment in product development and customer support. Ben argues that AI can accelerate and augment human taste and decision-making but should not eliminate human involvement altogether. He cites his own projects, like Hunk, a terminal diff tool, which was built to improve his own workflow and based on his personal taste, illustrating how individual human judgment shapes successful products. Ben stresses that taste, vision, and the ability to say no are irreplaceable, as AI tends to produce median or average solutions. He supports a balanced approach where automation handles repetitive tasks and data collection, freeing humans to focus on meaningful judgment and strategic decisions. He shares an example of how community-driven open-source projects thrive on individual taste, reinforcing his view that human imperfection and discretion are crucial to creating distinctive, valuable products.

The episode concludes with a reflection on maintaining a strong product culture that values human connection, particularly in customer interactions. Ben shares his experience at FreshBooks, where customer support was deeply integrated into the company culture—support team members actively engaged with users and rotated through support roles to foster empathy and understanding. Kent and Ben agree that automation should facilitate, not replace, human relationships. Ben advocates for leveraging automation to enable more meaningful communication rather than dilute it. As a practical takeaway, Ben recommends that listeners get five people to try their product and talk to them about their experiences, emphasizing the value of direct conversations for improving product and strengthening relationships.