article thumbnail

Assumption Testing: Everything You Need to Know to Get Started

Product Talk

A regular cadence of assumption testing helps product teams quickly determine which ideas will work and which ones won’t. And sadly, most product teams don’t do any assumption testing at all. In this article, I’ll cover assumption testing from beginning to end, including: Why should product teams test their assumptions?

article thumbnail

Product in Practice: Testing Assumptions Was Tricky But the Convo Team Didn’t Give Up

Product Talk

Identifying and testing assumptions is a critical part of continuous discovery. But what happens when your assumption tests don’t go as planned? Amanda Wernicke , Craig Fogel , and Jason Ruzicka knew they needed to test assumptions with users, but found that a virtual assumption test over Zoom wasn’t working for them.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Product in Practice: Assumption Testing with Engineers at Orion Labs

Product Talk

Ellen says they examined different risks and things they’d have to test out. This reframing helped them more easily identify specific areas to run usability tests. When they were discussing the riskiest part of the feature, the Android team said, “Well, we can actually just build this one piece in an hour and put it in a test build.”

article thumbnail

522: Stop the stupid using proactive problem solving – with Doug Hall

Product Innovation Educators

Doug joined us in episode 518 and is back to share battle-tested strategies that will help you fix problems faster and smarter. While corporate environments often expect perfect planning and immediate success, true innovation requires multiple cycles of creation, testing, and refinement. hours every day dealing with problems.

article thumbnail

How to Achieve High-Accuracy Results When Using LLMs

Speaker: Ben Epstein, Stealth Founder & CTO | Tony Karrer, Founder & CTO, Aggregage

In this new session, Ben will share how he and his team engineered a system (based on proven software engineering approaches) that employs reproducible test variations (via temperature 0 and fixed seeds), and enables non-LLM evaluation metrics for at-scale production guardrails.

article thumbnail

517: How to conduct an AI Design Sprint – with Mike Hyzy

Product Innovation Educators

This allows for immediate testing and validation of the user experience. The team’s creative energy feeds into the AI tool’s capabilities, while external validation helps refine and improve the outputs from both human and AI contributions. What makes this process particularly valuable is its flexibility.

article thumbnail

Usability testing: the complete guide

UX Planet

Photo by UX Indonesia This ‘complete’ guide to usability testing follows an overview in my UX research methods playbook articles. Introduction If you’re responsible in some way for a digital product or system, you should be doing usability testing — whatever your sector, industry or role. Ok, that’s great for UX theory nerds.

article thumbnail

A Tale of Two Case Studies: Using LLMs in Production

Speaker: Tony Karrer, Ryan Barker, Grant Wiles, Zach Asman, & Mark Pace

Some takeaways include: How to test and evaluate results 📊 Why confidence scoring matters 🔐 How to assess cost and quality 🤖 Cross-platform cost vs. quality trade offs 🔀 and more!

article thumbnail

Improving the Accuracy of Generative AI Systems: A Structured Approach

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

Key Learning Objectives: How to leverage human feedback and observability frameworks to detect when the system generates incorrect output and as the basis for accuracy improvements 📈 How the use of playgrounds integrated into the administrative console of the application can isolate the source of the error 🔍 How building a robust regression (..)

article thumbnail

The Science of High-Impact Experimentation

Speaker: Holly Hester-Reilly, Founder and Product Management Coach, H2R Product Science

But too many teams don't know what to test, which leads to poorly designed experiments and unclear results. She’ll walk us through the entire process, from deciding what to test to sharing the results with stakeholders, to illustrate what strong experimentation practices look like and how they can be implemented in every organization.

article thumbnail

Building a Culture of Experimentation: Using Continuous Development for Faster & Safer Product Releases

Continuous development takes things further by giving product teams more autonomy and freedom to test out their ideas and experiment with new features in production by choosing who they want to test on. Testing in production –– why it’s important, and the many ways you can deploy your features safely and efficiently.

article thumbnail

Best Practices for Creating Long-Lasting and Continuous Discovery Habits

Speaker: Teresa Torres, Internationally Acclaimed Author, Speaker, and Coach at ProductTalk.org

As a result, many of us are still stuck in a project-world rut: research, usability testing, engineering, and a/b testing, ad nauseam. Industry-wide, product teams have adopted discovery practices like customer interviews and experimentation merely for end-user satisfaction.

article thumbnail

100 Pipeline Plays: The Modern Sales Playbook

Apply tested plays to your funnel - Use real-world scenarios, triggers, actions and expected results to improve your entire funnel. Use our proven data-driven plays to grow your pipeline and crush your revenue targets. Close more deals with these winning plays!

article thumbnail

The SaaS Guide to Conversion Rate Optimization

New ways to test, learn, and iterate to improve feature adoption. In this guide, you’ll learn: 7 detailed steps to infuse data-power into your conversion process. How to define the right events. How to shine a light on where customers drop off.

article thumbnail

The Ultimate Guide to Conversion Rate Optimization

New ways to test, learn, and iterate. In this guide, you’ll learn: 7 detailed steps to infuse data-power into your conversion process. How to define the right events. How to shine a light on where customers drop off.