Why your Discovery Insights
|
Dear Reader,
"I believe we should split-test this change to the funnel."
"No, we tried that 3 years ago. Didn't work."
End of story...right?
9-ish years ago, I got to listen to Willem Isbrucker sharing his insights from running experiments at booking.com (famous for their quantitative data-first approach) at ProductTank Hamburg. Among other things, he discussed how split-test results had an expiration date. If I remember correctly, it was 6 months. Meaning, if you had an idea that was tested less than 6 months ago, it might not be worth retesting right now. But if it was more than 6 months ago, the changes that have occurred in the meantime justify re-testing.
Many people get hung up on how "horrible" booking.com's UI looks or how "6 months doesn't work for us." But I believe there's a more universal practice in that anecdote, that applies to you, no matter the industry, company size, or maturity: It's that what was true in the past might no longer be true because of context changes. In simpler terms, your insights could benefit from an expiration date.
In the context of Product Discovery, this doesn't necessarily mean you have to re-do generative research or evaluative testing every six months. What it means instead is to run planned decisions and activities through a mental checklist:
Having researched or tested something in the past isn't a reason not to do it again, any more than it's a reason to start all over every time. What it is is an insight from a specific context you need to check for its applicability right now.
So, take this with you into your day:
What is an activity or decision you have recently dismissed because there was an effort around it in the past? How long was that ago? What has changed since then that might yield different, more actionable results?
Then, please reply to this email and let me know what came up for you.
Thank you for Practicing Product,
Tim
I'm excited to bring my beloved in-person workshops back to Berlin in January 2026. You can choose between 1-day workshops on Product Strategy, Product OKRs, or Product Discovery, or opt for the full 3-day experience for you or your team.
| LEARN MORE |
(reach out for custom team quotes)
As a Product Management Coach, I guide Product Teams to measure the real progress of their evidence-informed decisions.
I focus on better practices to connect the dots of Product Strategy, Product OKRs, and Product Discovery.
1 tip & 3 resources per week to improve your Strategy, OKRs, and Discovery practices in less than 5 minutes. Explore my new book on realprogressbook.com
Product Practice #395 How it feels being Interviewed by AI PUBLISHED Feb 13, 2026 READ ON HERBIG.CO Dear Reader, Last week, I invited you to join an AI-led concept test of a side project idea. Here's what participants share with me about their experience: "It was like getting interviewed by someone who is doing this one of the first times." "I felt free to say what I wanted without 'hurting' the interviewers. I felt listened (as the AI was repeating my points). But sometimes the conversation...
Product Practice #394 Can an AI Interviewer doYour Concept Testing? PUBLISHED Feb 6, 2026 READ ON HERBIG.CO Dear Reader, What happens when you let an AI do the concept testing of design variations? I used Reforge's AI Concept testing* to find that out. As a prototype, I chose an app idea that lets you document taste notes from brewing specialty coffee. And I need your help exploring how AI-led interviews feel for participants (and improving the app design ☕️). I mostly went with their...
Product Practice #393 How much Money willthis Feature make? PUBLISHED Jan 30, 2026 READ ON HERBIG.CO I'm hosting my first free live webinar in 2026: Go From "We Need a Strategy" to "Here's Exactly What We're Doing and Why" — In 60 Minutes on Feb 11 at 5:00 PM CET (11:00 AM EST | 8:00 AM PT). Bring all your questions, and I will work through them on the spot. Note that there will be no recording - this is about hands-on interaction, not just information transmission. CLAIM YOUR FREE SPOT Dear...