Question Page

How do you know you’re conducting thorough enough market research, in order to reduce the amount of unknown unknowns?

Jameelah Calhoun
Jameelah Calhoun
Eventbrite VP, Global Head of Product Marketing | Formerly Amazon, Ex-AmexMarch 9

It's important to take an iterative approach to customer research that spans the product development cycle. No single research study can anticipate and answer every potential customer challenge or angle, so it is important to build iteration into your plans. I follow 4 main stages of research: 1) finding opportunities, 2) evaluating concepts, 3) UX Research and Usability, and 4) market acceptance research. 

Throughout each step, it is important to constantly revisit the core question - which is are we solving a real customer problem? Second, it is important to understand what product decisions and customer behaviors would make or break your launch. Priortize getting high fidelity signals on those items.

1) Finding product opportunities should be a consistent stream of research. These can be composed of win/loss interviews, NPS surveys, customer service calls, and ongoing customer interviews. The goal here is to surface pain points and identify any emerging dimensions customers may be using to evaluate your company relative to competition
2) Once an opportunity is identified, I move to the concept validation. In this phase, the focus is on testing basic concept ideas and how customers value that feature. Surveys can provide quick signals on receptivity. After you feel you have a receptive audience, I move to focus groups to help prioritize features and understand high level requirements. These groups also can help inform how much of an irritant the defined customer problem is and what is their motivation to change behavior.
3) UXR is where you get even more in depth into the customer acceptance criteria for the new feature. You will get more clear signals about the actual likelihood that the concept you've developed can be usable by customers and ultimately solve a problem for them. 

        4) Lastly, it's time to put the boat in the water. Market acceptance research and testing involves having a small group of customers test drive your feature. It is important to observe critical KPIs on behaviors and downstream results, but also to incorporate qualitative interviews into this phase as well. 

1157 Views
Vanessa Thompson
Vanessa Thompson
Twilio Vice President MarketingDecember 2

Everyone in your business knows something about your market, and your customers. So its not only important to do the research but to make sure you share it with enough people in your business to validate that you dont have any blindspots or other elements that you’ve missed.

You dont need to have all the answers yourself but your work does need to interpret what the research means, so even though there are unknowns, focus on being thorough around the ones your team/business has the most control over and responsibility for. There will always be things you cant control (the pandemic is a good example).

734 Views
Influencing the Product Roadmap
Thursday, December 12 • 12PM PT
Influencing the Product Roadmap
Virtual Event
Lauren Novak
Tiago Martins
Deanna Abudu
+129
attendees
Daniel Palay
Daniel Palay
KPI Sense Chief Executive OfficerMarch 30

Great question, and I love discussing topics like "unknown unknowns." My primary advice would be: Don't mistake "thorough enough" for "specific enough" when it comes to market research. The most thorough research in the world can still have significant blindspots if it's not specific enough. In other words, it all comes down to the questions used to preface your research. If they're overly broad and vague, the best research in the world won't capture the relevant data. 

Begin any research initiative knowing what question(s) you ultimately want to answer, and what you will be able to do with those answers. If you start with "I want to know as much as I can about Demographic X so I can better market to it" the outputs may tell you a lot... of the wrong, or least relevant, information. If, on the other hand, you start with: "I want to know how Demographic X evaluates the switching costs associated with enterprise software, so I can justify the necessary behavior change" you'll be able to thoroughly investigate the pivotal issue at hand.

472 Views
Top Product Marketing Mentors
Mary Sheehan
Mary Sheehan
Adobe Head of Lightroom Product Marketing
Jeffrey Vocell
Jeffrey Vocell
Panorama Education Head of Product Marketing
Kevin Garcia
Kevin Garcia
Anthropic Product Marketing Leader
April Rassa
April Rassa
Clari VP, Solutions Marketing
Susan "Spark" Park
Susan "Spark" Park
Monzo Director of Product Marketing
JD Prater
JD Prater
AssemblyAI Head Of Product Marketing
Jeff Hardison
Jeff Hardison
Calendly VP of Product Marketing
Leah Brite
Leah Brite
Gusto Head of Product Marketing, Employers
Mike Berger
Mike Berger
Ex-VP, Product Marketing @ ClickUp, SurveyMonkey, Gainsight, Marketo
Meghan Keaney Anderson
Meghan Keaney Anderson
Watershed VP of Marketing - Product Marketing & Communications