Question Page

What third-party services do you use for panel testing? what are the pros and cons of each? How you used these insights to impact the product roadmap with PMs?

Molly Friederich
Molly Friederich
Sanity.io Director of Product Marketing | Formerly Twilio, SendGridSeptember 16

I've used a few different panel providers for large-scale segmentation studies, messaging feedback, and more. I won't call them out by name here, but I'll suggest things to look for as you evaluate options: 

  1. How well can they recruit against your unique market, and how will they make sure to meet their targets? What will it cost to meet your goals? 
  2. When responses come back, how do they filter out bad responses, and what visilibity will you have to the data coming in (before you're out of field). 
  3. What support do they offer for survey design to make sure you get the most value from their breadth of experience? 

In terms of insights guiding the product roadmap for PMs, I've found segmentation studies to be an incredibly powerful tool to align the organization on strategy. It sizes the market, identifies what personas to prioritize, provides rationale for what pain points to solve for first, and creates a lock-step experience from product development to messaging and launch planning to sales enablement. 

For smaller-scale, more acute decisions, working with PMs to identify specific questions they need to answer at a regular cadence (say, top questions for a given program increment) to drive product strategy is also a great way to bring value to the table. 

1142 Views
Randi Lee
Randi Lee
Fundbox Head of Product MarketingSeptember 17

We have used usertesting.com and Survey Monkey panels. Usertesting is better for qualitative insights and SM is better for quantitative and quick results. It's impt to be aware of panel quality and to use the feedback accordingly. For example, you might want to validate what you hear from a panel by using multiple sources. PMs have been involved in development of questionnaires, we make it easy for them to see results and they use the results to inform roadmap priorities. 

282 Views
Sharebird PMM Exec Event - KPI's
Wednesday, November 20 • 12PM PT
Sharebird PMM Exec Event - KPI's
Virtual Event
Sharon Markowitz
Nate Franklin
Surabhi Jayal
+48
attendees
Top Product Marketing Mentors
Mary Sheehan
Mary Sheehan
Adobe Head of Lightroom Product Marketing
Jeffrey Vocell
Jeffrey Vocell
Panorama Education Head of Product Marketing
Kevin Garcia
Kevin Garcia
Anthropic Product Marketing Leader
April Rassa
April Rassa
Clari VP, Solutions Marketing
Susan "Spark" Park
Susan "Spark" Park
Monzo Director of Product Marketing
Marcus Andrews
Marcus Andrews
Pendo Sr. Director of Product Marketing
Leah Brite
Leah Brite
Gusto Head of Product Marketing, Employers
JD Prater
JD Prater
AssemblyAI Head Of Product Marketing
Jeff Hardison
Jeff Hardison
Calendly VP of Product Marketing
Julien Sauvage
Julien Sauvage
Clari VP, Brand, Content and Product Marketing