Question Page

What are common expectations of the type of feedback that alpha/beta users should provide to Product Marketing Managers and Product Managers? What are some perks or incentives that you offer for alpha/beta users?

3 Answers
Anna Wiggins
Anna Wiggins
Bluevine Sr. Director of Product Marketing, Content, Customer ResearchAugust 11

This goes back to your goals for running the alpha/beta and what kind of information you want to gather.

In general I look for honest feedback on some of the following themes, but you’ll want to work closely with your PM partners to define specifics.

1. Does the product solve the right problem or in other words is this a problem the customer actually has?

2. Does the product actually solve the problem? If not, what would need to change.

3. Does the product meet customer’s expectations. If not, what did they expect and how should it be adjusted to meet them?

4. Does the customer enjoy using the product -- what are the pain points, what’s missing, what do they really like.

5. How would they describe what the product does and why they are using it.

You can gather this feedback through qualitative interviews or ideally through a UX study so you can work out any kinks in usability.

Usually participating in the alpha/beta tends to be a good incentive in itself since customers enjoy getting early access to tech. However you can also thank them with gift cards. If funds are an issue, you can get creative by offering access to a gated feature/plan, an hour with somebody from the leadership team, or free tickets to one of your events.

1203 Views
Grant Shirk
Grant Shirk
Cisco Head of Product Marketing, Cisco Campus Network ExperiencesDecember 15

I strongly recommend against providing ANY incentive for alpha and beta users to provide feedback or engagement. I find it creates bias and influences the kind of feedback you receive. You want real users with real problems running into your software; otherwise you get nice-to-haves or less thoughtful comments. 

It's hard to set expectations for the kind of feedback you receive. Early on, you don't know what customers will react to, or even where the real bumps will be. I'd recommend starting super open ended, and then narrowing in after some of those early patterns emerge. The best time for this is when you start addressing the first round of feedback. 

The most important thing is to create the space for feedback, and make it an active process. Don't sit back. Set the expectation for feedback with beta users early, and then make it part of a process to capture it. 

So I'd say that:

  1. Initial phase: Open-ended discovery with users. Watch, ask questions like "Tell me about your experience." "What were you trying to accomplish?" "What was challenging?" 
  2. Second phase: Regular (weekly/bi-weekly) checkins. "How's it going?" "Have you tried X yet?"
  3. Third phase (fixing things). Take specific improvements back to customers. "We heard your feedback (and others') and made some updates. Can we look at this again together?"
  4. Fourth phase. THANK THEM. Not just with physical rewards and words. Show them exactly how their feedback shaped the product. Show the impact, what new ideas it created, and how it helped others. 
576 Views
Matt Hodges
Matt Hodges
Equals Head of Product MarketingDecember 14

PM and PMMs are likely to have different goals when it comes to feedback from users with early access, but I think that both should at the very least seek to understand, "to what degree have we solved the problem for customers that we set out to solve with this feature/product/release?". If you practice jobs-be-done, that question might be better phrased as "is the user able to hire our product for their job-to-be-done? Why or why not".

As for PMM-specific expectations, I would base these on the goal of your alpha/beta, which you should align with PM on upfront. For example:

- Validate Problem-Solution fit

- Uncover and fix issues ahead of GA

- Source reference customers for a marketable moment 

- Improve the UX before GA

- Inform positioning and messaging

- Inform pricing and packaging

Lastly, I've never given or been involved in a project where an incentive other than, "get early/exclusive access", was offered. If you're building the right things for your customers, you should have no issue getting users wanting to participate in a beta. In theory. 😅

1728 Views
Product Launches
Thursday, May 23 • 12PM PT
Product Launches
Virtual Event
JoAnn Courtney
Mariela Madzharova
Andra Dinu
+30
attendees
Top Product Marketing Mentors
Sarah Din
Sarah Din
Quickbase VP of Product Marketing
Mary Sheehan
Mary Sheehan
Adobe Head of Lightroom Product Marketing
Dave Steer
Dave Steer
GitLab Vice President of Product Marketing
Jeffrey Vocell
Jeffrey Vocell
Panorama Education Head of Product Marketing
Jenna Crane
Jenna Crane
Klaviyo Head of Product Marketing
Alex Lobert
Alex Lobert
Meta Product Marketing Lead, Facebook for Business & Commerce
Kevin Garcia
Kevin Garcia
Anthropic Product Marketing Leader
Amanda Groves
Amanda Groves
Crossbeam Senior Director Product Marketing
Christine Sotelo-Dag
Christine Sotelo-Dag
ThoughtSpot Senior Director of Product Marketing
Abdul Rastagar
Abdul Rastagar
GTM Leader | Marketing Author | Career Coach