Level Up Your Career
Learn the best practices and latest trends directly from leaders in your field
All related (43)
Matt Hodges
Head of Marketing, Confluence at Atlassian December 12

PM and PMMs are likely to have different goals when it comes to feedback from users with early access, but I think that both should at the very least seek to understand, "to what degree have we solved the problem for customers that we set out to solve with this feature/product/release?". If you practice jobs-be-done, that question might be better phrased as "is the user able to hire our product for their job-to-be-done? Why or why not".

As for PMM-specific expectations, I would base these on the goal of your alpha/beta, which you should align with PM on upfront. For example:

- Validate Problem-Solution fit

- Uncover and fix issues ahead of GA

- Source reference customers for a marketable moment 

- Improve the UX before GA

- Inform positioning and messaging

- Inform pricing and packaging

Lastly, I've never given or been involved in a project where an incentive other than, "get early/exclusive access", was offered. If you're building the right things for your customers, you should have no issue getting users wanting to participate in a beta. In theory. 😅

Anna Wiggins
Sr. Director Product Marketing, Insights, Copy & Content at Bluevine August 11

This goes back to your goals for running the alpha/beta and what kind of information you want to gather.

In general I look for honest feedback on some of the following themes, but you’ll want to work closely with your PM partners to define specifics.

1. Does the product solve the right problem or in other words is this a problem the customer actually has?

2. Does the product actually solve the problem? If not, what would need to change.

3. Does the product meet customer’s expectations. If not, what did they expect and how should it be adjusted to meet them?

4. Does the customer enjoy using the product -- what are the pain points, what’s missing, what do they really like.

5. How would they describe what the product does and why they are using it.

You can gather this feedback through qualitative interviews or ideally through a UX study so you can work out any kinks in usability.

Usually participating in the alpha/beta tends to be a good incentive in itself since customers enjoy getting early access to tech. However you can also thank them with gift cards. If funds are an issue, you can get creative by offering access to a gated feature/plan, an hour with somebody from the leadership team, or free tickets to one of your events.

Grant Shirk
Head of Product Marketing, Cisco Meraki at Cisco Meraki | Formerly Tellme Networks, Microsoft, Box, Vera, Scout RFP, and Sisu Data, to name a few.December 15

I strongly recommend against providing ANY incentive for alpha and beta users to provide feedback or engagement. I find it creates bias and influences the kind of feedback you receive. You want real users with real problems running into your software; otherwise you get nice-to-haves or less thoughtful comments. 

It's hard to set expectations for the kind of feedback you receive. Early on, you don't know what customers will react to, or even where the real bumps will be. I'd recommend starting super open ended, and then narrowing in after some of those early patterns emerge. The best time for this is when you start addressing the first round of feedback. 

The most important thing is to create the space for feedback, and make it an active process. Don't sit back. Set the expectation for feedback with beta users early, and then make it part of a process to capture it. 

So I'd say that:

  1. Initial phase: Open-ended discovery with users. Watch, ask questions like "Tell me about your experience." "What were you trying to accomplish?" "What was challenging?" 
  2. Second phase: Regular (weekly/bi-weekly) checkins. "How's it going?" "Have you tried X yet?"
  3. Third phase (fixing things). Take specific improvements back to customers. "We heard your feedback (and others') and made some updates. Can we look at this again together?"
  4. Fourth phase. THANK THEM. Not just with physical rewards and words. Show them exactly how their feedback shaped the product. Show the impact, what new ideas it created, and how it helped others.