Question Page

What are the different ways of testing the customer profiles and messaging for each profile?

Greg Hollander
Greg Hollander
Novi VP of GTM & StrategyDecember 21

I have NOT found success testing messages out of context, like in surveys. It’s hard for respondents to truly put themselves in a buyer’s mindset. I’d recommend putting messaging into practice, in context, in ways that you can test and iterate.  For example, look at lift in conversion on landing pages, ads, or emails with messaging A vs. messaging B. Put pages up on sites like UserTesting.com to hear first-hand from potential customers (I’ve found a lot of success with the screeners they offer).  Ask sales reps whether they’re having success with your materials, and where they’re hitting friction.  

 

As you learn what works, you should feed that back into your understanding of the customer.  Did the messaging that flowed from your customer profile resonate best?  If not, why not?  Reach out to a few more customers or throw some more tests up on UserTesting with specific questions, and continue to iterate from there.

1530 Views
Jon Rooney
Jon Rooney
Unity Vice President Product Marketing | Formerly Splunk, New Relic, Microsoft, OracleMarch 13

I don’t count internal debate/discussion or “inside the building” opinions to be testing per se, so I assume you mean external validation. In the realm of enterprise software (which is where I’m coming from), I’ve found 4 ways (best run in parallel then rationalized) to test messaging once you have some initial draft/hypothesis messaging to test:

  1. Hopefully your company has some sort of beta/early access program to validate new capabilities and products - usually managed by product. What customers say organically and unprompted during this beta/early access process (what actual words they use to describe what problems they’re trying to solve, how your solution works - or doesn’t - and how it helps them - or doesn’t) is the single most useful signal I’ve gotten for crafting messaging, particularly for something new. So as a PMM, join all of the calls and just listen. Don’t put your draft messaging in front of the customers for feedback, just listen carefully to what the customer’s going through and how they describe it. Chances are, their words (when rationalized across a handful of beta deployments) will give you the foundation you need to write compelling messaging for launch.
  2. If you have budget, contract out for market research to be done with target personas in which the problem statement, solution/product description and value proposition is presented (even without screenshots or any type of demo) then ranked/scored both with and without your company name being attached to it. The key here is ensuring that the customer panel is selected correctly (this is super easy to do wrong and thus invalidate the entire exercise) and the information presented is clear and differentiated enough to provide specific feedback (so don’t ask about overarching things like “digital transformation” - get specific).
  3. If you don’t have budget - and you sell enterprise software through standard procurement processes - get your hands on as many RFPs as possible and read them carefully. Make note of how exactly customers talk about what they need and be sure to make note of words and phrases that show up over and over again. You’re probably obscuring the value of what your product actually does in vague descriptors or cliches. What you pull out of reading a bunch of RFPs will improve your messaging, no doubt.
  4. Again, this is more for enterprise software, and I know this might seem like a no-brainer, but reach out early and often for feedback from industry analysts (Gartner, IDC, Forrester, 451, Red Monk, etc). They talk to customers and likely every one of your competitors, plus most have practitioner backgrounds, so they know their stuff and have ideas to share. Lots of vendors make the mistake of treating analysts transactionally and developing adversarial relationships around rankings and such. That’s a huge mistake and, if that’s where your head’s at, change it today. If you genuinely approach analysts for their thoughts and ideas (so present for 10% of the time, listen for 90% of the time) you’ll be surprised at how frank many of these analysts will be and how helpful their feedback can be. Don’t take it all for gospel - be sure to triangulate and synthesize - but it’s a great input when gathered correctly.
1820 Views
Sharebird PMM Exec Event - KPI's
Wednesday, November 20 • 12PM PT
Sharebird PMM Exec Event - KPI's
Virtual Event
Sharon Markowitz
Nate Franklin
Surabhi Jayal
+48
attendees
Julia Szatar
Julia Szatar
Tavus Head of MarketingDecember 3

This is the same as generally testing your messaging, but just segmenting your tests per audience or persona.

  • a/b testing emails and landing pages
  • using an agency to survey audiences for large brand campaings
  • direct user interviews
  • interviewing your frontline teams
  • competitive research

Sometimes you don't have time to do all of the above and you have to go with your gut and then evolve it over time as you get to know your product, users, and market better.

566 Views
Alex Lobert
Alex Lobert
Meta Product Marketing Lead, Facebook for Business & CommerceMarch 17

When testing messaging, I like to start simple and practical by first talking to the people closest to the customer. That could be a sales team or a partnerships team. I typically bring hypothesis messaging to these experts and evaluate if changes need to be made for a given customer segment. 

After working with internal experts, it is usually time to bring messaging to customers. This often takes the form of interviews with target customer personas to get reaction to website / product copy. If your product has a B2B sales component, you can also do live testing of messaging in a set of client meetings. This approah is typically low cost (just editing some slides) and gives you data on whether or not your messaging works in the real world. With any customer test, I recommend that prior to any testing, identify the metrics or data you will use to make a decision about if your messaging is working. This will help you stay objective in your analysis. 

After user research, Alpha Testing / Pilots are a way to see if your messaging holds up in the real world. Can you actually get customers to use your product / commit to your pilot? If not, it may be back to the drawing board. 

724 Views
Top Product Marketing Mentors
Mary Sheehan
Mary Sheehan
Adobe Head of Lightroom Product Marketing
Jeffrey Vocell
Jeffrey Vocell
Panorama Education Head of Product Marketing
Kevin Garcia
Kevin Garcia
Anthropic Product Marketing Leader
April Rassa
April Rassa
Clari VP, Solutions Marketing
Susan "Spark" Park
Susan "Spark" Park
Monzo Director of Product Marketing
Marcus Andrews
Marcus Andrews
Pendo Sr. Director of Product Marketing
Leah Brite
Leah Brite
Gusto Head of Product Marketing, Employers
JD Prater
JD Prater
AssemblyAI Head Of Product Marketing
Jeff Hardison
Jeff Hardison
Calendly VP of Product Marketing
Julien Sauvage
Julien Sauvage
Clari VP, Brand, Content and Product Marketing