We think about this as a layered approach, of which time is an important consideration. Here are some ways to think about the differences:
Ideally, in everything :)
Product Marketers should aim to approach our work from the perspective of the consumer, and frequently bring that view into internal conversations. This is why we closely evaluate their options (via competitive tracking), their experience (product and userflow), and their motivations (quant / qual surveys).
At the most tactical level, we leverage those insights to inform positioning, messaging, and GTM execution. On a broader level, consumer insights fuel broader strategic discussions such as feature development, roadmap discussions, prioritization, and initiative planning.
PMM and UXR are equal partners. Typically PMM is responsible for drafting the project brief which provides context and the learning objective. UXR recommends the research approach, the tools, and designs the execution brief. PMM will review the questions to ensure it aligns with our goals. UXR will run the studies, synthesize the data, and present the findings, most often to the extended team.
With that - I want to share credit with Kris Tyler. In addition to refining my responses in this AMA, Kris has been my co-lead on all other projects this year: be it Market Analysis, sentiment tracking, surveys, conjoint - you name it. She's a Star among Stars.
A market analysis is complex: there are many (many) different things that make up a market, and it can easily become a sociological discussion - especially as you see similar trends across multiple markets, driven by divergent factors.
Ultimately, you are seeking to understand a) headwinds b) tailwinds c) market accelerants and d) what your competitors may be doing to influence this.
At a very basic level, the tools that will help you evaluate that are:
The key to a market analysis is to try and piece together different data points and view it as a whole to start to see the story. Like a puzzle.
Always assume best intent. Start there. Often times people want to help, but there are other things going on; there may be nuances you have not yet considered which your stakeholder is weighing carefully. It's important to dig in to see where the resistance may be coming from and get your stakeholders support against the goal itself - even if the means to achieve that goal may change.
Listen carefully to your stakeholder and treat them as a subject matter expert when it comes to their clients. Try to deeply understand their concerns. Share your purpose, how it supports company objectives, and ask for their recommendation on the approach. Invite them to help you find a solution. Usually, worst case scenario is that they'll redirect you; best case scenario is that they'll help you design + execute communications.
If you can work through it then, in addition to getting the project off the ground, you may have also found a great new partner to work with in the future.
Tactically, you can apply the learnings in pretty much any way - from sourcing to targeting. However, in many case, you'll want to make sure other teams are aware of this information so that they can use it even if you personally aren't involved. With that in mind, think about how you can socialize important information that you collect broadly. Some tactical ideas:
The trick with any material piece of research is to remind people that it exists. In addition to getting more traction, it helps the organization operate more efficiently and avoid redundancy. Oftentimes, people are re-inventing reports simply because they are unaware that someone has already done it.
Yes! We can and we do - surveys, interviews, localization checks, experimentation, and instructor advisory boards. Some of these are a heavier lift than others, so it’s important to ensure you are really thoughtful to marry the content and desired outcome to the testing approach, to ensure you can glean as much actionable data as possible.
The language of love at Udemy is Data. As such, we're always looking for more, and consumer insights are a constant.
Research is conducted on an ongoing basis by our incredible User Research group. This includes longitudinal research where we would like to track progress over time such as for upper-funnel brand metrics like recall and awareness, as well as campaign specific research related to things like message testing and feature promotion.
We use a combination of survey tools like SurveyMonkey and Qualaroo, and host in-depth interviews 1x1 with prospective and existing customers via UserTesting.
We also leverage more complex survey methodologies, such as MaxDiffs and Conjoint Analyses. However, these can be costly in terms of time, resource, and funding, so are reserved for more long-term, strategic initiatives Typically an agency will support these, but for smaller-scale projects, they can be executed internally with Conjointly, a self-serve platform that builds and analyses the data
Insights are distilled and shared with the cross-functional team fairly regularly every month or two, regularly revisited, and built upon.
It truly does take a team to develop a strong pov on the market - a PMM can drive it, but you'll want other internal subject-matter experts to contribute.
I'd recommend first aligning w/your leadership team, and ask them to dedicate one person to help even if in a limited capacity (a few hours a week). Cross-functional teammates will provide essential guidence, enrich conversations, and distribute important info to different parts of the company in real time.
Secondarily, focus on what you're seeking to learn and the timeline. Try to organize sprints of ~2 months, and plan to do a refreshes ~6 months later. This should allow time to conduct experiments to evaluate anything you have learned, and identify new areas to investigate.