Sharebird
Virgilia Kaur Pruthi (she/her)

AMA: Microsoft Principal Product Manager, Virgilia Kaur Pruthi on Product Management KPIs


February 1, 2022 @ 10:00AM PT

View AMA Answers

  1. How would you change a product team/organization to be more KPI driven?

    Virgilia Kaur Pruthi (she/her)

    Expedia Group Senior Director of Product, Head of Trust and Safety | Formerly Amazon • 4y

    What a terrific question! This is one takes time and depending upon your organization will require patience. The best way I have learned, is to ask "why" a particular feature is being prioritized, and the "impact" it is bringing to the customer. The best way to create change is to start with your own product team (even if that consists of you as the PM, engineering, and UX/UI). For every epic/story, make sure to note down the KPI that it will impact, and why that is important to your target (end ...Read More

    1,181 Views
    2 requests
  2. What are some of the *worst* KPIs for Product Managers to commit to achieving?

    Virgilia Kaur Pruthi (she/her)

    Expedia Group Senior Director of Product, Head of Trust and Safety | Formerly Amazon • 4y

    This could really range based upon the company, your users, your target goals, where you are in your business lifecyle, etc.

    The most basic ones are: acquisition, activation, retention, revenue, referral

    You could also be measuring customer lifetime value

    In regards to the worst KPIs, honestly those that cannot be discretely measured and tracked over a specific time period. Vanity metrics (e.g. the number of views from a marketing article or number of shares of a post) really add no value.

    1,650 Views
    1 request
  3. What is an important KPI that you see product teams completely missing?

    Virgilia Kaur Pruthi (she/her)

    Expedia Group Senior Director of Product, Head of Trust and Safety | Formerly Amazon • 4y

    Interestingly enough I see two trends in the types of KPIs product teams miss.  1) Aligning with the larger's organization or business goals - Ensuring that your product roadmap is actually impacting the success metrics (OKRs, KPIs) of the business itself is critical to knowing if you are investing in and prioritizing the right work. 2) Capturing "technical or engineering" metrics - Any work that your team spends time on should be impacting some metric. Even metrics that are technical (the most ...Read More

    1,580 Views
    5 requests
  4. How do you define and set SLAs with engineers?

    I'm currently struggling to define checkout error rates for our e-commerce platform. We're currently at 1.5%. Personally, I think it's too high. However, I have nothing to substantiate my opinion.

    Virgilia Kaur Pruthi (she/her)

    Expedia Group Senior Director of Product, Head of Trust and Safety | Formerly Amazon • 4y

    I would recommend first building a relationship with your technical lead/engineering counterpart. Have them show you how your e-commerce platform (or product area) works end to end, from the backend perspective. Make sure that you first understand the end to end flow and specifically the systems design (which is critical in any e-comm platform). Once you understand how the customer's journey equates to the systems design, then start looking into each customer interaction with the site and make s ...Read More

    1,057 Views
    2 requests
  5. What are good OKRs for product management?

    Virgilia Kaur Pruthi (she/her)

    Expedia Group Senior Director of Product, Head of Trust and Safety | Formerly Amazon • 4y

    This could really range based upon the company, your users, your target goals, where you are in your business lifecyle, etc.

    The most basic ones are: acquisition, activation, retention, revenue, referral

    You could also be measuring customer lifetime value. 

    Again this will really depend upon what type of business you are in.

    1,568 Views
    2 requests
  6. I’m the first PM hire in my company. What advice would you give to someone tasked with establishing this function in an existing business structure?

    Virgilia Kaur Pruthi (she/her)

    Expedia Group Senior Director of Product, Head of Trust and Safety | Formerly Amazon • 4y

    Wonderful, congrats! Get into a rhythm by understanding the business/company goals. Then understand how the tech works (look at the customer/user interface first and then make sure you understand how the system behind the UI works). Begin collecting data in a transparent way and share your learnings with your stakeholders and leadership. Conduct user research (both qualitative and quantitative) to help illustrate what product areas (epics/themes) you want to focus on and how these connect back t ...Read More

    1,518 Views
    1 request
  7. Setting KPIs can often feel arbitrary, especially when entering new markets. How do you get past this uncertainty to set realistic goals?

    Virgilia Kaur Pruthi (she/her)

    Expedia Group Senior Director of Product, Head of Trust and Safety | Formerly Amazon • 4y

    Such a great question! When you first set a KPI especially if you are in a new market and/or in a new product/customer space, it can feel uneasy. The best way I have learned is by setting something and tracking it over time, seeing if there is any measurable change. If not start by marking out the customer's journey (no matter who they are) and see if you can collect data on their interactions along the way. This may reveal some hidden trends you weren't yet measuring.

    955 Views
    1 request
  8. While working on large and complex projects, how to effectively manage between speed of delivery vs managing and aligning a large number of stakeholders?

    Virgilia Kaur Pruthi (she/her)

    Expedia Group Senior Director of Product, Head of Trust and Safety | Formerly Amazon • 4y

    Creating the right mechanisms to manage your stakeholders is critical to managing up and across. Allowing your stakeholders to stay on the pulse of your product while having access to updates really helps in building trust. Creating mechanisms like brownbag/learning sessions on a frequent basis (weekly or biweekly basis) also helps in creating an open forum. Then you can focus on protecting your engineering/design team and enabling yourself to scale.

    1,341 Views
    1 request
  9. How should product split feature adoption KPIs with the product marketing team?

    Virgilia Kaur Pruthi (she/her)

    Expedia Group Senior Director of Product, Head of Trust and Safety | Formerly Amazon • 4y

    It really depends on what type of business it is. For instance, a product feature or product should be so frictionless that it allows users to onboard (adopt) easily once they are in the experience. Product marketing is responsible for bringing users to that experience. So it is almost eyeballs vs. activation. In reality these metrics should be shared, and over time broken up where the tech is meant to solve for the customer's need.

    1,050 Views
    1 request
  10. How do product KPI’s change with a self-serve product?

    Virgilia Kaur Pruthi (she/her)

    Expedia Group Senior Director of Product, Head of Trust and Safety | Formerly Amazon • 4y

    I'd love to learn more about what you mean by this. In reality they shouldn't change, your customers would just be internal that's all. You could still measure activation, activation, retention, engagement, resolution time, etc. On the other hand, you could measure self help vs. those who still asked for support or metrics lik elatency.

    1,423 Views
    1 request
  11. How do you break down responsibilities and KPIs for product launches between product management and product marketing?

    Virgilia Kaur Pruthi (she/her)

    Expedia Group Senior Director of Product, Head of Trust and Safety | Formerly Amazon • 4y

    If you are lucky enough to have a PMM partner, then I would create a very transparent RACI chart which showcases who is: R - responsible A - accountable C - consulted I - informed  about the various pieces of work. In my experience, depending upon the size of the team/company roles and responsibilies realy vary between product and PMM when it comes to product launches. Here is just one example of what could work: Product Management - Responsible for managing launch ready engineering and design w ...Read More

    1,269 Views
    2 requests
  12. What's your process for figuring out what metrics to hold product management accountable for?

    Virgilia Kaur Pruthi (she/her)

    Expedia Group Senior Director of Product, Head of Trust and Safety | Formerly Amazon • 4y

    This is a hard one as I am sure there are a ton of layers to unpack here. Whenever there is a question around metrics, I would first look to the customer and understand what customer pain points your product area is solving for. Then see how those needs and your business goals align, and how your specific area can help solve for that. If it is a matter of stakeholder management that is a different story, but engineering, product and design should really have shared KPIs.

    1,168 Views
    1 request
  13. How do you think about shared KPI’s with your engineering team? And what are ones that product teams often miss?

    Virgilia Kaur Pruthi (she/her)

    Expedia Group Senior Director of Product, Head of Trust and Safety | Formerly Amazon • 4y

    Product teams in my opinion consist of product, engineering, and design (at a minimum). With that said, product KPIs should always be shared with engineering since what they are building essentially impacts the KPIs of the product in question. All the work that product teams do should always build up back to the overall company/business unit objectives (even if those metrics are more technical).

    1,088 Views
    1 request
  14. I'm working at a start-up, and a first PM hire; what KPIs should I own and not own?

    Virgilia Kaur Pruthi (she/her)

    Expedia Group Senior Director of Product, Head of Trust and Safety | Formerly Amazon • 4y

    Don't think of it of what you should and should not own. Think about what makes sense to the customers you are focusing on. Then think about where you are in the customer/product lifecycle and product/market fit. What does the overall business care about at this time (e.g. retention vs. acquisition) and start seeing how your product area could contribute back to that overall goal.

    988 Views
    1 request