Question Page

Have you received user feedback regarding the AI features, and how are you incorporating it into product improvements?

Hiral Shah
Hiral Shah
DocuSign Director of Product ManagementMay 8

Getting user feedback is a very important element of building any AI feature. Without the user input, you cannot improve your AI, which means you cannot improve your product. Treat the AI feature similar to any product feature, you need to be nimble, agile and adaptable. There are a number of ways you can gather this feedback and depending on that you can incorporate it in many different ways

  • In feature feedback: Think about this as the thumbs up or down you do on your chatGPT or ask it to re-generate. This is one type of user input to feed back to the algorithms that the output produced was not satisfactory to the user. This is human in the loop

    • I have used this when I was building chatbots 7 years ago by providing 5 emojis at the end of generating a response to the question. The ones that are on lower satisfaction, we would go analyze each of the answers manually to see what went wrong.

  • Feature on/off: Lets say if you have an Opt-in / Opt-out feature, tracking the number of people option out can be a good way to know whether AI is working or not.

    • If customers are not signing up for the feature, there can be an awareness and onboarding problem. This can be fixed with some education material in the product as well as branding and messaging outside.

  • Qualitative feedback - This is sitting down with your customers and showing them the AI and gathering input. This method us true of any product feature, even more important in the AI feature

676 Views
Top Product Management Mentors
Sheila Hara
Sheila Hara
Barracuda Sr. Director, Product Management
Paresh Vakhariya
Paresh Vakhariya
Atlassian Director of Product Management (Confluence)
Farheen Noorie
Farheen Noorie
Grammarly Monetization Lead, Product
Natalia Baryshnikova
Natalia Baryshnikova
Atlassian Head of Product, Enterprise Strategy and Planning
Kellet Atkinson
Kellet Atkinson
Triple Whale 🐳 Director of Product Management
Nicolas Liatti
Nicolas Liatti
Adobe Senior Director of Product Management, 3D Category
Clara Lee
Clara Lee
PayPal VP, Product
Orit Golowinski
Orit Golowinski
Anima Chief Product Officer
Rupali Jain
Rupali Jain
Optimizely Chief Product Officer
Trisha Price
Trisha Price
Pendo Chief Product Officer