Question Page

Have you received user feedback regarding the AI features, and how are you incorporating it into product improvements?

Hiral Shah
DocuSign Director of Product ManagementMay 8

Getting user feedback is a very important element of building any AI feature. Without the user input, you cannot improve your AI, which means you cannot improve your product. Treat the AI feature similar to any product feature, you need to be nimble, agile and adaptable. There are a number of ways you can gather this feedback and depending on that you can incorporate it in many different ways

  • In feature feedback: Think about this as the thumbs up or down you do on your chatGPT or ask it to re-generate. This is one type of user input to feed back to the algorithms that the output produced was not satisfactory to the user. This is human in the loop

    • I have used this when I was building chatbots 7 years ago by providing 5 emojis at the end of generating a response to the question. The ones that are on lower satisfaction, we would go analyze each of the answers manually to see what went wrong.

  • Feature on/off: Lets say if you have an Opt-in / Opt-out feature, tracking the number of people option out can be a good way to know whether AI is working or not.

    • If customers are not signing up for the feature, there can be an awareness and onboarding problem. This can be fixed with some education material in the product as well as branding and messaging outside.

  • Qualitative feedback - This is sitting down with your customers and showing them the AI and gathering input. This method us true of any product feature, even more important in the AI feature

688 Views
Top Product Management Mentors
Tanguy Crusson
Tanguy Crusson
Atlassian Head of Product, Jira Product Discovery
Laurent Gibert
Laurent Gibert
Unity Director of Product Management
Farheen Noorie
Farheen Noorie
Grammarly Monetization Lead, Product
Deepak Mukunthu
Deepak Mukunthu
Salesforce Senior Director of Product, Generative AI Platform (Einstein GPT)
Mike Flouton
Mike Flouton
GitLab VP, Product
Tara Wellington
Tara Wellington
BILL Senior Director of Product Management
Paresh Vakhariya
Paresh Vakhariya
Atlassian Director of Product Management (Confluence)
JJ Miclat
JJ Miclat
Zendesk Director of Product Management
Reid Butler
Reid Butler
Cisco Director of Product Management
Aaron Bloom
Aaron Bloom
Bluevine Senior Director of Product Management