How do you handle scenarios where the AI may not perform as expected?
2 Answers
Atlassian Head of Product, Enterprise Strategy and Planning • 5mo
This question is pretty much the reason why evals exist. "As expected" is a very subjective and blurry construct, so we need to get it out of our heads and "share it" wit...
963 Views
Atlassian Director | Senior Principal PM, Teamwork Collection • 4mo
Unexpected AI behaviour should be treated it as a quality and risk problem than a traditional bug. It would be good to get a better understanding of any patterns in the f...
1638 Views
Related Questions
Have you ever invalidated an AI idea purely based on data constraints? What was your process?What’s the biggest mistake you’ve seen PMs make when shipping an AI feature?What’s the most underrated skill PMs need when working in AI-heavy environments?How are we thinking about liability and accountability when our AI agents make autonomous decisions?Have you encountered any challenges in terms of user understanding or acceptance of AI?What strategies are you using for testing and validating the AI components of your product?