0:0050:25

Product Management for AI

Asma Syeda 50:25 2021

Her AI risk engine was scrapped mid-build over one data category

An AI risk engine built for a bank's relationship managers gets scrapped midway because the legal team rules out the member financial data it depends on. Asma Syeda, a senior product manager with more than 15 years in IT, uses lessons like this to argue that AI products break the habits of traditional product management. What must a PM add before an AI idea deserves a place on the roadmap?

Learn the skills, checks and data habits that keep AI products from stalling before adoption

Watch on YouTube

In short

Asma Syeda, a senior product manager, explains how traditional product management practices must change when the product is an AI model. She walks through the PM role and product lifecycle, then covers the extra skills AI PMs need: vetting whether a problem needs AI, data fluency, realistic expectation setting, explainability, ethics and planning for adoption.

“So AI PMs need to ensure that AI POCs must match the organization's reality. Say no when machine learning is not a good candidate.”
“People need to know why they were rejected for a loan or why a model made a certain decision.”

What you will learn

  • Assess whether a problem truly needs AI using the five whys, value stream mapping and ROI baselines from comparable applications.
  • Build enough AI fluency in model training, feature engineering and technique trade-offs to make product calls without coding.
  • Plan training data, labeling and the model's delivery format early so the model holds up in production.
  • Set realistic expectations with leadership on timelines, accuracy and ROI, and agree on acceptable risk before deployment.
  • Clear legal, ethical and ownership questions up front so an AI product is not scrapped or left unmaintained.

Key takeaways from the speaker

  • Grow the Women in Tech and AI community
  • Connect with WTN
  • Evolve my on stage persona

Details

Level
Intermediate
Format
Tech talk
Technical depth
Introductory technical
For
Mid-career, Senior individual contributor
Length
50:25
Published
June 2021

Questions this talk answers

How is AI product management different from traditional product management?

AI products are heavily data driven and less UX focused, so AI PMs need data and AI fluency, use case familiarity and strong cross-functional buy-in. They must also prepare for a constant loop of iteration instead of shipping features every sprint.

How should a product manager decide whether a problem needs AI?

Ask the five whys, make sure proofs of concept match the organization's reality and say no when machine learning is not a good candidate. Use value stream mapping and the results of comparable AI applications as a baseline for ROI.

How technical does an AI product manager need to be?

They do not need to code or be data scientists, but they need a conceptual understanding of how models are trained, how feature engineering works, which AI techniques suit which data, and the AI project lifecycle.

Why do AI models fail when they reach production?

Models trained on general web data or data unlike the production environment perform differently on real data. Training data should be captured in the same conditions as production, and labeled data needs strong quality and privacy checks.

How can a PM drive adoption of an AI product?

Build explainability into model predictions so users trust the decisions, since team members otherwise fall back on their own gut sense. Then evangelize carefully and design for reuse through APIs and microservices.

About this talk

"The Future is Technology "and its not Complicated . The World is undergoing a revolution once again and technology is key driver of advancement in all industry areas , We have a whole new way of doing things now . Words and phrases like Digitization, transformation , startups, Artificial Intelligence , Machine learning , API's etc have become the most common words appearing on every content . As it seems pretty overwhelming new skills and frameworks like Agile, Scrum and product management have become a needed area of expertise to reimagine how we build on ideas to solve real problems looking through the lens of a customer . The big question .. Can product management be a good framework to build AI products with the challenge that they are not heavily UX focused . What specific approaches and skills do Product managers need to get their AI ideas to works and drive adoption

Topics

Related talks

Browse the library

AI Product Management

Eva Agapaki Founder and CEO, Hatch Labs

Dazzling AI still fails: what Watson, Anki and a laundry robot got wrong

Intermediate Product and design 2024