0:0018:39

Not Another AI talk - A PM's practical tips to building AI Products

Navdeep Martin 18:39 2022

Your next AI product might not need machine learning at all

An engineering team spends four months building functionality on deadline, and at the last minute nobody can explain it to users. Navdeep Martin, VP of Product Management at Blackbird.AI, who led personalization at The Washington Post, has watched AI products stall on poor design, feuding teams and runaway infrastructure costs. For product managers shipping machine learning, the question is which habits separate a working AI product from an expensive experiment.

Get six field-tested tips for designing, prototyping, staffing and costing AI products

Watch on YouTube

In short

Navdeep Martin, VP of Product Management at Blackbird.AI, shares six practical tips for product managers building AI products, drawn from her work at The Washington Post, Comcast and AI startups. She argues that design, parallel prototyping, team trust, honest cost estimates and hands-on data tagging matter as much as the models, and that teams should first ask whether a problem needs machine learning at all. She closes by encouraging women in AI to ask their questions out loud.

“My point here is take a look at the problems you're trying to solve and determine the fast and most effective solution. You might not even need machine learning.”
“It doesn't matter how good your machine learning models are if no one wants to use your product.”

What you will learn

  • Run an ugly machine learning prototype and a design prototype in parallel, then validate both in back-to-back user interviews.
  • Judge whether a problem truly needs machine learning or whether regular expressions, rule-based logic or open source datasets will do.
  • Estimate model, storage and GPU costs on the back of an envelope before committing to costly infrastructure.
  • Build respect and trust across product, data science, design and front-end engineering from the start of a project.
  • Tag data yourself to uncover edge cases and make product decisions such as renaming or retraining a classifier.

Key takeaways from the speaker

  • Helping women find creative solutions to building a well-functioning product.
  • Discovering a new field of technology they may be excited to dive into.
  • Sharing best practices on tagging data, prototyping and productionizing the AI work coming out of your AI team.
  • What the future looks like for women in AI.

Details

Level
Intermediate
Format
Talk
Technical depth
Introductory technical
For
Early career, Mid-career, Senior individual contributor
Length
18:39
Published
July 2022

Questions this talk answers

How should a product manager prototype an AI product?

Have the machine learning team deploy an ugly prototype with no design effort while the designer builds wireframes in parallel. Then show both in back-to-back user interviews, updating the design between sessions.

When should a team use machine learning at all?

Navdeep Martin advises looking for the fastest, most effective solution first, since regular expressions, simple if-then rules, open source datasets or published papers often solve the problem. Engineers can then focus machine learning on the hard problems.

Why should product managers tag data themselves?

Classifier results always contain edge cases that are not clear from the start, and tagging data helps the PM understand them. That knowledge supports product decisions, such as renaming an elections classifier to elections and voting.

How do you keep AI product costs under control?

Do back-of-the-envelope cost estimates before going too far, to make sure customer demand will justify the cost of models, data storage, transfer and GPUs.

What advice does she give women advancing in AI careers?

Begin asking your questions, even in large settings. Tech keeps evolving, you gain more by pushing the conversation, and someone else in the room usually has the same question.

About this talk

Building AI-products requires a completely different process and mindset. There are creative solutions to building a well-functioning product. In this session, I'll run through examples of AI in different products. Then we'll go through tricks of the trade including best practices on tagging data, prototyping and productionizing the AI work coming out of your AI team.

Topics

Related talks

Browse the library