0:0021:43

Impact of AI on Society

Jyotika Singh 21:43 2022

Round-trip 'she's a doctor' through Hungarian and AI makes her the nurse

Type 'she's a doctor, he's a nurse' into Google Translate, send it to Hungarian and back, and the roles swap. Models trained on historical data quietly carry old assumptions into tools people use every day, from photo tagging to resume screening. Jyotika Singh, Director of Data Science at Placemakr and an inventor of machine learning patents, traces where that bias enters and what it would take to break the cycle.

See where bias slips into AI models and the practical steps that reduce it

Watch on YouTube

In short

Jyotika Singh, Director of Data Science at Placemakr, explains how AI already shapes everyday products and how historical, societal and cognitive biases get into the models behind them. Using examples from Google Translate, Amazon's resume screening and text-to-image systems, she argues that diverse teams, careful testing and ongoing monitoring for data drift are needed to break the cycle of biased data.

“We often hear the argument that computers are impartial, but unfortunately, that may not be the case.”
“So overcoming bias is important and AI models can only be as good as the person behind it and the data behind it.”

What you will learn

  • Recognize the everyday products, from email autocomplete to shopping recommendations, that run on AI behind the scenes.
  • Explain how models learn from historical data and the difference between supervised and unsupervised models.
  • Identify where bias enters an AI system: data sampling, feature engineering, the people building it and the applications that feed data back.
  • Apply practical bias-reduction habits such as building diverse teams, testing models on varied inputs and monitoring for data drift.
  • Question the assumption that computers are impartial when using or building AI products.

Key takeaways from the speaker

  • Impact of AI on everyday lives
  • Influence of past bias in AI models
  • Overcoming bias

Details

Level
Beginner
Format
Talk
Technical depth
Introductory technical
For
All career stages
Length
21:43
Published
July 2022

Questions this talk answers

Where do people interact with AI in everyday life?

In autocorrect, Gmail sentence completion and spam filtering, photo tagging, Google Translate, robotic vacuums, chatbots and product recommendations. Brands also use AI to classify product reviews by topic such as fit.

How does bias get into AI models?

Through historical, societal, gender, racial and cultural patterns in the training data, through unrepresentative data samples, and through the cognitive biases of the people who engineer features and build the models.

Why does AI bias tend to reinforce itself?

Biased models shape what people see and do, which produces new data that strengthens the original patterns, so each model update repeats the cycle.

What are real examples of biased AI?

The speaker cites Google Translate swapping gendered roles, a portrait app that could not render people of color well, Amazon's resume screener penalizing the word 'women's', and Zoom cropping out a Black person's face.

How can teams reduce bias in AI?

Build diverse data science teams, understand the underlying data and what is missing from it, test models with many types of input, and monitor models over time for data drift.

About this talk

Today, Artificial Intelligence technologies are at the forefront across the globe and across industries. Each of us interact with a product or service powered by AI on a daily basis. AI and Machine Learning have provided us with a range of useful and efficient products in the last decade. However, there is a bias created alongside that has been carried forward in forms not directly visible to consumers of such technologies. Historical, societal, gender, racial, and cultural biases have made their way into models we consume each day impacting our everyday decisions. A note on overcoming such biases for the future generations of researchers, practitioners, and consumers will help the world move towards a much-needed equilibrium.

Topics

Related talks

Browse the library