0:0023:08

Does Artificial Intelligence (AI) Support Diversity, Equity and Inclusion?

Patrice Caire 23:08 2022

A friend aged 60 never saw the job ad, and that was by design

A job ad sits on one screen and is invisible on another, because the platform shows it only to users aged 18 to 54. Biased data and design choices like this decide who sees jobs, what search returns for CEO and how much credit a wife gets. Patrice Caire, a computer scientist and consulting scientist at Stanford University's Robotics Lab, asks what it would take for AI to support diversity instead of reinforcing inequality.

See where AI bias comes from and the steps users, companies and governments can take against it

Watch on YouTube

In short

Computer scientist Patrice Caire argues that AI systems often reinforce society's inequalities because they are trained on biased, incomplete or outdated data and built by teams that do not reflect society. Using everyday cases such as age-targeted job ads, mislabeled images, CEO image search and Apple Card credit limits, she shows where bias enters and calls for transparency, diverse teams, user vigilance and AI standards and regulation.

“So we can see that it is in the interactions between AI systems and humans that often the ethical issues are taking place.”
“So the bigger the data set, and also the more diverse the data set, the more refined will be the training model, and the more precise will be the output.”

What you will learn

  • Explain how training data size, diversity and labeling quality shape what an AI system outputs.
  • Spot everyday cases where AI reinforces bias, from ad targeting and image search to credit decisions and translation.
  • Distinguish the statistical and computational biases that toolkits address from the human and systemic biases they miss.
  • Report and challenge AI outcomes that feel discriminatory instead of letting them go.
  • Advocate for transparent data sets, gender-balanced AI teams, multi-stakeholder testing and enforceable AI standards.

Key takeaways from the speaker

  • Understand that today, AI impacts almost everyone, but that the negative impacts are particularly affecting women and minorities.
  • Learn why scientific experts are urging governments and companies to take action and develop AI standards and regulations.
  • See how critical it is for all citizens be aware of AI biases and learn how to identify them.
  • Grasp the significance of the input data used to train AI models.
  • Realize that to prepare the future, women and minorities should become full participants in the design and development of the AI technologies that shape our world.

Details

Level
Beginner
Format
Talk
Technical depth
Introductory technical
For
All career stages
Length
23:08
Published
July 2022

Questions this talk answers

Why do AI systems end up biased against women and minorities?

They learn from training data that may be incomplete, wrongly labeled or outdated, and are built by teams in which women make up only about 23% of tech workers, as the speaker cited. What is missing from the data, like the zebra in her example, cannot be recognized correctly.

Do companies' quick fixes solve AI bias?

Often not: Google removed the gorilla label instead of fixing the problem, and University of Washington researchers found that a slight change to a CEO search term brought back outdated results with no women or people of color.

What part of AI bias are current fairness toolkits missing?

Citing a NIST report, Caire explains that toolkits address only the tip of the iceberg, statistical and computational bias, while human and systemic biases below the surface remain unaddressed.

What can individuals do about biased AI?

Stay on the lookout, report ethical issues, talk to each other and speak out when something feels discriminatory, while demanding transparency from companies about their data sets and automated decisions.

How can AI be regulated when legal frameworks are unclear?

Follow what governments and bodies such as the IEEE are publishing, join petitions and discussions, and press governments to set and enforce AI standards and ways to audit algorithms.

About this talk

Today, Artificial Intelligence (AI) is deployed everywhere—from smartphones to search engines—raising ethical questions particularly concerning women and minorities. However, governments and companies have been slow to address AI biases and discriminations. In this talk, I focus on the question whether AI supports diversity, equity, and inclusion. Using daily life use cases and examples, I illustrate the significance of the input data while training models. Then I stress the importance to recognize, understand and remove biases in this input. All along, I present recommendations like establishing AI standards and regulations in order to fill the legal void in which companies operate and including diverse demographics that reflect the composition of our society, to design, develop and test current and future AI technologies.

Topics

Related talks

Browse the library