0:0019:23

AI Needs Black Feminism: Principles and Questions to Guide AI Development and Policy

Serena Oduro 19:23 2021

AI trained on a history of redlining can multiply racism at scale

The neighborhoods redlined on a 1930s map of Oakland still echo in the data that AI uses to make decisions about finance and policing. Serena Oduro, Technology Equity Fellow at the Greenlining Institute, argues that statistical fairness fixes cannot undo that history on their own. So which questions should anyone building, buying or regulating AI ask before calling a system good for everyone?

Learn the Black feminist questions that test who an AI system really serves

Watch on YouTube

In short

Serena Oduro, Technology Equity Fellow at the Greenlining Institute, argues that AI trained on historical data inherits a history of racism, from redlining onward, and can multiply it at scale. She contends that statistical fairness fixes and intent-based anti-discrimination law are not enough, and offers Black feminism, with questions from her poetic guide, as a framework for building and regulating AI that serves those most often harmed.

“It's not just a mathematical problem. It's a problem of justice.”
“Liberation needs to lead for technology to actually be useful or else it'll just become another tool for oppression, as we've seen in other cases of algorithmic bias.”

What you will learn

  • Explain how historical data shaped by practices like redlining leads AI to reproduce and amplify racism.
  • Recognize real cases of algorithmic oppression in hiring, healthcare and public services.
  • Distinguish statistical fairness fixes from justice-oriented approaches to AI and AI policy.
  • Apply Black feminist questions to test whether an AI product or policy improves well-being for Black women and other marginalized groups.
  • Challenge claims that a technology is beneficial for everyone by asking who everyone really includes.

Key takeaways from the speaker

  • Examples of Algorithmic Oppression
  • An understanding of Black Feminism
  • How Black Feminism provides a great theoretical framework for equitable and liberating technology and technology policy
  • 5 questions I present from my poetic guide that the audience can use to implement in any field of work/study they are in.

Details

Level
Beginner
Format
Talk
Technical depth
Introductory technical
For
All career stages
Length
19:23
Published
June 2021

Questions this talk answers

Why is AI trained on historical data not race neutral?

An algorithm finds patterns in past data and uses them to predict the future, and that data carries a history of racism such as redlining. As a result, AI can see patterns of racism and exacerbate them on a massive scale.

Why is statistical fairness not enough to fix algorithmic bias?

Oduro notes incompatibilities between legal and machine learning fairness approaches, and argues bias is a social problem. It is a question of what fairness means in a history of racism, not just a mathematical one.

Why does US anti-discrimination law struggle with AI?

US anti-discrimination law focuses on the intent of a human, while discrimination in AI is not really about intention, so the legal tools do not match how harm arises.

What does Black feminism add to AI development and policy?

Black feminism centers the combined oppression of race, gender and class that Black women face. Oduro argues it demands more liberatory outcomes and higher standards of justice than fairness that is not race aware.

How can I apply these ideas in my own work?

Ask how a solution increases individual and communal well-being for Black women or any historically marginalized group, and when something is said to benefit everyone, ask who everyone actually is.

About this talk

“AI Needs Black Feminism: Principles and Questions to Guide AI Development and Policy” will introduce the audience to why Black Feminism provides the theoretical foundations to thwart algorithmic oppression. I will present my poetic guide forthcoming from Meatspace Press, “Do we need AI or do we need Black Feminisms? A Poetic Guide” that provides questions that can guide not only developers, academics, and policymakers interested in algorithmic equity, but all creating or influencing technology who want to ensure that their work is not furthering racial inequality.

Topics

Related talks

Browse the library