0:0020:20

Demystifying Artificial Intelligence

Marjory Da Costa Abreu 20:20 2021

Default AI settings can hide bias behind high accuracy scores

A face classifier can report high accuracy while the images it gets wrong belong to people of Asian background or Black people, simply because nobody tuned it beyond its default settings. Anyone uploading data to an off-the-shelf AI tool risks shipping that. Marjory Da Costa Abreu, who has spent around 20 years researching artificial intelligence, asks what it really takes to use these black boxes responsibly.

Learn five practical rules for using off-the-shelf machine learning without reinforcing bias

Watch on YouTube

In short

Marjory Da Costa Abreu, a Senior Lecturer at Sheffield Hallam University, argues that the push-button popularity of machine learning tools hides a serious risk: people use black-box models with default settings they do not understand. She shows how untuned models can report high accuracy while their errors fall on specific groups, and closes with practical rules for understanding data, techniques and parameter tuning.

“But worst of all, when you don't change and you don't refine the parameters, you can create solutions that look fine.”
“So each technique is dedicated. It should be fine tuned to the data set to the problem that is trying to solve.”

What you will learn

  • Distinguish artificial intelligence, machine learning and deep learning as nested concepts rather than competing ones.
  • Spot how default settings in off-the-shelf tools can produce models that look accurate but do not really classify.
  • Check which groups a model's errors fall on, not only its overall accuracy, to catch reinforced bias.
  • Apply five rules before using machine learning: understand your data, understand the technique, change the defaults, be creative and treat black boxes with care.
  • Challenge the belief that AI is a panacea that will solve every problem or replace people.

Key takeaways from the speaker

  • gender equality
  • artificial intelligence
  • bias in data
  • fine tuning

Details

Level
Beginner
Format
Talk
Technical depth
Introductory technical
For
Student, Early career, Mid-career
Length
20:20
Published
June 2021

Questions this talk answers

What is the difference between AI, machine learning and deep learning?

Deep learning is a set of techniques inside machine learning, and machine learning is a subset of techniques within artificial intelligence. They are nested, not separate things.

Why are default settings in off-the-shelf machine learning tools risky?

Defaults are not optimized for your data or problem. Using them can lock a model in a local optimum, reinforce bias and produce results that look good without really classifying anything.

How can a model with high accuracy still be biased?

In a gender-from-faces example, most images may be classified correctly while the misclassified ones belong to people of Asian background or Black people, so the model reinforces bias despite its accuracy rate.

Will AI replace people in the workplace?

The speaker argues it will not: well-tuned solutions are built to do specific tasks really well, not to become or replace human beings.

What should you do before using a machine learning model?

Understand your data first, understand the overall workings of the technique, change the default settings through fine tuning, be creative, and use black boxes only with careful analysis.

About this talk

The understanding that the widespread use of technology by the citizen will always benefit of the wider society is conditioned by this use and dependent on it. Countless of the most basic and fundamental public and private activities, nowadays, necessarily pass through access to tangible and intangible computational innovations. However, there has been an increase in social inequalities which can be linked to limited access to educational opportunities, public health inefficiency, institutionalised violence (gender, race, for instance), irrationality in the exploitation of natural resources, corruption, lack of transparency and abuse of power and so on which can inadvertently powered by the popularisation of Social Media platforms. On top of all of this, the use of artificial intelligence has become the panacea that will solve all the issues of the world. At a first glance, it might look like a good and fair solution, but the indiscriminate use of black boxes (Python scikit learn/Tensorflow, Weka, MATLAB ML toolbox, Google AI, etc) without the AI models understating and the human bias in data can make this use a powerful enforcement of the current inequalities. Thus, this talk with discuss the social related issues of using AI without understanding it.

Topics

Related talks

Browse the library