0:0018:43

The Journey of Data Science - How Did It Iterate the Way to AI

18:43 2023

Over 85% of siloed data science projects failed, and AI grew from the fix

Data science once ran in silos, and the speaker says over 85% of those projects failed at high cost and low profit. For anyone building a data or AI career, that history explains how today's AI took shape. A strategist with more than 20 years in analytics, data science and AI traces each stage, then asks what the journey teaches the people who will shape what comes next.

Learn the stages, AI waves and analytics levels behind today's AI, plus five career lessons

Watch on YouTube

In short

The speaker (not named in the session record), a data science and AI strategist with over 20 years of experience, traces how data science evolved into today's AI. She describes six foundational pillars, the move from siloed projects to modernization and automation, four AI waves and five levels of analytics maturity, then turns that history into five lessons for building a data science or AI career.

“The progress is not linear, it's zigzag, but it's reached upon a huge breakthrough.”
“When the machines become smarter, actually humans become also smarter.”

What you will learn

  • Name the six pillars behind any data science effort: business problem, algorithm, data, computing power, strategy and people.
  • Trace how methods moved from frequency counts and linear models to ensembles, neural networks and generative AI.
  • Place your organization on a five-level analytics maturity scale, from dashboards to decision intelligence.
  • Explain why siloed data science projects stalled and how reusable pipelines, centers of excellence and DevOps, DataOps and MLOps helped.
  • Apply five career lessons: build foundations, start small, collaborate, partner proactively and mentor others.

Details

Level
Beginner
Format
Talk
Technical depth
Introductory technical
For
Student, Early career, Mid-career
Length
18:43
Published
June 2023

Questions this talk answers

What stages has data science gone through on its way to AI?

The speaker describes laying theoretical foundations, a silo-based practice stage, AI emerging through modernization and reuse, automation through the Ops practices, and the current state of AI.

What are the four AI waves?

Rule-based systems where humans hard-code rules, then automated machine learning, then deep learning, and now reinforcement learning that puts humans in the loop to teach machines.

What are the five levels of analytics?

Dashboards show what happened, root cause analysis and A/B testing show why, model fitting predicts what will happen, simulation finds the best solution, and decision intelligence automates decisions.

Why did early data science projects struggle?

People, data processing, algorithms and analytics worked in silos, making projects slow, less efficient and costly, and the speaker says over 85% failed.

What should people building a data science or AI career learn from this history?

Lay a solid data and algorithm foundation, start with something easier, learn to collaborate humbly, partner proactively with others, and once successful coach and mentor others.

Topics

Related talks

Browse the library

The world of Python

Ayushi Gupta Student | Data product management intern, Bhilai Institute of Technology | KYCHub

Two lines of Python can do the work of 10 or 15 in other languages

Beginner Software engineering and cloud 2021