0:0030:04

MLOps and ModelOps - Why does it matter?

Priyanka Sharma 30:04 2022

A model built in three weeks can still take 11 months to deploy

There are fewer perfumers in the world than astronauts, yet Firmenich has a robot that composes fragrances on request, and building that kind of intelligent product takes far more than model code. Teams can build a model in weeks and still wait months to deploy it. Priyanka Sharma, an enterprise architect who began as a developer 17 years ago, asks what organizations must change so models, data and code reach production together.

Learn the three organizational changes that let MLOps, DataOps and DevOps work together

Watch on YouTube

In short

Priyanka Sharma, an enterprise architect at Firmenich, traces how waterfall and agile led to DevOps and distills the general idea of ops: break a life cycle into steps, assign tools to each step and automate the workflow. She argues that intelligent applications rest on three pillars (model, data and code), explains how MLOps and DataOps differ from DevOps, and outlines the team structure, tooling and KPI changes organizations need to get models into production.

“And what we all have observed now that no matter in what industry or what domain you belong to, being digitally successful can make or break your enterprise.”
“each ops is very very distinct discipline and they require different people and tools so don't push the people to do all the tasks together because the skill sets are very very different”

What you will learn

  • Explain how waterfall, agile and DevOps tooling led to the general concept of ops.
  • Apply the ops pattern to any domain: map its life cycle, assign a tool to each step and automate the workflow.
  • Distinguish MLOps from DevOps and DataOps in testing, monitoring, users served and skills required.
  • Compare product squad and centralized team structures for building intelligent applications.
  • Define model KPIs up front so teams stop tuning models indefinitely.

Key takeaways from the speaker

  • complete understanding of the model lifecycle
  • Understanding of Devops and how does regular devops differ from modelOps
  • ML model code is only a small part (~5–10%) of a successful ML system, and the objective should be to create value by placing sustainable ML models into production .

Details

Level
Intermediate
Format
Talk
Technical depth
Introductory technical
For
Mid-career, Senior individual contributor, People manager
Length
30:04
Published
July 2022

Questions this talk answers

What does ops mean beyond DevOps?

Ops means identifying the life cycle of a domain such as code, models, data or a business process, breaking it into small steps, assigning a tool to each step and letting the tools talk to each other so the workflow runs on autopilot.

How is MLOps different from DevOps?

Model training and testing differ from code building, models depend on data quality and accuracy requirements, and model monitoring tracks model and data quality rather than CPU and latency. MLOps also serves data scientists, who need self-service tools rather than complex developer tooling.

Are MLOps and DataOps the same thing?

They go together but are distinct disciplines: DataOps relies on pipelines, Spark clusters, SQL, ETL tools and database administration, while ModelOps needs data engineering and data scientist profiles.

How should an organization structure teams for intelligent applications?

A product squad puts a data scientist, data engineer and software engineer together for fast iteration but risks losing expertise, while a centralized core team model iterates more slowly but centralizes skills, governance and best practices. She also recommends separate infrastructure teams for app, ML and data services.

Why do models take so long to reach production?

Because organizations need structural changes to onboard ops: the right team structure, the right tools for collaboration, discoverability, security and self-service (buying rather than building where possible), and clear ownership with defined KPIs.

About this talk

It took a while for the IT industry to realize that Development and deployment goes hand in hand and There could be no successful project without Devops. We should take this learning and adopt MLOPs as a basic element for any AI/ML project. My talk will consist of with 1: The explaination of development process and introducing devops , and importance of devops 2: Understanding what are the curent trends and best practises in devops. 3: explaining how the development of AI /ML models differs from traditional application develoment 4: How to adopt devops in machine learning annd introducing modelops 5: What is models ops 6: lifecycle of preditive models 7: Best practises Pre and Post model deployment 8: How modelops cover the model lifecycle

Topics

Related talks

Browse the library