0:0025:05

Media Workflows Leveraging Cloud

Anvita Jain 25:05 2022

Before cloud pipelines, film footage travelled between countries by hand

Footage shot in a Mexican jungle may need an editor in Toronto, sound and VFX artists in India and a creative team in Los Angeles, and it once travelled as physical tapes carried between places. Netflix senior software engineer Anvita Jain works on the post-production pipelines that replaced that hand-off. The question is how a single platform keeps terabytes of media moving through jobs that run for seconds or for years.

See how Netflix builds media pipelines as state machines on its open source Conductor

Watch on YouTube

In short

Anvita Jain, Senior Software Engineer at Netflix, walks through how footage travels from a film set to a streamable title by way of automated, cloud-based post-production pipelines. She explains the stages of a media workflow, the microservices and "pipeline as a platform" layer behind them, and how Netflix models each pipeline as a state machine running on its open source Conductor orchestrator.

“A media workflow is a representation of a media exchange between different teams.”
“So every pipeline is in a manner, a state machine running on top of a process orchestrator and has certain resources that are being managed on it.”

What you will learn

  • Map the post-production stages a title passes through, from on-set ingest to editorial, VFX, sound, picture finishing, localization and archival.
  • Design long-running workflows as state machines with explicit states such as draft, in progress, failed and redeliver.
  • Apply a pipeline-as-a-platform approach so teams can run pipelines without managing scale, scheduling or cloud resources.
  • Use an orchestrator such as Conductor to handle retries, back-off policies, priorities, queuing and asynchronous tasks.
  • Explain why streaming services generate multiple encodes so quality fits each device and connection.

Key takeaways from the speaker

  • Cloud Technologies
  • Application of Cloud
  • Everything as a Service
  • Media Workflows
  • Pipelines

Details

Level
Intermediate
Format
Tech talk
Technical depth
Practitioner
For
Mid-career, Senior individual contributor
Length
25:05
Published
July 2022

Questions this talk answers

What is a media workflow?

It is a representation of a media exchange between different teams, such as editors, VFX artists, sound artists and picture finishing facilities working on the same title.

How do production partners get footage into Netflix's systems?

Technically equipped vendors connect through an external API, while others use a UI tool called Content Hub to import different types of media.

How does Netflix model its media pipelines?

Each pipeline is a state machine on a process orchestrator, moving through states such as draft, in progress, failed or redeliver, while a resource manager tracks the files and assets attached to it.

What does the Conductor orchestrator take care of?

Conductor, Netflix's open source orchestrator, provides workflow, task, decider and queuing services that handle scheduling, retries, back-off and priorities, with workflows defined as JSON blueprints and visible in a UI.

Why does Netflix video quality vary by device?

Netflix generates several encodes for different kinds of devices, so a small phone on a low-bandwidth connection does not receive the encode meant for a 4K TV.

About this talk

This talk is about how Digital Assets are handled from when a show idea is pitched to a video from a shooting location to making it streamable media on Netflix app by leveraging cloud. Often we enjoy our favorite show on Netflix but wonder how did it all come together. Get a sneak peak of what happens to each and every shot, how the VFX are reviewed and finalized, how it is processed to be of highest quality on different devices, etc. How we automated each and every post production process in cloud and scaled for the amount of shows and movies produced by Netflix every year!

Topics

Related talks

Browse the library