Amanda
Moran
Senior Engineering Manager at NVIDIA
"Behind the Model: The Infrastructure Powering the Magic"
"Behind the Model: The Infrastructure Powering the Magic"
Don’t miss out and join visionaries, innovators, and thought leaders from all over the world at the Women in Tech Global Conference.
Vote by Sharing
Unite 100 000 Women in Tech to Drive Change with Purpose and Impact.
Do you want to see this session? Help increase the sharing count and the session visibility. Sessions with +10 votes will be available to career ticket holders.
Please note that it might take some time until your share & vote is reflected.
Session: Behind the Model: The Infrastructure Powering the Magic
This will be a deep dive session about how the models you know and love are architected and hosted. Typically, we look at this process from the researcher's perspective, today you will learn from the lens of the people who manage the infrastructure. Through this session, you will discover how the hardware that enables model development is configured and managed at scale. Learn about inference, large scale training and tuning in multiple cloud environments.Key Takeaways
- Why GPUs are Important
- How models are hosted -- why infrastructure matters
- How inference works at the infrastructure level
Bio
Amanda has been working in technology since graduating from Santa Clara University in 2012 with a Master’s in Science in Computer Science. Prior to this she had graduated with an BS in Biology from the University of Washington. Amanda has worked over the last 14 years as a Software Engineer, a Solutions Architect, and now a Senior Engineering Manager at NVIDIA. At NVIDIA she manages a diverse team, who are all primarily focused on supporting their AI research community. Amanda has spoken at numerous conferences — providing technical talks as well as technical trainings. Amanda is a technologist, a Disney Adult, a vegetarian foodie, a Corgi Dog Mom, and an exercise lover.