Avin Regmi

Engineering Manager, ML Spotify

Avin is an Engineering Manager at Spotify, leading the ML training and compute team for the Hendrix ML Platform. His areas of expertise include training and serving ML models at scale, ML infrastructure, and growing high-performing teams. The Hendrix ML Platform is now integral to Spotify's core functions, such as search, ranking, and recommendations. Prior to joining Spotify, Avin led the ML Platform team at Bell. In this role, he focused on distributed training and serving LLMs. Additionally, Avin is the founder of Panini AI, which is a cloud solution that serves ML models at low latency using adaptive distributed batching. Outside of work, Avin practices yoga and meditation and enjoys high-altitude alpine climbing and hiking.

Generative AI Week 2024 Day Three: Wednesday, 9 October

11:35 AM Efficient and Cost-Effective Compute Strategies for Generative AI: Strategies for Business Leaders

Optimizing compute in generative AI is paramount. As businesses increasingly rely on AI technologies for innovation and growth, optimizing compute resources becomes crucial not only for financial

sustainability but also for environmental responsibility.

• Distributing computing efforts strategically to maximize resource utilization and minimize wastage.

• Investing in Spotify’s Hendrix ML Platform, which streamlines AI training and serving processes for models with over 70 billion parameters.

• Collaborating with cloud service providers to access specialized hardware for efficient model training.

Check out the incredible speaker line-up to see who will be joining Avin.

Download The Latest Agenda