The Critical Role of Storage in Optimizing AI Training Workloads

Logo
Presented by

Ugur Kaynar, Dell Technologies; Jayanthi Ramakalanjiyam, Celestica

About this talk

This presentation examines the critical role of storage solutions in optimizing AI workloads, with a primary focus on storage-intensive AI training workloads. We will highlight how AI models interact with storage systems during training, focusing on data loading and checkpointing mechanisms. We will explore how AI frameworks like PyTorch utilize different storage connectors to access various storage solutions. Finally, the presentation will delve into the use of file-based storage and object storage in the context of AI training: Attendees will: - Gain a clear understanding of the critical role of storage in AI model training workloads - Understand how AI models interact with storage systems during training, focusing on data loading and checkpointing mechanisms - Learn how AI frameworks like PyTorch use different storage connectors to access various storage solutions. - Explore how file-based storage and object storage is used in AI training
Related topics:

More from this channel

Upcoming talks (7)
On-demand talks (50)
Subscribers (23711)
Each month, the AI: the Future of Business series explores the latest trends, technologies and best practices in the world of Enterprise AI and sheds light on Artificial Intelligence for the modern business.