Addressing the Hidden Costs of AI

Logo
Presented by

Rob Davis, NVIDIA; David McIntyre, Samsung; Mishali Naik, Intel; Justin Potuznik, Dell; Erik Smith, Dell

About this talk

The latest buzz around generative artificial intelligence (AI) ignores the massive costs to run and power the technology. Without any guard rails in place, what are the impacts of AI on sustainability and costs across our technology resources? This webinar will offer insights on the potentially hidden technical and infrastructure costs associated with generative AI, best practices and potential solutions to be considered, discussing: • Scalability considerations for generative AI in enterprises • Significant computational requirements and cost for Large Language Model inferencing • Fabric requirements and costs • Sustainability impacts due to increased power consumption, heat dissipation, and cooling implications • AI infrastructure savings - On-prem vs. Cloud • Practical steps to reduce impact, leveraging existing pre-trained models for specific market domains
Related topics:

More from this channel

Upcoming talks (5)
On-demand talks (364)
Subscribers (64920)
The Enterprise Architecture channel presents the next generation of Enterprise IT: recognizing the strategic importance of digital transformation and the data center to make companies more nimble and competitive. These presentations will help demanding IT and BizOps professionals achieve flexibility, scalability and performance with reduced risk and complexity.