Power-Hungry Machines and How to Tame Them

Generative AI Power Demand, AI Training, and Inference
Forbes, 2024

AI is raising concerns about its environmental impact: as this technology advances its energy consumption levels double every 100 days. AI's energy use is projected to surpass that of entire countries in the near future, with its most significant energy demands coming from the inference phase of AI models (World Economic Forum, 2024).

On one hand our energetic needs are not going to slow down any time soon. On the other the AI revolution is still facing significant constraints due to insufficient chip supply and inadequate cooling technologies in data centres and high-performance computing (HPC). As AI drives increased transaction speeds and surges in data, the demand for more efficient servers and microprocessors has never been higher (Goldman Sachs, 2024). While currently several cooling solutions are available they still fall short of market needs. From air cooling to 2-phase immersion cooling, the various available options at the moment are often noisy, energy-intensive, expensive, and ill-suited for the latest generation of super chips. This shortfall poses a challenge for meeting AI's growing demands in the short- to medium-term.

In the rapidly evolving HPC world, one company is making waves with its innovative approach to thermal management. GemaTEG, a cutting-edge technology firm, is redefining the computing performance race through its advanced liquid cooling architecture. As the HPC industry continues to grow and evolve, GemaTEG is well-positioned to address the critical challenge of thermal management, potentially playing a significant role in shaping the future of HPC cooling solutions.

We use cookies to improve your experience and to help us understand how you use our site. Please refer to our cookie notice and privacy policy for more information regarding cookies and other third-party tracking that may be enabled.

Intuit Mailchimp logo
Facebook icon
LinkedIn icon
Website icon

© 2023 Kobo Funds