Power is the dominant constraint for AI, impacting the achievable performance of AI systems. This talk covers the growth trends in AI, the impact this has on the power consumption of AI hardware, and the stress it places on the US power grid. We then examine where the power goes and some solutions that combine hardware and software techniques to lower power dissipation on ever larger systems. The talk concludes with challenges and goals for future systems.
