Capacity Planning
GPU Infrastructure for Enterprise AI
An organization that has decided to run models itself now owns an unfamiliar class of infrastructure. Accelerators behave differently from the servers around them in ways that matter operationally, and most of the surpri...
AI Infrastructure Capacity Planning
Capacity planning for AI has an unusually high ratio of confident numbers to defensible ones. The reason is that the familiar unit, requests per second, does not describe the workload, and everything built on top of it i...