Containers
Containers for AI Workloads
Containers arrived in AI infrastructure for an unglamorous reason: the dependency problem is severe. A model serving stack couples a framework, a numerical library, a device driver interface and a specific Python environ...
Kubernetes for AI Workloads
Kubernetes is the default answer to running containers at scale, and AI workloads inherit that default whether or not it suits them. Often it does. Sometimes it is a great deal of machinery in front of two servers that w...