Neopolis Akademy · Free AI training

Kubernetes and GPU Workloads

Deep dive into Kubernetes for GPU workloads: Kubernetes primitives for AI services, GPU scheduling, NVIDIA GPU Operator and GPU telemetry/failure modes. Practical guidance for running GPU clusters in production.

AI Production Infrastructure and Model Serving Engineer

Course overview

Deep dive into Kubernetes for GPU workloads: Kubernetes primitives for AI services, GPU scheduling, NVIDIA GPU Operator and GPU telemetry/failure modes. Practical guidance for running GPU clusters in production.

Introduces Kubernetes primitives relevant to AI services: Deployments, StatefulSets, Services and AI-focused CRDs.

Covers GPU scheduling strategies: node pools, taints and tolerations for correct workload placement.

Describes the NVIDIA GPU Operator to manage drivers and GPU components declaratively.

Covers GPU telemetry: key metrics, common failure modes and practical investigation techniques.

4lessons
4lessons
20activities
0exercises
3videos

Skills and topics covered

Access the platform

Open the catalogue to review course details, access conditions, and your personal progress. Sign in.

Explore Golden Jobs and their learning paths