NVIDIA Developer
Read post

How to Run Isolated Tenant Kubernetes Clusters on Shared GPU Infrastructure

A step-by-step guide to running isolated Kubernetes clusters for multiple teams on shared GPU hardware using two open source tools: KAI Scheduler and vCluster. KAI Scheduler handles GPU resource allocation with hierarchical queues and per-team quotas, while vCluster gives each team its own isolated Kubernetes control plane (API server, CRDs, RBAC) without splitting the physical infrastructure. The tutorial walks through setting up MicroK8s with the NVIDIA GPU Operator, installing KAI Scheduler with GPU sharing enabled, defining team queues with guaranteed GPU fractions, spinning up one vCluster per team, and deploying GPU workloads that each team can only see within their own cluster. The result is three teams sharing a single NVIDIA L40S GPU with full workload isolation and no wasted hardware.

    #kubernetes#multi-tenancy
Aug 03•10m read time•From developer.nvidia.com
Post cover image
Table of contents
Tutorial prerequisites and notesStep 1: Local toolingStep 2: Add the Helm repoStep 3: Confirm the GPU OperatorStep 4: Install KAI SchedulerStep 5: Define team queuesStep 6: Spin up a vCluster per teamStep 7: Deploy a workload from each teamGet started running isolated tenant Kubernetes clusters
81 Impressions
NVIDIA Developer's image
NVIDIA Developer

NVIDIA DevTalk serves as a vibrant community hub where developers can engage in discussions, seek as...

704 Followers

•

1.6K Upvotes

Would you recommend this post?

Copy link
WhatsApp
Facebook
X
New Squad
  • © 2026 Daily Dev Ltd.
  • Guidelines
  • Explore
  • Tags
  • Sources
  • Squads
  • Leaderboard