Technology1 min read

Validating GPU Platforms with Runtime AI Inventory via the NVIDIA DSX AI Factory

By · Published by Everything Blog

In short

The integration couples NVIDIA AI Cluster Runtime, which establishes locked deployment recipes for GPU platform components, with Google's k8s-aibom tool to monitor active workloads higher up the software stack. Emitting CycloneDX 1.6 reports, the utility catalogs inference runtimes, models, and retrieval-augmented generation dependencies running across Kubernetes nodes. This runtime tracking is enabled by default in two standard Google Kubernetes Engine recipes designed for NVIDIA H100 GPUs running Container-Optimized OS.

Key points

  • Pairing static configuration validation with active runtime inventory mitigates blind spo…: Pairing static configuration validation with active runtime inventory mitigates blind spots caused by mutable container tags.
  • The system automatically detects shadow workloads and configuration drift across workload…: The system automatically detects shadow workloads and configuration drift across workloads like NIMService and LeaderWorkerSet.
  • NVIDIA validates the security of the integrated tool by verifying provenance against Goog…: NVIDIA validates the security of the integrated tool by verifying provenance against Google's build identity alongside role-based controls.

Sources checked by our analysis pipeline: 1

As teams deploy and scale AI workloads using NVIDIA Dynamo, Kubeflow, or Slurm, tracking what actually runs requires visibility beyond the platform configuration captured in a recipe. Application teams define and update these workloads independently of the platform recipe, so a reproducible deployment bundle alone cannot establish which workload artifacts are running on each node. Mutable image tags like :latest

add another layer of complexity. Two nodes can end up running different code under identical tags, and a node that pulls next week may retrieve an image that was not covered by an earlier security review.

NVIDIA AI Cluster Runtime (AICR), an open source modular component of the NVIDIA DSX AI Factory Platform, now includes a qualified AI bill of materials (AIBOM) component to close that gap. An open source project created by Google, k8s-aibom tracks AI workloads running on Kubernetes. Two stock recipes select k8s-aibom by default: h100-gke-cos-inference

and h100-gke-cos-inference-dynamo

. Other GKE recipes can opt in during generation with --runtime-inventory

enabled. Recipes selecting it can opt out with --runtime-inventory

disabled.

AICR turns known-good GPU platform configurations into version-locked…

Technology