Description
When GPU allocation happens through DRA (KUBERNETES_ENABLE_DRA=true), setting DCGM_EXPORTER_KUBERNETES_ENABLE_POD_UID=true does not add the UID label to metrics. The same configuration on a device-plugin node adds it as expected.
Expected behavior
With both KUBERNETES_ENABLE_DRA=true and
DCGM_EXPORTER_KUBERNETES_ENABLE_POD_UID=true, metrics attributed to a pod holding a DRA ResourceClaim should carry the UID label, the same as device-plugin allocated GPUs.
Actual behavior
DRA-attributed series carry pod, namespace, container, the dra_* labels, and (when enabled) pod labels, but no UID, regardless of the pod-UID setting.
Steps to reproduce
- Node with DRA GPU allocation (e.g. GPU Operator with the DRA stack; NVIDIA DRA driver publishing ResourceSlices).
- Run dcgm-exporter with
KUBERNETES_ENABLE_DRA=true, DCGM_EXPORTER_KUBERNETES_ENABLE_POD_UID=true, a ServiceAccount token, and read access to resource.k8s.io/resourceslices and pods.
- Start a pod that requests a GPU via a ResourceClaim and scrape
/metrics.
- Metrics for that pod have
pod/namespace/container and dra_* labels but no UID label. Repeating with a device-plugin allocation on the same exporter produces the UID label.
Environment
Observed with dcgm-exporter 4.6.0-4.8.3 (GPU Operator DRA stack, Kubernetes with resource.k8s.io/v1).
Description
When GPU allocation happens through DRA (
KUBERNETES_ENABLE_DRA=true), settingDCGM_EXPORTER_KUBERNETES_ENABLE_POD_UID=truedoes not add theUIDlabel to metrics. The same configuration on a device-plugin node adds it as expected.Expected behavior
With both
KUBERNETES_ENABLE_DRA=trueandDCGM_EXPORTER_KUBERNETES_ENABLE_POD_UID=true, metrics attributed to a pod holding a DRA ResourceClaim should carry theUIDlabel, the same as device-plugin allocated GPUs.Actual behavior
DRA-attributed series carry
pod,namespace,container, thedra_*labels, and (when enabled) pod labels, but noUID, regardless of the pod-UID setting.Steps to reproduce
KUBERNETES_ENABLE_DRA=true,DCGM_EXPORTER_KUBERNETES_ENABLE_POD_UID=true, a ServiceAccount token, and read access toresource.k8s.io/resourceslicesandpods./metrics.pod/namespace/containeranddra_*labels but noUIDlabel. Repeating with a device-plugin allocation on the same exporter produces theUIDlabel.Environment
Observed with dcgm-exporter
4.6.0-4.8.3(GPU Operator DRA stack, Kubernetes withresource.k8s.io/v1).