I’m trying to collect power consumption metrics from a v6e TPU VM created through the Cloud TPU API.
The Cloud Monitoring metrics documentation lists these metrics as BETA:
compute.googleapis.com/instance/tpu/accelerator/power_draw
compute.googleapis.com/instance/tpu/accelerator/hbm_power_draw
compute.googleapis.com/instance/tpu/accelerator/tray_power
I queried the Cloud Monitoring projects.timeSeries.list API for the past 48 hours, using a filter like this:
metric.type="compute.googleapis.com/instance/tpu/accelerator/power_draw"
AND resource.type="gce_instance"
AND resource.labels.instance_id="<INSTANCE_ID>"
The request succeeds with HTTP 200, but returns no time series or data points for any of these three metrics. For comparison, I can retrieve tpu.googleapis.com/accelerator/duty_cycle data for the same TPU.
Could someone clarify whether:
- There is a problem with my query or resource filter;
- These power metrics are not yet available for TPU VMs created through the Cloud TPU API;
- Additional configuration is required?
My goal is to measure TPU power consumption during inference. If these metrics are not currently supported on this deployment, is there another supported way to obtain that measurement?
Thank you!