Skip to main content

Connect Grafana to Prometheus

Grafana must have Prometheus configured as a data source before you can build dashboards.
  1. Go to Connections → Data Sources and check whether Prometheus is already listed. If it is, confirm it shows “Data source is working.”
  2. If not, click Add data source, select Prometheus, enter your Prometheus endpoint URL, and click Save & test.

Example dashboards

Detect thermal issues before they cause downtime

Build a dashboard to catch overheating RDUs and hosts before thermal throttling or shutdown occurs.
PanelQueryAlert threshold
Host inlet temperature (time series)ipmi_temperature_celsius{name=~".*[Ii]nlet.*|.*[Aa]mbient.*"}Warn at 35 °C, critical at 40 °C
XRDU core temperature (time series)xrdu_bmc_temp_celsisus{sensor=~".*CORETEMP.*"}Warn at 80 °C, critical at 90 °C
Fan speeds (time series)ipmi_fan_speed_rpmAlert if any fan drops below 1000 RPM
Cooling fault state (stat)ipmi_chassis_cooling_fault_state0 = fault (red), 1 = OK (green)
Recommended variables: rack, node – lets operators drill from cluster-wide heat map down to a specific host.

Monitor RDU utilization across the cluster

Build a dashboard to see which RDUs are active, idle, or fully loaded – useful for capacity planning and detecting stalled workloads.
PanelQueryNotes
Tile execution % (time series, grouped by node)sambanova_tile_exec_percentHigh value = RDU under load
Tile idle % (time series)sambanova_tile_idle_percentSustained 100% = unused capacity
Tile frequency (time series)sambanova_tile_frequency_mhzDrop in frequency may indicate throttling
Platform fault count (stat)increase(sambanova_platform_fault_count[1h])Alert on any non-zero value
Platform error count (stat)increase(sambanova_platform_error_count[1h])Alert on any non-zero value
Recommended variables: rack, node, xrdu – lets operators isolate a single XRDU’s utilization.

Add topology drill-down with variables

To make every panel filterable by rack, node, or XRDU, add Grafana dashboard variables. Open: Dashboard settings → Variables → Add variable
VariableTypeQueryPurpose
rackQuerylabel_values(xrdu_bmc_power_watts, rack)Filter by rack
nodeQuerylabel_values(xrdu_bmc_power_watts, node)Filter by node
xrduQuerylabel_values(xrdu_bmc_power_watts, xrdu)Filter by XRDU
The node label on XRDU metrics comes from the node: field in your values.yaml target entries (Manual discovery mode). If you used Auto Discovery, XRDU metrics do not carry a node label and the $node variable dropdown will be empty. Verify available labels with label_values(xrdu_bmc_power_watts) in the Grafana Explore view.
Then update your panel queries to use the variables:
xrdu_bmc_temp_celsisus{rack="$rack", node="$node"}
xrdu_bmc_power_watts{rack="$rack", sensor=~"ps.*input.*"}

What’s next

Monitoring metrics reference

Full catalog of all Prometheus metrics exposed by each exporter