HydraIssues

Issues / #217
Investigate streaming monitor GPU anomaly detection — flag bodies with high GPU load and no active stream
open feature Project: hydrastreamingmonitor Reporter: hydra 19 May 2026 08:26

Description

Today cosmic-pretzel-98 was sitting at 96% GPU (RTX 5090) with 6 GB VRAM used while not streaming to any head. Root cause: Mercator56-Win64-Shipping.exe left running from a previous session — hydrabody did not clean it up on stream stop.

Investigate whether the streaming monitor (hydrastreamingmonitor.experiencenet.com) can surface this class of problem automatically:

  • Body nodes report GPU utilization (already available via nvidia-smi)
  • If a body has GPU load > threshold (e.g. 60%) AND has no active stream attached in hydracluster, flag it as anomalous
  • Could be a dashboard indicator on the streaming monitor or an alert

Related: the cleanup failure in hydrabody (experience process not killed on stream stop) should be investigated separately, but the monitor can act as a safety net.