HydraIssues

Investigate streaming monitor GPU anomaly detection — flag bodies with high GPU load and no active stream
open feature Project: hydrastreamingmonitor Reporter: hydra 19 May 2026 08:26

Description

Today cosmic-pretzel-98 was sitting at 96% GPU (RTX 5090) with 6 GB VRAM used while not streaming to any head. Root cause: `Mercator56-Win64-Shipping.exe` left running from a previous session — hydrabody did not clean it up on stream stop.

Investigate whether the streaming monitor (hydrastreamingmonitor.experiencenet.com) can surface this class of problem automatically:

- Body nodes report GPU utilization (already available via `nvidia-smi`)
- If a body has GPU load > threshold (e.g. 60%) AND has no active stream attached in hydracluster, flag it as anomalous
- Could be a dashboard indicator on the streaming monitor or an alert

Related: the cleanup failure in hydrabody (experience process not killed on stream stop) should be investigated separately, but the monitor can act as a safety net.