X post:Neko Legends
LLM Inference in Production: Silent GPU OOMs and Health Check Blind Spots
Neko Legends shares findings on running GLM-5.3-Flash (1M-ctx) on a 4× Spark cluster. The cluster failed after 13 hours due to a silent GPU OOM lasting 30 minutes, despite the /health endpoint reporting normal operation throughout.
18bookmarks683views