GPU utilization increased from ~20% to 43% on a reservation of 96 NVIDIA H100 GPUs, while cutting queue starvation by 74%, with blocked jobs falling from roughl

GPU utilization increased from ~20% to 43% on a reservation of 96 NVIDIA H100 GPUs, while cutting queue starvation by 74%, with blocked jobs falling from roughly 10 per day to around 4. That’s the concrete result @​SpreeAI saw after fixing their orchestration. When a unified diffusion model require…