Hitting GPU Capacity for H100s creating large queue times for some models
Started
Resolved
Duration
1 day
Resolvedminor impact
Update timeline
Resolved
This issue is resolved
Monitoring
This issue is now resolved
Monitoring
GPU usage is back below capacity. We're continuing to monitor.
Identified
We are over provisioned on H100s currently which is causing long queue times for some models running on H100s