New model instances unable to start
Resolved·Degraded performance

All impacted models and instances have recovered and we are operating normally. Thank you for your patience.

Wed, Jun 18, 2025, 05:32 PM
(1 week ago)
·
Affected components
Updates

Resolved

All impacted models and instances have recovered and we are operating normally. Thank you for your patience.

Wed, Jun 18, 2025, 05:32 PM

Monitoring

Most models have recovered, investigating straggling models that are failing to start.

Wed, Jun 18, 2025, 03:00 PM(2 hours earlier)

Monitoring

New model instances were unable to boot between 12:41 and 13:14 UTC. Existing models were able to serve traffic.

The underlying issue has been resolved.

While the core of the incident was resolved we are waiting for instances to clear the error state. We will continue to monitor while the system works through the backlog of booting instances.

Wed, Jun 18, 2025, 01:42 PM(1 hour earlier)