Previous incidents

February 2024
Feb 26, 2024
2 incidents

Web endpoints is down

Downtime

Resolved Feb 26 at 07:39pm EST

Web endpoints recovered.

1 previous update

GPU functions on OCI is down

Downtime

Resolved Feb 26 at 06:37am EST

GPU functions on OCI recovered.

1 previous update

Feb 20, 2024
1 incident

GPU functions on OCI is down

Downtime

Resolved Feb 20 at 12:45pm EST

GPU functions on OCI recovered.

3 previous updates

Feb 18, 2024
1 incident

GPU functions on OCI is down

Downtime

Resolved Feb 18 at 10:57am EST

GPU functions on OCI recovered.

1 previous update

Feb 14, 2024
1 incident

DNS issues causing website downtime and degradation of the service

Resolved Feb 14 at 07:20am EST

We experienced a problem with our DNS records for modal.com and modal.run, meaning that the website and webpoints were unreachable for a period, unless DNS records were cached by your local resolver.

This also affected workloads running on modal to some degree, as some workloads were failing to communicate with our API server.

The issue has been resolved but there might be lingering effects due to negative DNS caches in your local DNS resolver (e.g. your ISP resolvers).

Feb 01, 2024
1 incident

Database upgrade

Maintenance

Resolved Feb 01 at 04:00am EST

We are upgrading an internal database. The Modal service should remain available during this time, although response latencies and error rates might be somewhat elevated.

January 2024
Jan 31, 2024
1 incident

GPU functions on OCI is down

Downtime

Resolved Jan 31 at 04:35pm EST

GPU functions on OCI recovered.

1 previous update

Jan 19, 2024
1 incident

GPU functions on GCP is down

Downtime

Resolved Jan 19 at 06:22pm EST

GPU functions on GCP recovered.

1 previous update

Jan 18, 2024
1 incident

Frontend and Web API are down

Downtime

Resolved Jan 18 at 06:07pm EST

Frontend recovered.

5 previous updates

Jan 17, 2024
1 incident

Frontend, Web API, and 1 other service are down

Downtime

Resolved Jan 18 at 03:52am EST

According to our investigation this was a false positive. Independent internal monitoring reports no issues and we failed to reproduce any problems. We're continuing to investigate the root cause.

6 previous updates

Jan 16, 2024
1 incident

Database upgrades

Maintenance

Resolved Jan 17 at 04:27am EST

Upgrade complete.

3 previous updates

Jan 09, 2024
1 incident

Web API and Web endpoints are down

Downtime

Resolved Jan 09 at 03:52pm EST

Web endpoints recovered.

4 previous updates

Jan 08, 2024
1 incident

Web endpoints is down

Downtime

Resolved Jan 08 at 02:38pm EST

Web endpoints recovered.

1 previous update

December 2023
Dec 25, 2023
2 incidents

Web endpoints is down

Downtime

Resolved Dec 26 at 10:48am EST

Web endpoints recovered.

7 previous updates

Web endpoint incident resolved

Resolved Dec 25 at 08:40pm EST

From 23:30 UTC - 01:40 UTC, web endpoints deployed on Modal had degraded performance and transient "400 Bad Request" status codes. We responded to the issue and published a fix.

The root cause was increased load on our web endpoint system from user traffic, which tripped an internal rate limit.