Historial de interrupciones de Scale Ai

Degraded performance

Comenzó January 6, 2025 at 7:34 PM UTC 2h 37m

OutageMajor incident

Componentes afectados

APIPlatformWeb Application

January 6, 2025 at 7:34 PM UTCinvestigating
We are currently investigating this issue.
January 6, 2025 at 7:40 PM UTCinvestigating
We are continuing to investigate this issue.
January 6, 2025 at 10:11 PM UTCresolved
This incident has been resolved.

Site Outage

Comenzó April 26, 2024 at 7:24 PM UTC 36m

IssuesMinor incident

Componentes afectados

APIPlatformWeb Application

April 26, 2024 at 7:24 PM UTCinvestigating
We are currently investigating this issue.
April 26, 2024 at 8:01 PM UTCresolved
This incident has been resolved.

Nucleus Degraded Performance

Comenzó March 19, 2024 at 10:08 AM UTC 3h 14m

IssuesMinor incident

Componentes afectados

Nucleus

March 19, 2024 at 10:08 AM UTCinvestigating
Nucleus and Data Engine is currently experiencing degraded performance. Pages and queries will take longer to respond than usual.
March 19, 2024 at 12:37 PM UTCmonitoring
A fix has been implemented and we are monitoring the results.
March 19, 2024 at 1:22 PM UTCresolved
This incident has been resolved.

Cloudflare Outage

Comenzó January 15, 2024 at 7:54 PM UTC 6h 19m

OutageCritical incident

Componentes afectados

Commercial Web Application

January 15, 2024 at 7:54 PM UTCinvestigating
We are currently investigating this issue.
January 15, 2024 at 7:55 PM UTCinvestigating
Cloudflare has implemented a fix and seems to be resolving any certificate issues.
January 15, 2024 at 7:55 PM UTCinvestigating
Confirmed that the issue has been resolved.
January 16, 2024 at 2:13 AM UTCresolved
This incident has been resolved.

Donovan Web Application Outage

Comenzó November 20, 2023 at 7:59 PM UTC 32m

OutageCritical incident

Componentes afectados

Commercial Web Application

November 20, 2023 at 7:59 PM UTCinvestigating
We are currently investigating an application issue. We will post updates shortly.
November 20, 2023 at 8:27 PM UTCmonitoring
A fix has been implemented and we are monitoring the results.
November 20, 2023 at 8:31 PM UTCresolved
This incident has been resolved.

Site Outage

Comenzó October 23, 2023 at 7:29 PM UTC 1h 9m

Pending

Componentes afectados

APIDocument AISpellbookQuality AssurancePlatformWeb ApplicationNucleus

October 23, 2023 at 7:29 PM UTCinvestigating
We are currently investigating an issue, some operations are experiencing high latency or are failing.
October 23, 2023 at 8:25 PM UTCmonitoring
A fix has been implemented and we are monitoring the results.
October 23, 2023 at 8:38 PM UTCresolved
This incident has been resolved.

Elevated Error Rate

Comenzó September 18, 2023 at 6:35 PM UTC 23h 15m

OutageCritical incident

Componentes afectados

APIDocument AIQuality AssurancePlatformWeb ApplicationNucleus

September 18, 2023 at 6:35 PM UTCinvestigating
We are currently investigating this issue.
September 18, 2023 at 7:09 PM UTCidentified
We are seeing elevated error rates with our cloud provider. We are currently investigating the issue.
September 18, 2023 at 11:25 PM UTCidentified
We are continuing to work on mitigating the issue. Our website is experiencing a technical issue with the hosting provider. Current ETA for resolution is ~2 hours, or around 6:30 PT.
September 19, 2023 at 12:30 AM UTCmonitoring
A temporary fix has been implemented and we are monitoring the status of the platform
September 19, 2023 at 12:52 AM UTCmonitoring
We are continuing to monitor for any further issues.
September 19, 2023 at 5:50 PM UTCresolved
This incident has been resolved.

Spellbook Application Error

Comenzó May 16, 2023 at 11:12 PM UTC 1h 16m

OutageCritical incident

Componentes afectados

Spellbook

May 16, 2023 at 11:12 PM UTCidentified
We have identified a platform issue impacting all Spellbook applications. Applications will not appear in the UI or be available over the API. We are deploying a fix for this issue.
May 16, 2023 at 11:48 PM UTCidentified
The fix for the deployment is in progress now.
May 17, 2023 at 12:27 AM UTCresolved
The Spellbook application is fully back up and operational.

Catalog Forge Platform Unresponsive

Comenzó April 28, 2023 at 2:26 PM UTC 3h 14m

OutageCritical incident

Componentes afectados

Catalog Forge

April 28, 2023 at 2:26 PM UTCinvestigating
We are currently investigating this issue.
April 28, 2023 at 3:59 PM UTCmonitoring
A fix has been implemented and we are monitoring the results.
April 28, 2023 at 5:40 PM UTCresolved
This incident has been resolved.

ML Pod Startup Failures

Comenzó March 30, 2023 at 2:30 PM UTC 0m

Pending

March 30, 2023 at 5:13 PM UTCresolved
There was an outage with a service that manages the metadata for models from 7:06am PT to 7:50am PT. It prevented model services from starting up new pods. ML services that received security updates, deployed a new version, or attempted to scale up were impacted. There was an additional 8 to 12 minutes of service degradation after restoring the impacted ML services to catch up on missed requests.

Site Outage

Comenzó March 11, 2023 at 10:58 AM UTC 1h 36m

OutageCritical incident

Componentes afectados

APIDocument AIQuality AssurancePlatformWeb ApplicationNucleus

March 11, 2023 at 10:58 AM UTCinvestigating
We are currently investigating this issue.
March 11, 2023 at 12:20 PM UTCmonitoring
A fix has been implemented and we are monitoring the results.
March 11, 2023 at 12:34 PM UTCresolved
This incident has been resolved.

Elevated latencies

Comenzó March 3, 2023 at 11:59 PM UTC 1h 42m

IssuesMinor incident

Componentes afectados

APICatalog ExplorerDocument AISpellbookQuality AssurancePlatformWeb ApplicationNucleusCatalog Forge

March 3, 2023 at 11:59 PM UTCinvestigating
We are currently investigating this issue.
March 4, 2023 at 12:15 AM UTCmonitoring
A fix has been implemented and we are monitoring the results.
March 4, 2023 at 1:41 AM UTCresolved
This incident has been resolved.

Elevated API Error Rates

Comenzó March 3, 2023 at 1:30 AM UTC 1h 15m

OutageMajor incident

Componentes afectados

APIDocument AIQuality AssurancePlatformWeb ApplicationNucleus

March 3, 2023 at 2:19 AM UTCinvestigating
We're experiencing an elevated level of API errors and are currently looking into the issue.
March 3, 2023 at 2:45 AM UTCresolved
This incident has been resolved.

Catalog Forge slow or unresponsive

Comenzó January 27, 2023 at 7:31 PM UTC 1h 26m

OutageMajor incident

Componentes afectados

Catalog Forge

January 27, 2023 at 7:31 PM UTCinvestigating
We are currently investigating this issue.
January 27, 2023 at 8:42 PM UTCmonitoring
A fix has been implemented and we are monitoring the results.
January 27, 2023 at 8:57 PM UTCresolved
This incident has been resolved.

ML Inference Failures

Comenzó December 29, 2022 at 7:00 PM UTC 0m

Pending

December 29, 2022 at 9:03 PM UTCresolved
Networking issue with ML infra.

Degraded Site Performance

Comenzó December 29, 2022 at 7:08 AM UTC 17h 25m

OutageMajor incident

Componentes afectados

APIDocument AIPlatformWeb ApplicationNucleus

December 29, 2022 at 7:08 AM UTCinvestigating
We are currently investigating this issue.
December 29, 2022 at 11:57 AM UTCidentified
Many users may still be experiencing slow application loading times and less responsiveness. We have identified that our database has been experiencing internal issues and are continuing to work to resolve them. We have made efforts to mitigate the impact caused and have tuned our database to optimize for the current situation.
December 29, 2022 at 10:36 PM UTCmonitoring
A fix has been implemented and we are monitoring the results.
December 30, 2022 at 11:32 PM UTCresolved
This incident has been resolved.

Platform slow or unresponsive

Comenzó December 1, 2022 at 8:42 AM UTC 3h 45m

OutageCritical incident

Componentes afectados

Platform

December 1, 2022 at 8:42 AM UTCinvestigating
We are currently investigating this issue.
December 1, 2022 at 11:41 AM UTCinvestigating
We are continuing to investigate this issue.
December 1, 2022 at 11:52 AM UTCmonitoring
A fix has been implemented and we are monitoring the results.
December 1, 2022 at 12:13 PM UTCmonitoring
We are continuing to monitor for any further issues.
December 1, 2022 at 12:27 PM UTCresolved
This incident has been resolved.

Platform Slow or Unresponsive

Comenzó November 27, 2022 at 1:24 PM UTC 45m

OutageCritical incident

Componentes afectados

APIDocument AIQuality AssurancePlatformWeb ApplicationNucleus

November 27, 2022 at 1:24 PM UTCinvestigating
We are seeing elevated error rates that may indicate a slow or unresponsive platform. We are currently investigating the issue.
November 27, 2022 at 2:09 PM UTCresolved
This incident has been resolved.

Platform slow or unresponsive

Comenzó November 23, 2022 at 5:04 PM UTC 1h 10m

OutageMajor incident

Componentes afectados

APIDocument AIQuality AssurancePlatformWeb ApplicationNucleus

November 23, 2022 at 5:04 PM UTCinvestigating
We are currently investigating this issue.
November 23, 2022 at 5:06 PM UTCinvestigating
We are continuing to investigate this issue.
November 23, 2022 at 6:15 PM UTCresolved
Incident has been resolved.

Degraded performance

Comenzó November 10, 2022 at 1:38 PM UTC 5h 23m

IssuesMinor incident

Componentes afectados

APIDocument AIQuality AssurancePlatformWeb ApplicationNucleus

November 10, 2022 at 1:38 PM UTCinvestigating
We are currently investigating an issue with our asynchronous jobs.
November 10, 2022 at 6:45 PM UTCmonitoring
A fix has been implemented and we are monitoring the results.
November 10, 2022 at 7:01 PM UTCresolved
This incident has been resolved.