Historia awarii Scrutinizer

Increased error rates

Początek 7 maja 2026 11:09 UTC 1h 50m

OutagePoważny incydent

Dotknięte komponenty

Workers

7 maja 2026 11:09 UTCinvestigating
We are currently investigating this issue.
7 maja 2026 12:19 UTCmonitoring
A fix has been implemented and we are monitoring the results.
7 maja 2026 12:59 UTCmonitoring
We are continuing to monitor for any further issues.
7 maja 2026 12:59 UTCresolved
This incident has been resolved.

Website Unavailable

Początek 25 sierpnia 2025 19:45 UTC 17h 35m

OutageKrytyczny incydent

Dotknięte komponenty

Web

25 sierpnia 2025 19:45 UTCidentified
The issue has been identified and a fix is being implemented.
25 sierpnia 2025 21:33 UTCmonitoring
A fix has been implemented and we are monitoring the results.
25 sierpnia 2025 21:33 UTCmonitoring
We are continuing to monitor for any further issues.
26 sierpnia 2025 06:40 UTCmonitoring
We are still affected by database performance issues. We are currently working on migrating to a newer set-up. The new replica should be ready within the next one to two hours.
26 sierpnia 2025 09:39 UTCmonitoring
Database migration has been completed and performance should be back to normal. We keep monitoring the situation.
26 sierpnia 2025 13:20 UTCresolved
This incident has been resolved.

Worker Processing

Początek 4 marca 2025 08:59 UTC 2h 9m

OutageKrytyczny incydent

Dotknięte komponenty

Workers

4 marca 2025 08:59 UTCidentified
The issue has been identified and a fix is being implemented.
4 marca 2025 09:49 UTCmonitoring
A fix has been implemented and we are monitoring the results.
4 marca 2025 11:08 UTCresolved
This incident has been resolved.

Inavailability of Shared Filesystem

Początek 11 października 2024 10:06 UTC 2d 0h

OutageKrytyczny incydent

Dotknięte komponenty

WorkersWeb

11 października 2024 10:06 UTCinvestigating
We are currently investigating this issue.
11 października 2024 10:20 UTCmonitoring
A fix has been implemented and we are monitoring the results.
11 października 2024 10:29 UTCmonitoring
We are continuing to monitor for any further issues.
13 października 2024 10:42 UTCresolved
This incident has been resolved.

Backlog in task processing

Początek 27 sierpnia 2024 13:51 UTC 7h 35m

IssuesDrobny incydent

Dotknięte komponenty

Workers

27 sierpnia 2024 13:51 UTCinvestigating
We are currently investigating this issue.
27 sierpnia 2024 21:26 UTCresolved
This incident has been resolved.

Result Processing Error Rate

Początek 5 czerwca 2024 08:44 UTC 4h 0m

OutagePoważny incydent

Dotknięte komponenty

Workers

5 czerwca 2024 08:44 UTCinvestigating
We are currently investigating this issue.
5 czerwca 2024 09:19 UTCidentified
The issue has been identified and a fix is being implemented.
5 czerwca 2024 09:49 UTCmonitoring
A fix has been implemented and we are monitoring the results.
5 czerwca 2024 12:44 UTCresolved
This incident has been resolved.

Increased Web Error Rate

Początek 10 listopada 2023 13:05 UTC 207d 19h

OutagePoważny incydent

Dotknięte komponenty

Web

10 listopada 2023 13:05 UTCinvestigating
We are currently investigating this issue.
10 listopada 2023 13:07 UTCidentified
The issue has been identified and a fix is being implemented.
5 czerwca 2024 08:43 UTCresolved
This incident has been resolved.

Slow Repository Cloning Operations

Początek 15 września 2023 10:08 UTC 1h 50m

Pending

Dotknięte komponenty

Workers

15 września 2023 10:08 UTCinvestigating
We are currently investigating reports of slow cloning for some repositories.
15 września 2023 10:20 UTCidentified
The issue has been identified and a fix is being implemented.
15 września 2023 10:41 UTCmonitoring
A fix has been implemented and we are monitoring the results.
15 września 2023 11:58 UTCresolved
This incident has been resolved.

Worker Storage Error

Początek 14 lutego 2023 10:37 UTC 9m

OutagePoważny incydent

Dotknięte komponenty

Workers

14 lutego 2023 10:37 UTCinvestigating
We are currently investigating this issue.
14 lutego 2023 10:41 UTCidentified
The issue has been identified and a fix is being implemented.
14 lutego 2023 10:44 UTCmonitoring
A fix has been implemented and we are monitoring the results.
14 lutego 2023 10:47 UTCresolved
This incident has been resolved.

Network Connectivity

Początek 3 sierpnia 2022 14:50 UTC 11m

OutageKrytyczny incydent

Dotknięte komponenty

WorkersWeb

3 sierpnia 2022 14:51 UTCinvestigating
We are currently investigating an issue with the network connectivity between some services.
3 sierpnia 2022 14:51 UTCidentified
There is currently a routing malfunction. Our infrastructure provider is working to resolve the issue.
3 sierpnia 2022 14:55 UTCmonitoring
A fix has been implemented and we are monitoring the results.
3 sierpnia 2022 18:35 UTCresolved
This incident has been resolved.

Networking Issues

Początek 21 czerwca 2022 06:30 UTC 2h 10m

OutagePoważny incydent

Dotknięte komponenty

Workers

21 czerwca 2022 06:49 UTCinvestigating
We are currently investigating this issue.
21 czerwca 2022 07:23 UTCidentified
A third-party service, Cloudflare, is currently experiencing network issues impacting our job processing.
21 czerwca 2022 07:24 UTCmonitoring
They have implemented a fix, we are monitoring the situation.
21 czerwca 2022 07:54 UTCmonitoring
We are continuing to monitor for any further issues.
21 czerwca 2022 08:41 UTCresolved
This incident has been resolved.

Network Connectivity

Początek 13 czerwca 2022 08:35 UTC 35m

OutagePoważny incydent

Dotknięte komponenty

Workers

13 czerwca 2022 08:35 UTCinvestigating
We are currently investigating this issue.
13 czerwca 2022 08:37 UTCidentified
The issue has been identified and a fix is being implemented.
13 czerwca 2022 08:41 UTCmonitoring
A fix has been implemented and we are monitoring the results.
13 czerwca 2022 09:10 UTCresolved
This incident has been resolved.

Job Processing

Początek 23 maja 2022 09:42 UTC 8m

OutagePoważny incydent

Dotknięte komponenty

Workers

23 maja 2022 09:42 UTCinvestigating
We are currently investigating this issue.
23 maja 2022 09:44 UTCidentified
We have identified a network connectivity issue, and are working on implementing a fix.
23 maja 2022 09:46 UTCmonitoring
A fix has been implemented and we are monitoring the results.
23 maja 2022 10:27 UTCresolved
This incident has been resolved.

Increased Backlog in Result Processing

Początek 13 października 2021 07:50 UTC 1h 56m

IssuesDrobny incydent

Dotknięte komponenty

Workers

13 października 2021 07:50 UTCinvestigating
We are currently investigating this issue.
13 października 2021 08:42 UTCidentified
This issue has been tracked down to an external network issue. We are implementing a workaround on our end.
13 października 2021 08:49 UTCmonitoring
A fix has been implemented and we are monitoring the results.
13 października 2021 09:46 UTCresolved
This incident has been resolved.

Backlog in Build Log Processing

Początek 4 października 2021 08:24 UTC 38m

IssuesDrobny incydent

Dotknięte komponenty

Workers

4 października 2021 08:24 UTCinvestigating
We are currently investigating this issue. Inspection processing is unaffected by this issue.
4 października 2021 08:43 UTCidentified
The issue has been identified and a fix is being implemented.
4 października 2021 08:56 UTCmonitoring
A fix has been implemented and we are monitoring the results.
4 października 2021 09:02 UTCresolved
This incident has been resolved.

Increased Error Rate in Inspections

Początek 30 września 2021 16:00 UTC 5h 14m

OutagePoważny incydent

Dotknięte komponenty

Workers

30 września 2021 18:09 UTCidentified
The issue has been identified and a fix is being implemented.
30 września 2021 18:34 UTCmonitoring
A fix has been implemented and we are monitoring the results.
30 września 2021 21:14 UTCresolved
This incident has been resolved.

Delay in scheduling source installation

Początek 7 lipca 2021 11:53 UTC 50m

IssuesDrobny incydent

Dotknięte komponenty

Workers

7 lipca 2021 11:53 UTCinvestigating
We are currently investigating this issue.
7 lipca 2021 12:00 UTCidentified
The issue has been identified and a fix is being implemented.
7 lipca 2021 12:06 UTCmonitoring
A fix has been implemented and we are monitoring the results.
7 lipca 2021 12:44 UTCresolved
This incident has been resolved.

Increased Backlog

Początek 17 maja 2021 06:28 UTC 1h 31m

IssuesDrobny incydent

Dotknięte komponenty

Workers

17 maja 2021 06:28 UTCinvestigating
We are currently investigating this issue.
17 maja 2021 06:55 UTCidentified
The issue has been identified and a fix is being implemented.
17 maja 2021 07:10 UTCmonitoring
A fix has been implemented and we are monitoring the results.
17 maja 2021 07:58 UTCresolved
This incident has been resolved.

Increased Backlog in Tasks

Początek 30 marca 2021 09:29 UTC 1h 22m

IssuesDrobny incydent

Dotknięte komponenty

Workers

30 marca 2021 09:29 UTCinvestigating
We are currently investigating this issue.
30 marca 2021 09:41 UTCidentified
The issue has been identified and a fix is being implemented.
30 marca 2021 09:50 UTCmonitoring
A fix has been implemented and we are monitoring the results.
30 marca 2021 10:51 UTCresolved
This incident has been resolved.

Delayed Inspection Processing

Początek 25 marca 2021 14:17 UTC 18m

IssuesDrobny incydent

Dotknięte komponenty

Workers

25 marca 2021 14:17 UTCinvestigating
We are currently investigating this issue.
25 marca 2021 14:35 UTCresolved
This incident has been resolved.