Störungsverlauf von Scrutinizer

Increased error rates

Beginn 7. Mai 2026 um 11:09 UTC 1h 50m

OutageSchwerwiegender Vorfall

Betroffene Komponenten

Workers

7. Mai 2026 um 11:09 UTCinvestigating
We are currently investigating this issue.
7. Mai 2026 um 12:19 UTCmonitoring
A fix has been implemented and we are monitoring the results.
7. Mai 2026 um 12:59 UTCmonitoring
We are continuing to monitor for any further issues.
7. Mai 2026 um 12:59 UTCresolved
This incident has been resolved.

Website Unavailable

Beginn 25. August 2025 um 19:45 UTC 17h 35m

OutageKritischer Vorfall

Betroffene Komponenten

Web

25. August 2025 um 19:45 UTCidentified
The issue has been identified and a fix is being implemented.
25. August 2025 um 21:33 UTCmonitoring
A fix has been implemented and we are monitoring the results.
25. August 2025 um 21:33 UTCmonitoring
We are continuing to monitor for any further issues.
26. August 2025 um 06:40 UTCmonitoring
We are still affected by database performance issues. We are currently working on migrating to a newer set-up. The new replica should be ready within the next one to two hours.
26. August 2025 um 09:39 UTCmonitoring
Database migration has been completed and performance should be back to normal. We keep monitoring the situation.
26. August 2025 um 13:20 UTCresolved
This incident has been resolved.

Worker Processing

Beginn 4. März 2025 um 08:59 UTC 2h 9m

OutageKritischer Vorfall

Betroffene Komponenten

Workers

4. März 2025 um 08:59 UTCidentified
The issue has been identified and a fix is being implemented.
4. März 2025 um 09:49 UTCmonitoring
A fix has been implemented and we are monitoring the results.
4. März 2025 um 11:08 UTCresolved
This incident has been resolved.

Inavailability of Shared Filesystem

Beginn 11. Oktober 2024 um 10:06 UTC 2d 0h

OutageKritischer Vorfall

Betroffene Komponenten

WorkersWeb

11. Oktober 2024 um 10:06 UTCinvestigating
We are currently investigating this issue.
11. Oktober 2024 um 10:20 UTCmonitoring
A fix has been implemented and we are monitoring the results.
11. Oktober 2024 um 10:29 UTCmonitoring
We are continuing to monitor for any further issues.
13. Oktober 2024 um 10:42 UTCresolved
This incident has been resolved.

Backlog in task processing

Beginn 27. August 2024 um 13:51 UTC 7h 35m

IssuesGeringfügiger Vorfall

Betroffene Komponenten

Workers

27. August 2024 um 13:51 UTCinvestigating
We are currently investigating this issue.
27. August 2024 um 21:26 UTCresolved
This incident has been resolved.

Result Processing Error Rate

Beginn 5. Juni 2024 um 08:44 UTC 4h 0m

OutageSchwerwiegender Vorfall

Betroffene Komponenten

Workers

5. Juni 2024 um 08:44 UTCinvestigating
We are currently investigating this issue.
5. Juni 2024 um 09:19 UTCidentified
The issue has been identified and a fix is being implemented.
5. Juni 2024 um 09:49 UTCmonitoring
A fix has been implemented and we are monitoring the results.
5. Juni 2024 um 12:44 UTCresolved
This incident has been resolved.

Increased Web Error Rate

Beginn 10. November 2023 um 13:05 UTC 207d 19h

OutageSchwerwiegender Vorfall

Betroffene Komponenten

Web

10. November 2023 um 13:05 UTCinvestigating
We are currently investigating this issue.
10. November 2023 um 13:07 UTCidentified
The issue has been identified and a fix is being implemented.
5. Juni 2024 um 08:43 UTCresolved
This incident has been resolved.

Slow Repository Cloning Operations

Beginn 15. September 2023 um 10:08 UTC 1h 50m

Pending

Betroffene Komponenten

Workers

15. September 2023 um 10:08 UTCinvestigating
We are currently investigating reports of slow cloning for some repositories.
15. September 2023 um 10:20 UTCidentified
The issue has been identified and a fix is being implemented.
15. September 2023 um 10:41 UTCmonitoring
A fix has been implemented and we are monitoring the results.
15. September 2023 um 11:58 UTCresolved
This incident has been resolved.

Worker Storage Error

Beginn 14. Februar 2023 um 10:37 UTC 9m

OutageSchwerwiegender Vorfall

Betroffene Komponenten

Workers

14. Februar 2023 um 10:37 UTCinvestigating
We are currently investigating this issue.
14. Februar 2023 um 10:41 UTCidentified
The issue has been identified and a fix is being implemented.
14. Februar 2023 um 10:44 UTCmonitoring
A fix has been implemented and we are monitoring the results.
14. Februar 2023 um 10:47 UTCresolved
This incident has been resolved.

Network Connectivity

Beginn 3. August 2022 um 14:50 UTC 11m

OutageKritischer Vorfall

Betroffene Komponenten

WorkersWeb

3. August 2022 um 14:51 UTCinvestigating
We are currently investigating an issue with the network connectivity between some services.
3. August 2022 um 14:51 UTCidentified
There is currently a routing malfunction. Our infrastructure provider is working to resolve the issue.
3. August 2022 um 14:55 UTCmonitoring
A fix has been implemented and we are monitoring the results.
3. August 2022 um 18:35 UTCresolved
This incident has been resolved.

Networking Issues

Beginn 21. Juni 2022 um 06:30 UTC 2h 10m

OutageSchwerwiegender Vorfall

Betroffene Komponenten

Workers

21. Juni 2022 um 06:49 UTCinvestigating
We are currently investigating this issue.
21. Juni 2022 um 07:23 UTCidentified
A third-party service, Cloudflare, is currently experiencing network issues impacting our job processing.
21. Juni 2022 um 07:24 UTCmonitoring
They have implemented a fix, we are monitoring the situation.
21. Juni 2022 um 07:54 UTCmonitoring
We are continuing to monitor for any further issues.
21. Juni 2022 um 08:41 UTCresolved
This incident has been resolved.

Network Connectivity

Beginn 13. Juni 2022 um 08:35 UTC 35m

OutageSchwerwiegender Vorfall

Betroffene Komponenten

Workers

13. Juni 2022 um 08:35 UTCinvestigating
We are currently investigating this issue.
13. Juni 2022 um 08:37 UTCidentified
The issue has been identified and a fix is being implemented.
13. Juni 2022 um 08:41 UTCmonitoring
A fix has been implemented and we are monitoring the results.
13. Juni 2022 um 09:10 UTCresolved
This incident has been resolved.

Job Processing

Beginn 23. Mai 2022 um 09:42 UTC 8m

OutageSchwerwiegender Vorfall

Betroffene Komponenten

Workers

23. Mai 2022 um 09:42 UTCinvestigating
We are currently investigating this issue.
23. Mai 2022 um 09:44 UTCidentified
We have identified a network connectivity issue, and are working on implementing a fix.
23. Mai 2022 um 09:46 UTCmonitoring
A fix has been implemented and we are monitoring the results.
23. Mai 2022 um 10:27 UTCresolved
This incident has been resolved.

Increased Backlog in Result Processing

Beginn 13. Oktober 2021 um 07:50 UTC 1h 56m

IssuesGeringfügiger Vorfall

Betroffene Komponenten

Workers

13. Oktober 2021 um 07:50 UTCinvestigating
We are currently investigating this issue.
13. Oktober 2021 um 08:42 UTCidentified
This issue has been tracked down to an external network issue. We are implementing a workaround on our end.
13. Oktober 2021 um 08:49 UTCmonitoring
A fix has been implemented and we are monitoring the results.
13. Oktober 2021 um 09:46 UTCresolved
This incident has been resolved.

Backlog in Build Log Processing

Beginn 4. Oktober 2021 um 08:24 UTC 38m

IssuesGeringfügiger Vorfall

Betroffene Komponenten

Workers

4. Oktober 2021 um 08:24 UTCinvestigating
We are currently investigating this issue. Inspection processing is unaffected by this issue.
4. Oktober 2021 um 08:43 UTCidentified
The issue has been identified and a fix is being implemented.
4. Oktober 2021 um 08:56 UTCmonitoring
A fix has been implemented and we are monitoring the results.
4. Oktober 2021 um 09:02 UTCresolved
This incident has been resolved.

Increased Error Rate in Inspections

Beginn 30. September 2021 um 16:00 UTC 5h 14m

OutageSchwerwiegender Vorfall

Betroffene Komponenten

Workers

30. September 2021 um 18:09 UTCidentified
The issue has been identified and a fix is being implemented.
30. September 2021 um 18:34 UTCmonitoring
A fix has been implemented and we are monitoring the results.
30. September 2021 um 21:14 UTCresolved
This incident has been resolved.

Delay in scheduling source installation

Beginn 7. Juli 2021 um 11:53 UTC 50m

IssuesGeringfügiger Vorfall

Betroffene Komponenten

Workers

7. Juli 2021 um 11:53 UTCinvestigating
We are currently investigating this issue.
7. Juli 2021 um 12:00 UTCidentified
The issue has been identified and a fix is being implemented.
7. Juli 2021 um 12:06 UTCmonitoring
A fix has been implemented and we are monitoring the results.
7. Juli 2021 um 12:44 UTCresolved
This incident has been resolved.

Increased Backlog

Beginn 17. Mai 2021 um 06:28 UTC 1h 31m

IssuesGeringfügiger Vorfall

Betroffene Komponenten

Workers

17. Mai 2021 um 06:28 UTCinvestigating
We are currently investigating this issue.
17. Mai 2021 um 06:55 UTCidentified
The issue has been identified and a fix is being implemented.
17. Mai 2021 um 07:10 UTCmonitoring
A fix has been implemented and we are monitoring the results.
17. Mai 2021 um 07:58 UTCresolved
This incident has been resolved.

Increased Backlog in Tasks

Beginn 30. März 2021 um 09:29 UTC 1h 22m

IssuesGeringfügiger Vorfall

Betroffene Komponenten

Workers

30. März 2021 um 09:29 UTCinvestigating
We are currently investigating this issue.
30. März 2021 um 09:41 UTCidentified
The issue has been identified and a fix is being implemented.
30. März 2021 um 09:50 UTCmonitoring
A fix has been implemented and we are monitoring the results.
30. März 2021 um 10:51 UTCresolved
This incident has been resolved.

Delayed Inspection Processing

Beginn 25. März 2021 um 14:17 UTC 18m

IssuesGeringfügiger Vorfall

Betroffene Komponenten

Workers

25. März 2021 um 14:17 UTCinvestigating
We are currently investigating this issue.
25. März 2021 um 14:35 UTCresolved
This incident has been resolved.