Elevated queue times on saas-linux-medium-arm64 runner
开始时间 2026年8月13日 UTC 17:47 · 0m
Outage重大事件
resolved
August 13, 2026 13:58 UTC Investigating - We are seeing a growing queue of pending jobs on the saas-linux-medium-arm64 hosted runner on GitLab.com. We are rolling out a mitigation. Details: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22702 August 13, 2026 15:22 UTC Monitoring - The issue is mitigated and the queue of pending jobs on saas-linux-medium-arm64 is going down. We are monitoring recovery. Details: gitlab.com/gitlab-com/gl-infra/production/-/work_items/22702 August 13, 2026 16:48 UTC Monitoring - The queue of pending jobs on the affected runners has returned to normal and we are monitoring recovery. Details: gitlab.com/gitlab-com/gl-infra/production/-/work_items/22702 August 13, 2026 17:47 UTC Resolved - The queue of pending jobs on the affected runners has returned to normal and has stayed at that level. This incident is now resolved. Please open a ticket with support if you are still seeing job delays. Details: gitlab.com/gitlab-com/gl-infra/production/-/work_items/22702
Issue with background jobs
开始时间 2026年8月6日 UTC 16:22 · 0m
Issues轻微事件
resolved
August 6, 2026 14:01 UTC Investigating - We are investigating an issue affecting background jobs, including webhook delivery and pipelines. For more info, see: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22661 August 6, 2026 14:26 UTC Identified - We have identified the cause of the issue and we are taking action to mitigate customer impact. For more info, see: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22661 August 6, 2026 16:22 UTC Resolved - We're seeing consistent background job and webhook delivery. The issue is now resolved.
Issues with pipelines
开始时间 2026年8月5日 UTC 23:47 · 0m
Issues轻微事件
resolved
August 5, 2026 22:13 UTC Investigating - We're investigating reports of pipelines failing and becoming stuck. Details in https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22654. August 5, 2026 22:39 UTC Investigating - We've disabled a worker, which should let the job queue begin recovering while we continue investigating the root cause. Details in https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22654. August 5, 2026 23:26 UTC Identified - We've identified a likely root cause, and the job queue has remained healthy. Details in https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22654. August 5, 2026 23:47 UTC Resolved - We've applied mitigations that have stabilized the job queue. The issue is now resolved. Details in https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22654.
Issues with webhook deliveries
开始时间 2026年8月5日 UTC 15:19 · 0m
Issues轻微事件
resolved
August 4, 2026 16:42 UTC Investigating - We are investigating reports of webhook deliveries from GitLab.com originating from IP addresses outside our documented ranges. Details in https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22637. August 4, 2026 18:49 UTC Investigating - Our investigation is ongoing. We will provide another update by 21:00 UTC. August 4, 2026 21:07 UTC Identified - We've traced the issue to a recent network change and are preparing a fix. Another update will be provided by 23:00 UTC. August 4, 2026 23:14 UTC Identified - Deployment of the fix is progressing steadily. Another update will be provided once deployed. Details in https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22637. August 5, 2026 03:26 UTC Monitoring - A fix has been deployed and checks have confirmed that unexpected IP addresses are no longer being used. August 5, 2026 15:19 UTC Resolved - Webhook delivery failures have subsided in logs, and customer reports indicate no further errors. This incident is considered resolved.
与 Duo 码审查流程
开始时间 2026年8月4日 UTC 17:54 · 0m
Issues轻微事件
resolved
August 4, 2026 13:56 UTC Investigating - We are investigating an issue which may be affecting Duo Code Review Flows. For more info, see: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22633 August 4, 2026 16:30 UTC Identified - We've identified the cause of the issue and have temporarily reverted the default Agentic Chat model to Sonnet 4.6 while we continue to investigate. Details in https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22633. August 4, 2026 17:54 UTC Resolved - Duo Code Review sessions on GitLab.com have returned to normal operation. This issue is now resolved.
July 7, 2026 17:47 UTC Identified - We've discovered that attempts to delete newly created MR approval rules may fail in certain cases. The cause has been identified and the fix is in the works. More: https://gitlab.com/gitlab-org/gitlab/-/work_items/605117 July 7, 2026 17:48 UTC Identified - We've discovered that attempts to delete newly created MR approval rules may fail in certain cases. The cause has been identified and the fix is in the works. More: gitlab.com/gitlab-org/gitlab/-/work_items/605117 July 7, 2026 18:35 UTC Identified - The fix is still in progress, no updates at this time. More: https://gitlab.com/gitlab-org/gitlab/-/work_items/605117 July 7, 2026 19:29 UTC Identified - A merge request fix has been created and is currently being worked on. We will update as the situation changes. More: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22470 July 7, 2026 20:00 UTC Identified - No updates at this time. A merge request fix has been created and is currently being worked on. More: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22470 July 7, 2026 20:42 UTC Identified - No further updates at this time. The merge request is in progress. More: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22470 July 7, 2026 22:40 UTC Identified - The fix will merge as soon as it's pipeline completes. The status will change to monitoring at that time. More: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22470 July 7, 2026 23:02 UTC Monitoring - The fix has been merged and we are now monitoring. If you still experience the issues, please open a ticket with support. More: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22470 July 8, 2026 15:59 UTC Resolved - The fix has been completed in production. This incident is now resolve. More: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22470
CI pipelines stuck in pending state
开始时间 2026年7月1日 UTC 14:04 · 0m
Issues轻微事件
resolved
July 1, 2026 13:14 UTC Investigating - We are currently investigating the cause of CI pipelines being stuck in pending state. More details can be found here: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22433 July 1, 2026 13:58 UTC Investigating - We are continuing to investigate and look into CI pipelines being stuck in pending state. July 1, 2026 14:04 UTC Resolved - Incident has now been mitigated. CI pipelines are now resuming. Engineers will continue to monitor this recovery.
Code Suggestions not working
开始时间 2026年6月30日 UTC 23:59 · 0m
Issues轻微事件
resolved
June 30, 2026 21:53 UTC Investigating - We are investigating errors with code suggestion not completing. June 30, 2026 22:08 UTC Investigating - We are continuing to investigate the issue, but it appears to be isolated to specific models and we recommend for the time being switching to Claude Sonnet 4.5 for code completion while we continue to investigate the matter. Details on how to do that can be found at https://docs.gitlab.com/user/gitlab_duo/model_selection/#select-a-model-for-a-feature June 30, 2026 23:06 UTC Identified - We have identified the issue and are pushing a fix. While this fix is pushed we still recommend switching to Claude Sonnet 4.5 until the fix is fully pushed. June 30, 2026 23:30 UTC Monitoring - The fix is pushed and systems appear to be operating normally. We are monitoring the situation to ensure that services have returned to normal. June 30, 2026 23:59 UTC Resolved - Operations have returned to normal and this issue is resolved.