이메일 전송 오류
- resolved
상태: 해결된 해결책은 유효했습니다. Affected 부품 비밀 탐지 API (Operational)
공식 인시던트 업데이트를 자동 번역했습니다.
33 Gitguardian incidents · 2021년 3월 — official updates, affected components, duration and resolution details.
상태: 해결된 해결책은 유효했습니다. Affected 부품 비밀 탐지 API (Operational)
공식 인시던트 업데이트를 자동 번역했습니다.
상태: Resolved 체계는 정상 가동으로 돌아갑니다. Affected Components Webhooks (Operational) 비밀 탐지 - 스캔 체크 실행 (Operational)
공식 인시던트 업데이트를 자동 번역했습니다.
상태: 해결된 해결. 데이터베이스 쿼리 최적화를 따르고 노이즈 백그라운드 작업에서 부하를 줄이면 더 성능 향상이 관찰되지 않았습니다. 미터는 해결의 배포부터 안정되었습니다. 감염된 부품 비밀 탐지 - 스캔 체크 실행 (Operational)
공식 인시던트 업데이트를 자동 번역했습니다.
상태: 해결 이 사건은 이제 해결되었습니다. 우리의 팀에 의해 배치된 수정 후에, 우리는 더 성과 degradation를 관찰하지 않으며, 미터는 안정되어 있습니다. 감염된 부품 비밀 탐지 - 스캔 체크 실행 (Operational)
공식 인시던트 업데이트를 자동 번역했습니다.
우리는 현재 우리의 공중 ingestion 파이프라인에 있는 degraded 성과를 경험하고 있습니다. GitHub API의 지속적인 아웃리지로 인해 GitHub는 자체 상태 페이지에서 인정 받았습니다. 우리 팀은 적극적으로 상황을 모니터링하고 있습니다. 루트 원인은 GitHub의 측에 있기 때문에, 해결은 GitHub에서 API를 복원합니다. 우리의 파이프라인은 GitHub 복구를 한 번 자동적으로 재시작하도록 설계되었으며, 상황에 따라 더 많은 업데이트를 제공할 것입니다.
GitHub는 API를 복원하고, 우리의 공개 ingestion 파이프라인은 복구. 실시간 이벤트 ingestion and commit retrieval are resuming. 우리는 전체 복구를 확인하기 위해 상황을 모니터링하고 파이프 라인은 일반적으로 처리됩니다. 우리는 사건이 완전히 해결되면 최종 업데이트를 제공합니다.
GitHub는 API를 복원하고, 우리의 공공 ingestion 파이프라인은 완전히 복구되었습니다. Real-time event ingestion and commit retrieval은 정상적으로 동작합니다. 이 사건은 업스트림 GitHub API 아웃리지에 의해 발생했으며 이제 해결되었습니다. 감사합니다.
공식 인시던트 업데이트를 자동 번역했습니다.
우리는 현재 일부 고객이 체크를 처리 할 때 느린의 간헐적인 스파이크를 경험할 수있는 문제점을 조사하고 있습니다. 우리 팀은 수정을 배포하고 상황을 적극적으로 모니터링합니다. 우리는 상황에 따라 업데이트를 제공 할 것입니다. 우리는 불편을 끼쳐 드려요.
수정은 성공적으로 배포되고 상황은 정상으로 돌아야합니다. 불편을 드려 죄송합니다.
공식 인시던트 업데이트를 자동 번역했습니다.
Status: Resolved What happened:From June 1 12:00am UTC to June 1 08:45am UTC, one of the component serving the public monitoring experienced some delays and a growing backlog of unprocessed messages. Impact:No data was lost. The only impact for customers could have been a delay between the detection of a secret and the moment the corresponding incident was created in the customer's dashboard. The problem is now fixed, the faulty component was able to re-start and to process the backlog of messages.
Status: Resolved We deployed a fix today that addressed the check run issues. A brief database load increase was observed post-deployment with no impact on check run results.This incident is now resolved. Affected components Secret Detection - Scan Check Run (Operational)
Due to an availability issue of github.com Actions APIs (https://www.githubstatus.com/incidents/z3c6q056q332), some check runs have timed out on our side, resulting in a neutral status.
We are currently experiencing an incident on GPUB that started around yesterday, 10PM Monday 13th of March. An unexpected activity led to an overload of the queuing system of GPUB. We are deploying a fix to resume processing and catch up with the lag. In terms of data, some events will need to be reprocessed afterward, and we need to assess if some events cannot be processed again.
The fix has been deployed, the processing has resumed at full speed and the awaiting queue will be processing within the next hour.
This incident has been resolved.
Following a upgrade operation of a network component, GIM endpoints have been unavailable most of the time during this incident between 09:48 and 10:24 UTC. Fix has been deployed, situation is still under monitoring.
During deployment of GIM new version, The app was malfunctioning for a few minutes. The events that failed to evaluate during the incidents have been processed again.
We have identified a Network issue on Internal Repositories Monitoring that impacted Hook, Dashboard and API.
Following a DNS misconfiguration, GitGuardian Internal Monitoring platform was unavailable for about 20 minutes. Impact: No realtime scan (webhook): - GitHub events from recent GHE instances and Github.com were redelivered after the incident - Other events (BitBucket, GitLab) have been lost but we fully rescanned repositories when possible No API for secrets detection: CI and pre-commit hook failed. Dashboard was unavailable. Impacted entries: - api.gitguardian.com - dashboard.gitguardian.com - hook.gitguardian.com
Since October 17th, 2022, 12:28am (CEST) we are sending notifications by email for certain incidents already present in your workspace. We are currently investigating this incident.
This incident has been resolved.
On October 17th 2022, at around 5pm GMT, The queuing system in charge of handling Github Check Runs and Real Time Monitoring accumulated tasks that were slow to process and impacted the whole system. The size of the task queue started increasing for several hours straight, delaying processing for all customers. until it started decreasing again and went back to normal the day after at around 1am GMT, where processing time was back to normal. This event occurred again on October 18th 2022, at around 4pm GMT, but has been detected earlier and have been solved at 5pm GMT. Actions were taken to avoid this issue to happen again: It includes a better monitoring of those queues to improve time to detect an issue. The montoring of processing latencies on a end-user point of view will be improved too. More long terms actions are also planned, including implementing mechanisms to avoid accumulating latency in case of slow tasks accumulations.
We are continuing to work on a fix for this issue.
This incident has been resolved.
From Friday 9th Sept 6:30pm UTC to Monday 12th Sept 7:30 UTC, data collectors services were partially down due to an internal error. Github events have been correctly gathered into GitGuardian platform but processing of those events was down. There is no data loss but no alerts have been sent during this period of time. The processing has resumed correctly on Monday 12th Sept 7:30 UTC, the backdata from the week-end is being analyzed and should be caught up around 12pm. Update Monday 12th Sept. 10:25am UTC: Queues processing is slower than expected, ETA for catch up with the lag is postponed to at least to Tuesday morning (UTC), more precise ETA will be communicated when available. Update Monday 12th Sept. 2:05pm UTC: Slowness issues have been solved, queues processing has resumed at normal speed, ETA for catch up with the lag is Monday 12th Sept. 5:00pm UTC
This incident has been resolved.
A fix has been implemented and the systems are getting back to normal progressively.
Start of the issue.
We have an issue with our database. We are still evaluating the impact.
The incident has been resolved at 9h10 CEST.
The incident has been resolved.
We have detected a spike in errors on some endpoints of GitGuardian Internal Monitoring API. Our teams are investigating.