Cloudsmith outage history

We are investigating reports of intermittent UI timeouts affecting the Package view, starting at approximately 12:16 PM UTC. Our engineering team is actively working to identify and resolve the underlying cause. We will post our next update by 12:51 PM UTC.

We are investigating reports of intermittent UI timeouts affecting the Package view, starting at approximately 12:16 PM UTC. Users may experience 504 timeout errors on the Packages view. Our engineering team has identified the issue, and mitigation steps are being deployed. Next Update by 16:00 UTC

Scope has been determined to be non-production only, so the incident is marked as non-impacting.

We are investigating reports of intermittent 500 errors affecting API and web requests across all regions, starting from approximately 17:14 UTC and finishing at 17:15 UTC (Approx 31 seconds impact), related to Database connection exhaustion. We detected a small number of errors across millions of successful requests in the window. The team is investigating the cause

Impact has been confirmed as ended. The engineering team is investigating & monitoring.

No further impact to API or Web applications outside of the 1 minute window

We are currently investigating elevated latency for Python package downloads. Users may experience slow request times or timeouts when downloading packages. Our engineering team is actively investigating, and we'll update the status accordingly.

Our engineering team has identified the cause and is working to resolve the issue.

We have confirmed that our work has returned services to normal operations.

We are investigating reports of intermittent authentication failures affecting Docker and Helm OCI logins for customers in all regions, starting from approximately 09:24UTC. We will post our next update by 09:54 UTC. This did not impact Enterprise (custom) domains or Enterprise Customers with custom domains.

We've reverted a change and confirmed resolution. This did not impact Enterprise (custom) domains or Enterprise Customers with custom domains.

We are investigating reports of Intermittent RPM package upload sync failures affecting package synchronisation for customers starting from approximately 15:53 UTC today. Our engineering team is actively working on the issue and has already implemented immediate mitigations. We will post our next update by 17:51 UTC.

We are investigating reports of Intermittent RPM package upload sync failures affecting package synchronisation for customers starting from approximately 15:53 UTC today. Our engineering team is actively working on the issue and is currently deploying a fix. We will post our next update by 18:20 UTC.

We are investigating reports of Intermittent RPM package upload sync failures affecting package synchronisation for customers starting from approximately 15:53 UTC today. Our engineers have successfully deployed a fix and are currently re-syncing affected packages. We will post our next update by 18:37 UTC at the latest.

Packages have successfully resynced and package syncing is operating as expected

We are currently investigating elevated latency for Python package downloads across the US West & EU West regions. Users may experience slow request times or timeouts when downloading packages. Our engineering team is actively investigating, and we'll update the status accordingly.

We are continuing to investigate elevated latency for Python package downloads across the US West & EU West regions. Users may experience slow request times or timeouts when downloading packages. Our engineering team is currently undertaking several actions to return to normal operations, and we'll update the status accordingly

We have confirmed the cause of elevated latency for Python package downloads across the US West & EU West regions. The Engineering team has released a change internally and we're monitoring the service to confirm continued stability.

We have confirmed that our change has returned stability to the service

Customers may experience intermittent sync failures for docker images. Our engineers our currently investigating.

The issue has been identified and our engineering team is currently working on deploying a fix. We will share the next update once the fix is deployed.

Package syncing has been restored. Some security scan results may be delayed while we finish rolling out the remaining fix.

Package sync is now fully operational. Some customers may have experienced failures in generating SBOMs during mitigation. We are running a backfill.

Backfill is currently in progress. We will share the next update once it is completed.

Services have become fully operational and the backfill for the impacted SBOMs have completed. We are continuing to monitor the platform to ensure stability.

We experienced minor service degradation in eu-west-1 between 1:15am and 7:25am UTC. During this time, some customers may have experienced elevated error rates when using the web application, API, or downloading packages. Our engineers identified the root cause and implemented a mitigation. Services have recovered and we are continuing to monitor the platform to ensure stability.

Services have recovered and we are continuing to monitor the platform to ensure stability.

We are experiencing elevated error rates across all regions. Our engineers are investigating the cause.

Our Engineers have identified and resolved the issue. We will continue to monitor.

System has returned to normal operational levels.

We are investigating reports of degraded performance to package downloads and APIs in the Europe and US East regions.

We have taken steps to mitigate the issue. We are seeing operations return to normal levels in most regions. Customers may still experience some degradation in us-west-2.

The system has returned to normal operations across all regions, and we will continue to monitor stability.

All systems are operational.

We are investigating reports of degraded performance to package downloads and APIs in the Europe and US East regions.

We have taken steps to mitigate the issue and are actively monitoring the results.

The mitigation steps taken have resolved the issue. Latency has returned to normal levels, and we will continue monitoring for stability.

We're currently investigating performance issues affecting continuous policy evaluations for existing packages. As a precaution, we've temporarily disabled this feature while our team works on a resolution. Newly ingested packages continue to be evaluated as normal, and index-level cooldown policies remain unaffected. We're actively working to restore full functionality and will provide updates as we make progress.

We're currently investigating performance issues affecting continuous policy evaluations for existing packages. As a precaution, we've temporarily disabled this feature while our team works on a resolution. Newly ingested packages continue to be evaluated as normal, and index-level cooldown policies remain unaffected. No other operations for package upload, processing, or download are affected. We've identified several actions and will continue to keep you updated on progress.

We've identified the root cause and have a fix in progress. We've re-enabled continuous policy evaluations and are actively monitoring platform performance. We'll provide a further update once the fix is fully rolled out.

We've re-enabled continuous policy evaluations and are actively monitoring platform performance. The system is operational, and we're continuing to work on backfill and further performance enhancements.

We've re-enabled continuous policy evaluations and are continuing to monitor platform performance. The system is operational, and we're continuing our work on the backfill and additional performance enhancements. We'll provide additional updates on Thursday 25th June.

The system is operational, and we're continuing our work on the backfill and additional performance enhancements. We'll provide additional updates as we progress

The system is operational, and we've resolved the backfill operation and our additional performance enhancements.

We’re seeing an increase in request times. API and Web UI requests are impacted. Our engineers are investigating.

We have mitigated the issue and request queuing has reduced. API requests & Web App are returning to normal response times. We are actively monitoring.

No further impacts were noted during the monitoring. All services are working as expected.

We are investigating reports of degraded performance to package downloads and apis in the Europe region

Performance has returned to normal in the Europe region.

We are currently investigating an issue affecting some analytics and UI queries. A small percentage of requests are experiencing timeouts around 10 seconds or returning errors. Most queries are completing successfully. We're working with our partners on investigating and mitigating this issue.

We are continuing to investigate an issue affecting some analytics and UI queries. A small percentage of requests are timing out (around 10 seconds) or returning errors. We’re continuing to work with our partners to investigate and mitigate the issue.

We are continuing to monitor the issue affecting analytics and UI queries within the Cloudsmith web app, client log exports, and Datadog integrations. Working alongside our infrastructure partners, a root cause has been identified. Mitigation efforts are currently underway to restore full capacity. A large majority of queries continue to complete successfully. We will provide another update once the issue is fully resolved or within the next 1 hour.

Working with our infrastructure partners, we've received confirmation that the issue has been resolved. We are validating across our platform, and we'll provide another update with confirmation within the next hour.

We've validated across our platform and confirmed all services are operating normally

We’re seeing an increase in error rates in the US region. Our engineers are investigating the cause.

The elevated download errors have been resolved, and all systems are running normally. Impact Windows (UTC): • us-west: 16:35 – 16:47 • us-east: 17:02 – 17:03

We can confirm the issue has been resolved.

We are currently experiencing elevated error rates and increased request latency. Our engineers are actively investigating the cause. Impacted services • Europe: Requests are partially impacted • Uploads: Requests are partially impacted across all regions • Docker: Downloads are partially impacted across all regions • US, Tokyo, Sydney: Downloads are not affected at this time

We are currently experiencing elevated error rates and increased request latency related to a significant increase in illegitimate network requests Impacted services • Europe: Requests are partially impacted • Uploads: Requests are partially impacted across all regions • Docker: Downloads are partially impacted across all regions • US, Tokyo, Sydney: Downloads are not affected at this time Engineers are engaged and continuing to investigate & mitigate

We have mitigated the issue related to the significant increase in illegitimate network requests, and we're continuing to monitor service availability & performance.

We have mitigated the issue related to the significant increase in illegitimate network requests, and we're continuing to monitor service availability & performance. **Impact:** **Region:** EU **Web Applications:** Service Degradation **API:** Partial Service Degradation **Uploads/Downloads:** Partial Service Degradation

We can confirm the issue has been fully resolved.

We are seeing an increase in errors for users accessing the classic web app and our new web app. Our engineers are investigating this issue.

Error rates for the classic and new web apps have returned to normal levels. Our engineers are continuing to monitor to ensure stability.

We have taken measures to ensure continued stability. After continued monitoring, we have confirmed that error rates remain at normal levels for both the classic and new web apps.

Since 19:00 UTC on 14 May, customers outside the EU may experience intermittent failures when pushing Docker packages. Our engineers are investigating the issue.

We’ve identified the issue. The main region impacted was Japan. The engineering team has implemented a fix and is now monitoring the system.

We can confirm that the issue is now resolved.

We are aware of an issue affecting session management. Our team has taken mitigative action and customers may notice some session timeouts. Users encountering issues should log back into the webapp, and any failed jobs should succeed on rerun.

We have resolved the issue affecting session management. The underlying cause has been addressed and our engineers are continuing to monitor. Customers who were experiencing session timeouts should now be able to log in without issue, and any previously failed jobs should complete successfully on rerun. We apologize for any inconvenience this may have caused.

We can confirm the session management issue has been fully resolved and all systems are operating normally.