Pricing
Status historyRSS updatesStatus API

Powered by Uptimus

    Solarwinds 장애 기록

    50 Solarwinds incidents · 2018년 7월 — official updates, affected components, duration and resolution details.

    현재 상태로 돌아가기

    DPM System Degradation

    시작 2025년 10월 20일 오후 6:30 UTC · 1h 32m

    Issues경미한 인시던트
    영향을 받은 구성 요소
    Query Sample ProcessingAPIsMetrics Ingest PipelineMetrics DownsamplingAlert Integrations
    1. 2025년 10월 20일 오후 6:30 UTCinvestigating

      We are currently experiencing service degradation due to an issue with our cloud provider. Our teams are working closely with their engineers to resolve the impact as quickly as possible. We’ll provide an update as soon as more information becomes available.

    2. 2025년 10월 20일 오후 6:43 UTCidentified

      We are currently experiencing service degradation due to an issue with our cloud provider. Our teams are working closely with their engineers to resolve the impact as quickly as possible. We’ll provide an update as soon as more information becomes available.

    3. 2025년 10월 20일 오후 8:02 UTCresolved

      This incident has been resolved.

    Delayed Alerts

    시작 2025년 10월 20일 오후 2:00 UTC · 0m

    Pending
    1. 2025년 10월 23일 오후 9:37 UTCresolved

      Between 07:10 AM and 11:54 AM UTC on October 20, 2025, we experienced a delay in alert notifications triggered by metric thresholds. The issue was caused by a service degradation at our cloud provider, which impacted the timely processing and delivery of alerts. The provider has since resolved the underlying issue, and our alerting systems have fully recovered.

    Ingest Pipeline Processing

    시작 2024년 11월 19일 오후 7:14 UTC · 11h 16m

    Issues경미한 인시던트
    영향을 받은 구성 요소
    APIsMetrics Ingest PipelineAlert Integrations
    1. 2024년 11월 19일 오후 7:14 UTCinvestigating

      Ingest pipeline congestion resulted in a backlog. We have disabled processing for some elements and things are stabilizing. Disabled elements will be re-enabled in a controlled fashion once all other customers are caught up

    2. 2024년 11월 19일 오후 9:10 UTCinvestigating

      We are continuing to investigate this issue.

    3. 2024년 11월 19일 오후 10:54 UTCidentified

      The issue has been identified and a fix has been implemented.

    4. 2024년 11월 20일 오전 6:16 UTCmonitoring

      A fix has been implemented and we are monitoring the results.

    5. 2024년 11월 20일 오전 6:30 UTCresolved

      This incident has been resolved.

    Login Issues

    시작 2024년 8월 21일 오전 11:26 UTC · 7h 33m

    Outage중대한 인시던트
    영향을 받은 구성 요소
    Web Application
    1. 2024년 8월 21일 오전 11:26 UTCinvestigating

      There have been reports of login issues, which we are actively investigating.

    2. 2024년 8월 21일 오후 5:27 UTCmonitoring

      An issue has been addressed and the situation seems to be improving rapidly. We expect the processing backlog to be entirely cleared shortly, at which time it is anticipated that API response times should improve.

    3. 2024년 8월 21일 오후 6:59 UTCresolved

      This incident has been resolved.

    Checkins issue

    시작 2024년 8월 20일 오후 9:48 UTC · 7h 13m

    Outage중대한 인시던트
    영향을 받은 구성 요소
    Query Sample ProcessingWeb ApplicationAPIsMetrics Ingest PipelineMetrics DownsamplingAlert Integrations
    1. 2024년 8월 20일 오후 9:48 UTCinvestigating

      Connections to one of the shard servers are experiencing issues, which impacts environments hosted on that shard. We are investigating the issue.

    2. 2024년 8월 20일 오후 11:19 UTCinvestigating

      We are continuing to investigate this issue.

    3. 2024년 8월 21일 오전 3:11 UTCidentified

      The issue has been identified and a fix is being implemented.

    4. 2024년 8월 21일 오전 4:36 UTCmonitoring

      Most backlog has cleared and we are monitoring the progress

    5. 2024년 8월 21일 오전 5:01 UTCresolved

      All backlogs have cleared, and no issues are evident with the service at this time.

    Event processing

    시작 2024년 8월 9일 오후 4:26 UTC · 6h 36m

    Issues경미한 인시던트
    영향을 받은 구성 요소
    APIs
    1. 2024년 8월 9일 오후 4:26 UTCinvestigating

      There is an issue with event processing that may cause alerts to be delayed or not issued. Investigation continues.

    2. 2024년 8월 9일 오후 4:49 UTCmonitoring

      A fix has been implemented and we are monitoring the results. There is a processing backlog, which we expect will clear shortly.

    3. 2024년 8월 9일 오후 11:02 UTCresolved

      This incident has been resolved. All backlog has been cleared.

    Event processing delayed

    시작 2024년 8월 9일 오전 12:00 UTC · 0m

    Outage중대한 인시던트
    1. 2024년 8월 9일 오후 2:49 UTCresolved

      There is an issue with event processing that may cause alerts to be delayed or not issued. Investigation continues.

    Query Sample Processing Slowdown

    시작 2023년 11월 30일 오후 7:41 UTC · 5d 15h

    Issues경미한 인시던트
    영향을 받은 구성 요소
    Query Sample Processing
    1. 2023년 11월 30일 오후 7:41 UTCinvestigating

      We have detected some slowdowns in Query Sample processing, and are currently investigating the issue

    2. 2023년 12월 1일 오후 5:36 UTCmonitoring

      Last night, our team identified the issue and applied a fix. Conditions have improved and we are currently monitoring for the query sample processing backlog to clear

    3. 2023년 12월 1일 오후 6:30 UTCmonitoring

      We are continuing to monitor for any further issues.

    4. 2023년 12월 2일 오후 6:33 UTCmonitoring

      While conditions have improved, the backlog has not yet cleared. We continue to monitor for the query sample processing backlog to clear.

    5. 2023년 12월 3일 오후 6:58 UTCmonitoring

      The Query Sample Processing backlog has continued to improve but is not yet 100% finished. Many customer environments are current, with a few seeing about a 1-day lag.

    6. 2023년 12월 4일 오후 4:50 UTCmonitoring

      The majority of samples are now being processed in real-time, and we continue to monitor the remaining backlog

    7. 2023년 12월 5일 오후 2:55 UTCmonitoring

      A small number of environments are still affected, and we are expecting to clear the remaining backlog by tomorrow (Wednesday 6th)

    8. 2023년 12월 6일 오전 10:51 UTCresolved

      This incident has been resolved.

    Delayed Ingestion

    시작 2023년 11월 7일 오후 4:06 UTC · 15d 23h

    Issues경미한 인시던트
    영향을 받은 구성 요소
    Metrics Ingest Pipeline
    1. 2023년 11월 7일 오후 4:06 UTCinvestigating

      The issue has been identified. Possible fixes are under investigation.

    2. 2023년 11월 9일 오후 7:22 UTCidentified

      The issue has been identified and a fix is being implemented. Currently, a few customer environments may see data gaps in some charts.

    3. 2023년 11월 20일 오후 9:45 UTCmonitoring

      Over the last few days, we have continued to see a large amount data coming into our ingestion pipeline. We have tried to address this issue by increasing our infrastructure capacity and have tuned the configurations to the maximum allowed limits. In parallel, we have paused one of the problematic environments temporarily to not inundate the ingestion pipeline. These actions are helping to process the data at an improved speed. However, it may still take 2-3 days to get through all the backlog. Until such time, some customers may see some data gaps in monitoring.

    4. 2023년 11월 21일 오후 9:04 UTCmonitoring

      Although progress has been made in reducing the backlog in the ingestion pipeline for certain environments, the processing speed is not meeting our desired pace. We are actively examining the source and quantity of incoming data to find ways to decrease the amount of data being ingested, aiming to enhance processing efficiency. This involves tasks such as relocating high-volume workloads for manual load balancing. Additionally, the architecture team is ongoing in their assessment of scaling options to further address the issue.

    5. 2023년 11월 22일 오후 5:25 UTCmonitoring

      Our recent initiative to relocate demanding workloads has significantly boosted the performance of our ingestion pipeline. Processing has become more efficient, and we anticipate that within the next 24 hours, the system is expected to clear the entire backlog, based on the current rate and trend. We're actively monitoring the situation and concurrently working on further optimizing processing of incoming data.

    6. 2023년 11월 23일 오후 3:17 UTCresolved

      The delayed ingestion issue was resolved approximately at 11:00 pm EST on 11/22/2023. All customer environments are functioning normally. We are continuing to monitor the environment. If you are experiencing any difficulties, please contact us at https://support.solarwinds.com/

    DPM memory leaks for Mongo Agents

    시작 2023년 8월 1일 오후 3:24 UTC · 1d 22h

    Pending
    영향을 받은 구성 요소
    Metrics Ingest Pipeline
    1. 2023년 8월 1일 오후 3:24 UTCinvestigating

      We are currently investigating the issue.

    2. 2023년 8월 1일 오후 6:01 UTCidentified

      We are in the process of reverting to a stable version. Will update the status once the reversion happens.

    3. 2023년 8월 1일 오후 11:37 UTCmonitoring

      We have reverted to a previous version in a controlled environment to monitor further.

    4. 2023년 8월 3일 오후 1:53 UTCresolved

      We have reverted our changes and the issue is resolved

    Host checkins and metrics ingestion slowdown

    시작 2022년 9월 28일 오후 5:15 UTC · 1d 13h

    Issues경미한 인시던트
    영향을 받은 구성 요소
    Web ApplicationMetrics Ingest Pipeline
    1. 2022년 9월 28일 오후 5:15 UTCinvestigating

      We are currently investigating this issue.

    2. 2022년 9월 29일 오후 4:45 UTCmonitoring

      Issue identified & addressed, everything catching up, continuing to monitor.

    3. 2022년 9월 30일 오전 7:05 UTCresolved

      This incident has been resolved.

    querysample processing delay

    시작 2022년 3월 26일 오후 7:05 UTC · 12h 7m

    Issues경미한 인시던트
    영향을 받은 구성 요소
    Query Sample Processing
    1. 2022년 3월 26일 오후 7:05 UTCinvestigating

      Querysample processing is functional, but may be delayed/degraded at this time; we are working on the issue.

    2. 2022년 3월 26일 오후 11:53 UTCidentified

      The issue has been identified and a fix is being implemented.

    3. 2022년 3월 27일 오전 12:58 UTCmonitoring

      A fix has been implemented and we are monitoring the results.

    4. 2022년 3월 27일 오전 7:12 UTCresolved

      This incident has been resolved.

    Event processing issues

    시작 2022년 3월 21일 오후 5:29 UTC · 1h 50m

    Outage중대한 인시던트
    영향을 받은 구성 요소
    Alert Integrations
    1. 2022년 3월 21일 오후 5:29 UTCidentified

      We have identified issues in Event processing which may affect some clients; we are working to remedy the issue

    2. 2022년 3월 21일 오후 7:05 UTCmonitoring

      A fix has been implemented and we are monitoring the results. We believe that there is zero impact at this time.

    3. 2022년 3월 21일 오후 7:19 UTCresolved

      This incident has been resolved.

    Host checkins and metrics ingestion slowdown

    시작 2021년 12월 22일 오후 4:20 UTC · 3h 23m

    Pending
    영향을 받은 구성 요소
    Query Sample ProcessingMetrics Downsampling
    1. 2021년 12월 22일 오후 4:20 UTCmonitoring

      Situation seems to have stabilized; we have backfilled gaps and continue to monitor. There may be further incidents until the infrastructure is completely stable.

    2. 2021년 12월 22일 오후 7:43 UTCresolved

      This incident has been resolved.

    Host checkins and metrics ingestion slowdown

    시작 2021년 8월 25일 오전 11:18 UTC · 12h 35m

    Pending
    영향을 받은 구성 요소
    Query Sample ProcessingMetrics Downsampling
    1. 2021년 8월 25일 오전 11:18 UTCinvestigating

      We are currently investigating this issue.

    2. 2021년 8월 25일 오후 2:24 UTCidentified

      The issue has been identified and a fix is being implemented.

    3. 2021년 8월 25일 오후 11:52 UTCresolved

      This incident has been resolved.

    Host checkins and metrics ingestion slowdown

    시작 2021년 6월 14일 오후 7:15 UTC · 46m

    Pending
    영향을 받은 구성 요소
    Metrics Ingest Pipeline
    1. 2021년 6월 14일 오후 7:15 UTCinvestigating

      We are currently investigating this issue.

    2. 2021년 6월 14일 오후 7:27 UTCmonitoring

      A fix has been implemented and we are monitoring the results.

    3. 2021년 6월 14일 오후 8:01 UTCresolved

      This incident has been resolved.

    DPM system outage

    시작 2021년 5월 25일 오후 12:13 UTC · 35m

    Outage심각한 인시던트
    영향을 받은 구성 요소
    Web ApplicationAPIsMetrics Ingest Pipeline
    1. 2021년 5월 25일 오후 12:13 UTCidentified

      We are currently investigating a system wide outage.

    2. 2021년 5월 25일 오후 12:22 UTCmonitoring

      The application is back up. We are monitoring the state of the system.

    3. 2021년 5월 25일 오후 12:48 UTCresolved

      All systems have recovered. We will continue to monitor.

    System slowdown / outage

    시작 2021년 5월 21일 오후 8:10 UTC · 1h 4m

    Pending
    영향을 받은 구성 요소
    Query Sample ProcessingWeb ApplicationAPIsMetrics Ingest PipelineMetrics Downsampling
    1. 2021년 5월 21일 오후 8:10 UTCinvestigating

      Metrics processing has fallen behind, and some clients are not able to view their hosts.

    2. 2021년 5월 21일 오후 8:58 UTCmonitoring

      We are processing the metrics backlog, and are continuing to monitor the system.

    3. 2021년 5월 21일 오후 9:14 UTCresolved

      This incident has been resolved.

    Dashboards page is not loading data

    시작 2021년 4월 7일 오후 1:47 UTC · 44m

    Outage중대한 인시던트
    영향을 받은 구성 요소
    Web ApplicationAPIs
    1. 2021년 4월 7일 오후 1:47 UTCinvestigating

      We are currently investigating an issue with the "Dashboards" page not loading any data.

    2. 2021년 4월 7일 오후 2:07 UTCinvestigating

      The dashboards are now operational.

    3. 2021년 4월 7일 오후 2:31 UTCresolved

      This incident has been resolved.

    Alerts page not showing data

    시작 2021년 3월 17일 오후 6:53 UTC · 24m

    Pending
    영향을 받은 구성 요소
    Web Application
    1. 2021년 3월 17일 오후 6:53 UTCinvestigating

      We are currently experiencing an issue with users not being able to see any data on the "Alerts" page. We are investigating the issue.

    2. 2021년 3월 17일 오후 7:17 UTCresolved

      The "Alerts" page has been fixed. Users can view the data on the UI now.