On July 12, 2026, we experienced delays in our alerting system, resulting in an interruption to alert processing for some Loggly customers.
The issue was traced to a production scheduler service responsible for evaluating and scheduling alerts. Due to resource exhaustion on the host, the scheduler was unable to operate normally, preventing alert jobs from being process downstream.
The team restored service by increasing the capacity of the affected host, returning resource utilization to healthy levels and allowing the scheduler to resume normal operation.
Following the remediation, alert processing has since been operating normally.
Alerts Issue
開始 2026年5月11日 21:06 UTC · 1h 14m
Pending
影響を受けたコンポーネント
Alerts
monitoring
At 5:46 AM PDT we started experiencing delays in our alerting system caused by a network provider issue. The issue is resolved and we are monitoring the recovery.
resolved
This incident has been resolved.
Alerts Issue
開始 2026年1月21日 15:44 UTC · 43m
Pending
影響を受けたコンポーネント
Alerts
investigating
We are investigating an issue with our alerting system that started at 13:06 UTC.
identified
The issue has been identified and a fix is being implemented.
monitoring
A fix has been implemented and we are monitoring the results.
resolved
This incident has been resolved.
Front-end experiencing issues
開始 2025年11月18日 12:07 UTC · 4h 12m
Issues軽微なインシデント
影響を受けたコンポーネント
Website Availability
investigating
We are experiencing issue with our Front-End application. Our engineers are investigating.
identified
We have identified an issue with an outside provider
identified
We are continuing to work on a fix for this issue.
monitoring
We have identified an issue with an outside provider and are monitoring the situation.
monitoring
We are continuing to monitor the issue
resolved
This incident has been resolved.
Indexing Delay
開始 2025年2月4日 18:03 UTC · 1h 56m
Pending
影響を受けたコンポーネント
Indexing Data
investigating
Our engineers have identified an issue with log ingestion starting at 07:22 PST . All customer data continues to be collected and stored, but indexing of all customer data is being delayed. Customer data from after this time will not appear in search results until we resolve this issue.
identified
The issue has been identified and a fix is being implemented.
monitoring
A fix has been implemented and we are monitoring the results.
monitoring
We are continuing to monitor for any further issues.
resolved
This incident has been resolved.
Indexing Delay
開始 2025年1月25日 5:17 UTC · 6h 58m
Issues軽微なインシデント
影響を受けたコンポーネント
AlertsSearch AvailabilityIndexing Data
investigating
Our engineers have identified an issue with log ingestion starting at 20:56 PST . All customer data continues to be collected and stored, but indexing of all customer data is being delayed. Customer data from after this time will not appear in search results until we resolve this issue.
identified
The issue has been identified and a fix is being implemented.
monitoring
A fix has been implemented and we are monitoring the results.
monitoring
We are continuing to monitor for any further issues.
resolved
This incident has been resolved.
Indexing Delay
開始 2024年12月8日 16:25 UTC · 11h 14m
Pending
影響を受けたコンポーネント
S3 IngestionAlertsData Collection & StorageSearch AvailabilityIndexing Data
investigating
Our engineers have identified an issue with log ingestion starting at 06:02 PST . All customer data continues to be collected and stored, but indexing of all customer data is being delayed. Customer data from after this time will not appear in search results until we resolve this issue.
identified
The issue has been identified and a fix is being implemented.
monitoring
A fix has been implemented and we are monitoring the results.
monitoring
We are continuing to monitor for any further issues.
resolved
This incident has been resolved.
S3 Ingestion incident
開始 2024年10月16日 12:35 UTC · 45m
Issues軽微なインシデント
影響を受けたコンポーネント
S3 Ingestion
investigating
We are currently investigating this issue.
identified
The issue has been identified and a fix is being implemented.
monitoring
A fix has been implemented and we are monitoring the results.
resolved
This incident has been resolved.
Search Unavailable
開始 2024年10月1日 21:00 UTC · 0m
Pending
resolved
At 1:56 PM PDT we were alerted that search was unavailable. We identified the problem and applied a fix and search is once again available.
Indexing Delay
開始 2024年8月24日 4:02 UTC · 8h 58m
Pending
影響を受けたコンポーネント
AlertsData Collection & StorageSearch AvailabilityIndexing Data
investigating
Our engineers have identified an issue with log ingestion starting at 20:22 PDT . All customer data continues to be collected and stored, but indexing of all customer data is being delayed. Customer data from after this time will not appear in search results until we resolve this issue.
investigating
We are continuing to investigate the issue.
identified
The issue has been identified and a fix is being implemented.
identified
We are continuing to work on a fix for this issue.
monitoring
A fix has been implemented and we are monitoring the results.
monitoring
We are continuing to monitor for any further issues.
resolved
This incident has been resolved.
Indexing Delay
開始 2024年8月21日 21:47 UTC · 2h 32m
Issues軽微なインシデント
影響を受けたコンポーネント
AlertsData Collection & StorageSearch AvailabilityIndexing Data
investigating
Our engineers have identified an issue with log ingestion starting at 14:08 PDT. All customer data continues to be collected and stored, but indexing of all customer data is being delayed. Customer data from after this time will not appear in search results until we resolve this issue.
identified
The issue has been identified and a fix is being implemented.
identified
We are continuing to work on a fix for this issue.
monitoring
A fix has been implemented and we are monitoring the results.
resolved
This incident has been resolved.
Account usage data missing
開始 2024年7月24日 16:56 UTC · 20h 36m
Outage重大なインシデント
影響を受けたコンポーネント
Account Usage
investigating
We experienced an issue with our volume data reporting service and are working on restoring it.
identified
The issue has been identified and a fix is being implemented.
identified
A fix is still being implemented and the next update will be 06:00 UTC
monitoring
A fix has been implemented and we are monitoring the results.
monitoring
We are continuing to monitor.
resolved
This incident has been resolved.
Front-end experiencing issues
開始 2023年10月18日 13:21 UTC · 5h 8m
Pending
影響を受けたコンポーネント
Search AvailabilityWebsite Availability
investigating
We are experiencing issue with our Front-End application. Our engineers are investigating.
investigating
We are continuing to investigate this issue.
identified
The issue has been identified and a fix is being implemented.
monitoring
A fix has been implemented and we are monitoring the results.
resolved
This incident has been resolved.
Indexing Delay
開始 2023年10月10日 12:45 UTC · 1h 9m
Issues軽微なインシデント
影響を受けたコンポーネント
Indexing Data
investigating
Our engineers have identified an issue with log ingestion starting at 5:28 AM PDT . All customer data continues to be collected and stored, but indexing of all customer data is being delayed. Customer data from after this time will not appear in search results until we resolve this issue.
identified
The issue has been identified and a fix is being implemented.
monitoring
A fix has been implemented and we are monitoring the results.
resolved
This incident has been resolved.
Indexing Delay
開始 2023年8月23日 19:13 UTC · 1h 27m
Outage重大なインシデント
影響を受けたコンポーネント
Indexing Data
investigating
Our engineers have identified an issue with log ingestion starting at 11:54AM PDT . All customer data continues to be collected and stored, but indexing of all customer data is being delayed. Customer data from after this time will not appear in search results until we resolve this issue.
identified
The issue has been identified and a fix is being implemented.
monitoring
A fix has been implemented and we are monitoring the results.
resolved
This incident has been resolved.
Issue with sending mail for account invites and password reset
開始 2023年4月10日 14:00 UTC · 0m
Pending
resolved
Issue started: 14:05 UTC
Issue resolved: 14:54am UTC
Issue with sending mail for account invites and password reset. Other mail notifications should have still worked.
Indexing Delay
開始 2023年3月3日 14:24 UTC · 3h 9m
Issues軽微なインシデント
影響を受けたコンポーネント
Indexing Data
investigating
Our engineers have identified an issue with log ingestion starting at 5:52 PST . All customer data continues to be collected and stored, but indexing of all customer data is being delayed. Customer data from after this time will not appear in search results until we resolve this issue.
identified
The issue has been identified and a fix is being implemented.
monitoring
A fix has been implemented and we are monitoring the results.
resolved
This incident has been resolved.
Indexing Delay
開始 2022年11月14日 10:47 UTC · 2h 17m
Pending
影響を受けたコンポーネント
Indexing Data
investigating
Our engineers have identified an issue with log ingestion starting at 2:25 PST . All customer data continues to be collected and stored, but indexing of all customer data is being delayed. Customer data from after this time will not appear in search results until we resolve this issue.
identified
The issue has been identified and a fix is being implemented.
monitoring
A fix has been implemented and we are monitoring the results.