这一事件已经得到解决。
事件由我们用来部署 Circle 应用程序代码更改的应用程序中缺少的配置所引起. 经过调查,我们立即应用了临时补丁来恢复可用性. 然后,我们查明了根源,并实施了永久解决办法。
所有服务正常运行.
postmortem
页:1
5:44至5:57 AM EST 发生事件
我们为中断感到抱歉
发生什么了\(高度\)
事件发生的原因是我们用来部署 Circle 应用程序新代码更改的应用程序中缺少配置
缓解和立即补救
在调查这个问题后,我们立即对这个应用程序进行了临时修改,恢复了应用程序的可用性。
今天晚些时候,我们查明了根源,并采取了明确的解决办法。
状态
所有服务目前都正常运行.
The issue has been identified and a fix is being implemented.
monitoring
A fix has been implemented and we are monitoring the results.
resolved
The issue has been fully resolved and all systems are operating normally. A detailed post-mortem report will be published here shortly. Thank you for your patience and cooperation.
postmortem
## Delays in Asynchronous Actions and Workflows
**Issue Summary** On May 28, 2026, we experienced an incident that caused delays in asynchronous actions and automated workflows.
**Timeline \(UTC\)**
* **11:29** – The issue began, causing delays in newly scheduled automated workflows.
* **15:51** – Our engineering team identified the root cause of the scheduling interruption.
* **16:42** – A fix was deployed, restoring normal operations to the background processing framework.
* **18:45** – The resulting backlog of delayed tasks was completely cleared and normal service was confirmed.
**Root Cause** A routine system update included a software dependency upgrade that unexpectedly conflicted with our background processing framework. This conflict prevented scheduled background jobs from moving into the active processing queue. As a result, automated workflows and other asynchronous actions were delayed, though no underlying data was lost or corrupted during this time.
**Resolution** Upon investigating the anomaly in the scheduling queue, our engineering team determined that the recent dependency upgrade was responsible. We immediately reverted the update, which restored the flow of scheduled tasks. To resolve the issue as swiftly as possible, we temporarily scaled up our infrastructure's processing capacity to rapidly clear the backlog of delayed actions.
**Preventative Measures** To prevent this type of issue from occurring in the future, we are planning on implementing the following improvements:
* **Enhanced Alerting:** We are deploying strict, automated alerts specifically designed to detect anomalies in scheduled task queues, drastically reducing our time to detection.
* **Upgraded Telemetry:** We are adding granular, time-series visualizations to our monitoring systems to better track the exact states of background jobs \(scheduled, enqueued, and processed\) in real time.
We sincerely apologize for any disruption this may have caused to your operations. The issue was fully mitigated, and all backlogged tasks have been successfully processed.
app.circle.so is down
开始时间 2026年5月22日 UTC 13:26 · 2m
Pending
investigating
We are currently investigating this issue.
resolved
This incident has been resolved.
app.circle.so is down
开始时间 2026年5月20日 UTC 16:12 · 1m
Pending
investigating
We are currently investigating this issue.
resolved
This incident has been resolved.
app.circle.so is down
开始时间 2026年5月9日 UTC 03:12 · 1m
Pending
investigating
We are currently investigating this issue.
resolved
This incident has been resolved.
app.circle.so is down
开始时间 2026年4月30日 UTC 18:00 · 1h 43m
Pending
investigating
We are currently investigating this issue.
resolved
This incident has been resolved.
postmortem
Some users experienced an issue where app.circle.so was unavailable. This was caused by the Redis cluster reaching 100% CPU due to a large volume of workflow jobs being re-enqueued. We identified the root cause, scaled down the background deployment pods to relieve the load, and restored service within approximately 3 minutes. We are continuing to investigate and address the underlying issue.
Search functionality was degraded starting at approximately 6:52 PM EDT on April 14. The issue was caused by Elasticsearch cluster degradation. An incident report was filed internally. This issue should have had a status page entry since customers reported broken search.
Customers checking [status.circle.so](http://status.circle.so) saw 'All Systems Operational' during this period.
postmortem
Search functionality was degraded starting at approximately 6:52 PM EDT on April 14. The issue was caused by Elasticsearch cluster degradation. An incident report was filed internally. This issue should have had a status page entry since customers reported broken search.
Customers checking [status.circle.so](http://status.circle.so/) saw 'All Systems Operational' during this period.
app.circle.so is down
开始时间 2026年4月14日 UTC 04:17 · 4m
Issues轻微事件
investigating
We are currently investigating this issue.
resolved
This incident has been resolved.
postmortem
Communities experienced approximately 19 minutes of downtime starting at 12:17 AM EDT. The database crashed due to an out-of-memory error at the infrastructure level, a known AWS RDS bug. Our team raised a second escalation to AWS \(case 177616832700336\), and both cases have been escalated to AWS's highest priority tier. We are actively working with AWS to resolve the underlying infrastructure issue and have additional safeguards in place.
