Störungsverlauf von Rollbar

Status: Scheduled During the maintenance window, we will perform a series of routine tasks on our databases Affected components Core Processing Pipeline (Under maintenance) iOS Symbolication processing pipeline (Under maintenance) Source map processing pipeline (Under maintenance) Proguard processing pipeline (Under maintenance)

Status: Complete Maintenance has completed Affected components Core Processing Pipeline (Under maintenance) Web Application (app.rollbar.com) (Under maintenance) iOS Symbolication processing pipeline (Under maintenance) Source map processing pipeline (Under maintenance) API Tier (api.rollbar.com) (Under maintenance) Proguard processing pipeline (Under maintenance)

Status: Complete Maintenance has completed Affected components Web Application (app.rollbar.com) (Under maintenance) iOS Symbolication processing pipeline (Under maintenance) Source map processing pipeline (Under maintenance) API Tier (api.rollbar.com) (Under maintenance) Proguard processing pipeline (Under maintenance) Core Processing Pipeline (Under maintenance)

Status: Resolved Incident resolved Affected components Core Processing Pipeline (Operational) iOS Symbolication processing pipeline (Operational) Source map processing pipeline (Operational) Proguard processing pipeline (Operational)

Status: Scheduled During the maintenance window, we will perform a series of routine tasks on our databases Affected components Core Processing Pipeline (Under maintenance) iOS Symbolication processing pipeline (Under maintenance) Source map processing pipeline (Under maintenance) Proguard processing pipeline (Under maintenance)

Status: Complete Maintenance has completed Affected components Core Processing Pipeline (Under maintenance) iOS Symbolication processing pipeline (Under maintenance) Source map processing pipeline (Under maintenance) Proguard processing pipeline (Under maintenance)

Status: Complete This process is now complete. Affected components Core Processing Pipeline (Operational) iOS Symbolication processing pipeline (Operational) Source map processing pipeline (Operational) Proguard processing pipeline (Operational)

Status: Complete We have completed the various work and verified there is nothing backlogged. Sorry for any inconvenience. Affected components Core Processing Pipeline (Operational) iOS Symbolication processing pipeline (Operational) Source map processing pipeline (Operational) Proguard processing pipeline (Operational)

Status: Complete Maintenance has completed Affected components Core Processing Pipeline (Under maintenance) iOS Symbolication processing pipeline (Under maintenance) Source map processing pipeline (Under maintenance) Proguard processing pipeline (Under maintenance)

Status: Complete Apologies for this, our incident management system should have auto closed this. Affected components Source map processing pipeline (Operational) Proguard processing pipeline (Operational) Core Processing Pipeline (Operational) iOS Symbolication processing pipeline (Operational)

Status: Resolved We have fully rolled this back and applied the updated image. Affected components Homepage (rollbar.com) (Operational) Web Application (app.rollbar.com) (Operational)

Status: Resolved Earlier today we identified and resolved an issue impacting customers using our PHP and Ruby SDKs. A backend API change deployed on Friday 5/8/26 ~2:30PM PT inadvertently broke request parsing for certain payloads sent with the Ruby and PHP SDKs. As a result, occurrences sent during this window were rejected and not recorded. We rolled back the change this morning (5/9 at 8:30 am PT) and occurrence ingestion is back to normal. Unfortunately, occurrences that were dropped during the affected window, were not stored and cannot be recovered. We understand thats a gap in your observability and we take that seriously. We’re conducting a full postmortem and will publish details on our statue page. In the meantime if you’re still seeing issues or have questions, please don’t hesitate to reply here. Affected components Rollbar Docs (Operational) rollbar.min.js (Operational) SCIM and SSO (Operational) Source map processing pipeline (Operational) Mailgun Outbound Delivery (Operational) Mailgun SMTP (Operational) Proguard processing pipeline (Operational) Homepage (rollbar.com) (Operational) Core Processing Pipeline (Operational) Web Application (app.rollbar.com) (Operational) iOS Symbolication processing pipeline (Operational) API Tier (api.rollbar.com) (Operational)

Status: Complete This maintenance is now completed. Affected components Source map processing pipeline (Operational) Proguard processing pipeline (Operational) Core Processing Pipeline (Operational) iOS Symbolication processing pipeline (Operational)

Status: Resolved Pipeline processing is back to normal levels for all occurrence variants. This incident has been resolved. Affected components Source map processing pipeline (Operational) Proguard processing pipeline (Operational) Core Processing Pipeline (Operational) iOS Symbolication processing pipeline (Operational)

Status: Complete We are cancelling this update , and will push this out to a future date. Affected components Core Processing Pipeline (Operational) iOS Symbolication processing pipeline (Operational) Source map processing pipeline (Operational) API Tier (api.rollbar.com) (Operational) Proguard processing pipeline (Operational)

Status: Complete Maintenance has completed Affected components Core Processing Pipeline (Under maintenance) iOS Symbolication processing pipeline (Under maintenance) Source map processing pipeline (Under maintenance) Proguard processing pipeline (Under maintenance)

Status: Resolved This incident was resolved. Rollbar processing pipeline latency (measured at p99) was elevated above our 30-second p99 SLO today during the following windows: 02:02AM - 02:35AM PDT: 30s - 7.0 minutes latency 06:02AM - 07:03AM PDT: 30s - 3.9 minutes latency 08:00AM - 09:02AM PDT: 30s - 37.2 minutes latency 09:02AM - 09:52AM PDT: 30s - 23.1 minutes latency p50 stayed at SLO (~5s) during the entire time period, and no data was lost. The initial cause analysis is a particular traffic pattern. We're investigating the root cause to ensure the system is resilient to this traffic pattern going forward. Affected components SCIM and SSO (Operational) Source map processing pipeline (Operational) Mailgun Outbound Delivery (Operational) Proguard processing pipeline (Operational) Core Processing Pipeline (Operational) Web Application (app.rollbar.com) (Operational) iOS Symbolication processing pipeline (Operational) API Tier (api.rollbar.com) (Operational) Mailgun SMTP (Operational) Homepage (rollbar.com) (Operational) Rollbar Docs (Operational) rollbar.min.js (Operational)

Status: Complete Maintenance has completed Affected components Web Application (app.rollbar.com) (Under maintenance) API Tier (api.rollbar.com) (Under maintenance) Homepage (rollbar.com) (Under maintenance)

Status: Complete This work is now complete, apologies for any inconvenience caused. Affected components API Tier (api.rollbar.com) (Operational) Proguard processing pipeline (Operational) Homepage (rollbar.com) (Operational) Core Processing Pipeline (Operational) Web Application (app.rollbar.com) (Operational) iOS Symbolication processing pipeline (Operational) Source map processing pipeline (Operational)

Status: Complete This maintenance is now complete. Affected components Core Processing Pipeline (Operational) iOS Symbolication processing pipeline (Operational) Source map processing pipeline (Operational) Proguard processing pipeline (Operational)