Störungsverlauf von Subsplash

We are currently investigating an issue causing media items to endlessly load on websites, web embeds, and web apps.

A fix has been implemented and we are monitoring the results.

This incident has been resolved.

We are currently investigating an issue causing SnapPages dashboards to display a 500 error.

The issue has been identified and a fix is being implemented.

A fix has been implemented and we are monitoring the results.

This incident has been resolved.

We are currently investigating this issue.

This incident has been resolved.

Giving website blocks are currently failing to load.

A fix has been implemented and we are monitoring the results.

This incident has been resolved.

We are currently investigating an issue where some media pages, giving pages and embeds are failing to load

We are continuing to investigate this issue.

We've identified the issue, implemented a fix and are monitoring the results.

This incident has been resolved.

We’re investigating the current livestream disruption, and our team is working to resolve the situation as quickly as possible.

The issue has been identified and a fix is being implemented.

A fix has been implemented and we are monitoring the results.

This incident has been resolved.

**Summary:** A service disruption on March 8th impacted Subsplash Live performance and access to the Live section of the dashboard. During a period of high traffic, a rate limiting setting on our recently updated web gateway incorrectly flagged internal system traffic as an overload. This prevented some users from accessing their Subsplash Live accounts and caused a drop in livestream connection success rates. **Timeline, Resolution & Recovery:** * Incident start: 6:00 AM PST * Fix Applied: Our engineering team identified the bottleneck and disabled the restrictive setting at 7:30 AM PST, restoring full service by 7:38 AM PST. * Video Backfill: All "Live-to-On-Demand" videos that were delayed during the outage have been successfully processed and are now visible in your library. **Next Steps:**  To ensure long-term stability and as part of our ongoing infrastructure enhancements, we have refined our internal routing protocols. This change allows essential system traffic to bypass traffic filtering while maintaining the integrity of the security measures protecting Subsplash Live.

We are currently investigating an issue causing multiple services to display error messages including giving, events images, and images in the mobile app.

A fix has been implemented and we are monitoring the results.

This incident has been resolved.

We are currently investigating an issue causing some live streams to fail to start and return an error message.

We are continuing to investigate this issue.

The issue has been identified and a fix is being implemented.

A fix has been implemented and we are monitoring the results.

This incident has been resolved.

We are currently investigating an issue with recurring gifts that is affecting some users.

The issue has been identified and a fix is being implemented.

We are continuing to work on a fix for this issue.

A fix has been implemented and we are monitoring the results.

This incident has been resolved.

We are currently investigating an issue causing some Subsplash LiveRS streams to fail going live. RTMP protocol is unaffected and can be used as a workaround.

A fix has been implemented and we are monitoring the results.

This incident has been resolved.

We are currently investigating this issue.

We are continuing to investigate this issue.

The issue has been identified and a fix is being implemented.

A fix has been implemented and we are monitoring the results.

This incident has been resolved.

We are currently investigating an issue where links in media items are not loading within the Web App.

The issue has been identified and a fix is being implemented.

This incident has been resolved!

We are continuing to investigate this issue.

Our team is currently investigating an issue where some users are experiencing difficulties with the Check-In system loading correctly within the dashboard.

We are continuing to investigate this issue. Our team has been able to improve the loading of the Check-In system.

A fix has been implemented and we are monitoring the results.

We are continuing to monitor for any further issues.

This incident has been resolved.

We are currently investigating an issue causing forms to be unable to submit

The issue has been identified and a fix is being implemented.

We are continuing to work on a fix for this issue.

A fix has been implemented and we are monitoring the results.

This incident has been resolved.

We are currently investigating this issue.

We are continuing to investigate this issue.

A fix has been implemented and we are monitoring the results.

We are continuing to monitor for any further issues.

This incident has been resolved.

We are currently investigating an issue causing an error message to appear when attempting to login to the dashboard. The error message reads "There was an issue loading this content".

The issue has been identified and a fix is being implemented.

A fix has been implemented and we are monitoring the results.

This incident has been resolved.

We are currently investigating this issue.

A fix has been implemented and we are monitoring the results.

This incident has been resolved.

We are currently investigating an issue causing pages across multiple Subsplash features to display a "Something went wrong" error message. In many cases, refreshing the page will cause it to load correctly

A fix has been implemented and we are monitoring the results.

We are currently investigating an issue causing pages across multiple Subsplash features to display a "Something went wrong" error message. In many cases, refreshing the page will cause it to load correctly.

This incident has been resolved.

We are currently investigating this issue.

The issue has been identified and a fix is being implemented.

A fix has been implemented and we are monitoring the results.

This incident has been resolved.

We are currently investigating an issue causing some Simulated Live Streams to either fail to start, or disconnect. This only affects Simulated Live Streams. True live broadcasts are unaffected.

The issue has been identified and a fix is being implemented.

A fix has been implemented and we are monitoring the results.

This incident has been resolved.