Ιστορικό διακοπών του Snapsheet

1. 23 Ιουλίου 2026 στις 4:22 μ.μ. UTCidentified

   Αντιμετωπίζουμε καθυστερήσεις αντιγραφής δεδομένων για πίνακες ιστορικού/ελεγκτών στο περιβάλλον παραγωγής των ΗΠΑ. Έχουμε εντοπίσει την αιτία και έχουμε κάνει βελτιώσεις για τη βελτίωση των επιδόσεων. Η τρέχουσα ETA για την επανάληψη της κανονικής ταχύτητας αντιγραφής είναι 18 - 24 ώρες, και συνεχίζουμε να εργαζόμαστε για περαιτέρω βελτιστοποιήσεις. Θα σας ενημερώσουμε εντός 4 ωρών.

2. 23 Ιουλίου 2026 στις 5:31 μ.μ. UTCidentified

   Παρακαλείστε να σημειώσετε ότι η καθυστέρηση αντιγραφής δεδομένων είναι μόνο για τους πίνακες ιστορικού/ελέγχου στο περιβάλλον παραγωγής των ΗΠΑ. Άλλοι πίνακες αναπαράγονται κανονικά. Συνεχίζουμε να ερευνούμε πιθανές βελτιστοποιήσεις και θα παρέχουμε ενημέρωση εντός 4 ωρών.

3. 23 Ιουλίου 2026 στις 10:01 μ.μ. UTCmonitoring

   Συνεχίζουμε να κάνουμε ενημερώσεις για την ενίσχυση των επιδόσεων του συστήματος και την ελαχιστοποίηση της λανθάνουσας λανθάνουσας λανθάνουσας λανθάνουσας λανθάνουσας λανθάνουσας λανθάνουσας λανθάνουσας λανθάνουσας λανθάνουσας λανθάνουσας λανθάνουσας ιστορίας/ελεγκτών στο περιβάλλον παραγωγής των ΗΠΑ. Η τρέχουσα ETA για την επανάληψη της κανονικής ταχύτητας αντιγραφής είναι περίπου 10 ώρες. Θα ενημερώσουμε αύριο το πρωί για να επιβεβαιώσουμε την κατάσταση.

4. 24 Ιουλίου 2026 στις 6:02 μ.μ. UTCresolved

   Το περιστατικό λύθηκε.

Αυτόματη μετάφραση από την επίσημη ενημέρωση του συμβάντος.

1. 17 Ιουνίου 2026 στις 11:23 μ.μ. UTCidentified

   We are experiencing a delay in US UAT data replication of approximately 2.5 hours. We are actively working on resolving the issue and will provide another update within 2 hours.

2. 18 Ιουνίου 2026 στις 2:21 π.μ. UTCidentified

   We are continuing to progress on the fix for the issue and performance is improving. We will provide another update by 9am central.

3. 18 Ιουνίου 2026 στις 11:26 π.μ. UTCresolved

   The delay in US UAT data replication has been resolved, and performance and returned to normal levels.

1. 10 Ιουνίου 2026 στις 9:34 μ.μ. UTCinvestigating

   We have identified an issue within the UAT environment that is impacting user access. We are investigating the issue as a high priority and will provide an update within one hour.

2. 10 Ιουνίου 2026 στις 9:57 μ.μ. UTCresolved

   This incident has been resolved and access restored. Please reach out to Snapsheet Support with any further questions or concerns.

1. 7 Μαΐου 2026 στις 7:10 μ.μ. UTCidentified

   We are currently experiencing data replication latency in the production environment. We are aware of the issue and working to improve performance. We will provide another update within the next two hours.

2. 7 Μαΐου 2026 στις 8:51 μ.μ. UTCresolved

   Data replication latency has returned to normal levels. We will review the incident and follow up with a post-mortem within the next business week. Please contact the Snapsheet support team if you experience any further issues.

3. 21 Μαΐου 2026 στις 5:18 μ.μ. UTCpostmortem

   On May 7, 2026, a data pipeline component responsible for replicating production data to the warehouse entered a silent failure state due to an internal schema inconsistency. This caused data replication to stall for over 4 hours, resulting in missing or delayed data for affected clients. The issue was not caught by automated alerting because the pipeline continued to report a healthy status despite being inactive. Once identified, the problem was resolved by removing the affected table from the pipeline configuration, restoring normal data flow. We are in the process of updating our alerting to report this kind of issue going forward.

1. 14 Απριλίου 2026 στις 2:38 μ.μ. UTCidentified

   We have identified some remaining data inconsistencies from the replication delay experienced on April 13. We are working to address the issue with an ETR of end of business today. We will provide another update by 2pm CDT today.

2. 14 Απριλίου 2026 στις 7:03 μ.μ. UTCidentified

   We are continuing to address the data inconsistencies. We will provide another update at 5pm CDT.

3. 14 Απριλίου 2026 στις 10:29 μ.μ. UTCidentified

   We are continuing to address the data inconsistencies. We will provide another update by 8pm CDT.

4. 15 Απριλίου 2026 στις 2:30 μ.μ. UTCresolved

   The data inconsistencies have been addressed, and the incident is resolved.

5. 23 Απριλίου 2026 στις 4:44 μ.μ. UTCpostmortem

   ### **Incident Summary** On the afternoon of **April 13**, a technical capacity limit in our data pipeline caused a temporary halt in data updates. This resulted in a delay of real-time data replication to customer databases. ### **Resolution & Recovery** * **System Fix:** Our engineering team identified the bottleneck and upgraded our database infrastructure to prevent this limit from being reached again. * **Data Restoration:** We performed a comprehensive data reconciliation over the following 48 hours to ensure all missing records were recovered and accurately synced. * **Current Status:** All services are fully restored, and all backfilled data has been verified for accuracy. * **Enhanced Monitoring:** We are taking measures to improve our alerting and response process  **Note:** You may have experienced replication delay and data inconsistencies during this window, but no data was lost. We appreciate your patience while we worked to resolve this. If you notice any remaining discrepancies in your specific reports, please reach out to our support team.

1. 13 Απριλίου 2026 στις 8:02 μ.μ. UTCinvestigating

   We have identified a delay in data replication, and we are are working to address it as a high priority. We will provide an update by 5pm CDT.

2. 13 Απριλίου 2026 στις 9:40 μ.μ. UTCmonitoring

   We have resolved the data replication latency. All new data is replicating, and we are working to confirm data integrity for the time during which the issue occurred. We will provide another update within two hours.

3. 14 Απριλίου 2026 στις 12:45 μ.μ. UTCresolved

   This incident has been resolved.

1. 25 Φεβρουαρίου 2026 στις 5:39 μ.μ. UTCinvestigating

   We have observed an issue with Sendgrid that is causing some customers to experience degraded performance of Microsoft Outlook. This issue is resulting in pending deliveries of some emails from Snapsheet to the impacted Microsoft accounts.

2. 25 Φεβρουαρίου 2026 στις 6:40 μ.μ. UTCinvestigating

   We have engaged Sendgrid to remediate the issue that is causing the delays in email deliveries. The next update will be no later than 4pm CST.

3. 25 Φεβρουαρίου 2026 στις 9:59 μ.μ. UTCidentified

   We have identified the issue that is causing delayed email deliveries to some recipients with Microsoft associated inboxes. We are seeing some improved performance, but we are continuing to work with Sendgrid to fully resolve the issue. We will provide another update by 10am CST tomorrow.

4. 26 Φεβρουαρίου 2026 στις 3:37 μ.μ. UTCresolved

   Sendgrid has resolved the issue that is causing delayed email deliveries to some recipients with Microsoft associated inboxes, and pending emails have been delivered. Please contact Snapsheet Support with any further questions or concerns.

1. 23 Φεβρουαρίου 2026 στις 10:37 μ.μ. UTCinvestigating

   There is currently a delay in search indexing that is causing a delay in claims or policies becoming searchable. We are aware of the issue and working to address it as a high priority.

2. 24 Φεβρουαρίου 2026 στις 12:13 π.μ. UTCresolved

   We have resolved the delay in search indexing and confirmed searches are performing normally.

1. 2 Φεβρουαρίου 2026 στις 11:02 μ.μ. UTCidentified

   We have confirmed that users may experience intermittent issues accessing claims in UAT. We have identified that the issues are related to an interruption with the UAT deployment caused by a Github incident (https://www.githubstatus.com/). We will continue to monitor and work to complete the deployment as soon as possible.

2. 3 Φεβρουαρίου 2026 στις 12:56 π.μ. UTCmonitoring

   We have successfully deployed the latest UAT release, and we are monitoring to confirm no further issues.

3. 3 Φεβρουαρίου 2026 στις 2:11 π.μ. UTCresolved

   This incident has been resolved, and the latest UAT release has been successfully deployed. Please contact Snapsheet Support if you experience and further issues.

1. 22 Ιανουαρίου 2026 στις 11:34 μ.μ. UTCidentified

   Sendgrid is currently investigating an issue with Microsoft that is causing some customers to experience degraded performance of Microsoft Outlook. This issue is resulting in failed deliveries of some emails from Snapsheet to the impacted Microsoft accounts. Updates from Sendgrid are available at https://status.sendgrid.com/.

2. 23 Ιανουαρίου 2026 στις 2:12 μ.μ. UTCidentified

   Sendgrid is continuing to investigate the issue. Updates from Sendgrid are available at https://status.sendgrid.com/.

3. 27 Ιανουαρίου 2026 στις 7:59 μ.μ. UTCidentified

   We are seeing a some recovery in email deliverability following the disruption with our email delivery partner Sendgrid. While we are still awaiting official confirmation of a final resolution. We will continue to monitor the situation closely.

4. 28 Ιανουαρίου 2026 στις 4:35 μ.μ. UTCresolved

   We have received confirmation from SendGrid that the increased Microsoft inbox provider blocks are due to an issue with Microsoft, and that the issue is not isolated to SendGrid’s environment nor specific to their sending configuration. While we are seeing improvement (reduction) of deferrals, Microsoft customers who are continuing to observe excessive deferrals and/or blocks should fill out the OLC Support request form at https://olcsupport.office.com/. Thank you for your patience and understanding regarding this issue. If you have any further questions or concerns, please contact Snapsheet Support for assistance.

1. 1 Δεκεμβρίου 2025 στις 3:22 μ.μ. UTCinvestigating

   We are currently investigating an issue with API calls receiving errors. We are treating the issue as Urgent and will provide an update within one hour.

2. 1 Δεκεμβρίου 2025 στις 4:11 μ.μ. UTCidentified

   We have identified the issue and fix. We are working to implement the fix and continuing to monitor.

3. 1 Δεκεμβρίου 2025 στις 4:38 μ.μ. UTCmonitoring

   We have deployed a fix and continuing to monitor to confirm that there are no ongoing issues.

4. 1 Δεκεμβρίου 2025 στις 5:34 μ.μ. UTCresolved

   The incident is confirmed to be resolved.

1. 18 Νοεμβρίου 2025 στις 3:12 μ.μ. UTCmonitoring

   There is a Cloudflare outage that is impacting Smartcomms and causing letters to fail. Updates are provided by Cloudflare on their status page at https://www.cloudflarestatus.com/. We will continue to monitor and update our own status page accordingly.

2. 18 Νοεμβρίου 2025 στις 3:12 μ.μ. UTCmonitoring

   We are continuing to monitor for any further issues.

3. 18 Νοεμβρίου 2025 στις 4:19 μ.μ. UTCresolved

   The Cloudflare outage has been updated to resolved, and we've confirmed Smartcomm letters are sending successfully.

1. 30 Οκτωβρίου 2025 στις 3:53 μ.μ. UTCinvestigating

   We are seeing a delay in data replication and are investigating it as a high priority. We will provide updates as they become available.

2. 30 Οκτωβρίου 2025 στις 4:11 μ.μ. UTCmonitoring

   We are seeing improved performance and continuing to monitor. We will provide additional updates as they become available.

3. 30 Οκτωβρίου 2025 στις 5:53 μ.μ. UTCresolved

   This incident has been resolved. If you experience any further issues, please reach out to Snapsheet Support.

1. 20 Οκτωβρίου 2025 στις 2:59 μ.μ. UTCinvestigating

   We are aware of an ongoing outage within Amazon Web Services (AWS). Our team is actively monitoring for any potential impact to our systems and will provide updates as more information becomes available from AWS.

2. 20 Οκτωβρίου 2025 στις 5:03 μ.μ. UTCinvestigating

   We are continuing to monitor the ongoing AWS outage. As a result of this incident, we are experiencing delays in data warehouse replication. We'll share updates as more information becomes available.

3. 21 Οκτωβρίου 2025 στις 2:31 π.μ. UTCinvestigating

   The AWS outage has been confirmed to be resolved. Please reach out to Snapsheet Support with any questions or concerns.

4. 21 Οκτωβρίου 2025 στις 2:31 π.μ. UTCresolved

   This incident has been resolved.

1. 18 Αυγούστου 2025 στις 2:54 μ.μ. UTCidentified

   OFAC is experiencing an outage with the OFAC API from trade.gov. They are experiencing a certificate error on their platform and currently looking into it. Payments created with the feature on will be put in Compliance Hold until a user approves them.

2. 18 Αυγούστου 2025 στις 5:55 μ.μ. UTCidentified

   We are continuing to monitor OFAC's progress and will provide updates here as we receive them.

3. 18 Αυγούστου 2025 στις 7:52 μ.μ. UTCmonitoring

   OFAC has updated their certificate to resolve the error. We are currently transitioning the payments and will provide an update when the transitions are complete.

4. 18 Αυγούστου 2025 στις 10:53 μ.μ. UTCresolved

   All of the pending transactions impacted by the issue have been transitioned, and the incident is considered Resolved. Please contact Snapsheet Support if you continue to experience any further issues.

1. 18 Δεκεμβρίου 2024 στις 9:14 μ.μ. UTCidentified

   OFAC is experiencing an outage with the OFAC API from trade.gov. They are experiencing high latency on their platform and currently looking into it. Payments created with the feature on will be put in Compliance Hold until a user approves them.

2. 18 Δεκεμβρίου 2024 στις 9:14 μ.μ. UTCidentified

   OFAC is continuing to work on a fix for this issue.

3. 19 Δεκεμβρίου 2024 στις 12:51 π.μ. UTCresolved

   This incident has been resolved. If you experience any further issues, please contact Snapsheet support.

1. 28 Σεπτεμβρίου 2024 στις 4:30 μ.μ. UTCidentified

   We are currently seeing delays in replication through the data warehouse. We actively working on addressing the delay and will provide another update as soon as possible.

2. 28 Σεπτεμβρίου 2024 στις 6:08 μ.μ. UTCidentified

   We are continuing to work on addressing the replication delays and have engaged AWS support for Amazon's Data Migration Service where the delay is being experienced.

3. 28 Σεπτεμβρίου 2024 στις 6:55 μ.μ. UTCidentified

   We are seeing normal throughput for the data pipeline and expect the replication delays to be fully resolved shortly.

4. 28 Σεπτεμβρίου 2024 στις 7:39 μ.μ. UTCmonitoring

   The delays in replication have been resolved and we are continuing to monitor.

5. 28 Σεπτεμβρίου 2024 στις 7:51 μ.μ. UTCresolved

   This issue has been resolved. Please contact Snapsheet Support if you experience any further issues.

1. 19 Σεπτεμβρίου 2024 στις 1:51 μ.μ. UTCinvestigating

   “We are investigating an issue with the navigation bar in US UAT and will provide an update as soon as possible”

2. 19 Σεπτεμβρίου 2024 στις 2:57 μ.μ. UTCinvestigating

   We are continuing to investigate the issue and will provide an update as soon as possible.

3. 19 Σεπτεμβρίου 2024 στις 3:15 μ.μ. UTCresolved

   This incident has been resolved. Please contact Snapsheet Support if you experience any further issues.

1. 11 Σεπτεμβρίου 2024 στις 1:47 μ.μ. UTCidentified

   “We are currently seeing delays in claims being indexed for search. We are investigating and will provide updates as they become available.”

2. 11 Σεπτεμβρίου 2024 στις 2:36 μ.μ. UTCresolved

   This incident has been resolved. Please contact Snapsheet Support if you experience any further issues.

1. 4 Σεπτεμβρίου 2024 στις 1:55 μ.μ. UTCinvestigating

   We are currently experiencing processing delays with claim details showing up in the work queues.

2. 4 Σεπτεμβρίου 2024 στις 2:22 μ.μ. UTCinvestigating

   The processing delays have been resolved. We will continue to monitor performance and provide a post-mortem as soon as it becomes available.

3. 4 Σεπτεμβρίου 2024 στις 2:22 μ.μ. UTCresolved

   This incident has been resolved.