Historia awarii 7digital

1. 26 października 2026 17:52 UTCidentified

   Drodzy Klienci, Obecnie mamy do czynienia z przerwami, które wpływają na nasze punkty końcowe strumieniowania HLS: GET / stream / subscription.m3u8 GET / offline / subscription.m3u8 GET / stream / catalogue.m3u8 Progresywne strumieniowanie i pobieranie punktów końcowych nie mają wpływu. Nasi inżynierowie na wezwanie badają i pracują nad przywróceniem stabilności. Wyślemy kolejne aktualizacje we właściwym czasie. Jeśli masz jakieś pytania, skontaktuj się z Zespołem Sukces Klienta. Pozdrowienia. Massive Music Client Success Team

2. 26 października 2026 18:34 UTCidentified

   Po naszym wcześniejszym powiadomieniu, zidentyfikowaliśmy przyczynę awarii wpływającej na nasze punkty końcowe strumieniowania HLS. Nasz dostawca CDN bada problem z jego On- the- Fly Packaging Service, który generuje nasze strumienie HLS. Nasi inżynierowie są w bliskim kontakcie z dostawcą CDN, monitorując postępy i pracując na rzecz jak najszybszego przywrócenia usługi. Po przywróceniu usługi wyślemy kolejną aktualizację.

3. 26 października 2026 19:07 UTCmonitoring

   Problem dotyczący naszych punktów końcowych strumieniowania HLS został rozwiązany i monitorujemy usługę. Wycofanie było spowodowane problemem z naszym dostawcą CDN On- the- Fly Packaging Service, który generuje nasze strumienie HLS. Podczas gdy problem trwał, wnioski do następujących punktów końcowych zwróciły 503 błędy. Kwestia dotyczyła usług między 16: 36 a 18: 51 UTC w poniedziałek 26 października. Kontynuujemy ścisłą obserwację platformy i dokonamy jej przeglądu.

4. 26 października 2026 19:10 UTCresolved

   Ten incydent został rozwiązany.

Automatyczne tłumaczenie oficjalnej aktualizacji incydentu.

1. 20 marca 2026 14:37 UTCidentified

   Dear Clients, We are currently investigating a streaming outage affecting the us-east-1 region. Our engineering team is actively working on a resolution, and we will provide further updates as they become available. Further notices will be sent regarding this incident as they become available. With best regards, 7digital Client SuccessTeam

2. 20 marca 2026 14:41 UTCmonitoring

   A fix has been implemented for the streaming issues in us-east-1. We are currently monitoring the results and will provide a final update shortly.

3. 20 marca 2026 17:59 UTCresolved

   This incident has been resolved.

1. 16 marca 2026 11:01 UTCresolved

   Dear Clients, Between 10:00 AM and 10:25 AM UTC, we experienced elevated latency/error rates on our streaming APIs. Our engineering team identified the root cause and implemented a fix. Service has returned to normal operations, and all systems are now monitored and stable. With best regards, 7digital Client SuccessTeam

1. 4 kwietnia 2025 13:56 UTCidentified

   We're currently experiencing an outage with our Catalogue Search. This impacts users of the search API and the 7digital playlist tool with search currently unavailable within the playlist tool. The 7digital engineering team are working to resolve the issue and we'll provide further updates as soon we have them. Regards, 7digital Client Success Team

2. 4 kwietnia 2025 14:33 UTCmonitoring

   A fix has been implemented to restore service to search and we're continuing to monitor the issue. Regards, 7digital Client Success Team

3. 4 kwietnia 2025 15:00 UTCresolved

   This incident has been resolved.

1. 21 sierpnia 2024 09:26 UTCidentified

   As of ~08:00 BST we started to observe errors in our Catalogue Events product which meant we were unable to push out any event messages. We've identified the issue and are implementing a fix to resolve the impact on Events. Once the service is restored we'll follow up with further updates and information.

2. 21 sierpnia 2024 10:12 UTCidentified

   On further investigation we've identified that an issue with a 3rd party supplier is impacting our ingestion platform. Despite attempting to implement a resolution internally, this has resulted in an outage impacting our ability to ingest content from suppliers. All catalogue updates will be delayed until our ingestion platform is restored to full health. To clarify after the initial status message, our Catalogue Events product is operational but due to the underlying issue with our ingestion platform we won't be generating any catalogue updates through Events as a result.

3. 21 sierpnia 2024 12:01 UTCidentified

   Our 3rd party supplier has updated us that they're seeing significant signs of recovery to their service. As a result some of the impacted services on 7digital's platform are also starting to restore. We'll continue to monitor progress and have taken the decision to leave catalogue ingestion switched off until we're confident the platform is restored to full health. At this stage we plan to switch on catalogue ingestion shortly after 13:00 UTC if things continue to progress as expected. We'll update this incident at that time.

4. 21 sierpnia 2024 13:36 UTCresolved

   Catalogue ingestion has now been switched on and the platform has been restored to full health. The team will continue to monitor and be on hand to react to any further incidents.

1. 4 marca 2024 16:27 UTCidentified

   Dear Clients, Due to unforeseen circumstances with our data warehouse, the incremental artist feed for 20240304 has been generated, however, it will not contain any data. To ensure you have access to the most up-to-date catalogue, we advise continuing as normal by ingesting the incremental artist feed for 20240305, which will cover data for both 20240304 and 20240305. We apologise for any inconvenience this may cause and want to assure you that we are actively working to resolve this issue and prevent future occurrences. If you have any questions, please contact your Client Success Manager. If you are a client who does not ingest our feeds then please ignore this email. With best regards, 7digital Client Success Team

2. 4 marca 2024 17:06 UTCresolved

   This incident has been resolved.

1. 25 grudnia 2023 21:26 UTCidentified

   We're observing an elevated error rate against stream requests to the platform. The 7digital engineering team are working to resolve the issue and we'll provide further updates as we have them.

2. 25 grudnia 2023 22:24 UTCmonitoring

   A fix has been implemented to deal with the elevated error rate and we're now seeing error rates returning to a normal level. We're continuing to monitor the platform and will take any further action as necessary.

3. 25 grudnia 2023 22:46 UTCresolved

   This incident has now been resolved. We'll continue to monitor the platform and we'll continue to have engineering support staff on hand should any further issue occur.

1. 5 października 2023 09:34 UTCinvestigating

   We're currently observing an unprecedented volume of demand on the platform, and as a result multiple areas of the API are currently unavailable. We're in the process of scaling up the platform to support this increased load and restore availability. As soon as we have further updates they'll be posted here.

2. 5 października 2023 11:22 UTCmonitoring

   A fix has been implemented and we are monitoring the results.

3. 5 października 2023 12:18 UTCresolved

   This incident has been resolved.

1. 15 maja 2023 15:08 UTCinvestigating

   Dear Clients, During this time, we have noticed a higher than usual error rate on calls to various APIs and longer response times. Our team of on-call support engineers is currently investigating the issue and taking steps to improve the stability of the platform. We will provide you with additional details in a further notice once we have completed our analysis of the problem. If you have any questions, please create a Service Desk ticket with the Client Success Team. With best regards, 7digital Client Success Team

2. 15 maja 2023 15:38 UTCmonitoring

   Dear clients, The platform degradation/outage experienced today is now closed. The platform is stable and the error rate has dropped. Our Tech team will continue to investigate. If you continue to experience issues with the 7digital platform create a Service Desk ticket with the Client Success Team. With best regards, 7digital Client Success Team

3. 15 maja 2023 16:08 UTCresolved

   This incident has been resolved.

1. 24 kwietnia 2023 11:29 UTCidentified

   We are currently experiencing an outage on our content ingestion systems. We last processed new content and updates on Saturday morning (UK time). We are working towards a resolution now and plan to provide an update shortly.

2. 24 kwietnia 2023 15:24 UTCidentified

   We've identified the fault and are currently in the process of restoring our ingestion platform. Once the ingestion platform is functional again we can begin ingesting pending deliveries and will provide a further update at that time.

3. 25 kwietnia 2023 14:35 UTCmonitoring

   A fix has been implemented to solve the problem, allowing us to resume ingestion. The backlog will be cleared gradually as we ramp up processing capacity.

4. 26 kwietnia 2023 09:02 UTCresolved

   This incident has been resolved.

1. 23 marca 2023 00:33 UTCinvestigating

   We're currently investigating an issue with the download API where most, or all download attempts are failing. As soon as we have further information we'll provide additional updates.

2. 23 marca 2023 01:14 UTCresolved

   We've rolled back our Download API to a previous state which has restored downloads successfully. We'll continue to monitor to ensure the issue is resolved and will follow up with further information once we've compiled a post incident report.

1. 17 października 2022 11:34 UTCinvestigating

   Dear Clients, We are currently seeing a degradation of service across most APIs. This issue is only affecting uncached media as cache hits are served from our CDN and are therefore unaffected. Our on call support engineers are currently investigating the issue and taking action to further stabilise the platform. Once we have completed analysis of the issue we'll send an additional notice out with further details. Further notices will be sent regarding this incident as they become available. With best regards, 7digital Client SuccessTeam

2. 17 października 2022 11:43 UTCmonitoring

   Dear clients, The platform degradation. The platform is stable and the error rate has now returned to normal performance levels. Our Tech team will continue to investigate and monitor performance. If you continue to experience issues with the 7digital platform create a Service Desk ticket with the Client Success Team. With best regards, 7digital Client Success Team

3. 17 października 2022 12:22 UTCresolved

   This incident has been resolved.

1. 25 sierpnia 2022 13:57 UTCresolved

   At 13:46 BST we were alerted to an issue with one of our two network lines. After investigation, at 14:04 BST we removed the network at fault from service, directing all traffic to our secondary line which restored normal service to the platform. We are continuing to investigate what caused the failure and will restore network redundancy as soon as possible.

1. 24 czerwca 2022 06:59 UTCidentified

   Dear clients, The 7digital Playlist Tool is currently unavailable. Once we have further updates we'll share them with additional announcements. You can subscribe to updates via email, webhooks and RSS feed on our statuspage (insert link). If you would like to receive SMS updates, please create a Service Desk ticket with the Client Success Team. If you have any questions, please create a Service Desk ticket with the Client Success Team. With best regards, 7digital Client Success Team

2. 24 czerwca 2022 07:34 UTCmonitoring

   A fix has been implemented and we are monitoring the results.

3. 24 czerwca 2022 11:01 UTCresolved

   This incident has been resolved.

1. 28 kwietnia 2022 03:39 UTCinvestigating

   We are currently investigating a suspected platform outage. Currently all endpoints on 7digital's API are unavailable, 7digital engineers are investigating the cause and we'll provide further information as soon as it's available.

2. 28 kwietnia 2022 04:34 UTCidentified

   We've now isolated the cause of the outage to our DB cluster. We're observing an issue between the primary and replica node which is hindering our ability to bring the cluster back online. We're continuing to investigate the issue and will provide further updates as they're available.

3. 28 kwietnia 2022 05:49 UTCidentified

   We have been able to successfully bring back online the affected DB cluster, however we're still experiencing problems keeping the DB cluster online permanently, causing the platform to be unavailable. We are continuing to investigate and will provide further updates shortly.

4. 28 kwietnia 2022 08:42 UTCidentified

   We are continuing to work on a fix for the issue and will provide an update again shortly. We can also confirm that cached streams continue to be served throughout the incident. We're reviewing activity to identify other areas of the platform which are only partially unavailable and will communicate updates with further information shortly.

5. 28 kwietnia 2022 11:52 UTCidentified

   We are continuing to work to resolve the ongoing outage. The cause has been isolated to our SQL Server cluster, which is currently not able to keep certain databases online - choosing to take them down for as of yet, an unknown reason. Our efforts to force a single node to host the databases have so far not been effective at solving the current issue. We believe at this stage, that our cluster configuration has a non-trivial problem, and we are moving to bring up databases separately outside of the high-availability cluster to restore service as soon as we can. Following the return of stability, we will look to restore high-availability as soon as we can.

6. 28 kwietnia 2022 12:29 UTCmonitoring

   As per the previous update a fix has been implemented and service has been restored to the platform, with the exception of ALC purchasing, locker and ALC/permanent download endpoints. We are continuing to monitor the fix and will also be working on restoring high-availability to the platform.

7. 28 kwietnia 2022 12:55 UTCresolved

   Full service has been restored to all components of the platform and monitoring will continue. We're confident service has been restored and we will follow up with an incident report next week once we've been able to fully evaluate the issue and the actions taken to remedy it.

8. 10 maja 2022 15:20 UTCpostmortem

   The incident report for this outage is now available and can be found [here](https://drive.google.com/file/d/1MK4JVxFuKtHnnvekUzSk2aT61Z0zo43G/view).

1. 23 kwietnia 2022 17:47 UTCinvestigating

   Dear Clients, The Download APIs are currently down due to an outage. Streaming and Media Transfer endpoints are not affected. A new EC2 instance is being set up by the Tech team. Further updates will be announced as soon as they become available. If you have any questions, please create a Service Desk ticket with the Client Success Team. With best regards, 7digital Client Success Team

2. 23 kwietnia 2022 17:51 UTCmonitoring

   The download outage experienced today is now closed. The endpoint is back to normal. If you continue to experience issues with the 7digital platform create a Service Desk ticket with the Client Success Team. With best regards, 7digital Client Success Team

3. 23 kwietnia 2022 17:51 UTCresolved

   This incident has been resolved.

1. 26 lutego 2022 10:32 UTCidentified

   Dear Clients, Since 9.20am GMT we saw a degradation across all APIs. Engineers on-call are currently investigating the issue and are taking action to further stabilise the platform. A further update will be communicated in due course. If you have any questions, please create a Service Desk ticket with the Client Success Team. With best regards, 7digital Client Success Team

2. 26 lutego 2022 10:53 UTCresolved

   As of 10:50 GMT full service has resumed but we're continuing to monitor the platform.

1. 19 lipca 2021 15:10 UTCresolved

   Dear Clients, We are currently experiencing a delay with processing UMG content. A bug was detected in the UMG Teleporter application causing a backlog of content to develop on their side. Therefore, as a result, content will be delayed from entering the daily feeds. A fix has been deployed and UMG have been notified of the issue. We are currently processing the backlog which is estimated to take 24 hours. If you have any questions, please create a Service Desk ticket with the Client Success Team. With best regards, 7digital Client Success Team

1. 2 lipca 2021 14:27 UTCidentified

   We are currently experiencing a delay with processing UMG content. At 8pm 01/07 a bug was detected in the UMG Teleporter application causing a backlog of content to develop on their side. Therefore as a result, content delivered between 8pm 01/07 and 11am 02/07 may be delayed from entering the daily feeds. A fix has been deployed and UMG have been notified of the issue. We are currently processing the backlog.

2. 2 lipca 2021 14:43 UTCmonitoring

   A fix has been deployed and UMG have been notified of the issue. We are currently processing the backlog.

3. 3 lipca 2021 07:43 UTCresolved

   This incident has been resolved.

1. 8 czerwca 2021 10:15 UTCinvestigating

   Dear Clients, We are currently seeing a degradation of service with our CDN provider. Further notices will be sent regarding this incident as they become available. With best regards, 7digital Client SuccessTeam

2. 8 czerwca 2021 10:31 UTCidentified

   The CDN outage is affecting all 7digital API and Media Delivery endpoints. Our on-call support engineers are currently investigating the issue and in contact with our CDN provider. You can subscribe to updates via email, webhooks and RSS feed on our statuspage (https://status.7digital.com/). If you would like to receive SMS updates, please create a Service Desk ticket with the Client Success Team. Once we have further updates we'll share them with additional announcements. If you have any questions, please create a Service Desk ticket with the Client Success Team.

3. 8 czerwca 2021 10:33 UTCidentified

   We are continuing to work on a fix for this issue.

4. 8 czerwca 2021 11:00 UTCmonitoring

   The error rate has dropped since 11:53 GMT. Our Tech team will continue to monitor the platform before we close this incident. For the most current updates, you can follow Fastly Status page here: https://status.fastly.com/

5. 8 czerwca 2021 13:08 UTCresolved

   Dear Clients, The CDN outage experienced today is now closed. The platform is back to normal and the error rate has completely dropped since 13:37. With best regards, 7digital Client Success Team