История сбоев 7digital

1. 26 октября 2026 г. в 17:52 UTCidentified

   Уважаемые клиенты, В настоящее время мы испытываем перебои, влияющие на наши конечные точки потоковой передачи HLS: GET/stream/subscription.m3u8 GET/offline/subscription.m3u8 GET/stream/catalogue.m3u8 Прогрессивная потоковая передача и конечные точки загрузки не затрагиваются. Наши инженеры, работающие по вызову, исследуют и работают над восстановлением стабильности. Мы отправим дополнительные обновления в надлежащее время. Если у вас есть какие-либо вопросы, пожалуйста, свяжитесь с командой успеха клиента. Добрый вечер, Массивная музыкальная команда успеха

2. 26 октября 2026 г. в 18:34 UTCidentified

   После нашего предыдущего уведомления мы определили причину отключения, влияющего на наши конечные точки потоковой передачи HLS. Наш поставщик CDN исследует проблему со своим сервисом On-the-Fly Packaging, который генерирует потоки HLS. Наши инженеры находятся в тесном контакте с поставщиком CDN, отслеживая прогресс и работая над восстановлением сервиса как можно быстрее. Мы отправим дополнительное обновление после восстановления сервиса.

3. 26 октября 2026 г. в 19:07 UTCmonitoring

   Проблема, затрагивающая наши конечные точки потоковой передачи HLS, решена, и мы отслеживаем работу сервиса. Отключение было вызвано проблемой с сервисом On-the-Fly Packaging нашего поставщика CDN, который генерирует потоки HLS. В то время как проблема продолжалась, запросы к следующим конечным точкам возвращали 503 ошибки. Проблема затронула сервис между 16:36 и 18:51 UTC в понедельник 26 октября. Мы продолжаем внимательно следить за платформой и рассмотрим инцидент.

4. 26 октября 2026 г. в 19:10 UTCresolved

   Этот инцидент был урегулирован.

Автоматический перевод официального обновления инцидента.

1. 20 марта 2026 г. в 14:37 UTCidentified

   Dear Clients, We are currently investigating a streaming outage affecting the us-east-1 region. Our engineering team is actively working on a resolution, and we will provide further updates as they become available. Further notices will be sent regarding this incident as they become available. With best regards, 7digital Client SuccessTeam

2. 20 марта 2026 г. в 14:41 UTCmonitoring

   A fix has been implemented for the streaming issues in us-east-1. We are currently monitoring the results and will provide a final update shortly.

3. 20 марта 2026 г. в 17:59 UTCresolved

   This incident has been resolved.

1. 16 марта 2026 г. в 11:01 UTCresolved

   Dear Clients, Between 10:00 AM and 10:25 AM UTC, we experienced elevated latency/error rates on our streaming APIs. Our engineering team identified the root cause and implemented a fix. Service has returned to normal operations, and all systems are now monitored and stable. With best regards, 7digital Client SuccessTeam

1. 4 апреля 2025 г. в 13:56 UTCidentified

   We're currently experiencing an outage with our Catalogue Search. This impacts users of the search API and the 7digital playlist tool with search currently unavailable within the playlist tool. The 7digital engineering team are working to resolve the issue and we'll provide further updates as soon we have them. Regards, 7digital Client Success Team

2. 4 апреля 2025 г. в 14:33 UTCmonitoring

   A fix has been implemented to restore service to search and we're continuing to monitor the issue. Regards, 7digital Client Success Team

3. 4 апреля 2025 г. в 15:00 UTCresolved

   This incident has been resolved.

1. 21 августа 2024 г. в 09:26 UTCidentified

   As of ~08:00 BST we started to observe errors in our Catalogue Events product which meant we were unable to push out any event messages. We've identified the issue and are implementing a fix to resolve the impact on Events. Once the service is restored we'll follow up with further updates and information.

2. 21 августа 2024 г. в 10:12 UTCidentified

   On further investigation we've identified that an issue with a 3rd party supplier is impacting our ingestion platform. Despite attempting to implement a resolution internally, this has resulted in an outage impacting our ability to ingest content from suppliers. All catalogue updates will be delayed until our ingestion platform is restored to full health. To clarify after the initial status message, our Catalogue Events product is operational but due to the underlying issue with our ingestion platform we won't be generating any catalogue updates through Events as a result.

3. 21 августа 2024 г. в 12:01 UTCidentified

   Our 3rd party supplier has updated us that they're seeing significant signs of recovery to their service. As a result some of the impacted services on 7digital's platform are also starting to restore. We'll continue to monitor progress and have taken the decision to leave catalogue ingestion switched off until we're confident the platform is restored to full health. At this stage we plan to switch on catalogue ingestion shortly after 13:00 UTC if things continue to progress as expected. We'll update this incident at that time.

4. 21 августа 2024 г. в 13:36 UTCresolved

   Catalogue ingestion has now been switched on and the platform has been restored to full health. The team will continue to monitor and be on hand to react to any further incidents.

1. 4 марта 2024 г. в 16:27 UTCidentified

   Dear Clients, Due to unforeseen circumstances with our data warehouse, the incremental artist feed for 20240304 has been generated, however, it will not contain any data. To ensure you have access to the most up-to-date catalogue, we advise continuing as normal by ingesting the incremental artist feed for 20240305, which will cover data for both 20240304 and 20240305. We apologise for any inconvenience this may cause and want to assure you that we are actively working to resolve this issue and prevent future occurrences. If you have any questions, please contact your Client Success Manager. If you are a client who does not ingest our feeds then please ignore this email. With best regards, 7digital Client Success Team

2. 4 марта 2024 г. в 17:06 UTCresolved

   This incident has been resolved.

1. 25 декабря 2023 г. в 21:26 UTCidentified

   We're observing an elevated error rate against stream requests to the platform. The 7digital engineering team are working to resolve the issue and we'll provide further updates as we have them.

2. 25 декабря 2023 г. в 22:24 UTCmonitoring

   A fix has been implemented to deal with the elevated error rate and we're now seeing error rates returning to a normal level. We're continuing to monitor the platform and will take any further action as necessary.

3. 25 декабря 2023 г. в 22:46 UTCresolved

   This incident has now been resolved. We'll continue to monitor the platform and we'll continue to have engineering support staff on hand should any further issue occur.

1. 5 октября 2023 г. в 09:34 UTCinvestigating

   We're currently observing an unprecedented volume of demand on the platform, and as a result multiple areas of the API are currently unavailable. We're in the process of scaling up the platform to support this increased load and restore availability. As soon as we have further updates they'll be posted here.

2. 5 октября 2023 г. в 11:22 UTCmonitoring

   A fix has been implemented and we are monitoring the results.

3. 5 октября 2023 г. в 12:18 UTCresolved

   This incident has been resolved.

1. 15 мая 2023 г. в 15:08 UTCinvestigating

   Dear Clients, During this time, we have noticed a higher than usual error rate on calls to various APIs and longer response times. Our team of on-call support engineers is currently investigating the issue and taking steps to improve the stability of the platform. We will provide you with additional details in a further notice once we have completed our analysis of the problem. If you have any questions, please create a Service Desk ticket with the Client Success Team. With best regards, 7digital Client Success Team

2. 15 мая 2023 г. в 15:38 UTCmonitoring

   Dear clients, The platform degradation/outage experienced today is now closed. The platform is stable and the error rate has dropped. Our Tech team will continue to investigate. If you continue to experience issues with the 7digital platform create a Service Desk ticket with the Client Success Team. With best regards, 7digital Client Success Team

3. 15 мая 2023 г. в 16:08 UTCresolved

   This incident has been resolved.

1. 24 апреля 2023 г. в 11:29 UTCidentified

   We are currently experiencing an outage on our content ingestion systems. We last processed new content and updates on Saturday morning (UK time). We are working towards a resolution now and plan to provide an update shortly.

2. 24 апреля 2023 г. в 15:24 UTCidentified

   We've identified the fault and are currently in the process of restoring our ingestion platform. Once the ingestion platform is functional again we can begin ingesting pending deliveries and will provide a further update at that time.

3. 25 апреля 2023 г. в 14:35 UTCmonitoring

   A fix has been implemented to solve the problem, allowing us to resume ingestion. The backlog will be cleared gradually as we ramp up processing capacity.

4. 26 апреля 2023 г. в 09:02 UTCresolved

   This incident has been resolved.

1. 23 марта 2023 г. в 00:33 UTCinvestigating

   We're currently investigating an issue with the download API where most, or all download attempts are failing. As soon as we have further information we'll provide additional updates.

2. 23 марта 2023 г. в 01:14 UTCresolved

   We've rolled back our Download API to a previous state which has restored downloads successfully. We'll continue to monitor to ensure the issue is resolved and will follow up with further information once we've compiled a post incident report.

1. 17 октября 2022 г. в 11:34 UTCinvestigating

   Dear Clients, We are currently seeing a degradation of service across most APIs. This issue is only affecting uncached media as cache hits are served from our CDN and are therefore unaffected. Our on call support engineers are currently investigating the issue and taking action to further stabilise the platform. Once we have completed analysis of the issue we'll send an additional notice out with further details. Further notices will be sent regarding this incident as they become available. With best regards, 7digital Client SuccessTeam

2. 17 октября 2022 г. в 11:43 UTCmonitoring

   Dear clients, The platform degradation. The platform is stable and the error rate has now returned to normal performance levels. Our Tech team will continue to investigate and monitor performance. If you continue to experience issues with the 7digital platform create a Service Desk ticket with the Client Success Team. With best regards, 7digital Client Success Team

3. 17 октября 2022 г. в 12:22 UTCresolved

   This incident has been resolved.

1. 25 августа 2022 г. в 13:57 UTCresolved

   At 13:46 BST we were alerted to an issue with one of our two network lines. After investigation, at 14:04 BST we removed the network at fault from service, directing all traffic to our secondary line which restored normal service to the platform. We are continuing to investigate what caused the failure and will restore network redundancy as soon as possible.

1. 24 июня 2022 г. в 06:59 UTCidentified

   Dear clients, The 7digital Playlist Tool is currently unavailable. Once we have further updates we'll share them with additional announcements. You can subscribe to updates via email, webhooks and RSS feed on our statuspage (insert link). If you would like to receive SMS updates, please create a Service Desk ticket with the Client Success Team. If you have any questions, please create a Service Desk ticket with the Client Success Team. With best regards, 7digital Client Success Team

2. 24 июня 2022 г. в 07:34 UTCmonitoring

   A fix has been implemented and we are monitoring the results.

3. 24 июня 2022 г. в 11:01 UTCresolved

   This incident has been resolved.

1. 28 апреля 2022 г. в 03:39 UTCinvestigating

   We are currently investigating a suspected platform outage. Currently all endpoints on 7digital's API are unavailable, 7digital engineers are investigating the cause and we'll provide further information as soon as it's available.

2. 28 апреля 2022 г. в 04:34 UTCidentified

   We've now isolated the cause of the outage to our DB cluster. We're observing an issue between the primary and replica node which is hindering our ability to bring the cluster back online. We're continuing to investigate the issue and will provide further updates as they're available.

3. 28 апреля 2022 г. в 05:49 UTCidentified

   We have been able to successfully bring back online the affected DB cluster, however we're still experiencing problems keeping the DB cluster online permanently, causing the platform to be unavailable. We are continuing to investigate and will provide further updates shortly.

4. 28 апреля 2022 г. в 08:42 UTCidentified

   We are continuing to work on a fix for the issue and will provide an update again shortly. We can also confirm that cached streams continue to be served throughout the incident. We're reviewing activity to identify other areas of the platform which are only partially unavailable and will communicate updates with further information shortly.

5. 28 апреля 2022 г. в 11:52 UTCidentified

   We are continuing to work to resolve the ongoing outage. The cause has been isolated to our SQL Server cluster, which is currently not able to keep certain databases online - choosing to take them down for as of yet, an unknown reason. Our efforts to force a single node to host the databases have so far not been effective at solving the current issue. We believe at this stage, that our cluster configuration has a non-trivial problem, and we are moving to bring up databases separately outside of the high-availability cluster to restore service as soon as we can. Following the return of stability, we will look to restore high-availability as soon as we can.

6. 28 апреля 2022 г. в 12:29 UTCmonitoring

   As per the previous update a fix has been implemented and service has been restored to the platform, with the exception of ALC purchasing, locker and ALC/permanent download endpoints. We are continuing to monitor the fix and will also be working on restoring high-availability to the platform.

7. 28 апреля 2022 г. в 12:55 UTCresolved

   Full service has been restored to all components of the platform and monitoring will continue. We're confident service has been restored and we will follow up with an incident report next week once we've been able to fully evaluate the issue and the actions taken to remedy it.

8. 10 мая 2022 г. в 15:20 UTCpostmortem

   The incident report for this outage is now available and can be found [here](https://drive.google.com/file/d/1MK4JVxFuKtHnnvekUzSk2aT61Z0zo43G/view).

1. 23 апреля 2022 г. в 17:47 UTCinvestigating

   Dear Clients, The Download APIs are currently down due to an outage. Streaming and Media Transfer endpoints are not affected. A new EC2 instance is being set up by the Tech team. Further updates will be announced as soon as they become available. If you have any questions, please create a Service Desk ticket with the Client Success Team. With best regards, 7digital Client Success Team

2. 23 апреля 2022 г. в 17:51 UTCmonitoring

   The download outage experienced today is now closed. The endpoint is back to normal. If you continue to experience issues with the 7digital platform create a Service Desk ticket with the Client Success Team. With best regards, 7digital Client Success Team

3. 23 апреля 2022 г. в 17:51 UTCresolved

   This incident has been resolved.

1. 26 февраля 2022 г. в 10:32 UTCidentified

   Dear Clients, Since 9.20am GMT we saw a degradation across all APIs. Engineers on-call are currently investigating the issue and are taking action to further stabilise the platform. A further update will be communicated in due course. If you have any questions, please create a Service Desk ticket with the Client Success Team. With best regards, 7digital Client Success Team

2. 26 февраля 2022 г. в 10:53 UTCresolved

   As of 10:50 GMT full service has resumed but we're continuing to monitor the platform.

1. 19 июля 2021 г. в 15:10 UTCresolved

   Dear Clients, We are currently experiencing a delay with processing UMG content. A bug was detected in the UMG Teleporter application causing a backlog of content to develop on their side. Therefore, as a result, content will be delayed from entering the daily feeds. A fix has been deployed and UMG have been notified of the issue. We are currently processing the backlog which is estimated to take 24 hours. If you have any questions, please create a Service Desk ticket with the Client Success Team. With best regards, 7digital Client Success Team

1. 2 июля 2021 г. в 14:27 UTCidentified

   We are currently experiencing a delay with processing UMG content. At 8pm 01/07 a bug was detected in the UMG Teleporter application causing a backlog of content to develop on their side. Therefore as a result, content delivered between 8pm 01/07 and 11am 02/07 may be delayed from entering the daily feeds. A fix has been deployed and UMG have been notified of the issue. We are currently processing the backlog.

2. 2 июля 2021 г. в 14:43 UTCmonitoring

   A fix has been deployed and UMG have been notified of the issue. We are currently processing the backlog.

3. 3 июля 2021 г. в 07:43 UTCresolved

   This incident has been resolved.

1. 8 июня 2021 г. в 10:15 UTCinvestigating

   Dear Clients, We are currently seeing a degradation of service with our CDN provider. Further notices will be sent regarding this incident as they become available. With best regards, 7digital Client SuccessTeam

2. 8 июня 2021 г. в 10:31 UTCidentified

   The CDN outage is affecting all 7digital API and Media Delivery endpoints. Our on-call support engineers are currently investigating the issue and in contact with our CDN provider. You can subscribe to updates via email, webhooks and RSS feed on our statuspage (https://status.7digital.com/). If you would like to receive SMS updates, please create a Service Desk ticket with the Client Success Team. Once we have further updates we'll share them with additional announcements. If you have any questions, please create a Service Desk ticket with the Client Success Team.

3. 8 июня 2021 г. в 10:33 UTCidentified

   We are continuing to work on a fix for this issue.

4. 8 июня 2021 г. в 11:00 UTCmonitoring

   The error rate has dropped since 11:53 GMT. Our Tech team will continue to monitor the platform before we close this incident. For the most current updates, you can follow Fastly Status page here: https://status.fastly.com/

5. 8 июня 2021 г. в 13:08 UTCresolved

   Dear Clients, The CDN outage experienced today is now closed. The platform is back to normal and the error rate has completely dropped since 13:37. With best regards, 7digital Client Success Team