Historia awarii Panopto

1. 7 sierpnia 2026 19:32 UTCresolved

   August 7, 2026 6:29PM UTC Identified - Incident Details: We are investigating a site outage on the Panopto AU Cloud. We’re sorry for this interruption, our cloud operations team is urgently investigating the issue and we’ll update here as soon as we know more. Our next update will be within 15 minutes. What does this mean? During a site outage, end users are unable to access the service meaning they are unable to access your site, nor view, edit or upload new recordings. August 7, 2026 6:49PM UTC Monitoring - The Panopto Clouds are stable and metrics have remained normal since our last update. The Panopto Engineering Team is monitoring the site closely. We will post an update in an hour. August 7, 2026 7:32PM UTC Resolved - The Panopto Clouds are stable and metrics have remained normal since our last update. We are resolving this incident and Panopto engineers are completing a full root cause analysis, which we will post here, within the next week.

1. 21 lipca 2026 00:02 UTCresolved

   Lipiec 13, 2026 6: 50AM UTC Monitoring - Panopto NA Cloud doświadczył degradacji wydajności w ogólnym użyciu strony internetowej. Nasz zespół ds. operacji w chmurze zbadał tę kwestię, a źródło degradacji wydajności zostało złagodzone. Monitorujemy wskaźniki wydajności, aby upewnić się, że problem został rozwiązany i będziemy aktualizować tutaj, jak tylko dowiemy się więcej. Następna aktualizacja nastąpi w ciągu 24 godzin. Co to znaczy? W okresie pogarszającej się wydajności ogólna wydajność strony internetowej była wolniejsza, a niektóre operacje mogły się nie udać. Lipiec 14, 2026 3: 14PM UTC Resoluved - Chmury Panopto są stabilne i pomiary pozostają normalne od naszej ostatniej aktualizacji. Rozwiązujemy ten incydent, a inżynierowie Panopto kończą pełną analizę przyczyn, którą opublikujemy tutaj, w przyszłym tygodniu. Lipiec 21, 2026 12: 02AM UTC Resoluved - Na 2026-07-13 od 05: 48 UTC do 06: 00 UTC, Panopto North American (NA) Cloud doświadczył krótkiego przerwy w obsłudze. W tym czasie klienci mogli doświadczyć trudności lub tymczasowej niezdolności do dostępu do usługi, w tym do przesyłania lub oglądania treści. Serdecznie przepraszamy za wszelkie niedogodności. RCA: Zakłócenie spowodowane było dużą ilością jednoczesnych aktualizacji bazy danych, które doprowadziły do blokady zasobów uniemożliwiającej przetwarzanie kolejnych wniosków. Po rozwiązaniu sporu usługa wróciła do normy bez interwencji. Aby zapobiec ponownemu wystąpieniu tego problemu, nasze zespoły inżynieryjne wdrażają optymalizacje zapytań w bazie danych i wdrażają ulepszone mechanizmy kontroli współwalutowych, aby lepiej obsługiwać duże ilości równoległych operacji.

Automatyczne tłumaczenie oficjalnej aktualizacji incydentu.

1. 16 lipca 2026 13:58 UTCresolved

   Lipiec 16, 2026 1: 58PM UTC Resoluved - Panopto AP Cloud doświadczył zwiększonego wskaźnika błędów w ogólnym użyciu strony internetowej 13: 03 UTC do 13: 09 UTC. Przepraszamy za przerwę. Nasz zespół operacyjny w chmurze potwierdził, że strona działa, a wskaźniki są stabilne. Przeprowadzimy analizę przyczyn w ciągu tygodnia.

Automatyczne tłumaczenie oficjalnej aktualizacji incydentu.

1. 17 czerwca 2026 21:59 UTCresolved

   June 11, 2026 9:50PM UTC Investigating - Incident Details: We are investigating a video streaming outage on all Panopto Cloud sites. We’re sorry for this interruption, our cloud operations team is urgently investigating the issue and we’ll update here as soon as we know more. Our next update will be within 15 minutes. What does this mean? During a site outage, end users are unable to access the service meaning they are unable to access your site, nor view, edit or upload new recordings. June 11, 2026 10:02PM UTC Monitoring - The Panopto Clouds are now fully operational for all users. The source of the outage has been mitigated. Our cloud operations team is monitoring performance metrics to ensure the issue remains resolved. Our next update will be within 60 minutes. June 11, 2026 10:08PM UTC Resolved - The Panopto Clouds are stable and metrics have remained normal since our last update. We are resolving this incident and Panopto engineers are completing a full root cause analysis, which we will post here, within the next week. June 17, 2026 9:59PM UTC Resolved - On 2026-06-11 from 20:35 UTC to 21:50 UTC, the Panopto Production Cloud experienced a global video playback disruption. During this time, customers will have experienced a complete playback stoppage, where media files and videos across global regions failed to load. RCA: The incident was caused by an unintentional configuration adjustment made within our primary storage management console, which inadvertently impacted permissions required for our media streaming delivery system to serve video segments. This resulted in immediate playback errors. Once the issue was isolated, our Cloud Operations team coordinated an immediate rollback strategy and successfully reversed the configuration to restore full streaming functionality. To prevent a recurrence of this issue, the Cloud Operations team is restructuring our internal infrastructure permissions to tightly isolate and restrict storage configuration settings to authorized CloudOps deployment pathways. This added safeguard ensures that accidental adjustments of this nature cannot be executed or impact service availability.

1. 17 czerwca 2026 19:37 UTCresolved

   June 17, 2026 7:37PM UTC Resolved - The Panopto NA Cloud experienced search performance degradation from 18:37 UTC to 18:56 UTC. Our cloud operations team identified and investigated a brief performance degradation in Panopto's search functionality, beginning at 18:37 UTC. Additional resources were allocated, and the issue was mitigated, with search performance being back to full capacity as of 18:56 UTC. The alert is being closed at this time, and a full RCA will be posted within 7 days. What does this mean? New or modified content may have taken longer than expected to appear in search results.

1. 24 kwietnia 2026 10:51 UTCresolved

   April 16, 2026 9:48AM UTC Investigating - We are experiencing increased error rates in Knowledge Insights across all cloud regions Our cloud operations team is urgently investigating the issue and we’ll update here as soon as we know more. Our next update will be within 30 minutes. What does this mean? Knowledge insights widgets show “Query failed” April 16, 2026 10:17AM UTC Investigating - We are continuing to experience increased error rates in Knowledge Insights across all cloud regions Our engineering team is actively investigating this issue with urgent priority. Please bear with us while we continue to investigate the cause. Our next update will be within 30 minutes. April 16, 2026 10:48AM UTC Investigating - We are continuing to experience increased error rates in Knowledge Insights across all cloud regions Our engineering team is actively investigating this issue with urgent priority. Please bear with us while we continue to investigate the cause. Our next update will be within 30 minutes. April 16, 2026 11:16AM UTC Monitoring - The source of the increased error rates has been mitigated. Our cloud operations team is monitoring cloud metrics to ensure the issue is resolved. Our next update will be within 60 minutes. April 16, 2026 12:15PM UTC Resolved - Panopto Knowledge Insights has been stable across all cloud regions and metrics have remained normal since our last update. We are resolving this incident and Panopto engineers are completing a root cause analysis, which we will post here, within the next week. April 24, 2026 10:51AM UTC Resolved - On 2026-04-16 from 09:00 UTC to 11:16 UTC, the Panopto Cloud experienced a service disruption affecting the Knowledge Insights feature across all regions. During this time, customers may have encountered errors or been unable to access data within Knowledge Insights dashboards. RCA: The disruption was caused by a synchronization error during a routine update to our backend reporting services. A specific configuration parameter did not update as expected, which prevented the dashboard interface from successfully retrieving data from the reporting engine. To prevent a recurrence, we are refining our service deployment strategy to include more granular validation of connection parameters. Additionally, we are implementing enhanced, real-time monitoring and automated alerting specifically for Knowledge Insights data pathways to ensure faster detection and resolution of connectivity issues.

1. 23 marca 2026 19:37 UTCresolved

   March 23, 2026 6:51PM UTC Investigating - The Panopto NA Cloud experienced increased error rates between 6:25 and 6:27pm UTC (2:25pm-2:27pm EDT). We’re sorry for this interruption. Our cloud operations team is urgently investigating the issue and we’ll update here as soon as we know more. Our next update will be within 60 minutes. What does this mean? General website usage may have been unstable during the stated period. The site recovered automatically at 6:27pm UTC (2:27pm EDT) and remains stable. We apologize for the interruption and will continue to monitor the performance of the site. March 23, 2026 7:37PM UTC Resolved - The Panopto NA Cloud has been stable and metrics have remained normal since our last update. We are resolving this incident and Panopto engineers are completing a root cause analysis, which we will post here, within the next week. We apologize for the inconvenience and thank you for your partnership.

1. 22 marca 2026 07:30 UTCresolved

   March 16, 2026 2:22PM UTC Scheduled - Our Panopto Cloud services are scheduled for essential database maintenance and enhancements on Saturday, March 21st, 2026. These updates necessitate a period of downtime, which is projected to last up to three (3) hours. The scheduled downtime will occur according to the following regional times: AU: Sun, Mar 22 (2:00 am – 4:00 am) AEDT [UTC: Sat, 3:00 pm – 5:00 pm] AP: Sun, Mar 22 (1:00 am – 3:30 am) SGT [UTC: Sat, 5:00 pm – 7:30 pm] JP: Sun, Mar 22 (4:30 am – 6:00 am) JST [UTC: Sat, 7:30 pm – 9:00 pm] EU: Sat, Mar 21 (Sat, 10:00 pm – 1:00 am) CET [UTC: 9:00 pm – 12:00 am] CA: Sat, Mar 21 (10:30 pm – 12:30 am) EDT [UTC: Sun, 2:30 am – 4:30 am] NA: Sun, Mar 22 (12:30 am – 3:30 am) EDT [UTC: Sun, 4:30 am – 7:30 am] During this maintenance window, access to videos on your Panopto site will be unavailable. Furthermore, any attempts to upload new content from recording clients will result in a "Server unable to connect" error message. March 21, 2026 3:00PM UTC Active - Scheduled maintenance is starting. March 22, 2026 7:30AM UTC Completed - Scheduled maintenance is complete.

1. 2 marca 2026 02:42 UTCresolved

   March 2, 2026 2:16AM UTC Investigating - We are experiencing intermittent error rates with Panopto search in our North American cloud. Our cloud operations team is urgently investigating the issue and we'll update here as soon as we know more. We apologize for the disruption. Our next update will be within 30 minutes. March 2, 2026 2:42AM UTC Resolved - The search issue on the Panopto NA Cloud has been resolved and metrics have returned to normal. We are resolving this incident and Panopto engineers are completing a full root cause analysis, which we will post here, within the next week. We truly appreciate your partnership and patience.

1. 28 lutego 2026 01:04 UTCresolved

   February 23, 2026 5:50PM UTC Investigating - Incident Details: We are investigating a site outage on the Panopto CA Cloud. We’re sorry for this interruption, our cloud operations team is urgently investigating the issue and we’ll update here as soon as we know more. Our next update will be within 15 minutes. What does this mean? During a site outage, end users are unable to access the service meaning they are unable to access your site, nor view, edit or upload new recordings. February 23, 2026 6:05PM UTC Investigating - The Panopto CA Cloud is continuing to experience a major site availability outage. Our engineering team is actively investigating this issue with urgent priority. Apologies again for this disruption, please bear with us while we work to restore service as our number one priority. Our next update will be within 15 minutes. February 23, 2026 6:19PM UTC Identified - The Panopto CA Cloud is continuing to experience a site availability outage. Our cloud operations team has identified the source of the outage and is working on a mitigation for this issue for immediate deployment. Sites are currently accessible, but access may be interrupted again. Apologies again for this disruption, please bear with us while we work to restore service as our number one priority. Our next update will be within 15 minutes. February 23, 2026 6:33PM UTC Identified - The Panopto CA Cloud is now available for all users. The source of the outage has been mitigated. Our cloud operations team is monitoring performance metrics to ensure the issue remains resolved. Our next update will be within 60 minutes. February 23, 2026 7:32PM UTC Resolved - The Panopto CA Cloud has been stable and metrics have remained normal since our last update. We are resolving this incident, and Panopto engineers are completing a full root cause analysis, which we will post here within the next week. February 28, 2026 1:04AM UTC Resolved - On 2026-02-23, from 17:50 UTC to 18:33 UTC, customers on the Panopto CA Cloud experienced a service interruption. During this period, customers may have experienced temporary difficulties accessing the system, including viewing and recording videos. We sincerely apologize for any inconvenience this caused. RCA: The disruption was caused by high CPU utilization in our data layer, which led to resource contention and site unresponsiveness. Once the source was identified, a database failover was executed, and the service immediately returned to normal. To prevent a recurrence of this issue, our engineering teams are implementing database query optimizations and deploying enhanced concurrency controls to better handle high concurrent workloads.

1. 22 lutego 2026 01:58 UTCresolved

   February 16, 2026 4:17AM UTC Investigating - Incident Details: We are investigating a site outage on the Panopto NA Cloud that occurred between 2026-02-15 02:51 UTC and 2026-02-15 02:56 UTC. We’re sorry for this interruption. The source of the outage has been mitigated, and the site is now fully operational. Our cloud operations team is monitoring performance metrics to ensure the issue remains resolved. Our next update will be within 1 hour. February 16, 2026 5:27AM UTC Resolved - The Panopto NA Cloud has been stable and metrics have remained normal since our last update. We are resolving this incident and Panopto engineers are completing a full root cause analysis, which we will post here, within the next week. February 22, 2026 1:58AM UTC Resolved - On 2026-02-16, between 2:50 UTC and 2:56 UTC, the Panopto North American (NA) Cloud experienced a brief service interruption. During this period, customers may have experienced temporary difficulties accessing the service, including uploading or viewing content. We sincerely apologize for any inconvenience this caused. RCA: The disruption was caused by a large volume of concurrent updates to the database that led to a resource lock preventing further requests from being processed. Once the contention was resolved, the service returned to normal without intervention. To prevent a recurrence of this issue, our engineering teams are implementing database query optimizations and deploying enhanced concurrency controls to better handle high concurrent workloads.

1. 19 lutego 2026 16:41 UTCresolved

   February 13, 2026 3:09PM UTC Investigating - The Panopto NA Cloud is experiencing an increased error rate in recording. Our cloud operations team is urgently investigating the issue and we’ll update here as soon as we know more. Our next update will be within 30 minutes. What does this mean? Recorders showing 'Finalizing recording failed' message February 13, 2026 3:36PM UTC Monitoring - The source of the increased error rates has been mitigated. Our cloud operations team is monitoring cloud metrics to ensure the issue is resolved. We’re sorry for this interruption. Our next update will be within 60 minutes. February 13, 2026 4:35PM UTC Resolved - The Panopto NA Cloud has been stable and metrics have remained normal since our last update. We are resolving this incident and Panopto engineers are completing a root cause analysis, which we will post here, within the next week. February 19, 2026 4:41PM UTC Resolved - On 2026-02-13 from 15:00:00 UTC to 2026-02-13 15:20:00 UTC, a subset of customers on the Panopto NA Cloud experienced a service interruption. During this period, customers may have experienced temporary difficulties accessing the system, including viewing and recording videos. We sincerely apologize for any inconvenience this caused. RCA: The disruption was caused by high CPU utilization in our data layer which led to resource contention. To prevent a recurrence of this issue, our engineering teams are implementing database query optimizations and deploying enhanced concurrency controls to better handle high concurrent workloads.