Blackboard outage history

Blackboard is currently investigating a service disruption affecting a number of customers. We are investigating increased error rates related to a storage system impacting a group of clients deployed on Blackboard LMS in US East. Additional updates will be posted to status.blackboard.com

We are continuing to investigate the issue and are actively working with Blackboard's infrastructure partners to diagnose and resolve the issue as quickly as we can. We will continue to provide updates at status.blackboard.com

Update: Adjusting scope from "Blackboard - SaaS - Global" to "Blackboard - SaaS (US)"

Blackboard is continuing to work directly with our infrastructure partners to diagnose and resolve the issue. We will continue to post updates to status.blackboard.com

The issue has been identified, and Blackboard is working to restart and restore services. There may continue to be instability while we work to ensure all services are fully recovered. Next update to status.blackboard.com will be in 1 hour

The issue has been identified, and the affected services have been restored. Blackboard is continuing to monitor these underlying services. Updates will continue to be posted on status.blackboard.com until this incident is resolved.

Services have been restored. Blackboard is continuing to monitor these underlying services.

The affected services have been restored and remain stable. Blackboard continues to monitor the underlying services to ensure ongoing stability.

The affected services remain stable. Blackboard continues to monitor the underlying services to ensure ongoing stability. The next update will be provided by close of business.

The affected services remain stable. Blackboard continues to monitor the underlying services to ensure ongoing stability. The next update will be provided by Tomorrow ( Friday) Morning.

We are investigating increased error rates related to a storage system impacting a group of clients deployed on Blackboard LMS in US East

We are continuing to work on a fix for this issue.

A few Blackboard LMS clients are currently experiencing Intermittent issues. The team is investigating the root cause and working to restore normal performance.

Our team is actively working on the fix and continuing to investigate the root cause. We are closely monitoring the situation and working to restore normal performance as soon as possible.

Our team continues to investigate the underlying cause and is actively working toward a permanent resolution. The site has remained stable since 10:00 AM ET. We will continue to closely monitor the service and provide further updates as more information becomes available.

Our team continues to investigate the underlying cause and is actively working toward a permanent resolution. The site has remained stable since 10:00 AM ET, with no impact observed during this period. We will continue to closely monitor the service and provide further updates as more information becomes available.

Our team has identified the issue and is actively working toward a permanent resolution. The site has remained stable since 10:00 AM ET, with no impact observed during this period. We will continue to closely monitor the service and provide further updates as more information becomes available.

Our team has identified the issue and is actively working toward a permanent resolution. The site has remained stable since 10:00 AM ET, with no impact observed during this period. We will continue to closely monitor the service and provide further updates as more information becomes available.

The sites have remained stable since 10:00 AM ET, with no further issues. Closing the incident.

All messaging capabilities are currently down. We will advise as soon as they are operational.

This incident has been resolved.

We are aware of errors displaying in Accreditation & Program Review when attempting to edit standards or generate Offline Reports. The Development Team are working to resolve this issue.

This incident has been resolved.

We are currently investigating an issue affecting the production environment for multiple clients.

We have identified the issue as being related to AWS CloudFront. We are actively working with AWS to restore service as quickly as possible. Our team is closely monitoring the situation and will provide further updates as soon as additional information becomes available.

We have identified the issue impacting a subset of customers. AWS has confirmed the issue and is actively working on mitigation efforts to reduce the impact. Our teams are closely monitoring the situation, coordinating with AWS, and working toward full recovery. We will continue to provide updates as more information becomes available.

AWS continues to work on mitigation efforts, and our teams remain actively engaged and closely coordinating with them. We continue to monitor the environment and provide updates as progress is made.

AWS has implemented a fix for the underlying issue. We are observing signs of recovery, and service appears to be stable at this time. We will continue monitoring the environment and provide updates if necessary.

This incident has been resolved.

A few Blackboard LMS clients are currently experiencing performance issues. The team is investigating the root cause and working to restore normal performance.

We have identified the query causing the performance issue. The team is actively working on a fix

A fix has been implemented and we are monitoring the results.

The issue has been resolved.

This incident has been resolved.

The issue has been identified and a fix is being implemented.

We are continuing to work on a fix for this issue.

A fix has been implemented and we are monitoring the results

All sites are online

This incident has been resolved.

We are investigating a number of issues reported with the 4000.15.0 release to production environments. Multiple teams are working on this and we will provide more information as it becomes available.

As we investigate an issue related to Release Conditions, the release of 4000.15.0 will be paused until this issue can be resolved, so the US East release is now on hold. Once resolved all sites will be updated with the fix.

We have identified the root cause of the issue related to Release Conditions. The team is working on a fix that will be released as soon as possible. In the meantime, we have updated production instances for customers that have opened a support ticket.

The engineering team is actively working on a resolution for the Release condition issue. As a temporary workaround until the fix is available, please remove any assessment access exceptions configured in the Gradebook (for example, custom start/end dates assigned to individual students). Once the exceptions are removed, the assessment will appear correctly in the student view. We appreciate your patience and understanding while we work toward a permanent resolution.

Resolved Update - The engineering team has completed the fix for the Release Conditions issue identified in version 4000.15.0. Deployment of the fix to production environments is currently in progress and will continue across all the sites. Once the deployment is completed, the issue related to assessment visibility and Release Conditions will be fully resolved. The team will continue to closely monitor the environments following the deployment to ensure platform stability and expected behavior. We appreciate your patience and understanding throughout this process.

This incident has been resolved.

We are experiencing a spike in activity beginning at 11:20AM EDT which has caused intermittent delays in the real-time processing of new content added to the LMS for Canvas institutions in the US. Real-time processing delays of approximately 1 to 2 hours for new content items may be seen during this time. Note that all other Ally features (alternative formats, instructor feedback and institutional report) for previously processed content items should still be working as expected.

This incident has been resolved.

Faculty are receiving an "Upload failed" error message when they try to add video or audio feedback on a quiz in the Overall Feedback area for their students. The upload process fails at the final stage. This has been confirmed across multiple users and different media types. Browsers: Verified on latest versions of Chrome; persists after clearing cache, cookies, and restarting systems. Error Message: "Upload Failed" appears on the progress bar in the Video Details pane.

The issue has been resolved.

We are currently experiencing delays in the processing and generation of Alternative Formats for institutions in Europe. The Ally development team is treating this as a high priority while adding resources to process the existing backlog.

A fix has been implemented and we are monitoring the results.

Ally has worked through the remaining backlog and alternative formats are processing at a normal rate again.

We are currently experiencing performance degradation. As a result, some Snowflake queries may run slower than usual, and Illuminate reports may take longer to load or could time out. Our team is actively investigating the issue and working to restore normal performance at the earliest

We have identified the root cause of the issue and deployed a fix to production. The team is closely monitoring performance to ensure stability

The performance issue has been resolved. Snowflake queries and Illuminate reports are now operating normally

Ally's bulk processing queues that handle updates from course syncs and course onboards are currently experiencing high traffic which may result in a delay of 1-2 hours for showing new indicators and/or new course reports. During this high traffic period Ally and its associated components remain available, however there may be delays in processing some of these updates including course copy processes. Real time processing for new content items remains at expected levels, but users may see a slight delay in report updates during this time as these processes catch up.

Ally has processed the majority of the backlog in our bulk processing queues which should decrease the delays for course syncs, copy processes and onboards. The Ally development team will continue to monitor progress and performance.

This incident has been resolved.

We are experiencing another spike in activity which has caused intermittent delays in the processing of content added to the LMS for institutions in the US. Real time processing delays of approximately 1.5 hours for new content items may be seen during this time. Note that all other Ally features (alternative formats, instructor feedback and institutional report) for previously processed content items should still be working as expected.

The Ally development team has scaled up resources based on demand and will continue to monitor progress.

Real time processing queues have returned to normal levels while the team continues to monitor.

This incident has been resolved.

We are experiencing a spike in activity beginning just before noon EST which has caused intermittent delays in the processing of content added to the LMS for institutions in the US. Real time processing delays of approximately 1 to 3 hours for new content items may be seen during this time. Note that all other Ally features (alternative formats, instructor feedback and institutional report) for previously processed content items should still be working as expected.

Real time queues have returned to normal levels.

We are currently experiencing an issue with Single Sign-On that may prevent some users from logging in to Illuminate across all regions. We are actively working to resolve it.

The issue has been resolved and users should now be able to log in to Illuminate without issues.

We are experiencing issues on AI image generation within Blackboard LMS. Instructors receive an error when attempting to generate new images. Previously generated images applied to courses are fine and not effected. We are investigating and working with our service provider towards a solution.

We have identified the root cause of the issue and are analyzing the options available to us to bring image generation back online. Please bear with us as we work through this. We are 'following the sun' on getting a solution deployed as soon as possible.

We have found a fix for AI image generation in Blackboard LMS. This has been through our QA process, the rollout has begun with positive initial signs of service restoration in production instances. We aim to post a final status on this once the rollout process to all instances has completed and post rollout QA is successful.

We can report that the rollout to all production instances and final QA testing is now complete. Image generation is fully restored in all instances of Blackboard LMS. As part of this fix, you may notice an improvement in the generated image quality. If you have any further concerns or still are experience image generation issues, please raise a support ticket through the usual channels.

We are experiencing issue on AWS services in ME-Central region due to power issue in few of the availability zones, We are actively working with our service provider.

Our service provider is still working on the power issue. We are closely monitoring these efforts to ensure service is restored as quickly as possible. We will provide an update if new information becomes available.

Some users may experience difficulties accessing content or performing certain operations due to an increased error rate caused by a power issue. Our service provider is actively working to resolve the problem. We will share further updates as soon as more information becomes available.

Our service provider is still working on the primary root cause. We are closely monitoring these efforts to ensure service is restored as quickly as possible. We recognize the critical nature of these services and sincerely apologize for the disruption. We will provide an update if new information becomes available.

We are currently observing that additional sites are being affected due to the ongoing power outage. We are actively working with our service provider to explore available options. Our service provider is closely working on the recovery efforts. We will continue to monitor the situation and share updates as they become available.

Most of the sites hosted in the Middle East region are currently impacted due to the ongoing power outage. We are actively working with our service provider to assess the situation and explore all available options. Our service provider is closely engaged in recovery efforts to restore services. We will provide an update if new information becomes available.

Many Blackboard sites hosted in the Middle East region are currently impacted due to the ongoing power outage. We are actively working with our service provider (AWS) to assess the situation and explore all available options, including restoring services in another AWS Region. If your site is impacted, please look for further direct communication from our Client Support team. We will provide an update as new information becomes available.

Many Blackboard sites hosted in the Middle East region are currently impacted due to infrastructure damage. We are beginning to see partial recovery of the underlying services required to restore Blackboard sites to full functionality. To ensure quality of services, access to Blackboard sites will be restricted until further recovery efforts are completed. We are actively working with our service provider (AWS) to assess the situation and explore all available options, including restoring services in another AWS Region. Our Client Support team is communicating directly with impacted clients. We will continue to provide updates as new information becomes available.

All Blackboard sites hosted in the Middle East region are currently impacted due to infrastructure damage. The AWS services required to restore Blackboard sites to full functionality are not yet available. To ensure quality of services, access to Blackboard sites will be restricted until further recovery efforts are completed. We are actively working with our service provider (AWS) to assess the situation and explore all available options, including restoring services in another AWS Region. Our Client Support team is communicating directly with impacted clients. We will continue to provide updates as new information becomes available.

We have successfully restored several Blackboard sites previously hosted in the Middle East to an alternate AWS region. Recovery of additional sites is in progress. Our Client Support team is communicating directly with impacted clients. We will continue to provide updates as new information becomes available.

We have successfully restored all production Blackboard sites previously hosted in the Middle East to an alternate AWS region.

We are aware of the email issue that users are encountering while sending emails from Blackboard. Our teams are investigating this on priority to have this addressed as soon as possible.

We have identified the issue and continuing to work on a fix for this issue. We will share an ETA as soon as it becomes available.

A fix has been implemented and we are monitoring the results.

This incident has been resolved.