Octopus の障害履歴

1. 2026年10月22日 17:17 UTCmonitoring

   Octopus は直接影響を受けませんが、GitHub に依存するパイプラインまたは構成を持つ Octopus インスタンスは、現在の GitHub の停電により、画面上のエラー、失敗したデプロイメント、その他のそれ以降の問題が発生する可能性があります。 GitHubの停電の詳細については、https://www.githubstatus.comをご覧ください。 レポートをさらに監視し、情報があれば更新します.

2. 2026年10月22日 19:02 UTCresolved

   GitHubによると、そのサービスは通常の動作を再開しました。 訪問して、もっと見つかります。 https://www.githubstatus.com

公式のインシデント更新を自動翻訳しています。

1. 2026年10月5日 15:48 UTCinvestigating

   最近の調査

2. 2026年10月5日 15:53 UTCinvestigating

   現在、この問題を調査中です.

3. 2026年10月5日 16:46 UTCinvestigating

   現在、この問題を調査中です。 少数のインスタンスしか影響を受けていないようです.

4. 2026年10月5日 17:06 UTCmonitoring

   この問題は、断続的であり、外部サービスによって引き起こされた可能性があります。 さらなるレポートを監視しています.

5. 2026年10月5日 23:56 UTCresolved

   ユーザーが監査ログページを表示できない問題(https://github.com/OctopusDeploy/Issues/issues/10288)を特定し、解決しました。 これは2026.4.6234から固定されています.

公式のインシデント更新を自動翻訳しています。

1. 2026年7月31日 13:32 UTCinvestigating

   現在、https://g.octopushq.com の証明書で問題点を調べています。 クライアントは、V5 を使用して CLI をダウンロードしようとするサーバーを構築し、サーバーのステップをビルドする問題を見ることができます.

2. 2026年7月31日 14:02 UTCmonitoring

   URL短縮サービスでhttps://g.octopushq.comの証明書の問題を識別し、軽減しました。 すべてのg.octopushq.com URLは、証明書を提示する必要があります。 ほとんどの場合、顧客は6よりも前のステップバージョンを使用するときにOctopus CLIツールをダウンロードできるようになりました。 問題が見つからない場合は、[email protected]までメールでお問い合わせください.

3. 2026年7月31日 15:04 UTCresolved

   この問題は解決しました。 事故を調査した際に、忍耐をありがとうございません。 ご不明な点がございましたら、[email protected]までお問い合わせください.

公式のインシデント更新を自動翻訳しています。

1. 2026年7月23日 16:08 UTCidentified

   ウェスト・アメリカ地域におけるAzureの問題が上流しているため、一部のサービスは、接続が断続的でない場合があります。 当社のシステムへの影響を監視し続けています.

2. 2026年7月23日 16:09 UTCidentified

   著名なサービス: - Octopus.comブログ

3. 2026年7月23日 18:35 UTCmonitoring

   Azureの緩和は、影響を受けるサービスへのアクセスを許可しています。 今後もサービスの利用状況を監視してまいります.

4. 2026年7月23日 20:28 UTCresolved

   Azureはこの問題を解決しました.

公式のインシデント更新を自動翻訳しています。

1. 2026年7月3日 0:25 UTCidentified

   既存の Bicep デプロイメントが失敗すると、Octopus Server 2026.3.4658 以降で問題を特定しました。 弊社では、回避策 https://github.com/OctopusDeploy/Issues/issues/10129 でこれを追跡する公開問題があります。 修正に取り組んでおり、このインシデントと公開の問題が解決したときに更新されます.

2. 2026年8月4日 12:23 UTCresolved

   The fix has been live across all Octopus Cloud servers for several weeks now without further issues.

公式のインシデント更新を自動翻訳しています。

1. 2026年5月29日 6:10 UTCmonitoring

   Our upstream provider, Azure in West US2, is currently experiencing an issue which might be affecting your ability to deploy. We will resolve this incident once we have received confirmation the issue has been resolved from our upstream provider.

2. 2026年5月30日 0:38 UTCresolved

   Our upstream provider, Azure in West US2, has resolved their issue. While the issue was ongoing, some Octopus Cloud instances in West US2 may have experienced brief downtime and network communication issues. For more details, see Azure's incident report (Tracking ID: GHRP-84G) at https://azure.status.microsoft/en-us/status/history/.

1. 2026年5月15日 12:36 UTCidentified

   We have identified the issue and are working on a fix. If you are experiencing this please see the Github issue below for workarounds - https://github.com/OctopusDeploy/Issues/issues/10026

2. 2026年5月18日 10:49 UTCresolved

   We have pushed out a fix for this issue and it should be rolling out to Octopus Cloud customers over the next few days. Please contact [email protected] if you are seeing this issue and we can arrange to get your instance upgraded.

1. 2026年5月5日 13:18 UTCidentified

   We have observed issues provisioning Dynamic Workers in our West US 2 region. We are working on mitigations and monitoring. A small number of customers have experienced lease failures.

2. 2026年5月5日 13:25 UTCidentified

   We are in the process of switching Octopus Cloud instances in the West US 2 region to use dynamic workers in our standby region (Central US). Customers who have experienced leasing failures should retry their deployments or runbook runs.

3. 2026年5月5日 13:43 UTCmonitoring

   We have completed switching Octopus Cloud instances in the West US 2 region to use dynamic workers in our standby region (Central US). This should mitigate this issue for all customers. We will update this incident when dynamic workers in West US 2 are stable and we have reverted all Cloud instances back to using workers in West US 2.

4. 2026年5月7日 0:51 UTCmonitoring

   We are continuing to monitor for any further issues.

5. 2026年5月7日 6:40 UTCresolved

   We have not observed any further issues in the West US 2 region so all Octopus Cloud instances in the West US 2 region are using dynamic workers in West US 2 once again.

1. 2026年4月1日 8:06 UTCinvestigating

   We are aware of an issue affecting Octopus Cloud customers running deployments that interact with AWS, including EKS/Kubernetes targets and AWS health checks. Impacted customers may see authentication errors when running these deployments. Our team is actively investigating and working to resolve the issue. Workaround: If you are affected, adding your AWS region as an environment variable in your script steps may resolve the issue: export AWS_REGION= for Bash $env:AWS_REGION = " " for Powershell E.g export AWS_REGION=ap-southeast-2 $env:AWS_REGION = "ap-southeast-2" We apologise for the disruption and will share further updates as our investigation progresses. If you need help in the meantime, please contact us at [email protected]

2. 2026年4月1日 8:36 UTCinvestigating

   We are aware of an issue affecting Octopus Cloud customers running deployments that interact with AWS, including EKS/Kubernetes targets and AWS health checks. Impacted customers may see authentication errors when running these deployments. Our team is actively investigating and working to resolve the issue. Workaround: If you are affected, adding your AWS region as an environment variable in your script steps may resolve the issue: export AWS_REGION=[REGION] for Bash $env:AWS_REGION = "[REGION]" for Powershell E.g export AWS_REGION=ap-southeast-2 $env:AWS_REGION = "ap-southeast-2" We apologise for the disruption and will share further updates as our investigation progresses. If you need help in the meantime, please contact us at [email protected]

3. 2026年4月8日 4:11 UTCresolved

   This incident has been resolved.

1. 2026年3月30日 12:43 UTCresolved

   We have identified the cause of this issue and have produced a fix in Octopus version 2026.2.3825. Please email [email protected] if you are seeing AWS region endpoint errors in your deployments similar to the one in the title and we can discuss upgrade options.

1. 2026年3月24日 4:13 UTCinvestigating

   We have identified the cause and are working to complete it as quickly as possible. We will provide another update once the issue is resolved.

2. 2026年3月24日 4:13 UTCidentified

   The issue has been identified and a fix is being implemented.

3. 2026年3月24日 5:58 UTCmonitoring

   We have a resolution for the issue, and it should be rolled out to customer instances during their next maintenance windows. If this blocks your deployments in the meantime, please reach out to support.

4. 2026年3月25日 6:09 UTCresolved

   This incident has been resolved. Please don't hesitate to reach out to our support team if you are still having any related problems.

1. 2026年2月26日 1:51 UTCidentified

   Our upstream email provider is currently experiencing issues delivering emails from Octopus. This impacts all emails, including email verification during authentication, Octopus Cloud subscription invitations, and billing notifications. We're currently investigating and will update this page when we know more.

2. 2026年2月26日 5:11 UTCidentified

   We are continuing to work on a fix for this issue.

3. 2026年2月26日 5:32 UTCidentified

   Sign-in/sign-up emails have been restored. Note: emails will now be sent from [email protected]

4. 2026年2月26日 5:47 UTCresolved

   Email services have now been restored. Please contact [email protected] if you encounter any issues with email delivery.

1. 2026年2月2日 21:31 UTCinvestigating

   Octopus Cloud instances are failing to lease Ubuntu Dynamic Workers due to an issue with our upstream provider. We are currently investigating and working on mitigating the issue.

2. 2026年2月2日 22:09 UTCidentified

   Azure have identified the following issue on their side that affects the Dynamic Workers: Virtual Machines and dependent services - Service management issues in multiple regions. They are actively working to mitigate impact and expect it to be resolved by approximately 00:00 UTC. See Azure status page for additional details: https://azure.status.microsoft/en-gb/status

3. 2026年2月2日 23:46 UTCmonitoring

   Azure have rolled out a fix for this issue and we are seeing Dynamic Workers return to normal operation across all regions.

4. 2026年2月2日 23:49 UTCmonitoring

   We are continuing to monitor for any further issues.

5. 2026年2月3日 21:38 UTCresolved

   Azure has resolved the issue that was causing our Dynamic Workers lease failures and we haven't seen any additional failures since yesterday.

6. 2026年2月13日 4:58 UTCpostmortem

   # Summary On 2 Feb 2026, between 20:13:34 to 22:56:04 UTC, Octopus Cloud customers in `West US 2` and `West Europe` may have experienced failed deployments or failed runbook runs due to `Ubuntu Dynamic Worker` steps failing on Leasing timeout.  This disruption was caused by Azure failing to provision Virtual Machines across multiple regions - see Azure Issue `FNJ8-VQZ` on [Azure Status History](https://azure.status.microsoft/en-us/status/history/).  # Background Octopus Cloud [Dynamic Workers](https://octopus.com/docs/octopus-cloud/dynamic-worker) are isolated virtual machines that we provide as part of our Octopus Cloud Subscription offering as a way to execute deployment and runbook steps and scripts, without needing to run on the Octopus Server or deployment targets themselves. Customers can use both Windows and Ubuntu Dynamic Workers.  Octopus provides a [dynamic worker pool](https://octopus.com/docs/infrastructure/workers/dynamic-worker-pools) of these virtual machine types from which, as required by your deployment/runbook steps, your Octopus Cloud will exclusively lease a freshly provisioned dynamic worker VM for a limited time. ## Dynamic Workers Lifecycle 1. **Provisioning** - a new Azure Virtual Machine is provisioned, using the requested [Dynamic Worker image](https://octopus.com/docs/infrastructure/workers/dynamic-worker-pools#dynamic-worker-images) \(Windows/Ubuntu with a set of pre-installed tools\). 2. **Pool** - the newly created Dynamic Worker \(VM\) is placed in a worker pool until an instance requests a Dynamic Worker in one of its deployments/runbooks steps. Each region \(US, Europe and Australia\) has different pools for Windows and Ubuntu workers, with additional standby pools that can be turned on in cases of a temporary outage in an Azure region \(see below\). Octopus Cloud continuously monitors the pools’ levels and provision new workers automatically to keep them full. 3. **Leasing** - When a [deployment/runbook that uses a Dynamic Worker](https://octopus.com/docs/infrastructure/workers#where-steps-run) starts, if the instance doesn’t have a leased worker already \(in which case, it will continue using this worker, extending the worker’s lease for the new run\), the Octopus Server will request a new worker from the appropriate pool. This worker will be exclusively leased to this instance until it is no longer needed \(i.e. wasn’t used for an hour\) or until its maximum lifespan is reached \(3 days by default\).  4. **Deletion** - After a worker is no longer needed or it has reached its maximum lifespan, it is considered expired and will be deleted by the system automatically. The next time that the same instance will require a worker, it will lease a new one from the pool \(see above\). ## System Resilience & Safeguards Octopus Cloud implements multiple layers of protection to ensure Dynamic Workers’ availability and minimize customer impact in cases of service disruptions: * **Pre-provisioned Worker Pools:** We maintain multiple [dynamic worker pools](https://octopus.com/docs/infrastructure/workers/dynamic-worker-pools) \(for the different virtual machine OS and sizes\) with ready-to-use workers to provide immediate availability when deployments/runbooks are triggered, rather than waiting for on-demand provisioning. This also provides a safety buffer in cases where we can’t provision new Dynamic Workers due to temporary outages. * **Standby Services in Multiple Regions:** We maintain standby Dynamic Worker services in alternate Azure regions that we activate to provide continuity when a primary region experiences issues # Key Timing ‌ # Timeline and Impact All dates and times below are in UTC **Feb 2 2026:** **18:52:** 1st failed Dynamic Worker provisioning - At this point, our Dynamic Workers Service continued supplying workers successfully from the pools. However, since we couldn’t provision new workers, the pools started depleting.  **20:13:** 1st Ubuntu Dynamic Worker lease failed in `West US2` Azure region \(once the pool was depleted\) - start of customer impact **20:47:** Octopus on-call was paged after 3 Dynamic Worker lease requests failed in `West US2`. The on-call then started the incident to investigate the issue **20:47-21:20**:  * Octopus engineers started setting up a Dynamic Workers Service on a different Azure region in the US to mitigate the issue.  * During the investigation we saw that Dynamic Workers were also failing to provision in the `West Europe` and `East Australia` Azure regions. At this point we realized that this was a multi-region outage in Azure and decided to open a support ticket with them. * Octopus Engineers turned off non-essential services \(e.g. Instance Upgrades\) to preserve the available Dynamic Workers for customer use. **21:24:** an on-call engineer opened a Sev A support ticket with Azure **21:31:** We published the initial partial outage alert for Octopus Cloud on [https://status.octopus.com/](https://status.octopus.com/)  **21:33:** 1st Dynamic Worker lease failed in `West Europe` **21:42:** Azure acknowledged the multi-region issue and reported that they are investigating it. **22:56:** We saw the last Dynamic Worker lease failure. After this time, we were able to provision the required Virtual Machines and return the Dynamic Workers successfully to all lease requests. **23:46:** After verifying that all Dynamic Worker pools have been restored and we didn’t see any additional provisioning failures, we updated the incident status to “Mitigated”, and updated the Status page. ‌ **Feb 3 2026:** **6:05:** Azure confirmed that the issue was fully resolved on their side. **21:38:** Incident was resolved and Status page updated ‌ # Technical Details Octopus Cloud uses Azure Virtual Machines in order to supply Dynamic Workers to customers. During this Azure outage, we couldn’t provision new Azure Virtual Machines for our Ubuntu Dynamic Workers. Our pre-provisioned Dynamic Workers’ pools continued supplying Dynamic Workers for additional  * 1:21 hours in `West US 2` and  * 2:41 hours in `West Europe`  before they were depleted and customer requests for new Dynamic Workers started failing. It’s worth noting that `East Australia` customers were not impacted because the pools in this region didn’t deplete during the incident. Additionally, customers that already had a Dynamic Worker leased at the time of the outage were not impacted \(unless their Dynamic Worker expired so a new one was requested during the incident\). ‌ We made preparations to switch to our Dynamic Workers Standby Service on different Azure regions. However, once we realized that this was a multi-region outage, we decided to revert the switch since it wouldn’t have resolved the issue. ‌ Once we saw that we couldn’t supply Dynamic Workers from our standby regions, we turned off non-essential services \(e.g. Instance Upgrades\) to preserve the available Dynamic Workers for customer use.  ‌ Once Azure mitigated the issue on their side, our system recovered automatically and resumed providing new Dynamic Workers successfully.  ‌ # Remediation Octopus takes service availability seriously. Despite the difficulty with upstream cloud provider outages, especially ones that are widespread across multiple regions, we fully review and remediate any outages that occur. We do this so that we’re continuously improving and maintaining the best possible service we can. Following our post mortem, we identified the following improvements to our system to help identify and mitigate \(where possible\) similar issues earlier: * **Page an on-call earlier -**  add an alert to page the on-call when multiple Dynamic Workers in the same region fail to provision. This will allow us to detect similar incidents quicker and give us more time to mitigate the issue, before any Dynamic Worker leases fail and customers are impacted. * **Improve our Dynamic Workers Incident Playbook** to identify multi-regions incidents quicker in order to engage Azure support earlier to resolve the root cause of similar incidents.  # Conclusion We apologize to our customers for any disruption and inconvenience as a result of this incident. We have started work on the identified remediations to ensure that we can detect similar incidents more quickly and reduce the impact on our customers as much as possible.

1. 2025年11月25日 12:58 UTCinvestigating

   We are currently investigating issues with cloud customers accessing their instance via OctopusID. For some customers, this issue seems to be auto resolving after around 5 minutes. Whilst we are investigating the root cause, we recommend attempting to sign in whenever convenient incase you are able to access the instance.

2. 2025年11月25日 14:00 UTCmonitoring

   We have performed some changes that based on customer feedback, has mitigated this issue. We are still monitoring to ensure this issue does not reoccur, but customers should be able to sign in via OctopusID again.

3. 2025年11月25日 14:56 UTCmonitoring

   After monitoring the platform following our earlier mitigation, we can confirm that the issue has not resurfaced. OctopusID sign-in is functioning normally, and the incident has been resolved.

4. 2025年11月25日 14:57 UTCresolved

   Resolved.

5. 2025年12月8日 21:27 UTCpostmortem

   # Intermittent sign-in issues for Octopus Cloud instances ## Summary Between November 25, at 10:24 pm AEST, and November 26, at 12:58 am AEST, customers experienced sporadic issues signing into Octopus Cloud instances. These issues stemmed from a database connection leak, which caused some sign-in requests to time out. We apologize for the inconvenience this has caused our customers and are taking steps to prevent it from happening again. ### Timings Time to detection: 9hrs 41mins Time to incident declaration: 9hrs 41mins Time to resolution: 12hrs 15mins ## What happened? \(All dates and times below are in AEST\) ### November 25 **12:43 pm** We deployed a change to our authorization service. This change introduced a bug resulting in database connection leaks. The connection leak only became apparent in high-traffic scenarios, which our current test suite doesn't replicate. As a result, our test suite didn't detect the issue. **10:24 pm** A DevOps Support Engineer declared an incident after receiving reports from customers that they were having difficulty signing into Octopus Cloud instances. **10:24 pm - 11:41 pm** Investigations showed that the issue was due to database connection timeouts. **11:42 pm** Temporary mitigations implemented, including restarting services to release database connections. **11:42 pm - 11:59 pm** Effects of mitigations observed and deemed successful. Incident marked as mitigated. ### November 26 **12:00 am - 12:57 am** Incident responders continue to watch systems. **12:58 am** Mitigation steps considered successful, and the incident marked as resolved. **6:55 am** Root cause of database connection timeouts identified as a connection leak. **6:55 am - 8:33 am** Permanent fix implemented and deployed. ## Remediation and next steps We deployed a new service version to remove the database connection leak. We have also conducted an incident review to identify process improvements to prevent this from occurring in the future. We continue to work towards improving the reliability and security of our authentication and authorization services.

1. 2025年11月18日 21:11 UTCidentified

   GitHub is experiencing issue with git operations, resulting in in-product git operations to be degraded or fail. We're continuing to monitor this upstream outage.

2. 2025年11月18日 22:01 UTCmonitoring

   GitHub reports that git operations have been restored. We will continue to monitor this situation.

3. 2025年11月19日 0:47 UTCresolved

   We have observed no further errors stemming from this issue.

1. 2025年10月29日 16:31 UTCinvestigating

   We are currently investigating the issue.

2. 2025年10月29日 16:39 UTCidentified

   It appears this outage is due to a DNS issue with our upstream provider. We are currently awaiting for mitigation from the upstream provider to restore Octopus.com and related services.

3. 2025年10月29日 19:00 UTCidentified

   Customers may notice intermittent access to Octopus.com and Octopus services. Our upstream provider has made progress to mitigate the issue. We will continue to monitor the situation. We have contingency plans we are prepared to deploy if service recovery progress from the upstream provider mitigation stalls.

4. 2025年10月29日 21:13 UTCidentified

   As we continue to monitor Octopus.com and Octopus services, metrics are showing services becoming more reliably available. Our upstream provider is currently estimating full or near full mitigation approximately 2 hours from now (approximately 23:20 UTC on 29 October 2025). We will provide additional updates as the situation necessitates.

5. 2025年10月29日 23:57 UTCidentified

   As we continue to monitor Octopus.com and Octopus services, metrics are showing services becoming more reliably available. We are still waiting for our upstream provider's resolution and expect to give another update approximately 1 hour from now (approximately 00:55 UTC on 30 October 2025). We will continue to provide additional updates as the situation necessitates.

6. 2025年10月30日 1:13 UTCresolved

   All Octopus services affected by this outage are now operational.

1. 2025年10月20日 7:34 UTCidentified

   Docker Hub experienced issues that prevented access to container images, resulting in deployment failures for projects relying on those images.

2. 2025年10月20日 12:44 UTCmonitoring

   Docker Hub experienced issues that prevented access to container images, resulting in deployment failures for projects relying on those images.

3. 2025年10月20日 12:48 UTCmonitoring

   Most of the Docker Hub services seem to be operational but the incident is still on-going.

4. 2025年10月21日 0:15 UTCmonitoring

   Most of the Docker Hub services seem to be operational and we are continuing to monitor the situation

5. 2025年10月21日 1:11 UTCresolved

   Docker Hub have resolved their incident and we have not observed any further issues

1. 2025年10月12日 23:43 UTCidentified

   We have identified an issue where Kubernetes deployments using the Kubernetes agent may fail due to a failure to pull the octopusdeploy/kubernetes-agent-tools-base docker image.

2. 2025年10月12日 23:45 UTCmonitoring

   We have fixed the issue and pushed the missing tags to DockerHub. Kubernetes agent deployments should be working again.

3. 2025年10月13日 0:24 UTCresolved

   This has been resolved. All missing tags have been published to DockerHub and we are seeing successful deployments using these new tags.

1. 2025年9月25日 1:06 UTCidentified

   Docker Hub is experiencing an active incident: https://www.dockerstatus.com/pages/incident/533c6539221ae15e3f000031/68d47a2f93c09e05486d93a9 Octopus customers may experience issues pulling images from Docker Hub, including: 1. Octopus Server self-host images 2. Deployment process container images including execution containers and reference packages hosted by Docker Workarounds are available, please contact [email protected].

2. 2025年9月25日 1:23 UTCmonitoring

   Docker has implemented a fix and we are monitoring.

3. 2025年9月25日 4:18 UTCresolved

   The Docker Hub incident is resolved and we have not observed any ongoing issues.

4. 2025年10月9日 3:37 UTCpostmortem

   # **Incident Summary** Docker Hub experienced authentication issues that prevented access to container images, resulting in deployment failures for projects relying on those images. ## **What We're Doing** Following this incident, we've identified several improvements to enhance service resilience and customer communication: ### **Visibility & Monitoring** * Communicate third-party service outages more clearly on our status page * Explore in-app messaging to alert customers during service disruptions ### **Resilience & Good Practices** * Review image retrieval reliability and address identified risks * Share good practices with customers to help reduce impacts when Docker Hub is unavailable

1. 2025年9月15日 3:11 UTCinvestigating

   We are investigating reports of intermittent Azure authentication issues during deployments and runbook runs. We are working with Microsoft to resolve this issue.

2. 2025年9月15日 5:57 UTCmonitoring

   The downstream issue with running `az login` commands in Azure steps appears to be working again. We will be continuing to monitor this.

3. 2025年9月15日 6:05 UTCresolved

   The downstream issue with Azure CLI login commands has been resolved by Azure.