Pricing
Status historyRSS updatesStatus API

Powered by Uptimus

    Magemojo 中断历史

    49 Magemojo incidents · 2020年7月 — official updates, affected components, duration and resolution details.

    返回当前状态

    Service Alert – Email Service Inoperable for Stratus Customers (Updated July 8)

    开始时间 2025年7月9日 UTC 14:00 · 6h 6m

    Outage重大事件
    受影响的组件
    Webscale STRATUS - SydneyWebscale STRATUS - FrankfurtWebscale STRATUS - Northern Virginia
    1. 2025年7月9日 UTC 14:00identified

      Dear Customer, Since approximately 6:43 AM MT on Monday, July 7, email service has been inoperable for a subset of customers on our Stratus platform. Our engineering team has traced the root cause to an underlying AWS infrastructure issue and is collaborating closely with AWS engineers to implement a fix. Current impact Email sending and receiving is currently inoperable for Stratus customers. All other customer groups, remain unaffected. All other Webscale services continue to operate normally. Resolution timeline We anticipate full restoration of email service by 12:00 PM MT tomorrow (Wednesday, July 9). We will send an additional update no later than that time—or sooner if service is restored earlier. We apologize for the disruption and appreciate your patience. If you have urgent concerns before service is restored, please contact us at [email protected]. Thank you for your understanding,

    2. 2025年7月9日 UTC 20:06resolved

      Dear Customer, We’re pleased to report that AWS has resolved the underlying infrastructure issue, and email service for all Stratus customers was fully restored at approximately 2:02 PM MT today. What this means for you Email sending and receiving are now operating normally. No action is required on your end, though we recommend sending a quick test message to confirm everything looks good. Next steps Ongoing monitoring: Our team will closely monitor performance over the next 24 hours to ensure stability. Root Cause Analysis (RCA): We are preparing a detailed RCA that outlines exactly what happened and why. Future mitigation: The RCA will include concrete steps we’re taking—such as platform redundancy and enhanced alerting—to prevent similar incidents. Follow-up report: We will share the RCA and mitigation plan with all affected customers once it is finalized. If you notice any lingering issues, please contact us at [email protected], and we’ll address them immediately. Thank you for your patience while we worked with AWS to bring service back online. ================================================================================================== Dear Customer, This notice provides an update to the advisory sent last night. Current status: Email sending and receiving remain inoperable for Stratus customers only. All other customer groups are unaffected, and all other Webscale services are operating normally. Root cause: An AWS infrastructure fault first detected at 6:43 AM MT on Monday, July 7. Our response: While AWS works on remediation, we are moving Stratus email traffic from AWS to SendGridto accelerate recovery and add redundancy. Updated resolution estimate We now expect full restoration of email service by 5:00 PM MT today (Tuesday, July 8). We will send a confirmation once service is verified—or sooner if conditions change. Thank you for your continued patience. For urgent questions before service is restored, please email [email protected].

    Emergency Maintenance on 1 dev/staging node in USEast (b4faf81)

    开始时间 2024年4月28日 UTC 10:27 · 8h 2m

    Outage重大事件
    受影响的组件
    Webscale STRATUS - Northern Virginia
    1. 2024年4月28日 UTC 10:27investigating

      We are currently investigating this issue.

    2. 2024年4月28日 UTC 10:45identified

      The issue has been identified and a fix is being implemented.

    3. 2024年4月28日 UTC 15:34monitoring

      A fix has been implemented and we are monitoring the results.

    4. 2024年4月28日 UTC 18:30resolved

      This incident has been resolved.

    Emergency Maintenance on 1 dev/staging node in USEast (6154b7)

    开始时间 2024年2月26日 UTC 19:12 · 17h 43m

    Pending
    受影响的组件
    Webscale STRATUS - Northern Virginia
    1. 2024年2月26日 UTC 19:12identified

      The issue has been identified and a fix is being implemented.

    2. 2024年2月27日 UTC 12:55resolved

      This incident has been resolved.

    Emergency Maintenance on 1 node in USEast (eb34d3)

    开始时间 2023年11月13日 UTC 14:49 · 3h 22m

    Pending
    受影响的组件
    Webscale STRATUS - Northern Virginia
    1. 2023年11月13日 UTC 14:49identified

      The issue has been identified and a fix is being implemented.

    2. 2023年11月13日 UTC 18:12resolved

      This incident has been resolved.

    Emergency Maintenance on 1 node in USEast (eb34d3)

    开始时间 2023年10月30日 UTC 17:08 · 3h 30m

    Pending
    受影响的组件
    Webscale STRATUS - Northern Virginia
    1. 2023年10月30日 UTC 17:08investigating

      We are currently investigating this issue.

    2. 2023年10月30日 UTC 17:55identified

      The issue has been identified and a fix is being implemented.

    3. 2023年10月30日 UTC 20:38resolved

      This incident has been resolved.

    Emergency Maintenance on 1 node in USEast (9c912b)

    开始时间 2023年9月26日 UTC 17:01 · 3h 5m

    Pending
    受影响的组件
    Webscale STRATUS - Northern Virginia
    1. 2023年9月26日 UTC 17:01identified

      The issue has been identified and a fix is being implemented.

    2. 2023年9月26日 UTC 20:06resolved

      This incident has been resolved.

    Emergency Maintenance on 1 node in USEast (d79319)

    开始时间 2023年7月13日 UTC 18:42 · 17h 31m

    Outage重大事件
    受影响的组件
    Webscale STRATUS - Northern Virginia
    1. 2023年7月13日 UTC 18:42investigating

      We are currently investigating this issue.

    2. 2023年7月13日 UTC 21:58identified

      The issue has been identified and a fix is being implemented.

    3. 2023年7月14日 UTC 03:28monitoring

      A fix has been implemented and we are monitoring the results.

    4. 2023年7月14日 UTC 12:13resolved

      This incident has been resolved.

    Emergency Maintenance on 1 node in USEast (2a0fef)

    开始时间 2023年7月11日 UTC 12:02 · 7h 6m

    Outage重大事件
    受影响的组件
    Webscale STRATUS - Northern Virginia
    1. 2023年7月11日 UTC 13:33identified

      The issue has been identified and a fix is being implemented.

    2. 2023年7月11日 UTC 14:55monitoring

      A fix has been implemented and we are monitoring the results.

    3. 2023年7月11日 UTC 19:08resolved

      This incident has been resolved.

    Emergency Maintenance on 1 node in USEast (fd4119)

    开始时间 2023年5月22日 UTC 15:44 · 18h 3m

    Outage重大事件
    受影响的组件
    Webscale STRATUS - Northern Virginia
    1. 2023年5月22日 UTC 15:44investigating

      We are currently investigating this issue.

    2. 2023年5月22日 UTC 19:49identified

      The issue has been identified and a fix is being implemented.

    3. 2023年5月23日 UTC 07:37monitoring

      A fix has been implemented and we are monitoring the results.

    4. 2023年5月23日 UTC 09:46resolved

      This incident has been resolved.

    Emergency Maintenance on 1 node in USEast (d1cfc97b) dev/staging type

    开始时间 2023年1月4日 UTC 13:34 · 34m

    Outage重大事件
    受影响的组件
    Webscale STRATUS - Northern Virginia
    1. 2023年1月4日 UTC 13:34investigating

      We are currently investigating this issue.

    2. 2023年1月4日 UTC 13:52monitoring

      A fix has been implemented and we are monitoring the results.

    3. 2023年1月4日 UTC 14:08resolved

      This incident has been resolved.

    4. 2023年1月4日 UTC 14:09postmortem

      Our upstream provider AWS Services notified us that between Wed, 4 Jan 2023 13:17:18 GMT and Wed, 4 Jan 2023 14:03:20 GMT, a small number of EC2 instances were unavailable in the us-east-1 region. The issue has been resolved and the service is operating normally.

    Emergency Maintenance on 1 node in USEast (d1cfc97b) dev/staging type

    开始时间 2022年12月5日 UTC 20:19 · 33m

    Outage重大事件
    受影响的组件
    Webscale STRATUS - Northern Virginia
    1. 2022年12月5日 UTC 20:19investigating

      We are currently investigating this issue.

    2. 2022年12月5日 UTC 20:52resolved

      This incident has been resolved.

    3. 2022年12月5日 UTC 20:57postmortem

      Our upstream provider AWS informed us that between Mon, 5 Dec 2022 20:22:19 GMT and Mon, 5 Dec 2022 20:55:54 GMT, a small number of EC2 instances were unavailable in the us-east-1 region. The issue has been resolved, and the service is operating normally.

    Frankfurt Node under Emergency maintenance

    开始时间 2022年11月24日 UTC 02:40 · 2h 2m

    Issues轻微事件
    受影响的组件
    Webscale STRATUS - Frankfurt
    1. 2022年11月24日 UTC 02:40identified

      Frankfurt Node under Emergency maintenance due to degradation of the underlying hardware

    2. 2022年11月24日 UTC 04:42resolved

      This incident has been resolved

    Emergency Maintenance on 1 node in USEast (dc298c5)

    开始时间 2022年11月17日 UTC 19:44 · 47m

    Outage重大事件
    受影响的组件
    Webscale STRATUS - Northern Virginia
    1. 2022年11月17日 UTC 19:44investigating

      We are currently investigating this issue.

    2. 2022年11月17日 UTC 20:28monitoring

      A fix has been implemented and we are monitoring the results.

    3. 2022年11月17日 UTC 20:31resolved

      This incident has been resolved.

    Emergency Maintenance on 1 node in USEast (53d61e5)

    开始时间 2022年8月27日 UTC 18:48 · 1h 18m

    Outage重大事件
    受影响的组件
    Webscale STRATUS - Northern Virginia
    1. 2022年8月27日 UTC 18:48investigating

      We are currently investigating this issue.

    2. 2022年8月27日 UTC 19:19identified

      The issue has been identified and a fix is being implemented.

    3. 2022年8月27日 UTC 20:05resolved

      This incident has been resolved.

    4. 2022年8月29日 UTC 16:57postmortem

      The Root cause of this incident for a small subset of stores was due to a bad/degraded AWS EC2 instance. Due to this degradation we have activated HA failover mechanism and balanced stores on new hardware nodes from our fleet. For real time HA recovery additional High Availability Strategies are available: [https://magemojo.com/kb/best-practices/high-availability-strategies/](https://magemojo.com/kb/best-practices/high-availability-strategies/) Please feel free to contact support if you have any questions.

    Emergency Maintenance on 1 node in USEast (4b69ad1)

    开始时间 2022年8月13日 UTC 11:41 · 2h 52m

    Outage重大事件
    受影响的组件
    Webscale STRATUS - Northern Virginia
    1. 2022年8月13日 UTC 11:41investigating

      We are currently investigating this issue.

    2. 2022年8月13日 UTC 12:56identified

      The issue has been identified and a fix is being implemented.

    3. 2022年8月13日 UTC 13:44monitoring

      A fix has been implemented and we are monitoring the results.

    4. 2022年8月13日 UTC 14:34resolved

      This incident has been resolved.

    5. 2022年8月15日 UTC 11:55postmortem

      The Root cause of this incident for a small subset of stores was due to a bad/degraded AWS EC2 instance. Due to this degradation we have activated HA failover mechanism and balanced stores on new hardware nodes from our fleet. Please feel free to contact support if you have any questions.

    Emergency Maintenance on 1 node in USEast (03594a)

    开始时间 2022年8月7日 UTC 12:03 · 3h 57m

    Outage重大事件
    受影响的组件
    Webscale STRATUS - Northern Virginia
    1. 2022年8月7日 UTC 12:03identified

      AWS has informed us about the detected degradation of the underlying hardware hosting your Amazon EC2 instance associated with this instance. Our Engineers are working on recovery and failover to new hardware.

    2. 2022年8月7日 UTC 13:44identified

      We are continuing to work on a fix for this issue.

    3. 2022年8月7日 UTC 14:42monitoring

      A fix has been implemented and we are monitoring the results.

    4. 2022年8月7日 UTC 15:39monitoring

      We are continuing to monitor for any further issues.

    5. 2022年8月7日 UTC 16:00resolved

      This incident has been resolved.

    6. 2022年8月9日 UTC 20:09postmortem

      The Root cause of this incident for a small subset of stores was due to a bad/degraded AWS EC2 instance. Due to this degradation we have activated HA failover mechanism and balanced stores on new hardware nodes from our fleet. Please feel free to contact support if you have any questions.

    Stratus Panel down due to a 3rd party issue

    开始时间 2022年6月8日 UTC 18:46 · 40m

    Pending
    受影响的组件
    Webscale STRATUS - SydneyWebscale STRATUS - FrankfurtWebscale STRATUS - Northern Virginia
    1. 2022年6月8日 UTC 18:46identified

      Webscale Stratus panel is currently affected by an issue related to a 3rd party outage. Site up-time is not affected by this issue.

    2. 2022年6月8日 UTC 19:25resolved

      This incident has been resolved.

    Partial Outage in Sydney Region (94aef90)

    开始时间 2022年5月4日 UTC 13:14 · 1h 13m

    Outage重大事件
    受影响的组件
    Webscale STRATUS - Sydney
    1. 2022年5月4日 UTC 13:14investigating

      We are currently investigating this issue.

    2. 2022年5月4日 UTC 13:45identified

      The issue has been identified and a fix is being implemented.

    3. 2022年5月4日 UTC 14:01monitoring

      A fix has been implemented and we are monitoring the results.

    4. 2022年5月4日 UTC 14:28resolved

      This incident has been resolved.

    5. 2022年5月4日 UTC 14:28postmortem

      We have been notified that one of the hardware nodes has detected degradation of the underlying hardware. To resolve issue we have applied our built-in High Availability failover mechanism \([https://magemojo.com/kb/best-practices/high-availability-strategies/#what-is-high-availability](https://magemojo.com/kb/best-practices/high-availability-strategies/#what-is-high-availability)\).

    Emergency Maintenance on 1 node in USEast (4119)

    开始时间 2022年2月26日 UTC 09:20 · 1h 14m

    Outage重大事件
    受影响的组件
    Webscale STRATUS - Northern Virginia
    1. 2022年2月26日 UTC 09:20investigating

      We are currently investigating this issue.

    2. 2022年2月26日 UTC 09:44monitoring

      A fix has been implemented and we are monitoring the results.

    3. 2022年2月26日 UTC 10:34resolved

      This incident has been resolved.

    Emergency Maintenance on 1 node in USEast

    开始时间 2021年12月31日 UTC 02:50 · 3h 49m

    Outage重大事件
    受影响的组件
    Webscale STRATUS - Northern Virginia
    1. 2021年12月31日 UTC 02:50identified

      Emergency Maintenance is being performed on one node in USEast.

    2. 2021年12月31日 UTC 06:39resolved

      This incident has been resolved.

    3. 2022年1月5日 UTC 17:58postmortem

      The Root cause of this intermittent response for a small subset of stores was due to a bad/degraded AWS EC2 instance. Due to this degradation instance was rebooted in hope of recovery and urgent migration to a fresh node was initiated. Please feel free to contact support if you have any questions.