Pricing
Status historyRSS updatesStatus API

Powered by Uptimus

    Magemojo 장애 기록

    49 Magemojo incidents · 2020년 7월 — official updates, affected components, duration and resolution details.

    현재 상태로 돌아가기

    Service Alert – Email Service Inoperable for Stratus Customers (Updated July 8)

    시작 2025년 7월 9일 오후 2:00 UTC · 6h 6m

    Outage중대한 인시던트
    영향을 받은 구성 요소
    Webscale STRATUS - SydneyWebscale STRATUS - FrankfurtWebscale STRATUS - Northern Virginia
    1. 2025년 7월 9일 오후 2:00 UTCidentified

      Dear Customer, Since approximately 6:43 AM MT on Monday, July 7, email service has been inoperable for a subset of customers on our Stratus platform. Our engineering team has traced the root cause to an underlying AWS infrastructure issue and is collaborating closely with AWS engineers to implement a fix. Current impact Email sending and receiving is currently inoperable for Stratus customers. All other customer groups, remain unaffected. All other Webscale services continue to operate normally. Resolution timeline We anticipate full restoration of email service by 12:00 PM MT tomorrow (Wednesday, July 9). We will send an additional update no later than that time—or sooner if service is restored earlier. We apologize for the disruption and appreciate your patience. If you have urgent concerns before service is restored, please contact us at [email protected]. Thank you for your understanding,

    2. 2025년 7월 9일 오후 8:06 UTCresolved

      Dear Customer, We’re pleased to report that AWS has resolved the underlying infrastructure issue, and email service for all Stratus customers was fully restored at approximately 2:02 PM MT today. What this means for you Email sending and receiving are now operating normally. No action is required on your end, though we recommend sending a quick test message to confirm everything looks good. Next steps Ongoing monitoring: Our team will closely monitor performance over the next 24 hours to ensure stability. Root Cause Analysis (RCA): We are preparing a detailed RCA that outlines exactly what happened and why. Future mitigation: The RCA will include concrete steps we’re taking—such as platform redundancy and enhanced alerting—to prevent similar incidents. Follow-up report: We will share the RCA and mitigation plan with all affected customers once it is finalized. If you notice any lingering issues, please contact us at [email protected], and we’ll address them immediately. Thank you for your patience while we worked with AWS to bring service back online. ================================================================================================== Dear Customer, This notice provides an update to the advisory sent last night. Current status: Email sending and receiving remain inoperable for Stratus customers only. All other customer groups are unaffected, and all other Webscale services are operating normally. Root cause: An AWS infrastructure fault first detected at 6:43 AM MT on Monday, July 7. Our response: While AWS works on remediation, we are moving Stratus email traffic from AWS to SendGridto accelerate recovery and add redundancy. Updated resolution estimate We now expect full restoration of email service by 5:00 PM MT today (Tuesday, July 8). We will send a confirmation once service is verified—or sooner if conditions change. Thank you for your continued patience. For urgent questions before service is restored, please email [email protected].

    Emergency Maintenance on 1 dev/staging node in USEast (b4faf81)

    시작 2024년 4월 28일 오전 10:27 UTC · 8h 2m

    Outage중대한 인시던트
    영향을 받은 구성 요소
    Webscale STRATUS - Northern Virginia
    1. 2024년 4월 28일 오전 10:27 UTCinvestigating

      We are currently investigating this issue.

    2. 2024년 4월 28일 오전 10:45 UTCidentified

      The issue has been identified and a fix is being implemented.

    3. 2024년 4월 28일 오후 3:34 UTCmonitoring

      A fix has been implemented and we are monitoring the results.

    4. 2024년 4월 28일 오후 6:30 UTCresolved

      This incident has been resolved.

    Emergency Maintenance on 1 dev/staging node in USEast (6154b7)

    시작 2024년 2월 26일 오후 7:12 UTC · 17h 43m

    Pending
    영향을 받은 구성 요소
    Webscale STRATUS - Northern Virginia
    1. 2024년 2월 26일 오후 7:12 UTCidentified

      The issue has been identified and a fix is being implemented.

    2. 2024년 2월 27일 오후 12:55 UTCresolved

      This incident has been resolved.

    Emergency Maintenance on 1 node in USEast (eb34d3)

    시작 2023년 11월 13일 오후 2:49 UTC · 3h 22m

    Pending
    영향을 받은 구성 요소
    Webscale STRATUS - Northern Virginia
    1. 2023년 11월 13일 오후 2:49 UTCidentified

      The issue has been identified and a fix is being implemented.

    2. 2023년 11월 13일 오후 6:12 UTCresolved

      This incident has been resolved.

    Emergency Maintenance on 1 node in USEast (eb34d3)

    시작 2023년 10월 30일 오후 5:08 UTC · 3h 30m

    Pending
    영향을 받은 구성 요소
    Webscale STRATUS - Northern Virginia
    1. 2023년 10월 30일 오후 5:08 UTCinvestigating

      We are currently investigating this issue.

    2. 2023년 10월 30일 오후 5:55 UTCidentified

      The issue has been identified and a fix is being implemented.

    3. 2023년 10월 30일 오후 8:38 UTCresolved

      This incident has been resolved.

    Emergency Maintenance on 1 node in USEast (9c912b)

    시작 2023년 9월 26일 오후 5:01 UTC · 3h 5m

    Pending
    영향을 받은 구성 요소
    Webscale STRATUS - Northern Virginia
    1. 2023년 9월 26일 오후 5:01 UTCidentified

      The issue has been identified and a fix is being implemented.

    2. 2023년 9월 26일 오후 8:06 UTCresolved

      This incident has been resolved.

    Emergency Maintenance on 1 node in USEast (d79319)

    시작 2023년 7월 13일 오후 6:42 UTC · 17h 31m

    Outage중대한 인시던트
    영향을 받은 구성 요소
    Webscale STRATUS - Northern Virginia
    1. 2023년 7월 13일 오후 6:42 UTCinvestigating

      We are currently investigating this issue.

    2. 2023년 7월 13일 오후 9:58 UTCidentified

      The issue has been identified and a fix is being implemented.

    3. 2023년 7월 14일 오전 3:28 UTCmonitoring

      A fix has been implemented and we are monitoring the results.

    4. 2023년 7월 14일 오후 12:13 UTCresolved

      This incident has been resolved.

    Emergency Maintenance on 1 node in USEast (2a0fef)

    시작 2023년 7월 11일 오후 12:02 UTC · 7h 6m

    Outage중대한 인시던트
    영향을 받은 구성 요소
    Webscale STRATUS - Northern Virginia
    1. 2023년 7월 11일 오후 1:33 UTCidentified

      The issue has been identified and a fix is being implemented.

    2. 2023년 7월 11일 오후 2:55 UTCmonitoring

      A fix has been implemented and we are monitoring the results.

    3. 2023년 7월 11일 오후 7:08 UTCresolved

      This incident has been resolved.

    Emergency Maintenance on 1 node in USEast (fd4119)

    시작 2023년 5월 22일 오후 3:44 UTC · 18h 3m

    Outage중대한 인시던트
    영향을 받은 구성 요소
    Webscale STRATUS - Northern Virginia
    1. 2023년 5월 22일 오후 3:44 UTCinvestigating

      We are currently investigating this issue.

    2. 2023년 5월 22일 오후 7:49 UTCidentified

      The issue has been identified and a fix is being implemented.

    3. 2023년 5월 23일 오전 7:37 UTCmonitoring

      A fix has been implemented and we are monitoring the results.

    4. 2023년 5월 23일 오전 9:46 UTCresolved

      This incident has been resolved.

    Emergency Maintenance on 1 node in USEast (d1cfc97b) dev/staging type

    시작 2023년 1월 4일 오후 1:34 UTC · 34m

    Outage중대한 인시던트
    영향을 받은 구성 요소
    Webscale STRATUS - Northern Virginia
    1. 2023년 1월 4일 오후 1:34 UTCinvestigating

      We are currently investigating this issue.

    2. 2023년 1월 4일 오후 1:52 UTCmonitoring

      A fix has been implemented and we are monitoring the results.

    3. 2023년 1월 4일 오후 2:08 UTCresolved

      This incident has been resolved.

    4. 2023년 1월 4일 오후 2:09 UTCpostmortem

      Our upstream provider AWS Services notified us that between Wed, 4 Jan 2023 13:17:18 GMT and Wed, 4 Jan 2023 14:03:20 GMT, a small number of EC2 instances were unavailable in the us-east-1 region. The issue has been resolved and the service is operating normally.

    Emergency Maintenance on 1 node in USEast (d1cfc97b) dev/staging type

    시작 2022년 12월 5일 오후 8:19 UTC · 33m

    Outage중대한 인시던트
    영향을 받은 구성 요소
    Webscale STRATUS - Northern Virginia
    1. 2022년 12월 5일 오후 8:19 UTCinvestigating

      We are currently investigating this issue.

    2. 2022년 12월 5일 오후 8:52 UTCresolved

      This incident has been resolved.

    3. 2022년 12월 5일 오후 8:57 UTCpostmortem

      Our upstream provider AWS informed us that between Mon, 5 Dec 2022 20:22:19 GMT and Mon, 5 Dec 2022 20:55:54 GMT, a small number of EC2 instances were unavailable in the us-east-1 region. The issue has been resolved, and the service is operating normally.

    Frankfurt Node under Emergency maintenance

    시작 2022년 11월 24일 오전 2:40 UTC · 2h 2m

    Issues경미한 인시던트
    영향을 받은 구성 요소
    Webscale STRATUS - Frankfurt
    1. 2022년 11월 24일 오전 2:40 UTCidentified

      Frankfurt Node under Emergency maintenance due to degradation of the underlying hardware

    2. 2022년 11월 24일 오전 4:42 UTCresolved

      This incident has been resolved

    Emergency Maintenance on 1 node in USEast (dc298c5)

    시작 2022년 11월 17일 오후 7:44 UTC · 47m

    Outage중대한 인시던트
    영향을 받은 구성 요소
    Webscale STRATUS - Northern Virginia
    1. 2022년 11월 17일 오후 7:44 UTCinvestigating

      We are currently investigating this issue.

    2. 2022년 11월 17일 오후 8:28 UTCmonitoring

      A fix has been implemented and we are monitoring the results.

    3. 2022년 11월 17일 오후 8:31 UTCresolved

      This incident has been resolved.

    Emergency Maintenance on 1 node in USEast (53d61e5)

    시작 2022년 8월 27일 오후 6:48 UTC · 1h 18m

    Outage중대한 인시던트
    영향을 받은 구성 요소
    Webscale STRATUS - Northern Virginia
    1. 2022년 8월 27일 오후 6:48 UTCinvestigating

      We are currently investigating this issue.

    2. 2022년 8월 27일 오후 7:19 UTCidentified

      The issue has been identified and a fix is being implemented.

    3. 2022년 8월 27일 오후 8:05 UTCresolved

      This incident has been resolved.

    4. 2022년 8월 29일 오후 4:57 UTCpostmortem

      The Root cause of this incident for a small subset of stores was due to a bad/degraded AWS EC2 instance. Due to this degradation we have activated HA failover mechanism and balanced stores on new hardware nodes from our fleet. For real time HA recovery additional High Availability Strategies are available: [https://magemojo.com/kb/best-practices/high-availability-strategies/](https://magemojo.com/kb/best-practices/high-availability-strategies/) Please feel free to contact support if you have any questions.

    Emergency Maintenance on 1 node in USEast (4b69ad1)

    시작 2022년 8월 13일 오전 11:41 UTC · 2h 52m

    Outage중대한 인시던트
    영향을 받은 구성 요소
    Webscale STRATUS - Northern Virginia
    1. 2022년 8월 13일 오전 11:41 UTCinvestigating

      We are currently investigating this issue.

    2. 2022년 8월 13일 오후 12:56 UTCidentified

      The issue has been identified and a fix is being implemented.

    3. 2022년 8월 13일 오후 1:44 UTCmonitoring

      A fix has been implemented and we are monitoring the results.

    4. 2022년 8월 13일 오후 2:34 UTCresolved

      This incident has been resolved.

    5. 2022년 8월 15일 오전 11:55 UTCpostmortem

      The Root cause of this incident for a small subset of stores was due to a bad/degraded AWS EC2 instance. Due to this degradation we have activated HA failover mechanism and balanced stores on new hardware nodes from our fleet. Please feel free to contact support if you have any questions.

    Emergency Maintenance on 1 node in USEast (03594a)

    시작 2022년 8월 7일 오후 12:03 UTC · 3h 57m

    Outage중대한 인시던트
    영향을 받은 구성 요소
    Webscale STRATUS - Northern Virginia
    1. 2022년 8월 7일 오후 12:03 UTCidentified

      AWS has informed us about the detected degradation of the underlying hardware hosting your Amazon EC2 instance associated with this instance. Our Engineers are working on recovery and failover to new hardware.

    2. 2022년 8월 7일 오후 1:44 UTCidentified

      We are continuing to work on a fix for this issue.

    3. 2022년 8월 7일 오후 2:42 UTCmonitoring

      A fix has been implemented and we are monitoring the results.

    4. 2022년 8월 7일 오후 3:39 UTCmonitoring

      We are continuing to monitor for any further issues.

    5. 2022년 8월 7일 오후 4:00 UTCresolved

      This incident has been resolved.

    6. 2022년 8월 9일 오후 8:09 UTCpostmortem

      The Root cause of this incident for a small subset of stores was due to a bad/degraded AWS EC2 instance. Due to this degradation we have activated HA failover mechanism and balanced stores on new hardware nodes from our fleet. Please feel free to contact support if you have any questions.

    Stratus Panel down due to a 3rd party issue

    시작 2022년 6월 8일 오후 6:46 UTC · 40m

    Pending
    영향을 받은 구성 요소
    Webscale STRATUS - SydneyWebscale STRATUS - FrankfurtWebscale STRATUS - Northern Virginia
    1. 2022년 6월 8일 오후 6:46 UTCidentified

      Webscale Stratus panel is currently affected by an issue related to a 3rd party outage. Site up-time is not affected by this issue.

    2. 2022년 6월 8일 오후 7:25 UTCresolved

      This incident has been resolved.

    Partial Outage in Sydney Region (94aef90)

    시작 2022년 5월 4일 오후 1:14 UTC · 1h 13m

    Outage중대한 인시던트
    영향을 받은 구성 요소
    Webscale STRATUS - Sydney
    1. 2022년 5월 4일 오후 1:14 UTCinvestigating

      We are currently investigating this issue.

    2. 2022년 5월 4일 오후 1:45 UTCidentified

      The issue has been identified and a fix is being implemented.

    3. 2022년 5월 4일 오후 2:01 UTCmonitoring

      A fix has been implemented and we are monitoring the results.

    4. 2022년 5월 4일 오후 2:28 UTCresolved

      This incident has been resolved.

    5. 2022년 5월 4일 오후 2:28 UTCpostmortem

      We have been notified that one of the hardware nodes has detected degradation of the underlying hardware. To resolve issue we have applied our built-in High Availability failover mechanism \([https://magemojo.com/kb/best-practices/high-availability-strategies/#what-is-high-availability](https://magemojo.com/kb/best-practices/high-availability-strategies/#what-is-high-availability)\).

    Emergency Maintenance on 1 node in USEast (4119)

    시작 2022년 2월 26일 오전 9:20 UTC · 1h 14m

    Outage중대한 인시던트
    영향을 받은 구성 요소
    Webscale STRATUS - Northern Virginia
    1. 2022년 2월 26일 오전 9:20 UTCinvestigating

      We are currently investigating this issue.

    2. 2022년 2월 26일 오전 9:44 UTCmonitoring

      A fix has been implemented and we are monitoring the results.

    3. 2022년 2월 26일 오전 10:34 UTCresolved

      This incident has been resolved.

    Emergency Maintenance on 1 node in USEast

    시작 2021년 12월 31일 오전 2:50 UTC · 3h 49m

    Outage중대한 인시던트
    영향을 받은 구성 요소
    Webscale STRATUS - Northern Virginia
    1. 2021년 12월 31일 오전 2:50 UTCidentified

      Emergency Maintenance is being performed on one node in USEast.

    2. 2021년 12월 31일 오전 6:39 UTCresolved

      This incident has been resolved.

    3. 2022년 1월 5일 오후 5:58 UTCpostmortem

      The Root cause of this intermittent response for a small subset of stores was due to a bad/degraded AWS EC2 instance. Due to this degradation instance was rebooted in hope of recovery and urgent migration to a fresh node was initiated. Please feel free to contact support if you have any questions.