Pricing
Status historyRSS updatesStatus API

Powered by Uptimus

    Phraseapp outage history

    76 recorded Phraseapp incidents since August 2024, with official updates, affected components, duration and resolution information.

    Back to current status

    Performance Disruption of Phrase TMS (EU) between 11:35 AM and 11:46 AM CEST on October 15, 2026

    Started October 15, 2026 at 9:44 AM UTC · 40m

    OutageCritical incident
    Affected components
    Term baseProject managementCAT web editorAPIMachine translationTranslation memoryAnalyticsConnectorsFile processing
    1. October 15, 2026 at 9:44 AM UTCinvestigating

      We are currently investigating an issue affecting Phrase TMS services in the EU region, including the CAT editor, API, project management, translation memory, and related components. Users may experience errors or be unable to access these services at this time. Our team is actively working to identify the cause and restore full functionality as quickly as possible.

    2. October 15, 2026 at 9:58 AM UTCmonitoring

      Services have stabilized and Phrase TMS in the EU region is now operating normally. We keep monitoring the situation.

    3. October 15, 2026 at 10:24 AM UTCresolved

      This incident has been resolved.

    Degraded Performance of Identity management - IDM (EU and US) between 9:02 AM CEST and 11:27 AM CEST on September 23, 2026

    Started September 23, 2026 at 8:48 AM UTC · 1h 15m

    IssuesMinor incident
    Affected components
    Identity management - IDM (US)Identity management - IDM (EU)
    1. September 23, 2026 at 8:48 AM UTCinvestigating

      Some users might be experiencing issues with accessing Phrase TMS.

    2. September 23, 2026 at 8:58 AM UTCidentified

      The issue has been identified and a fix is being implemented.

    3. September 23, 2026 at 9:28 AM UTCmonitoring

      The fix has been implemented, and we are monitoring the results. Phrase TMS can now be accessed with no further issues.

    4. September 23, 2026 at 10:03 AM UTCresolved

      This incident has been resolved.

    5. September 30, 2026 at 12:12 PM UTCpostmortem

      ## Introduction We would like to share details about an incident that affected access to Phrase TMS on September 23, 2026. Between 9:02 AM and 11:27 AM CEST, users opening Phrase TMS from Phrase Platform could not complete the sign-in. They were either caught in a redirect loop or returned to the Phrase TMS login page with a sign-in error. Users who already had an active Phrase TMS session were not affected, and no customer data was lost or modified. Signing in to Phrase Platform itself kept working throughout the incident, both with a password and with single sign-on. So did signing in with a password directly on the Phrase TMS login page. This post-mortem explains what happened, how it was resolved, and what we are doing to prevent it from happening again. ## Timeline * **Sep 23, 2026 at 9:02 AM CEST** – An update to the Phrase TMS web application went live in production. It included a security improvement to how the sign-in flow handles redirects after login. From this point, users opening Phrase TMS from Phrase Platform could not complete sign-in. Shorty after, the issues was investigated internally. * **Sep 23, 2026 at 10:59 AM CEST** – The update from 9:02 AM CEST was identified as the cause, and we began preparing a rollback. * **Sep 23, 2026 at 11:13 AM CEST** – The rollback was verified in our test environment, and deployment to production started. * **Sep 23, 2026 at 11:27 AM CEST** – The rollback was live in all production regions. Customer-facing impact ended. * **Sep 23, 2026 at 11:28 AM CEST** – We confirmed that signing in to Phrase TMS from Phrase Platform worked again. * **Sep 23, 2026 at 12:04 PM CEST** – The incident was marked as resolved on our status page. ## Root Cause The incident was caused by a security improvement to the Phrase TMS web application. Its goal was to make sure users are only sent to trusted destinations after they sign in. To do this, the web application only accepted redirects to the Phrase TMS web address itself. However, when a user opens Phrase TMS from Phrase Platform, the sign-in process legitimately moves the user between different Phrase web addresses. Our servers already check each of these redirects against a list of trusted Phrase domains and allow them. The new check in the TMS core application was stricter than this server-side check and overrode it. As a result, legitimate redirects were replaced with the Phrase TMS start page, which started the sign-in process again. Users either looped through sign-in repeatedly or landed back on the Phrase TMS login page with an error. Signing in to Phrase Platform itself kept working throughout the incident, both with a password and with single sign-on. So did signing in with a password directly on the Phrase TMS login page. The failure happened at the step where a signed-in user moves from Phrase Platform into Phrase TMS. Because of this, some affected users reported the problem as a password issue: they entered their credentials successfully but were then sent back to a login screen. ## Actions to Prevent Recurrence 1. **Change rolled back** – The update that caused the issue was rolled back in all production regions at 11:27 AM CEST, which restored normal sign-in. 2. **Continuous sign-in monitoring** – We are adding automated checks that run regularly in all production regions and in our test environment. Each check performs the full sign-in from Phrase Platform into Phrase TMS and immediately alerts our on-call engineers if it fails. Before we rely on them, we will confirm that these checks detect the exact failure that occurred in this incident.

    Degraded Performance of Phrase Strings & Phrase TMS (EU) starting on September 10, 2026 06:52 CEST

    Started September 10, 2026 at 5:06 AM UTC · 57m

    OutageMajor incident
    Affected components
    ConnectorsTranslation center
    1. September 10, 2026 at 5:06 AM UTCinvestigating

      We are currently investigating an issue affecting the synchronization of jobs between Phrase Strings and Phrase TMS via webhooks in our EU region. Customers may experience failures or delays when syncing translation jobs between the two products. Our team is actively working to identify the root cause and restore full functionality as quickly as possible.

    2. September 10, 2026 at 5:34 AM UTCmonitoring

      A fix has been implemented and deployed to address the webhook synchronization failures between Phrase Strings and Phrase TMS. We are currently monitoring the situation to confirm full stability. We will provide a further update once we have validated the resolution.

    3. September 10, 2026 at 6:03 AM UTCresolved

      We are pleased to confirm that the webhook synchronization issue between Phrase Strings and Phrase TMS has been resolved and verified as fully operational, including for US data center customers. This incident is now closed.

    Degraded Performance of Project management in Phrase TMS (EU) starting on September 1, 2026 16:12 CEST

    Started September 1, 2026 at 2:18 PM UTC · 2h 5m

    OutageMajor incident
    Affected components
    Project management
    1. September 1, 2026 at 2:18 PM UTCinvestigating

      We are currently investigating an issue causing slowness in the Jobs view within Phrase TMS (EU). Users may experience delayed load times or reduced performance when accessing project management features. Our team is actively working to identify the root cause and restore normal performance as quickly as possible.

    2. September 1, 2026 at 3:00 PM UTCinvestigating

      We have identified the root cause of the issue. Our team is actively implementing a fix. We will provide further updates as we make progress.

    3. September 1, 2026 at 3:34 PM UTCmonitoring

      A fix has been deployed and we are monitoring the results. Customers might need to clear browser cache and close all opened tabs with TMS if still experiencing problems.

    4. September 1, 2026 at 4:23 PM UTCresolved

      The issue has been resolved and performance is stable.

    Disruption of Gengo Translation Orders - API Timeouts Affecting Order Submission (Strings EU and US DC)

    Started August 31, 2026 at 3:06 PM UTC · 1d 20h

    OutageMajor incident
    Affected components
    OrderingOrdering
    1. August 31, 2026 at 3:06 PM UTCinvestigating

      We are currently experiencing intermittent errors when communicating with Gengo, one of our third-party translation vendors. This is causing timeouts and 502 errors on price calculation and order submission for translation orders routed through Gengo, affecting both EU and US data centers. Gengo has confirmed the issue on their end and is investigating.

    2. September 2, 2026 at 11:46 AM UTCresolved

      Gengo has resolved the underlying issue on their end. Price calculations and translation order submissions to Gengo are now working again.

    Degraded performance of TMS Project Management Component (EU and US DC) between August 31 2:26 PM CEST and August 31 5:57 PM CEST

    Started August 31, 2026 at 1:11 PM UTC · 3h 42m

    OutageCritical incident
    Affected components
    Project managementProject management
    1. August 31, 2026 at 1:11 PM UTCinvestigating

      Users are currently unable to open existing jobs and to create new ones within their Phrase TMS projects. We are investigating the issue.

    2. August 31, 2026 at 1:22 PM UTCinvestigating

      We are continuing to investigate this issue.

    3. August 31, 2026 at 1:46 PM UTCidentified

      The issue has been identified and a fix is being implemented.

    4. August 31, 2026 at 4:02 PM UTCmonitoring

      A fix has been implemented and we are monitoring the results.

    5. August 31, 2026 at 4:53 PM UTCresolved

      The issue has been resolved.

    6. September 4, 2026 at 8:45 AM UTCpostmortem

      ## Introduction We would like to share details about an incident that affected Phrase TMS on August 31, 2026. Between 2:26 and 5:57 PM CEST, some users of the legacy Project page were unable to use Tools-menu actions such as creating or editing jobs and running analyses, and clicking to open a job did not launch the CAT web editor as expected, instead returning users to the project page. This post-mortem explains what happened, how it was resolved, and what we are doing to prevent it from happening again. ## Timeline * **August 31, 2026 at 2:26 PM CEST** – A code change reached production containing a defect that broke script execution on the Project page for any user who loaded it. * **August 31, 2026 at 2:49 PM CEST** – The first customer reports came in describing Tools-menu buttons as disabled and jobs failing to open in the editor. * **August 31, 2026 at approximately 3:10 PM CEST** – Our team identified the root cause of the issue. * **August 31, 2026 at 3:48 PM CEST** – A fix for the underlying defect was completed. * **August 31, 2026 at 4:04 PM CEST** – The fix was verified in a pre-production environment. * **August 31, 2026 at 5:18 PM CEST** – Deployment of the fix to production began. * **August 31, 2026 at 5:57 PM CEST** – The fix was fully live in production and normal functionality was restored for all affected customers. ## Root Cause The incident was caused by a code change intended to fix an unrelated, minor display issue on shared project pages. That change altered how a value was inserted into a script embedded directly in the page. The system that renders the page automatically encodes values for safety, but that encoding does not distinguish between a value being placed in regular page content versus inside a script. As a result, the embedded script's syntax was silently broken once the change reached production. Because browsers stop executing any further code on a page once they encounter invalid script syntax, every script placed after that point on the page stopped running — not just the part related to the original change. This is why customers experienced what looked like two separate problems \(disabled menu buttons and jobs failing to open in the editor\) that were, in fact, downstream effects of the same single defect. The issue was not caught before release because the verification performed at the time confirmed that the underlying data being inserted was correct, but did not load the actual page in a browser to confirm it rendered and executed correctly end-to-end. ## Actions to Prevent Recurrence 1. **Fix deployed** – The underlying defect was corrected and deployed to production the same day it was identified. 2. **Engineering guidance updated** – We have updated our internal engineering documentation to clearly describe this specific failure pattern and the correct, safe way to handle it, so this category of mistake is caught during code review going forward. 3. **Automated detection improvements underway** – We are working on adding automated monitoring for this class of front-end failure, so similar issues can be detected and addressed before customers are affected, rather than relying on customer reports.

    Degraded Performance of Translation Memory Component in Phrase TMS (EU) between August 19, 2016 2:11 PM CEST and August 19, 2016 4:10 PM CEST

    Started August 19, 2026 at 12:16 PM UTC · 1h 53m

    OutageMajor incident
    Affected components
    Translation memory
    1. August 19, 2026 at 12:16 PM UTCinvestigating

      We are currently investigating an issue affecting Translation Memory functionality in Phrase TMS (EU). Users may experience problems with creating Translation Memories and other related operations during this time. Our team is actively working to identify the cause and restore full functionality as quickly as possible.

    2. August 19, 2026 at 12:34 PM UTCidentified

      The issue has been identified, and a fix is being implemented.

    3. August 19, 2026 at 1:19 PM UTCmonitoring

      A fix has been implemented and we are monitoring the situation.

    4. August 19, 2026 at 2:09 PM UTCresolved

      The incident has been resolved.

    5. October 6, 2026 at 8:14 AM UTCpostmortem

      ## **Introduction** We would like to share more details about the events that occurred with Phrase between 2:11 PM CEST and 4:10 PM CEST on August 19, 2026, which led to degraded Translation Memory functionality in Phrase TMS \(EU\) and what Phrase engineers are doing to prevent these issues from recurring. ## **Timeline** * **August 19, 2026 at 2:11 PM CEST:** Phrase identified an issue affecting Translation Memory functionality in Phrase TMS \(EU\). Users experienced errors when creating translation memories and performing related operations, including confirming segments, elevating error rates across dependant services and use-cases. * **August 19, 2026 at 2:32 PM CEST:** Root cause was identified and engineers began applying a fix to the affected environment by rebalancing the cluster and restarting affected nodes to speed up recovery. * **August 19, 2026 at 3:10 PM CEST:** Translation memory creation and related operations were confirmed to be functioning normally again. * **August 19, 2026 at 4:10 PM CEST:** After a sustained monitoring period showed no recurrence, the incident was marked resolved. ## **Root Cause** Investigation revealed that the incident originated in the database cluster that stores Translation Memory data. A single Translation Memory had, over time, grown very large and required a disproportionate share of read activity to be served by the node that also coordinated the health and metadata management of the wider cluster. Because the cluster was undergoing zero-downtime maintenance spanning days, there was a higher amount of coordination actions and an elevated load on coordination nodes in the cluster. Those two combined with peak load caused multiple coordination nodes performance to slowly deteriorate, leading to elevated error rate and degraded performance. ## **Actions to Prevent Recurrence** To prevent similar incidents in the future and mitigate any negative effects, we: * Rebalanced the cluster and  its backing infrastructure to create more headroom for Translation Memory searches and updates. * Paused the ongoing maintenance on impacted Translation Memory cluster. * Improved capacity of coordination node and will be improving cluster’s topology to prevent cluster impact during sudden requests peaks.

    Degraded Performance of Branching in Phrase Strings (EU) between August 6, 2026 03:45 PM CEST and August 7, 2026 10:46 AM CEST

    Started August 7, 2026 at 7:27 AM UTC · 6h 45m

    OutageMajor incident
    Affected components
    APITranslation center
    1. August 7, 2026 at 7:27 AM UTCinvestigating

      We are currently investigating an issue with branching events missing in Phrase Strings (EU), which may cause changes to not be applied when branches are merged.

    2. August 7, 2026 at 7:54 AM UTCinvestigating

      We are continuing to investigate this issue.

    3. August 7, 2026 at 8:18 AM UTCidentified

      The issue has been identified and a fix is being implemented.

    4. August 7, 2026 at 8:30 AM UTCmonitoring

      A fix has been implemented. The backlog of missing events is now being processed. Once the queue is fully processed, unmerged branches will automatically receive the missing changes. We are monitoring the queue and results.

    5. August 7, 2026 at 2:12 PM UTCresolved

      Changes made to branches during the incident window are now fully applied. Merged branches that were affected have been identified and impacted customers have been contacted directly. This incident has been resolved.

    6. September 11, 2026 at 6:11 AM UTCpostmortem

      ## Introduction We would like to share details about an incident that affected Phrase Strings on the EU platform between August 6 and August 7, 2026. During this period, changes made in branches were not being recorded by our change-processing pipeline. As a result, branches that were merged during the incident could be merged without the changes made to them during that window, and branch comparison screens could show no differences even when differences existed. This post-mortem explains what happened, how it was resolved, and what we are doing to prevent it from happening again. ## Timeline * **August 6, 2026 at 5:44 PM CEST** – A network interruption severed the connection our change-processing pipeline uses to read database changes. The connection failed to recover, and branch changes stopped being processed. The affected component continued to report itself as healthy, so no automated alert was triggered. * **August 7, 2026 at 09:11 AM CEST** – The issue was identified following a customer report. * **August 7, 2026 at 09:19 AM CEST** – The incident was escalated to our highest severity level. * **August 7, 2026 at approximately 10:20 AM CEST** – The affected component was recovered by restarting it, and change processing resumed. * **August 7, 2026 at 10:46 AM CEST** – The backlog of pending changes was fully processed and the pipeline was caught up. * **August 7, 2026 afternoon** – The affected customers were identified and contacted individually with the data needed to restore their changes. ## Root Cause The incident was triggered by a transient network interruption that broke the connection our system uses to stream changes from the database into our branch-processing pipeline. The component responsible for this connection attempted to reconnect automatically, but the reconnection attempt hung indefinitely rather than either succeeding or failing. Because the component never reported a failure, our platform's automatic recovery mechanism — which restarts components that report an error state — was never triggered. The component remained in a state where it appeared to be running normally while processing no changes at all. This is why a standard restart of the connection did not resolve the issue, while fully restarting the underlying process, which established a fresh connection, did. The situation was not detected sooner because our monitoring for this pipeline relied on a signal that continued to report "healthy" throughout the incident, and we did not have a separate measure of whether changes were actually flowing through and being processed. ## Impact * Branches that had changes during the incident but were **not** merged did not lose any data. Their changes were processed once the pipeline recovered. * Branches that **were** merged during the incident were merged without the changes made to them during the incident window. Changes made before the incident were not affected. * Only a small number of customers were ultimately affected. Each was contacted individually and provided with the data and steps needed to restore the affected changes. ## Actions to Prevent Recurrence 1. **Fixed misleading monitoring** – We corrected the monitoring configuration that grouped different production environments together, which had delayed our awareness of the issue. 2. **Adding meaningful health signals** – We are adding monitoring that measures whether changes are actually flowing through the pipeline and how far behind it is, rather than relying on a status signal that can report "healthy" while no work is being done. This ensures a similar stall is detected immediately. 3. **Improving automatic recovery** – We are reviewing the reconnection and retry behaviour of this component so that a stuck connection results in a genuine failure that triggers automatic restart.

    Degraded Performance of Connectors in Phrase TMS (EU) on August 6, 2026

    Started August 6, 2026 at 8:11 AM UTC · 5h 8m

    OutageMajor incident
    Affected components
    ConnectorsConnectors
    1. August 6, 2026 at 8:11 AM UTCinvestigating

      We are currently investigating an issue affecting Connectors in Phrase TMS. Customers may be unable to access or use Connector functionality during this time. Our engineering team is actively working to identify the cause and restore full service as quickly as possible.

    2. August 6, 2026 at 8:18 AM UTCinvestigating

      We are continuing to investigate this issue.

    3. August 6, 2026 at 8:43 AM UTCmonitoring

      We have identified the root cause and the issue has now been resolved. Connectors should be appearing as active again. We will continue to monitor the situation to ensure full stability.

    4. August 6, 2026 at 12:00 PM UTCmonitoring

      We continue monitoring the situation.

    5. August 6, 2026 at 1:19 PM UTCresolved

      The incident has been resolved and all components are back to operational.

    Degraded Performance of Phrase Orchestrator (EU) Next-Gen Workflow Engine between July 28, 05:15 AM CEST and July 28, 09:56 AM CEST

    Started July 28, 2026 at 7:19 AM UTC · 4h 30m

    OutageMajor incident
    Affected components
    Next-Gen Workflow Engine
    1. July 28, 2026 at 7:19 AM UTCinvestigating

      The engineering team identified an issue with Orchestrator where the new Workflow Engine is currently not executing workflows. The problem is under investigation.

    2. July 28, 2026 at 7:53 AM UTCinvestigating

      We are continuing to investigate this issue.

    3. July 28, 2026 at 8:30 AM UTCidentified

      The issue has been identified and a fix is being implemented.

    4. July 28, 2026 at 8:35 AM UTCmonitoring

      A fix has been implemented and we are monitoring the results. The workflow engine is processing the queue of pending executions.

    5. July 28, 2026 at 11:49 AM UTCresolved

      All executions have been processed. This incident has been resolved.

    6. July 30, 2026 at 7:09 AM UTCpostmortem

      ## Introduction We would like to share details about an incident that affected Phrase Orchestrator on July 27–28, 2026. During this period, workflow executions in the Next-Gen Workflow Engine were unable to progress and remained stuck in an "executing" state. No data was lost during the incident. This post-mortem explains what happened, when it was resolved, and the steps we have taken to prevent a recurrence. ## Timeline * **27 July 2026 at 18:55 CEST** – The workflow engine began producing errors as database query performance degraded. Workflow executions stalled and stopped progressing. * **27 July 2026 at 20:54 CEST** – The first customer report of executions stuck in "executing" was received. * **27 July 2026 at 22:39 CEST** – The incident was formally declared. * **28 July 2026 at 02:18 CEST** – A service restart provided temporary relief; workflow executions resumed. * **28 July 2026 at 05:15 CEST** – The issue recurred as the underlying database performance problem persisted. * **28 July 2026 at 09:56 CEST** – The root cause was identified and addressed. No executions were lost; however, due to partial service restarts, some actions within executions were retried, which may have caused a small number of executions to fail that otherwise would have succeeded. * **28 July 2026 at 13:46 CEST** – The full backlog of stalled executions was confirmed as cleared. The system was declared stable. * **28 July 2026 at 13:48 CEST** – Incident resolved. ## Root Cause The incident was caused by progressive bloat in database indexes used by the workflow job scheduling system. The performance of these particular indexes gradually degraded over time as they accumulated dead index entries from prior writes and updates. The job scheduling engine acquires database-level coordination locks while querying these indexes to determine which jobs to dispatch. As the index lookups grew slower, they began exceeding the database's configured statement timeout. When a lookup was canceled by the timeout, the scheduling process responsible for that work crashed and restarted. With no schedulers running, no workflow steps could be dispatched and all in-progress workflow executions became stuck. The database server itself remained healthy throughout the incident, with normal CPU and connection levels. The problem was exclusively lock and latency contention within the scheduling layer. A service restart cleared the crashed processes and temporarily restored execution. However, because the index bloat was still present, the same degradation recurred once query load resumed. A manual index rebuild fully restored performance and resolved the issue. ## Actions to Prevent Recurrence 1. **Automated index maintenance added** – Scheduled automatic index maintenance has been configured for the affected indexes. This ensures bloat cannot accumulate over time and eliminates the conditions that triggered this incident. 2. **Legacy indexes removed** – Unused legacy database indexes have been identified and removed, reducing the overall maintenance surface and simplifying future index hygiene. 3. **Monitoring coverage updated** – Our monitoring landscape is being reviewed and updated to reflect the current state of the workflow engine. This work will close gaps that allowed the degradation to go undetected before the first customer report.

    Degraded Performance of Phrase Orchestrator (EU) Next-Gen Workflow Engine between July 27, 06:55 PM CEST and July 28, 02:14 AM CEST

    Started July 27, 2026 at 11:48 PM UTC · 52m

    OutageMajor incident
    Affected components
    Next-Gen Workflow Engine
    1. July 27, 2026 at 11:48 PM UTCinvestigating

      Engineering has identified an issue with Orchestrator where the new Workflow Engine is currently not executing workflows. The problem is under investigation.

    2. July 28, 2026 at 12:41 AM UTCresolved

      All workflows are being executed again as expected.

    3. July 30, 2026 at 7:08 AM UTCpostmortem

      ## Introduction We would like to share details about an incident that affected Phrase Orchestrator on July 27–28, 2026. During this period, workflow executions in the Next-Gen Workflow Engine were unable to progress and remained stuck in an "executing" state. No data was lost during the incident. This post-mortem explains what happened, when it was resolved, and the steps we have taken to prevent a recurrence. ## Timeline * **27 July 2026 at 18:55 CEST** – The workflow engine began producing errors as database query performance degraded. Workflow executions stalled and stopped progressing. * **27 July 2026 at 20:54 CEST** – The first customer report of executions stuck in "executing" was received. * **27 July 2026 at 22:39 CEST** – The incident was formally declared. * **28 July 2026 at 02:18 CEST** – A service restart provided temporary relief; workflow executions resumed. * **28 July 2026 at 05:15 CEST** – The issue recurred as the underlying database performance problem persisted. * **28 July 2026 at 09:56 CEST** – The root cause was identified and addressed. No executions were lost; however, due to partial service restarts, some actions within executions were retried, which may have caused a small number of executions to fail that otherwise would have succeeded. * **28 July 2026 at 13:46 CEST** – The full backlog of stalled executions was confirmed as cleared. The system was declared stable. * **28 July 2026 at 13:48 CEST** – Incident resolved. ## Root Cause The incident was caused by progressive bloat in database indexes used by the workflow job scheduling system. The performance of these particular indexes gradually degraded over time as they accumulated dead index entries from prior writes and updates. The job scheduling engine acquires database-level coordination locks while querying these indexes to determine which jobs to dispatch. As the index lookups grew slower, they began exceeding the database's configured statement timeout. When a lookup was canceled by the timeout, the scheduling process responsible for that work crashed and restarted. With no schedulers running, no workflow steps could be dispatched and all in-progress workflow executions became stuck. The database server itself remained healthy throughout the incident, with normal CPU and connection levels. The problem was exclusively lock and latency contention within the scheduling layer. A service restart cleared the crashed processes and temporarily restored execution. However, because the index bloat was still present, the same degradation recurred once query load resumed. A manual index rebuild fully restored performance and resolved the issue. ## Actions to Prevent Recurrence 1. **Automated index maintenance added** – Scheduled automatic index maintenance has been configured for the affected indexes. This ensures bloat cannot accumulate over time and eliminates the conditions that triggered this incident. 2. **Legacy indexes removed** – Unused legacy database indexes have been identified and removed, reducing the overall maintenance surface and simplifying future index hygiene. 3. **Monitoring coverage updated** – Our monitoring landscape is being reviewed and updated to reflect the current state of the workflow engine. This work will close gaps that allowed the degradation to go undetected before the first customer report.

    Degraded Performance of Phrase Strings API (EU) between June 16, 2026 01:00PM CEST and June 17, 2026 11:00AM CEST

    Started July 20, 2026 at 12:53 PM UTC · 0m

    IssuesMinor incident
    1. July 20, 2026 at 12:53 PM UTCresolved

      Between June 16, 2026 01:00PM CEST and June 17, 2026 11:00AM CEST, the Phrase Job Sync connector suffered degraded performance. Customers using the Job Sync with the default connection type experienced failures. The engineering team identified a root cause and provided a fix.

    2. July 20, 2026 at 12:54 PM UTCpostmortem

      ### Introduction We would like to share more details about the events that occurred with Phrase between June 16, 2026, 01:00PM CEST and June 17, 2026, 11:00AM CEST, which led to degraded performance of Phrase Strings API, causing customers using the Job Sync with the default connection type to experience failures. We apologize for the disruption and are committed to preventing similar incidents in the future. ### Timeline **Jun 16, 2026 @ 01:00 PM CEST** – Job Sync began failing for customers using the default connection type. Connectors were unable to authenticate against the Phrase Strings API. **Jun 17, 2026 @ 10:00 AM CEST** – The authentication failure was identified by the engineering team. **Jun 17, 2026 @ 10:28 AM CEST** – Impact scope was confirmed: Customers using the default Job Sync connection were affected. Customers using personal access token-based connectors were not affected. **Jun 17, 2026 @ 10:29 AM CEST** – Root cause was identified: A recent change which added multi-platform token support inadvertently introduced errors with some existing platform tokens. **Jun 17, 2026 @ 10:40 AM CEST** – A fix was prepared and submitted for review. **Jun 17, 2026 @ 10:53 AM CEST** – The fix was deployed and JobSync functionality was fully restored. ### Root Cause A code change introduced to add support for multi-platform authentication tokens modified how incoming platform tokens are validated and processed in the Phrase Strings API. This change was not compatible with an existing token format used by the default connection type. As a result, platform tokens were rejected by the Strings API with a `401 Unauthorized` response. The connector retried establishing the connection until exhausting its retry budget, causing all affected operations to fail. Customers using personal access tokens were not affected as their tokens follow a different code path. ### Actions to Prevent Recurrence The root cause was a backwards-incompatible change to token handling that was not detected during development. The following actions are being taken: * **Token format compatibility testing in auth changes:** When introducing a new token/authentication format alongside an existing one, tests must explicitly cover the transition case—old-format tokens being processed under the new detection logic—not just each format in isolation.

    Degraded Performance of Phrase (EU & US) starting on July 16, 2026 17:24 CEST

    Started July 16, 2026 at 3:47 PM UTC · 3d 20h

    OutageMajor incident
    Affected components
    Identity management - IDM (US)Identity management - IDM (EU)
    1. July 16, 2026 at 3:47 PM UTCinvestigating

      We are currently investigating an issue affecting our Metrics service that may result in duplicated metrics consumption for some customers. Our team is actively working to identify the affected components and determine the root cause. We will provide further updates as more information becomes available.

    2. July 16, 2026 at 4:29 PM UTCidentified

      We have identified the root cause as instability on a specific broker, which is causing repeated consumer group rebalancing in our Metrics service and leading to duplicate processing of metric updates. This may result in some customers experiencing incorrect consumption calculations or unexpected account blocking. We continue working on a fix.

    3. July 16, 2026 at 5:31 PM UTCmonitoring

      We have stopped the progression of the issue and are now working to identify the full scope of impact, including which organizations are affected or blocked. Affected accounts will be prioritized for resolution through a deduplication process, though this will take some time to complete.

    4. July 16, 2026 at 7:04 PM UTCidentified

      We have successfully deduplicated metrics consumption for all blocked organizations. We are continuing work to develop per-organization deduplication tooling to ensure accurate billing cycle data, with the full team scaling these fixes tomorrow morning.

    5. July 17, 2026 at 1:02 PM UTCmonitoring

      We continue to make progress resolving the duplicated metrics consumption issue first identified on July 16. The root cause has been identified and addressed. Since our last update, our team has corrected the duplicated data for all previously blocked accounts. We are now working through a remaining set of affected accounts and expect this cleanup to continue over the coming days. No further duplication is occurring, this work addresses historical data only.

    6. July 20, 2026 at 12:07 PM UTCresolved

      This incident has been resolved.

    Performance Disruption of Phrase Orchestrator (EU) on July 16, 2026 between 4:07 PM CEST and 5:32 PM CEST

    Started July 16, 2026 at 2:49 PM UTC · 1h 22m

    OutageCritical incident
    Affected components
    Workflow Builder
    1. July 16, 2026 at 2:49 PM UTCinvestigating

      We are currently investigating an issue affecting Phrase Orchestrator. We are working to identify the root cause and will provide further updates as soon as more information is available.

    2. July 16, 2026 at 3:27 PM UTCinvestigating

      We are continuing to investigate this issue.

    3. July 16, 2026 at 3:27 PM UTCidentified

      The issue has been identified and a fix is being implemented.

    4. July 16, 2026 at 3:41 PM UTCmonitoring

      A fix has been implemented and we are monitoring the results.

    5. July 16, 2026 at 4:12 PM UTCresolved

      Orchestrator (EU) is available again since 5:32 PM CEST. All pending executions are being processed. This incident has been resolved.

    Degraded Performance of Translation center in Phrase Strings (EU & US) between July 10, 2026 16:21 CEST and July 10, 2026 17:13 CEST

    Started July 10, 2026 at 2:24 PM UTC · 1h 1m

    OutageMajor incident
    Affected components
    Translation centerTranslation center
    1. July 10, 2026 at 2:24 PM UTCinvestigating

      We are currently investigating an issue affecting the Translation Center in Phrase Strings (EU and US regions), where strings are failing to load. Our engineering team has identified a potential cause and is actively working to resolve it. We will provide further updates as our investigation progresses.

    2. July 10, 2026 at 2:37 PM UTCmonitoring

      A fix has been implemented and we are monitoring the results.

    3. July 10, 2026 at 3:24 PM UTCresolved

      This incident has been resolved.

    4. August 7, 2026 at 7:14 AM UTCpostmortem

      ## Introduction On July 10, 2026, parts of the Phrase Strings frontend at [app.phrase.com](http://app.phrase.com/) failed to load correctly for a short period, after required stylesheets and scripts failed to load — the underlying service itself stayed available. The issue began at 16:08 CEST and was resolved by 16:27 CEST. This post-mortem explains what happened and what we're doing to prevent a recurrence. ## Timeline * **Jul 10, 2026 at 16:08 CEST** – A deployment introduced new application assets that were never uploaded to our storage service, so the application could no longer load its stylesheets and scripts for customers. * **Jul 10, 2026 at 16:21 CEST** – Issue detected, incident declared. * **Jul 10, 2026 at 16:24 CEST** – Root cause identified. * **Jul 10, 2026 at 16:26 CEST** – Fix applied. * **Jul 10, 2026 at 16:27 CEST** – Customer-facing impact ended. * **Jul 10, 2026 at 16:32 CEST** – Incident downgraded to monitoring while the underlying configuration was addressed. * **Jul 10, 2026 at 17:12 CEST** – Configuration corrected, incident resolved. ## Root Cause During a planned, routine maintenance, a configuration change unintentionally disabled the process that uploads application assets \(stylesheets, scripts\) to our storage and content-delivery service. This went unnoticed at first, since the assets already in place kept working and no new versions had been shipped yet. On July 10, 2026, a deployment shipped new versions of these assets. Because uploading was still disabled, the new files never reached the storage service, and the application could not load its stylesheets and scripts. ## Actions to Prevent Recurrence 1. **Asset synchronization re-enabled** – The disabled process was fixed, restoring correct asset delivery. 2. **Asset availability monitoring** – Adding monitoring to detect asset load failures automatically, before customers are affected.

    Degraded performance of TMS Project Management Component

    Started July 8, 2026 at 12:57 PM UTC · 57m

    IssuesMinor incident
    Affected components
    Project management
    1. July 8, 2026 at 12:57 PM UTCinvestigating

      We are getting reports from users about jobs disappearing from projects and we are currently investigating the issue.

    2. July 8, 2026 at 1:08 PM UTCmonitoring

      The issue has been identified, a fix was implemented and we are monitoring the situation.

    3. July 8, 2026 at 1:55 PM UTCresolved

      The incident has been resolved.

    Performance Disruption of Phrase TMS CAT Web Editor on July 7, 2026

    Started July 7, 2026 at 8:34 AM UTC · 53m

    OutageMajor incident
    Affected components
    CAT web editor
    1. July 7, 2026 at 8:34 AM UTCinvestigating

      We are currently investigating issues with CAT Web Editor.

    2. July 7, 2026 at 8:59 AM UTCmonitoring

      The issue has been identified, a fix was implemented and we are monitoring the situation.

    3. July 7, 2026 at 9:27 AM UTCresolved

      The incident has been resolved.

    TEST - Please ignore

    Started June 23, 2026 at 12:53 PM UTC · 5m

    OutageMajor incident
    Affected components
    Legacy Workflow Engine
    1. June 23, 2026 at 12:53 PM UTCinvestigating

      Hello everyone, this is a test, kindly ignore.

    2. June 23, 2026 at 12:57 PM UTCresolved

      This incident has been resolved.

    TEST - Please ignore

    Started June 22, 2026 at 2:16 PM UTC · 18m

    OutageMajor incident
    Affected components
    Legacy Workflow Engine
    1. June 22, 2026 at 2:16 PM UTCinvestigating

      This is a test, please ignore.

    2. June 22, 2026 at 2:21 PM UTCinvestigating

      This incident has been resolved.

    3. June 22, 2026 at 2:34 PM UTCresolved

      This incident has been resolved.

    Degraded Performance of Phrase Strings (EU) on June 22, 2026 from 12:52 PM CET to 02:57 PM CET

    Started June 22, 2026 at 11:20 AM UTC · 1h 47m

    IssuesMinor incident
    Affected components
    Translation center
    1. June 22, 2026 at 11:20 AM UTCinvestigating

      We are currently investigating an issue affecting Branches functionality in Phrase Strings for customers on our EU data center. Operations on branches may be failing or returning unexpected results. Our engineering team is actively looking into the root cause and will provide further updates as soon as more information is available.

    2. June 22, 2026 at 11:57 AM UTCinvestigating

      We are continuing to investigate this issue.

    3. June 22, 2026 at 12:40 PM UTCidentified

      The issue has been identified and a fix is being implemented.

    4. June 22, 2026 at 12:50 PM UTCmonitoring

      A fix has been implemented and we are monitoring the results.

    5. June 22, 2026 at 1:06 PM UTCmonitoring

      We are continuing to monitor for any further issues.

    6. June 22, 2026 at 1:07 PM UTCresolved

      This incident has been resolved.