54 Breadcrumb incidents · Mai 2021 — official updates, affected components, duration and resolution details.
Wir erleben einen teilweisen Ausfall, der die folgenden Merkmale betrifft: * Gästebuch * Magic Quadrant * Wiederholte Kundenfavoriten Wir haben die Ursache identifiziert und sind dabei, sie zu lösen.
Dieser Vorfall wurde behoben.
Automatisch aus der offiziellen Störungsmeldung übersetzt.
We have implemented key fixes to address potential security risks related to PHP vulnerabilities. Our engineering team is closely monitoring system health and will share additional updates as necessary.
This incident has been resolved.
Wir untersuchen derzeit Serviceunterbrechungen, die mehrere Tools betreffen, darunter HQ Reporting-Zugriff, Workforce-Integrationsleistung und Online-Bestelldienste (OLO). Unsere Engineering-Teams arbeiten aktiv daran, die volle Funktionalität in allen betroffenen Bereichen wiederherzustellen.
fix wurde eingesetzt, und unser Engineering-Team überwacht aktiv die Systemleistung, um volle Stabilität zu gewährleisten. Wir werden ein weiteres Update bereitstellen, sobald wir bestätigen, dass das Problem vollständig gelöst ist.
Dieser Vorfall wurde behoben.
Automatisch aus der offiziellen Störungsmeldung übersetzt.
Wir untersuchen derzeit Serviceunterbrechungen, die mehrere Tools betreffen, darunter HQ Reporting-Zugriff, Workforce-Integrationsleistung und Online-Bestelldienste (OLO). Unsere Engineering-Teams arbeiten aktiv daran, die volle Funktionalität in allen betroffenen Bereichen wiederherzustellen.
Ein Fix wurde bereitgestellt, und unser Engineering-Team überwacht aktiv die Systemleistung, um volle Stabilität zu gewährleisten. Wir werden ein weiteres Update bereitstellen, sobald wir bestätigen, dass das Problem vollständig gelöst ist.
Dieser Vorfall wurde behoben.
Automatisch aus der offiziellen Störungsmeldung übersetzt.
Das Upserve Engineering-Team hat ein Problem identifiziert, das zu einer Zunahme von Online-Bestellungsfehlern führt. Unser Team untersucht die Ursache und wird aktualisieren, sobald weitere Informationen verfügbar sind.
Das Upserve-Engineering-Team hat ein Problem behoben, das zu einer Zunahme von Online-Bestellfehlern führt. Wenn Sie Probleme mit der Online-Bestellung haben, wenden Sie sich bitte an den Support.
Automatisch aus der offiziellen Störungsmeldung übersetzt.
Das Upserve-Engineering-Team ist sich eines Problems bewusst, das Upserve Inventory betrifft, einschließlich der Berichterstattung und der Unfähigkeit, Zählungen zu bearbeiten. Ein Fix ist im Gange, und die Kunden sollten in den nächsten Stunden eine Erholung sehen. Bis dahin können Kunden weiterhin eine verschlechterte Leistung erleben. Wir werden ein weiteres Update veröffentlichen, sobald das Problem vollständig behoben ist.
Wir glauben, dass dieser Vorfall gelöst ist und das Upserve Inventory-System zu diesem Zeitpunkt normal funktioniert. Die Hauptursache des Vorfalls führte jedoch zu inkonsistenten Zähldaten und fehlenden Bestellaktualisierungen für einige Kunden während des betroffenen Zeitraums. Wir empfehlen den Kunden dringend, die von Lieferanten bereitgestellten Rechnungen für Bestellungen, die seit dem 14. Juli eingegangen oder aufgegeben wurden, zu kreuzen. Wir empfehlen auch, eine neue Zählung durchzuführen, um sicherzustellen, dass diese Werte korrekt sind. Wenn nach Abschluss dieser Schritte weiterhin Unstimmigkeiten auftreten, wenden Sie sich bitte an unser Support-Team mit relevanten Details, einschließlich des ungefähren Datums und der ungefähren Uhrzeit des erwarteten Updates und etwaiger unterstützender Unterlagen (wie Rechnungen oder Screenshots), damit wir weitere Untersuchungen durchführen können.
Automatisch aus der offiziellen Störungsmeldung übersetzt.
Das Upserve-Engineering-Team ist sich eines Problems bewusst, das Upserve Inventory betrifft, einschließlich der Berichterstattung und der Unfähigkeit, Zählungen zu bearbeiten. Ein Fix ist im Gange, und die Kunden sollten in den nächsten Stunden eine Erholung sehen. Bis dahin können Kunden weiterhin eine verschlechterte Leistung erleben. Wir werden ein weiteres Update veröffentlichen, sobald das Problem vollständig behoben ist.
Das Problem wurde identifiziert und ein Fix wird implementiert.
Ein Fix wurde implementiert und wir überwachen die Ergebnisse.
Dieser Vorfall wurde behoben.
Automatisch aus der offiziellen Störungsmeldung übersetzt.
We are currently investigating a major service disruption impacting the availability of our support channels across all products. The issue is related to a widespread outage with AWS US-East-1 (Amazon Web Services), which is affecting key Internet services globally. Customers may experience difficulty reaching support via phone and chat. We are monitoring the external provider and actively working to restore connectivity as quickly as possible. Workaround: Email Support is operational. If you require assistance, please send an email to [email protected]. We sincerely apologize for this disruption and thank you for your patience. We will provide an update as soon as the upstream issue is resolved.
Services have recovered and are now in a monitoring state. While our platform provider (AWS) continues backend work to fully restore their infrastructure, all support contact functionalities are operating normally.
This incident has been resolved.
We’re currently experiencing disruptions to our point of sale system due to an incident with our cloud provider. We will provide additional updates as they become available.
Our cloud provider's engineers are working to mitigate the issue. We have confirmation that services have recovered in some locations. We will continue to provide additional information as they become available.
Our cloud providers have mitigated the issues and expect full recovery in less than an hour. We will continue to provide additional information as it becomes available.
This incident has been resolved.
The U-Series team is aware of an issue with a third-party partner that is currently preventing access to hq.upserve.com. While we await updates from the partner, please use hq.breadcrumb.com or app.upserve.com to access your HQ Back Office. We will share more information as it becomes available. Thank you for your patience.
This incident has been resolved.
Our engineering team has identified a problem affecting a subset of merchants experiencing issues with hq.upserve.com. As a result, your reports may be delayed. We are actively working on a resolution
Our engineering team has applied a fix for the issue causing a subset of merchants to have reporting delay. We have observed merchants return to normal operations. We will continue to monitor this issue before resolving.
Since our last update, we have observed hq.upserve.com’s performance at normal levels and restaurants have returned to normal operation. This incident has been resolved.
The U-Series team is aware of an issue affecting performance for Online Ordering customers. We are actively investigating and will provide an update as soon as we have more information."
This incident has been resolved.
The Lightspeed Restaurant U-Series team is aware of an issue affecting a small number of customers using Mobile Tap readers, which may result in payment deposit delays for some transactions. The U-Series team is actively working on a fix and will ensure that any failed authorizations are captured.
A fix for the payment deposit delay affecting a small number of customers using Mobile Tap readers has been released in version 3.18.2 as of 12/17/24. Please update your terminals to prevent any further disruption to payments. The U-Series team is actively working to capture any failed authorizations caused by this issue.
The U-Series team has attempted the capture of all affected payments caused by the issue impacting customers using Mobile Tap payments. We will continue monitoring and capturing any new affected payments over the next few days. This issue has been permanently resolved in version 3.18.2, which is now available for download on the App Store.
We are currently investigating this issue.
We have observed merchants return to normal operations that had previously been operating in offline mode. We will continue to monitor this issue before resolving. If you have any questions, please contact our support team via chat in-app or at help.upserve.com.
Since our last update, we have observed merchants that had previously reported terminals in offline mode have returned to normal operation, and this incident is resolved. If you have any questions, please contact our support team via chat in-app or at help.upserve.com.
We are experiencing an issue that may cause a delay in reporting for some customers on their HQ Back Office.
We have identified an issue that may cause a delay in reporting for some customers in their HQ Back Office.
A fix has been implemented, and we are monitoring the results. Customers should no longer have delays in reporting on their HQ Back Office.
This incident has been resolved.
Our engineering team is aware of an issue that is causing the Lightspeed U-Series Point of Sale to be non-operational for some merchants. We will update as soon as we have more information.
Our engineering team has identified an issue due to a 3rd party provider that is causing the Lightspeed U-Series Point of Sale to be non-operational for some merchants. We will continue to update as soon as we have more information.
Our engineering team is actively working with our third-party provider to reach a resolution for the service disruption. We will provide updates as soon as additional information becomes available. As a temporary solution, please follow the following steps: 1. Quit the U-Series app 2. Force Offline Mode - Enable airplane mode or turn off wifi 3. Launch the U-Series app 4. Turn airplane mode off or wifi back on This will enable the device to operate in Offline Mode. Operating in Offline Mode permits ongoing business operations, including the collection of credit card payments. Learn more about Offline Mode here: https://help.upserve.com/s/article/Internet-Connectivity-Issues-Android-Tableside
Our engineering team is actively working with our third-party provider to reach a resolution for the service disruption. We will provide updates as soon as additional information becomes available. iOS As a temporary solution, please follow the following steps: 1. Quit the U-Series app 2. Force Offline Mode - Enable airplane mode or turn off wifi 3. Launch the U-Series app 4. Turn airplane mode off or wifi back on Android As a temporary solution, please follow the following steps: 1. Unplug the ethernet cable from ELO terminal or from the wall. 2. Tap the “Try again” button from the error screen. 3. You should see the PIN screen. Pin in as normal. 4. Plug the ethernet cable back in and after a few moments printing capabilities should be functional. This will enable the device to operate in Offline Mode. Operating in Offline Mode permits ongoing business operations, including the collection of credit card payments. Learn more about Offline Mode here: https://help.upserve.com/s/article/Internet-Connectivity-Issues-Android-Tableside
Our engineering team remains actively engaged with our third-party provider to address the service disruption. Updates will be shared as soon as more information becomes available. iOS As a temporary solution, please follow the following steps: 1. Quit the U-Series app 2. Force Offline Mode - Enable airplane mode or turn off wifi 3. Launch the U-Series app 4. Turn airplane mode off or wifi back on Android As a temporary solution, please follow the following steps: 1. Unplug the ethernet cable from the ELO terminal or from the wall. 2. Tap the “Try again” button from the error screen. 3. You should see the PIN screen. Pin in as normal. 4. Plug the ethernet cable back in and after a few moments, printing capabilities should be functional. This will enable the device to operate in Offline Mode. Operating in Offline Mode permits ongoing business operations, including the collection of credit card payments. Learn more about Offline Mode here: https://help.upserve.com/s/article/Internet-Connectivity-Issues-Android-Tableside
Our engineering team has worked with our third-party provider to mitigate an issue causing some merchants to encounter a service disruption. We have observed a gradual recovery with some merchants returning to normal operations that were previously unable to access their Lightspeed U-Series Point of Sale. We will continue to monitor for the full recovery of all merchants before resolving.
Our engineering team has worked with our third-party provider to resolve an incident that caused some merchants to encounter a service disruption. We have observed merchants return to normal operations. We are still working to correct reporting inconsistencies from the outage. We will continue to provide updates on our status page.
Our engineering team has begun successfully capturing delayed payments from the November 15th U-Series Outage. This process will continue throughout the weekend. Note that this work only affects payments and that reporting in HQ will continue to be inconsistent until further investigation can be done into potential recovery for that data. Thank you for your continued patience as this process continues in the coming days. To view the U-Series deposit schedule, please visit https://help.upserve.com/s/article/Deposit-Schedule-with-Upserve-Payments. If you have any questions please reach out via chat at https://help.upserve.com/s/ or via phone at 855-664-3887.
Our engineering team has successfully completed the capturing of all delayed payments from the November 15th U-Series outage. These payments will be deposited on Monday in correlation with the normal deposit schedule. HQ Reports remain inconsistent and our team will now shift focus to reconciling this data next week. To view the U-Series deposit schedule, please visit https://help.upserve.com/s/article/Deposit-Schedule-with-Upserve-Payments. If you have any questions please reach out via chat at https://help.upserve.com/s/ or via phone at 855-664-3887.
Our engineering team is making progress on reconciling delayed reporting data in response to the November 15th U-Series outage. Our focus this week remains on recovering as much of this data as possible. While this occurs, HQ reporting will remain inconsistent. All delayed payments from the outage were captured last week and should have been deposited today in correlation with the normal deposit schedule. To view the U-Series deposit schedule, please visit https://help.upserve.com/s/article/Deposit-Schedule-with-Upserve-Payments. For the best performance, make sure all your terminals are running the latest version of the application available in the app store, if you haven't already done so. If you have any questions please reach out via chat at https://help.upserve.com/s/ or via phone at 855-664-3887.
Our engineering team has successfully completed the reinstatement of all recoverable data in relation to the November 15th Google Cloud Platform outage that affected U-Series customers. These recovery efforts include both payments and HQ reporting. All payments are captured and all information in HQ is up to date. If there are still inconsistencies in your payments or reporting, or if you have any questions, please reach out to support via chat at help.upserve.com or via phone at 855-664-8335.
This incident has been resolved.
We identified an issue causing some customers to have difficulty generating U-Series POS Reports.
We have identified an issue that is causing a very small subset of customers to encounter difficulty when generating U-Series POS Reports.
Our engineering team has implemented a solution to address the issue that was causing challenges for certain merchants in generating U-Series POS Reports. Those merchants who previously faced difficulties in generating U-Series POS reports should now experience a return to regular operation.
There is currently an issue with an upstream Gift Card provider, eCard Systems. Our team is reaching out to eCards for more details. They are aware and working on it currently.
The incident with utilizing Gift Cards, is now fully resolved. You can continue to redeem, check balance, and load Gift Cards. If you have any questions, please contact our support team via chat in-app or at help.upserve.com.
Our engineering team is currently investigating syncing issues and your Point of Sale may be experiencing degraded performance or offline mode. Offline Mode allows you to continue operating and collecting credit card payments. More on offline mode here: https://help.upserve.com/s/article/Offline-Mode-Overview and https://help.upserve.com/s/article/Internet-Connectivity-Issues-Android-Tableside
We are continuing to investigate this issue.
Our engineering team has identified an issue due to a 3rd Party Service causing some merchants to experience syncing issues on the POS & degraded performance or offline mode. Offline Mode allows you to continue operating and collecting credit card payments. More on offline mode here: https://help.upserve.com/s/article/Offline-Mode-Overview & https://help.upserve.com/s/article/Internet-Connectivity-Issues-Android-Tableside.
Since our last update, we have observed merchants that had previously been experiencing syncing issues have returned to normal operation, and this incident is resolved. If you have any questions, please contact our support team via chat in-app or at help.upserve.com
Our engineering team has identified issues with syncing on the Point of Sale and HQ. This may cause degraded performance for loading reports and receiving Online Orders. We're actively working towards a resolution. If you have any questions, please contact our support team via chat in-app or at help.upserve.com.
We are continuing to mitigate syncing issues on the Point of Sale and HQ. This may cause degraded performance for loading reports and receiving Online Orders. We're actively working towards a resolution. If you have any questions, please contact our support team via chat in-app or at help.upserve.com.
Our engineering team has applied a resolution related to syncing issues on the Point of Sale and HQ. All systems at this time should be operational. If you have any questions, please contact our support team via chat in-app or at help.upserve.com.
