54 recorded Breadcrumb incidents since May 2021, with official updates, affected components, duration and resolution information.
We're experiencing a partial outage affecting the following features: * Guestbook * Magic Quadrant * Repeat Customer Favorites We have identified the cause and are in the process of resolving it.
This incident has been resolved.
We have implemented key fixes to address potential security risks related to PHP vulnerabilities. Our engineering team is closely monitoring system health and will share additional updates as necessary.
This incident has been resolved.
We are currently investigating service disruptions affecting multiple tools, including HQ Reporting access, Workforce integration performance, and Online Ordering (OLO) services. Our engineering teams are actively working to restore full functionality across all impacted areas.
fix has been deployed, and our engineering team is actively monitoring system performance to ensure full stability. We will provide another update once we confirm the issue is fully resolved.
This incident has been resolved.
We are currently investigating service disruptions affecting multiple tools, including HQ Reporting access, Workforce integration performance, and Online Ordering (OLO) services. Our engineering teams are actively working to restore full functionality across all impacted areas.
A fix has been deployed, and our engineering team is actively monitoring system performance to ensure full stability. We will provide another update once we confirm the issue is fully resolved.
This incident has been resolved.
The Upserve Engineering team has identified an issue causing an increase in Online Ordering errors. Our team is investigating the cause and will update once more information is available.
The Upserve engineering team has resolve an issue causing an increase in Online Ordering errors. If you are experiencing any issues with Online Ordering, please contact support.
The Upserve engineering team is aware of an issue affecting Upserve Inventory, including reporting and the inability to edit counts. A fix is in progress, and customers should begin seeing recovery over the next few hours. Until then, customers may continue to experience degraded performance. We'll post another update once the issue is fully resolved.
We believe this incident to be resolved, and the Upserve Inventory system to be working normally at this time. However, the root cause of the incident resulted in inconsistent counts data and missing purchase order updates for some customers during the impacted period. We highly recommend that customers cross-reference supplier-provided invoices for orders received or placed since July 14th. We also recommend performing a fresh count to ensure those values are accurate. If you continue to experience discrepancies after completing these steps, please contact our Support team with relevant details, including the approximate date and time of the expected update and any supporting documentation (such as invoices or screenshots), so we can investigate further.
The Upserve engineering team is aware of an issue affecting Upserve Inventory, including reporting and the inability to edit counts. A fix is in progress, and customers should begin seeing recovery over the next few hours. Until then, customers may continue to experience degraded performance. We'll post another update once the issue is fully resolved.
The issue has been identified and a fix is being implemented.
A fix has been implemented and we are monitoring the results.
This incident has been resolved.
We are currently investigating a major service disruption impacting the availability of our support channels across all products. The issue is related to a widespread outage with AWS US-East-1 (Amazon Web Services), which is affecting key Internet services globally. Customers may experience difficulty reaching support via phone and chat. We are monitoring the external provider and actively working to restore connectivity as quickly as possible. Workaround: Email Support is operational. If you require assistance, please send an email to [email protected]. We sincerely apologize for this disruption and thank you for your patience. We will provide an update as soon as the upstream issue is resolved.
Services have recovered and are now in a monitoring state. While our platform provider (AWS) continues backend work to fully restore their infrastructure, all support contact functionalities are operating normally.
This incident has been resolved.
We’re currently experiencing disruptions to our point of sale system due to an incident with our cloud provider. We will provide additional updates as they become available.
Our cloud provider's engineers are working to mitigate the issue. We have confirmation that services have recovered in some locations. We will continue to provide additional information as they become available.
Our cloud providers have mitigated the issues and expect full recovery in less than an hour. We will continue to provide additional information as it becomes available.
This incident has been resolved.
The U-Series team is aware of an issue with a third-party partner that is currently preventing access to hq.upserve.com. While we await updates from the partner, please use hq.breadcrumb.com or app.upserve.com to access your HQ Back Office. We will share more information as it becomes available. Thank you for your patience.
This incident has been resolved.
Our engineering team has identified a problem affecting a subset of merchants experiencing issues with hq.upserve.com. As a result, your reports may be delayed. We are actively working on a resolution
Our engineering team has applied a fix for the issue causing a subset of merchants to have reporting delay. We have observed merchants return to normal operations. We will continue to monitor this issue before resolving.
Since our last update, we have observed hq.upserve.com’s performance at normal levels and restaurants have returned to normal operation. This incident has been resolved.
The U-Series team is aware of an issue affecting performance for Online Ordering customers. We are actively investigating and will provide an update as soon as we have more information."
This incident has been resolved.
The Lightspeed Restaurant U-Series team is aware of an issue affecting a small number of customers using Mobile Tap readers, which may result in payment deposit delays for some transactions. The U-Series team is actively working on a fix and will ensure that any failed authorizations are captured.
A fix for the payment deposit delay affecting a small number of customers using Mobile Tap readers has been released in version 3.18.2 as of 12/17/24. Please update your terminals to prevent any further disruption to payments. The U-Series team is actively working to capture any failed authorizations caused by this issue.
The U-Series team has attempted the capture of all affected payments caused by the issue impacting customers using Mobile Tap payments. We will continue monitoring and capturing any new affected payments over the next few days. This issue has been permanently resolved in version 3.18.2, which is now available for download on the App Store.
We are currently investigating this issue.
We have observed merchants return to normal operations that had previously been operating in offline mode. We will continue to monitor this issue before resolving. If you have any questions, please contact our support team via chat in-app or at help.upserve.com.
Since our last update, we have observed merchants that had previously reported terminals in offline mode have returned to normal operation, and this incident is resolved. If you have any questions, please contact our support team via chat in-app or at help.upserve.com.
We are experiencing an issue that may cause a delay in reporting for some customers on their HQ Back Office.
We have identified an issue that may cause a delay in reporting for some customers in their HQ Back Office.
A fix has been implemented, and we are monitoring the results. Customers should no longer have delays in reporting on their HQ Back Office.
This incident has been resolved.
Our engineering team is aware of an issue that is causing the Lightspeed U-Series Point of Sale to be non-operational for some merchants. We will update as soon as we have more information.
Our engineering team has identified an issue due to a 3rd party provider that is causing the Lightspeed U-Series Point of Sale to be non-operational for some merchants. We will continue to update as soon as we have more information.
Our engineering team is actively working with our third-party provider to reach a resolution for the service disruption. We will provide updates as soon as additional information becomes available. As a temporary solution, please follow the following steps: 1. Quit the U-Series app 2. Force Offline Mode - Enable airplane mode or turn off wifi 3. Launch the U-Series app 4. Turn airplane mode off or wifi back on This will enable the device to operate in Offline Mode. Operating in Offline Mode permits ongoing business operations, including the collection of credit card payments. Learn more about Offline Mode here: https://help.upserve.com/s/article/Internet-Connectivity-Issues-Android-Tableside
Our engineering team is actively working with our third-party provider to reach a resolution for the service disruption. We will provide updates as soon as additional information becomes available. iOS As a temporary solution, please follow the following steps: 1. Quit the U-Series app 2. Force Offline Mode - Enable airplane mode or turn off wifi 3. Launch the U-Series app 4. Turn airplane mode off or wifi back on Android As a temporary solution, please follow the following steps: 1. Unplug the ethernet cable from ELO terminal or from the wall. 2. Tap the “Try again” button from the error screen. 3. You should see the PIN screen. Pin in as normal. 4. Plug the ethernet cable back in and after a few moments printing capabilities should be functional. This will enable the device to operate in Offline Mode. Operating in Offline Mode permits ongoing business operations, including the collection of credit card payments. Learn more about Offline Mode here: https://help.upserve.com/s/article/Internet-Connectivity-Issues-Android-Tableside
Our engineering team remains actively engaged with our third-party provider to address the service disruption. Updates will be shared as soon as more information becomes available. iOS As a temporary solution, please follow the following steps: 1. Quit the U-Series app 2. Force Offline Mode - Enable airplane mode or turn off wifi 3. Launch the U-Series app 4. Turn airplane mode off or wifi back on Android As a temporary solution, please follow the following steps: 1. Unplug the ethernet cable from the ELO terminal or from the wall. 2. Tap the “Try again” button from the error screen. 3. You should see the PIN screen. Pin in as normal. 4. Plug the ethernet cable back in and after a few moments, printing capabilities should be functional. This will enable the device to operate in Offline Mode. Operating in Offline Mode permits ongoing business operations, including the collection of credit card payments. Learn more about Offline Mode here: https://help.upserve.com/s/article/Internet-Connectivity-Issues-Android-Tableside
Our engineering team has worked with our third-party provider to mitigate an issue causing some merchants to encounter a service disruption. We have observed a gradual recovery with some merchants returning to normal operations that were previously unable to access their Lightspeed U-Series Point of Sale. We will continue to monitor for the full recovery of all merchants before resolving.
Our engineering team has worked with our third-party provider to resolve an incident that caused some merchants to encounter a service disruption. We have observed merchants return to normal operations. We are still working to correct reporting inconsistencies from the outage. We will continue to provide updates on our status page.
Our engineering team has begun successfully capturing delayed payments from the November 15th U-Series Outage. This process will continue throughout the weekend. Note that this work only affects payments and that reporting in HQ will continue to be inconsistent until further investigation can be done into potential recovery for that data. Thank you for your continued patience as this process continues in the coming days. To view the U-Series deposit schedule, please visit https://help.upserve.com/s/article/Deposit-Schedule-with-Upserve-Payments. If you have any questions please reach out via chat at https://help.upserve.com/s/ or via phone at 855-664-3887.
Our engineering team has successfully completed the capturing of all delayed payments from the November 15th U-Series outage. These payments will be deposited on Monday in correlation with the normal deposit schedule. HQ Reports remain inconsistent and our team will now shift focus to reconciling this data next week. To view the U-Series deposit schedule, please visit https://help.upserve.com/s/article/Deposit-Schedule-with-Upserve-Payments. If you have any questions please reach out via chat at https://help.upserve.com/s/ or via phone at 855-664-3887.
Our engineering team is making progress on reconciling delayed reporting data in response to the November 15th U-Series outage. Our focus this week remains on recovering as much of this data as possible. While this occurs, HQ reporting will remain inconsistent. All delayed payments from the outage were captured last week and should have been deposited today in correlation with the normal deposit schedule. To view the U-Series deposit schedule, please visit https://help.upserve.com/s/article/Deposit-Schedule-with-Upserve-Payments. For the best performance, make sure all your terminals are running the latest version of the application available in the app store, if you haven't already done so. If you have any questions please reach out via chat at https://help.upserve.com/s/ or via phone at 855-664-3887.
Our engineering team has successfully completed the reinstatement of all recoverable data in relation to the November 15th Google Cloud Platform outage that affected U-Series customers. These recovery efforts include both payments and HQ reporting. All payments are captured and all information in HQ is up to date. If there are still inconsistencies in your payments or reporting, or if you have any questions, please reach out to support via chat at help.upserve.com or via phone at 855-664-8335.
This incident has been resolved.
We identified an issue causing some customers to have difficulty generating U-Series POS Reports.
We have identified an issue that is causing a very small subset of customers to encounter difficulty when generating U-Series POS Reports.
Our engineering team has implemented a solution to address the issue that was causing challenges for certain merchants in generating U-Series POS Reports. Those merchants who previously faced difficulties in generating U-Series POS reports should now experience a return to regular operation.
There is currently an issue with an upstream Gift Card provider, eCard Systems. Our team is reaching out to eCards for more details. They are aware and working on it currently.
The incident with utilizing Gift Cards, is now fully resolved. You can continue to redeem, check balance, and load Gift Cards. If you have any questions, please contact our support team via chat in-app or at help.upserve.com.
Our engineering team is currently investigating syncing issues and your Point of Sale may be experiencing degraded performance or offline mode. Offline Mode allows you to continue operating and collecting credit card payments. More on offline mode here: https://help.upserve.com/s/article/Offline-Mode-Overview and https://help.upserve.com/s/article/Internet-Connectivity-Issues-Android-Tableside
We are continuing to investigate this issue.
Our engineering team has identified an issue due to a 3rd Party Service causing some merchants to experience syncing issues on the POS & degraded performance or offline mode. Offline Mode allows you to continue operating and collecting credit card payments. More on offline mode here: https://help.upserve.com/s/article/Offline-Mode-Overview & https://help.upserve.com/s/article/Internet-Connectivity-Issues-Android-Tableside.
Since our last update, we have observed merchants that had previously been experiencing syncing issues have returned to normal operation, and this incident is resolved. If you have any questions, please contact our support team via chat in-app or at help.upserve.com
Our engineering team has identified issues with syncing on the Point of Sale and HQ. This may cause degraded performance for loading reports and receiving Online Orders. We're actively working towards a resolution. If you have any questions, please contact our support team via chat in-app or at help.upserve.com.
We are continuing to mitigate syncing issues on the Point of Sale and HQ. This may cause degraded performance for loading reports and receiving Online Orders. We're actively working towards a resolution. If you have any questions, please contact our support team via chat in-app or at help.upserve.com.
Our engineering team has applied a resolution related to syncing issues on the Point of Sale and HQ. All systems at this time should be operational. If you have any questions, please contact our support team via chat in-app or at help.upserve.com.
