54 Breadcrumb incidents · май 2021 г. — official updates, affected components, duration and resolution details.
Мы испытываем частичное отключение, влияющее на следующие функции: * Гостевая книга Магический квадрант * Повторите любимые клиенты Мы определили причину и находимся в процессе ее устранения.
Этот инцидент был урегулирован.
Автоматический перевод официального обновления инцидента.
We have implemented key fixes to address potential security risks related to PHP vulnerabilities. Our engineering team is closely monitoring system health and will share additional updates as necessary.
This incident has been resolved.
В настоящее время мы расследуем сбои в обслуживании, затрагивающие несколько инструментов, включая доступ к отчетности штаб-квартиры, производительность интеграции рабочей силы и услуги онлайн-заказа (OLO). Наши инженерные команды активно работают над восстановлением полной функциональности во всех пострадавших районах.
ремонт был развернут, и наша команда инженеров активно отслеживает производительность системы для обеспечения полной стабильности. Мы предоставим еще одно обновление, как только подтвердим, что проблема полностью решена.
Этот инцидент был урегулирован.
Автоматический перевод официального обновления инцидента.
В настоящее время мы расследуем сбои в обслуживании, затрагивающие несколько инструментов, включая доступ к отчетности штаб-квартиры, производительность интеграции рабочей силы и услуги онлайн-заказа (OLO). Наши инженерные команды активно работают над восстановлением полной функциональности во всех пострадавших районах.
Было проведено исправление, и наша команда инженеров активно отслеживает производительность системы для обеспечения полной стабильности. Мы предоставим еще одно обновление, как только подтвердим, что проблема полностью решена.
Этот инцидент был урегулирован.
Автоматический перевод официального обновления инцидента.
Команда Upserve Engineering выявила проблему, вызывающую увеличение ошибок онлайн-заказа. Наша команда расследует причину и обновит еще одну информацию.
Инженерная команда Upserve решила проблему, вызвавшую увеличение ошибок онлайн-заказа. Если у вас возникли проблемы с онлайн-заказом, пожалуйста, обратитесь в службу поддержки.
Автоматический перевод официального обновления инцидента.
Инженерная команда Upserve знает о проблеме, затрагивающей инвентаризацию Upserve, включая отчетность и невозможность редактирования подсчетов. Ремонт продолжается, и клиенты должны начать восстановление в течение следующих нескольких часов. До тех пор клиенты могут продолжать испытывать ухудшение производительности. Мы опубликуем еще одно обновление, как только проблема будет полностью решена.
Мы считаем, что этот инцидент будет урегулирован, и система инвентаризации резерва будет работать нормально в это время. Однако первопричина инцидента привела к непоследовательным подсчетам данных и отсутствию обновлений заказов на покупку для некоторых клиентов в течение затронутого периода. Мы настоятельно рекомендуем клиентам предоставлять перекрестные счета-фактуры поставщиков для заказов, полученных или размещенных с 14 июля. Мы также рекомендуем выполнить новый подсчет, чтобы убедиться, что эти значения точны. Если вы продолжаете испытывать несоответствия после выполнения этих шагов, пожалуйста, свяжитесь с нашей службой поддержки с соответствующими деталями, включая приблизительную дату и время ожидаемого обновления и любую вспомогательную документацию (например, счета-фактуры или скриншоты), чтобы мы могли продолжить расследование.
Автоматический перевод официального обновления инцидента.
Инженерная команда Upserve знает о проблеме, затрагивающей инвентаризацию Upserve, включая отчетность и невозможность редактирования подсчетов. Ремонт продолжается, и клиенты должны начать восстановление в течение следующих нескольких часов. До тех пор клиенты могут продолжать испытывать ухудшение производительности. Мы опубликуем еще одно обновление, как только проблема будет полностью решена.
Этот вопрос был определен, и в настоящее время осуществляется исправление.
Реализовано исправление, и мы отслеживаем результаты.
Этот инцидент был урегулирован.
Автоматический перевод официального обновления инцидента.
We are currently investigating a major service disruption impacting the availability of our support channels across all products. The issue is related to a widespread outage with AWS US-East-1 (Amazon Web Services), which is affecting key Internet services globally. Customers may experience difficulty reaching support via phone and chat. We are monitoring the external provider and actively working to restore connectivity as quickly as possible. Workaround: Email Support is operational. If you require assistance, please send an email to [email protected]. We sincerely apologize for this disruption and thank you for your patience. We will provide an update as soon as the upstream issue is resolved.
Services have recovered and are now in a monitoring state. While our platform provider (AWS) continues backend work to fully restore their infrastructure, all support contact functionalities are operating normally.
This incident has been resolved.
We’re currently experiencing disruptions to our point of sale system due to an incident with our cloud provider. We will provide additional updates as they become available.
Our cloud provider's engineers are working to mitigate the issue. We have confirmation that services have recovered in some locations. We will continue to provide additional information as they become available.
Our cloud providers have mitigated the issues and expect full recovery in less than an hour. We will continue to provide additional information as it becomes available.
This incident has been resolved.
The U-Series team is aware of an issue with a third-party partner that is currently preventing access to hq.upserve.com. While we await updates from the partner, please use hq.breadcrumb.com or app.upserve.com to access your HQ Back Office. We will share more information as it becomes available. Thank you for your patience.
This incident has been resolved.
Our engineering team has identified a problem affecting a subset of merchants experiencing issues with hq.upserve.com. As a result, your reports may be delayed. We are actively working on a resolution
Our engineering team has applied a fix for the issue causing a subset of merchants to have reporting delay. We have observed merchants return to normal operations. We will continue to monitor this issue before resolving.
Since our last update, we have observed hq.upserve.com’s performance at normal levels and restaurants have returned to normal operation. This incident has been resolved.
The U-Series team is aware of an issue affecting performance for Online Ordering customers. We are actively investigating and will provide an update as soon as we have more information."
This incident has been resolved.
The Lightspeed Restaurant U-Series team is aware of an issue affecting a small number of customers using Mobile Tap readers, which may result in payment deposit delays for some transactions. The U-Series team is actively working on a fix and will ensure that any failed authorizations are captured.
A fix for the payment deposit delay affecting a small number of customers using Mobile Tap readers has been released in version 3.18.2 as of 12/17/24. Please update your terminals to prevent any further disruption to payments. The U-Series team is actively working to capture any failed authorizations caused by this issue.
The U-Series team has attempted the capture of all affected payments caused by the issue impacting customers using Mobile Tap payments. We will continue monitoring and capturing any new affected payments over the next few days. This issue has been permanently resolved in version 3.18.2, which is now available for download on the App Store.
We are currently investigating this issue.
We have observed merchants return to normal operations that had previously been operating in offline mode. We will continue to monitor this issue before resolving. If you have any questions, please contact our support team via chat in-app or at help.upserve.com.
Since our last update, we have observed merchants that had previously reported terminals in offline mode have returned to normal operation, and this incident is resolved. If you have any questions, please contact our support team via chat in-app or at help.upserve.com.
We are experiencing an issue that may cause a delay in reporting for some customers on their HQ Back Office.
We have identified an issue that may cause a delay in reporting for some customers in their HQ Back Office.
A fix has been implemented, and we are monitoring the results. Customers should no longer have delays in reporting on their HQ Back Office.
This incident has been resolved.
Our engineering team is aware of an issue that is causing the Lightspeed U-Series Point of Sale to be non-operational for some merchants. We will update as soon as we have more information.
Our engineering team has identified an issue due to a 3rd party provider that is causing the Lightspeed U-Series Point of Sale to be non-operational for some merchants. We will continue to update as soon as we have more information.
Our engineering team is actively working with our third-party provider to reach a resolution for the service disruption. We will provide updates as soon as additional information becomes available. As a temporary solution, please follow the following steps: 1. Quit the U-Series app 2. Force Offline Mode - Enable airplane mode or turn off wifi 3. Launch the U-Series app 4. Turn airplane mode off or wifi back on This will enable the device to operate in Offline Mode. Operating in Offline Mode permits ongoing business operations, including the collection of credit card payments. Learn more about Offline Mode here: https://help.upserve.com/s/article/Internet-Connectivity-Issues-Android-Tableside
Our engineering team is actively working with our third-party provider to reach a resolution for the service disruption. We will provide updates as soon as additional information becomes available. iOS As a temporary solution, please follow the following steps: 1. Quit the U-Series app 2. Force Offline Mode - Enable airplane mode or turn off wifi 3. Launch the U-Series app 4. Turn airplane mode off or wifi back on Android As a temporary solution, please follow the following steps: 1. Unplug the ethernet cable from ELO terminal or from the wall. 2. Tap the “Try again” button from the error screen. 3. You should see the PIN screen. Pin in as normal. 4. Plug the ethernet cable back in and after a few moments printing capabilities should be functional. This will enable the device to operate in Offline Mode. Operating in Offline Mode permits ongoing business operations, including the collection of credit card payments. Learn more about Offline Mode here: https://help.upserve.com/s/article/Internet-Connectivity-Issues-Android-Tableside
Our engineering team remains actively engaged with our third-party provider to address the service disruption. Updates will be shared as soon as more information becomes available. iOS As a temporary solution, please follow the following steps: 1. Quit the U-Series app 2. Force Offline Mode - Enable airplane mode or turn off wifi 3. Launch the U-Series app 4. Turn airplane mode off or wifi back on Android As a temporary solution, please follow the following steps: 1. Unplug the ethernet cable from the ELO terminal or from the wall. 2. Tap the “Try again” button from the error screen. 3. You should see the PIN screen. Pin in as normal. 4. Plug the ethernet cable back in and after a few moments, printing capabilities should be functional. This will enable the device to operate in Offline Mode. Operating in Offline Mode permits ongoing business operations, including the collection of credit card payments. Learn more about Offline Mode here: https://help.upserve.com/s/article/Internet-Connectivity-Issues-Android-Tableside
Our engineering team has worked with our third-party provider to mitigate an issue causing some merchants to encounter a service disruption. We have observed a gradual recovery with some merchants returning to normal operations that were previously unable to access their Lightspeed U-Series Point of Sale. We will continue to monitor for the full recovery of all merchants before resolving.
Our engineering team has worked with our third-party provider to resolve an incident that caused some merchants to encounter a service disruption. We have observed merchants return to normal operations. We are still working to correct reporting inconsistencies from the outage. We will continue to provide updates on our status page.
Our engineering team has begun successfully capturing delayed payments from the November 15th U-Series Outage. This process will continue throughout the weekend. Note that this work only affects payments and that reporting in HQ will continue to be inconsistent until further investigation can be done into potential recovery for that data. Thank you for your continued patience as this process continues in the coming days. To view the U-Series deposit schedule, please visit https://help.upserve.com/s/article/Deposit-Schedule-with-Upserve-Payments. If you have any questions please reach out via chat at https://help.upserve.com/s/ or via phone at 855-664-3887.
Our engineering team has successfully completed the capturing of all delayed payments from the November 15th U-Series outage. These payments will be deposited on Monday in correlation with the normal deposit schedule. HQ Reports remain inconsistent and our team will now shift focus to reconciling this data next week. To view the U-Series deposit schedule, please visit https://help.upserve.com/s/article/Deposit-Schedule-with-Upserve-Payments. If you have any questions please reach out via chat at https://help.upserve.com/s/ or via phone at 855-664-3887.
Our engineering team is making progress on reconciling delayed reporting data in response to the November 15th U-Series outage. Our focus this week remains on recovering as much of this data as possible. While this occurs, HQ reporting will remain inconsistent. All delayed payments from the outage were captured last week and should have been deposited today in correlation with the normal deposit schedule. To view the U-Series deposit schedule, please visit https://help.upserve.com/s/article/Deposit-Schedule-with-Upserve-Payments. For the best performance, make sure all your terminals are running the latest version of the application available in the app store, if you haven't already done so. If you have any questions please reach out via chat at https://help.upserve.com/s/ or via phone at 855-664-3887.
Our engineering team has successfully completed the reinstatement of all recoverable data in relation to the November 15th Google Cloud Platform outage that affected U-Series customers. These recovery efforts include both payments and HQ reporting. All payments are captured and all information in HQ is up to date. If there are still inconsistencies in your payments or reporting, or if you have any questions, please reach out to support via chat at help.upserve.com or via phone at 855-664-8335.
This incident has been resolved.
We identified an issue causing some customers to have difficulty generating U-Series POS Reports.
We have identified an issue that is causing a very small subset of customers to encounter difficulty when generating U-Series POS Reports.
Our engineering team has implemented a solution to address the issue that was causing challenges for certain merchants in generating U-Series POS Reports. Those merchants who previously faced difficulties in generating U-Series POS reports should now experience a return to regular operation.
There is currently an issue with an upstream Gift Card provider, eCard Systems. Our team is reaching out to eCards for more details. They are aware and working on it currently.
The incident with utilizing Gift Cards, is now fully resolved. You can continue to redeem, check balance, and load Gift Cards. If you have any questions, please contact our support team via chat in-app or at help.upserve.com.
Our engineering team is currently investigating syncing issues and your Point of Sale may be experiencing degraded performance or offline mode. Offline Mode allows you to continue operating and collecting credit card payments. More on offline mode here: https://help.upserve.com/s/article/Offline-Mode-Overview and https://help.upserve.com/s/article/Internet-Connectivity-Issues-Android-Tableside
We are continuing to investigate this issue.
Our engineering team has identified an issue due to a 3rd Party Service causing some merchants to experience syncing issues on the POS & degraded performance or offline mode. Offline Mode allows you to continue operating and collecting credit card payments. More on offline mode here: https://help.upserve.com/s/article/Offline-Mode-Overview & https://help.upserve.com/s/article/Internet-Connectivity-Issues-Android-Tableside.
Since our last update, we have observed merchants that had previously been experiencing syncing issues have returned to normal operation, and this incident is resolved. If you have any questions, please contact our support team via chat in-app or at help.upserve.com
Our engineering team has identified issues with syncing on the Point of Sale and HQ. This may cause degraded performance for loading reports and receiving Online Orders. We're actively working towards a resolution. If you have any questions, please contact our support team via chat in-app or at help.upserve.com.
We are continuing to mitigate syncing issues on the Point of Sale and HQ. This may cause degraded performance for loading reports and receiving Online Orders. We're actively working towards a resolution. If you have any questions, please contact our support team via chat in-app or at help.upserve.com.
Our engineering team has applied a resolution related to syncing issues on the Point of Sale and HQ. All systems at this time should be operational. If you have any questions, please contact our support team via chat in-app or at help.upserve.com.
