62 Lob incidents · 2023年8月 — official updates, affected components, duration and resolution details.
現在、ユーザーのログインに影響を及ぼす問題について調査しています。 一部のユーザーは、ログインしようとするとエラーが発生することがあります。 私たちのチームは、根本的な原因を特定し、正常な機能を回復するために積極的に取り組んでいます.
現在、ログインに影響を及ぼす問題について調査しています。 一部のユーザーは、ログインしようとするとエラーが発生することがあります。 影響を受けた場合、ログインページからパスワードをリセットすると、アクセスを復元します。 他のサイトではご利用いただけないパスワードを選択してください。 当社のチームは、通常の機能の復元に積極的に取り組んでおり、より多くの情報が利用できるようにアップデートを提供します.
公式のインシデント更新を自動翻訳しています。
We are currently seeing an elevated error rate on the /v1/bulk/us_verifications endpoint. Our team is actively investigating and we will post an update as soon as we have more information.
We applied a patch and the elevated error rate on the /v1/bulk/us_verifications endpoint has resolved. Our team is continuing to actively monitor.
This incident has been resolved.
We are currently experiencing an issue affecting ingestion of USPS tracking events. All tracking events will be delayed until this issue is resolved and the backlog of data is processed. Our team is aware of the issue and actively implementing a fix.
We've resolved the issue that prevented ingestion of USPS tracking events. USPS has sent us a backfill file, and we are currently processing the skipped events. Customers should see all tracking events caught up by the end of business today.
This incident has been resolved.
Lob API で 500 のエラーが発生している問題が解決しました。 今後もシステムを監視し、安定した状態を確保します.
エラーが発生する問題 Lob API が解決しました.
公式のインシデント更新を自動翻訳しています。
We're experiencing a temporary issue across our system due to an external service outage. We're actively working on resolving this issue
The external service is gradually recovering and we're now actively monitoring the recovery
The external service has been resolved and all our systems are operational
We are currently experiencing an issue affecting some export creation and are actively working to resolve it.
The issue affecting some export requests has been resolved, and processing has returned to normal.
We are currently investigating an issue affecting HTML templates. Users may encounter errors when proofing HTML templates or when sending mailpieces that use an HTML creative. Our team is actively working to identify the root cause and restore normal functionality. We will provide updates as more information becomes available.
We are currently investigating an issue affecting HTML templates. Users may encounter errors when proofing HTML templates or when sending mailpieces that use an HTML creative. Our team is actively working to identify the root cause and restore normal functionality. We will provide updates as more information becomes available.
The issue causing errors in proofing HTML has been resolved, and processing has returned to normal. We will continue to monitor the system to ensure it remains stable.
We are currently experiencing elevated rendering times, which may cause delays in processing some requests. Our team is investigating the issue and will provide updates as more information becomes available.
The issue causing elevated rendering times has been resolved, and processing has returned to normal. We will continue to monitor the system to ensure it remains stable.
We experienced a temporary issue with our international address verification service this evening that caused some requests to fail. The issue has been resolved and the service is operating normally.
We experienced a temporary issue with our international address verification service this evening that caused some requests to fail. The issue has been resolved and the service is operating normally
Our endpoint/service is currently experiencing an outage. As a result, users may be experiencing errors, degraded performance, or inability to access certain features. Our team has identified the issue and is actively investigating the root cause.
The issue has resolved and API endpoints resolve as expected.
We identified an issue causing some API endpoints to incorrectly return 401 Unauthorized responses. This has been resolved and all endpoints are functioning as expected. impact from the issue is over.
We identified an issue causing some API endpoints to incorrectly return 401 Unauthorized responses. This has been resolved and all endpoints are functioning as expected.
Customers may have experienced a temporary outage related to creating letters and obtaining information about previously created letters. The root cause has been identified and the issue resolved.
We've spotted that something has gone wrong. We're currently investigating the issue, and will provide an update soon.
We are aware of an issue affecting customers attempting to verify bank accounts with micro deposits through the Lob dashboard or API. We are investigating and working on a resolution. We apologize for the inconvenience and will provide an update as soon as we have more information.
We have implemented a mitigation that restores bank account verification for sending Checks. New bank account verification should now work as expected. If you created a bank account within the last 7 days and are still unable to complete verification, please reach out to our support team at [email protected] or visit https://help.lob.com/resources/getting-support for additional contact options. We will be providing an update in the coming week about longer-term changes to bank account verification, before they take effect. We apologize for any disruption this caused.
We think the impact from the issue is over.
Our rendering system is experiencing delays so proofs and thumbnails may lake longer than expected to appear in the dashboard. We have identified the issue and are actively working on a fix
Issue seem to be resolved. We are monitoring.
This incident has been resolved.
Our rendering system is experiencing delays so proofs and thumbnails may lake longer than expected to appear in the dashboard. We have identified the issue and are actively working on a fix
Our rendering system is back to being fully operational without any delays. Issue is resolved.
We've spotted that something has gone wrong. We're currently investigating the issue, and will provide an update soon.
We've spotted that something has gone wrong. We're currently investigating the issue, and will provide an update soon.
Our rendering system is experiencing delays so proofs and thumbnails may lake longer than expected to appear in the dashboard, we have identified the issue and are actively fixing it
All systems are operating normally. Issue is resolved.
We are currently experiencing an issue affecting new account registration on the Dashboard. Some users may be unable to create a new account at this time. Our team is aware of the issue and is actively investigating and implementing a fix.
The issue affecting new account registrations on the Dashboard has been resolved. Users should now be able to successfully create new accounts. We will continue to monitor the system to ensure stability.
Our data processing infrastructure is running behind which is causing inaccuracies in the reporting tools. Lob's QR Code Engagement visualizations in the "Mail Analytics" and "Campaigns" sections of the dashboard are missing some data that was created between Monday, March 16 and today, March 24. Only the data processing system was impacted - no original QR code scan data has been lost. Customers can still access this data if they make a GET call to Lob's APIs, or if they have webhook ingestion already set up. We've identified the issue and are actively backfilling the QR Code Engagement Chart with the missing records. We anticipate completing this backfill no later than tomorrow morning - Wednesday, March 25.
Our data processing infrastructure is running behind which is causing inaccuracies in the reporting tools. Lob's QR Code Engagement visualizations in the "Mail Analytics" and "Campaigns" sections of the dashboard are missing some data that was created between Monday, March 16 and Tuesday, March 24. Only the data processing system was impacted - no original QR code scan data has been lost. Customers can still access this data if they make a GET call to Lob's APIs, or if they have webhook ingestion already set up. We've identified the issue and new scan events are now visible in the QR Code Engagement Chart. We are actively backfilling scans from the outage period that are missing from the chart. We've updated our anticipated date of resolution for completing this backfill - this should be complete no later than the evening of Friday, March 27.
Backfills are complete. Additionally, Lob's engineering team has put improvements in place to prevent similar issues in the future, and updated our monitoring and alerting to catch similar issues if they do recur. Please reach out to [email protected] if you are still experiencing issues!