Ocrolus 장애 기록

1. 2026년 10월 6일 오후 4:22 UTCidentified

   우리는 EPC 서비스를 포함한 Ocrolus 서비스에 영향을 미치는 Encompass (ICE Mortgage Technology)와 지속적인 문제의 인식입니다. 우리의 팀은 적극적으로 상황을 모니터링하고 더 많은 정보를 제공 할 것입니다

2. 2026년 10월 6일 오후 6:35 UTCidentified

   ICE 팀은 모든 파트너 통합을 복원하는 데 중점을 둡니다. 우리는 진행 상황을 만들고 업데이트 한 번 모든 통합을 복원합니다.

3. 2026년 10월 6일 오후 9:12 UTCresolved

   ICE는 Encompass/EPC 서비스에 영향을 미치는 문제점을 해결했습니다. 우리는 문서 ingestion 및 처리가 일반적으로 작용하는 우리의 끝에서 확인되었습니다. 우리는 모니터를 계속할 것입니다, 그러나 더 이상 충격은 현재 예상되지 않습니다.

공식 인시던트 업데이트를 자동 번역했습니다.

1. 2026년 8월 11일 오전 1:16 UTCinvestigating

   We are currently experiencing delays in Document Verification due to degraded performance affecting our document processing system. Our team is actively investigating the issue and working to restore normal processing times. We will provide further updates as more information becomes available.

2. 2026년 8월 11일 오전 4:20 UTCinvestigating

   The issue causing delays in Document Verification is still ongoing. Our team continues to actively investigate the issue and is working on a fix with highest priority. We will continue to monitor the situation closely and provide further updates as more information becomes available.

3. 2026년 8월 11일 오전 6:13 UTCmonitoring

   We have identified the root cause of the issue and successfully implemented a fix. Document processing has returned to normal, and we are actively working to clear the backlog accumulated during the incident. While the backlog is being processed, customers may continue to experience elevated turnaround times (TAT). Our team is closely monitoring the recovery and prioritizing backlog clearance to restore normal TAT as quickly as possible.

4. 2026년 8월 11일 오후 12:53 UTCresolved

   The backlog has returned to normal levels, and turnaround time (TAT) has been steadily improving. We continue to actively monitor TAT and overall system health.

1. 2026년 7월 30일 오후 4:44 UTCinvestigating

   우리는 현재 Encompass modal이 로딩되지 않은 문제가 있습니다. 초기 분석에 기반한 문제점은 ICE 지원에 의해 확인된 상류 얼음 서비스와 관련이 있습니다. 더 많은 정보로 더 많은 업데이트를 제공할 것입니다.

2. 2026년 7월 30일 오후 5:31 UTCinvestigating

   ICE의 업데이트: 우리의 팀은 우리의 EPC 서비스를 restoring에 집중합니다. 이것은 저희를 위한 절대적인 우선권입니다. 우리는이 서비스를 복원하는 방법을 통해 적극적으로 일하고 있습니다 & 우리는 우리가 계속으로 당신의 인내력을 평가합니다.

3. 2026년 7월 30일 오후 6:18 UTCmonitoring

   업데이트 : 진행은 Encompass Partner Connect order의 처리에 ICE end에서 이루어집니다. 백로그는 가공을 시작하고, 완료된 주문은 신청에서 나타날 것입니다. 전체 백로를 처리하는 것은 시간이 걸릴 것이므로 사용자는 모든 주문이 처리 될 때까지 지연을 경험할 수 있습니다. 우리는 상황을 모니터링하고 더 많은 업데이트를 제공합니다.

4. 2026년 7월 30일 오후 7:13 UTCresolved

   Encompass modal에 가져가는 문제는 해결되었습니다. ICE에서 업데이트를 기반으로 Encompass Partner Connect는 이제 완전히 운영됩니다. 모든 backlog 주문은 현재 처리되고, 새로운 주문은 즉시 처리됩니다. 참고: Encompass Partner Connect를 통해 제출된 주문은 오전 7시 30분 이전에 제출해야 합니다.

공식 인시던트 업데이트를 자동 번역했습니다.

1. 2026년 7월 6일 오후 3:29 UTCinvestigating

   We are currently investigating an issue causing an increased number of document processing failures due to unknown rejections. As a result, some documents may be rejected unexpectedly during processing. Our engineering team is actively working to identify the root cause and restore normal processing. We will provide additional updates as more information becomes available.

2. 2026년 7월 6일 오후 3:29 UTCinvestigating

   We are continuing to investigate this issue.

3. 2026년 7월 6일 오후 3:53 UTCidentified

   Our team has identified the cause of the issue resulting in unknown document rejections and is actively working on a fix.

4. 2026년 7월 6일 오후 4:00 UTCmonitoring

   A fix has been implemented and we are monitoring the results.

5. 2026년 7월 6일 오후 7:30 UTCmonitoring

   Root cause has been fixed and we are currently reprocessing the impacted documents. Our teams are closely monitoring the situation to ensure a complete recovery and maintain system stability throughout the process.

6. 2026년 7월 7일 오전 4:09 UTCresolved

   We continued to monitor the system after the reprocessing to make sure everything was working as expected. The system has now fully recovered, and all Document Processing services are running normally.

1. 2026년 6월 5일 오후 2:28 UTCinvestigating

   We are noticing delays with Encompass interactions, causing degraded performance. We are actively looking into this.

2. 2026년 6월 5일 오후 3:55 UTCmonitoring

   Services are stabilizing and we continue to monitor performance.

3. 2026년 6월 5일 오후 4:13 UTCresolved

   The system has fully recovered, and encompass interactions are now functioning as expected.

1. 2026년 4월 29일 오후 2:51 UTCinvestigating

   We are noticing delays with Encompass interactions, causing delay in custom field updates.  We are actively looking into this.

2. 2026년 4월 29일 오후 3:33 UTCidentified

   We identified the root cause and are applying the necessary fix.

3. 2026년 4월 29일 오후 4:05 UTCmonitoring

   Services are stabilizing following the fix, and we will continue to closely monitor performance.

4. 2026년 4월 29일 오후 5:04 UTCresolved

   The issue has been successfully resolved, and impacted services are now fully operational.

1. 2026년 4월 22일 오후 10:59 UTCinvestigating

   Some customers are currently experiencing delays in document processing and Detect services, which may result in increased turnaround times (TAT) and slower Detect completion for documents. Our team is actively working through the backlog and monitoring the situation closely. We will continue to provide updates as progress is made.

2. 2026년 4월 22일 오후 11:47 UTCmonitoring

   We are continuing to clear the backlog and are actively monitoring the situation.

3. 2026년 4월 23일 오전 1:45 UTCmonitoring

   We have identified the issue impacting the Detect service and are actively monitoring the implemented fix. Our team is working to fully restore normal performance and is currently assessing the timeline for complete recovery. The issue affecting Document Processing has been resolved, and all related backlogs have been successfully cleared.

4. 2026년 4월 23일 오전 5:08 UTCresolved

   The system has fully recovered, and all Detect and Document Processing services are now running smoothly.

1. 2026년 3월 17일 오후 5:30 UTCinvestigating

   Some customers are experiencing a delay in our document processing services. As a result, you may notice an increase in turnaround time (TAT). Our team is actively working through our backlogs, and we’ll keep you updated as we make progress.

2. 2026년 3월 17일 오후 7:44 UTCmonitoring

   We are continuing to clear the backlog and are actively monitoring the situation.

3. 2026년 3월 17일 오후 9:17 UTCresolved

   The backlog has returned to normal levels, and turnaround time (TAT) has been steadily improving. We continue to actively monitor TAT and overall system health.

1. 2026년 1월 29일 오후 7:03 UTCinvestigating

   We are currently experiencing degraded performance with our authentication service that is causing some auth token refresh and Dashboard login requests to fail. API calls with valid non-expired tokens and document processing are unaffected.

2. 2026년 1월 29일 오후 7:11 UTCmonitoring

   The performance of our authentication service has improved after we released a configuration change.

3. 2026년 1월 29일 오후 7:26 UTCresolved

   Our authentication service has returned to normal performance.

1. 2025년 10월 20일 오후 12:57 UTCidentified

   Document processing may be delayed this morning due to ongoing recovery from a cloud provider outage.

2. 2025년 10월 20일 오후 2:57 UTCmonitoring

   We are continuing to monitor the situation as our cloud provider's outage persists. At this time, we are observing only minor, intermittent failures. Our team is actively mitigating any resulting slowness, and document processing remains fully operational and stable.

3. 2025년 10월 20일 오후 5:08 UTCmonitoring

   Our cloud provider's outage is ongoing, but current impact remains limited. We're continuing to apply mitigations and monitor system performance closely. Document processing remains stable, and we’ll provide further updates if conditions change.

4. 2025년 10월 20일 오후 8:44 UTCresolved

   Ocrolus remains fully operational as we continue to monitor the situation and await full service restoration from our cloud provider

1. 2025년 10월 14일 오후 5:24 UTCinvestigating

   We are currently experiencing a delay in our Detect, and you may notice an increase in turnaround time (TAT). Our team is actively investigating the issue, and we’ll keep you updated as we make progress.

2. 2025년 10월 14일 오후 6:08 UTCinvestigating

   We are continuing to investigate this issue.

3. 2025년 10월 14일 오후 6:38 UTCidentified

   We identified the root cause and have applied the necessary fix.

4. 2025년 10월 14일 오후 8:01 UTCmonitoring

   We are currently processing the backlog of messages and are approximately one hour behind. This delay is limited in scope — only a subset of books are affected, while the majority are processing as expected. Our teams continue to monitor the situation closely to ensure full recovery and system stability.

5. 2025년 10월 14일 오후 9:11 UTCresolved

   The system has fully recovered, and all Detect services are now running smoothly.

1. 2025년 10월 10일 오후 3:36 UTCinvestigating

   We are currently experiencing a delay in our document processing services. As a result, you may notice an increase in turnaround time (TAT). Our team is actively investigating the issue, and we’ll keep you updated as we make progress.

2. 2025년 10월 10일 오후 4:37 UTCmonitoring

   We have restored system operation, and we are working through the backlog of documents.

3. 2025년 10월 10일 오후 5:52 UTCresolved

   Our document processing system has fully returned to normal operations. Some documents may still experience delays as we work through the remaining backlog.

1. 2025년 9월 25일 오후 7:59 UTCinvestigating

   We are currently experiencing a delay in our Detect, and you may notice an increase in turnaround time (TAT). Our team is actively investigating the issue, and we’ll keep you updated as we make progress.

2. 2025년 9월 25일 오후 8:33 UTCinvestigating

   We are continuing to investigate this issue.

3. 2025년 9월 25일 오후 9:16 UTCmonitoring

   The regular document processing flow is running smoothly. We are still actively addressing the Detect-related issues, and it may take some time before the backlog is fully cleared.

4. 2025년 9월 25일 오후 10:40 UTCmonitoring

   We are continuing to monitor for any further issues.

5. 2025년 9월 25일 오후 11:01 UTCresolved

   The system has fully recovered, and all Detect services are now running smoothly.

1. 2025년 9월 3일 오후 4:38 UTCinvestigating

   We are noticing delays with Encompass interactions, causing degraded performance. We are actively looking into this.

2. 2025년 9월 3일 오후 4:47 UTCidentified

   We identified the root cause and have applied the necessary fix. Services are stabilizing and we continue to monitor performance.

3. 2025년 9월 3일 오후 4:52 UTCmonitoring

   A fix has been implemented and we are monitoring the results.

4. 2025년 9월 3일 오후 5:17 UTCresolved

   The system has fully recovered, and encompass interactions are now functioning as expected.

1. 2025년 8월 21일 오후 7:48 UTCinvestigating

   We are currently experiencing a delay in our API upload services. We are actively investigating the issue.

2. 2025년 8월 21일 오후 7:59 UTCidentified

   The problem seems to be related to our intake router. We’ve restarted it and are looking into it further.

3. 2025년 8월 21일 오후 8:22 UTCmonitoring

   We haven’t observed any latency in the upload service since it was restarted. We are now monitoring the situation.

4. 2025년 8월 21일 오후 8:53 UTCresolved

   The system has fully recovered and upload API endpoints are now functioning as expected.

1. 2025년 6월 3일 오후 5:21 UTCinvestigating

   We’re currently experiencing an issue where duplicate document files are being placed in the eFolder unexpectedly. The concerned team is already investigating and working on a fix to restore normal functionality as soon as possible

2. 2025년 6월 3일 오후 5:40 UTCinvestigating

   We are continuing to investigate this issue.

3. 2025년 6월 3일 오후 5:42 UTCidentified

   The issue has been identified and we are working on the fix.

4. 2025년 6월 3일 오후 5:59 UTCmonitoring

   The fix has been released, and we're currently monitoring the system to ensure everything is stable.

5. 2025년 6월 3일 오후 6:34 UTCmonitoring

   While keeping an eye on things, we noticed a few more irregularities. The team is already on it and working to sort them out.

6. 2025년 6월 3일 오후 11:15 UTCmonitoring

   We are actively monitoring the system and have started to observe a reduction in duplicate instances. The team continues to work on resolving the issue and restoring the system to normal operations.

7. 2025년 6월 4일 오전 10:46 UTCresolved

   The system has fully recovered and is now functioning as expected.

1. 2025년 5월 14일 오후 9:52 UTCinvestigating

   We are currently experiencing a delay in our document processing services. As a result, you may notice an increase in turnaround time (TAT). Our team is actively investigating the issue, and we’ll keep you updated as we make progress.

2. 2025년 5월 14일 오후 10:53 UTCinvestigating

   We are continuing to investigate this issue.

3. 2025년 5월 14일 오후 11:52 UTCmonitoring

   The system is currently coming back online, and our team is actively working to process the backlog and restore normal operations as quickly as possible.

4. 2025년 5월 15일 오전 2:06 UTCresolved

   System recovery began at 19:52 EDT and the backlog was successfully cleared by 22:02 EDT. Services have returned to normal operation.

1. 2025년 2월 25일 오후 1:31 UTCinvestigating

   We are currently experiencing login issues on the Ocrolus dashboard and API users due to an internal upgrade. Our engineering team is actively investigating the issue and working on a resolution. We will provide updates as soon as we have more information.

2. 2025년 2월 25일 오후 1:38 UTCinvestigating

   We are continuing to investigate this issue.

3. 2025년 2월 25일 오후 2:37 UTCmonitoring

   A fix has been implemented, and system performance is improving. We are actively monitoring the situation to ensure stability.

4. 2025년 2월 25일 오후 3:56 UTCresolved

   Things are looking good since the recent fix. Resolving the incident.

1. 2025년 1월 31일 오전 12:47 UTCinvestigating

   We are seeing an issue with detect responses not coming through that began at approximately 5:30 pm ET. We are investigating the issue and will provide more information as it becomes available.

2. 2025년 1월 31일 오전 1:04 UTCmonitoring

   We have identified the issue and are actively monitoring the solution. Our team is working to restore full service and is currently assessing the time required for full recovery. Additionally, we are focused on clearing the backlog.

3. 2025년 1월 31일 오전 2:22 UTCresolved

   The fix for this issue was successful and Detect service has returned to normal.

1. 2024년 12월 16일 오후 11:17 UTCmonitoring

   The issue has been identified and fixed. Currently, we are monitoring the document processing and clearing the backlogs.

2. 2024년 12월 16일 오후 11:19 UTCmonitoring

   We are continuing to monitor for any further issues.

3. 2024년 12월 16일 오후 11:19 UTCmonitoring

   Due to this issue clients may face high TAT issues

4. 2024년 12월 17일 오전 4:39 UTCresolved

   All of the backlog volume has been processed.