Togetherwork 장애 기록

1. 2026년 10월 21일 오후 6:06 UTCinvestigating

   Within the next hour, the Togetherpay application will become unavailable. This outage will affect only the front-end application. The Togetherpay API and payment processing will remain operational. TogetherWork IT expects to restore the application on Monday, October 26. We will provide updates as additional information becomes available and confirm when the application has been restored.

2. 2026년 10월 22일 오후 1:47 UTCresolved

   The Togetherpay application is fully operational. This incident is resolved.

1. 2026년 8월 25일 오후 12:50 UTCinvestigating

   일반 결제 파일, 종합 보고서 및 판매자 결제 파일은 오전 9 시까 지 사용할 수 없습니다. 동부 동부. 우리는 우리가 더 많은 정보를 가지고 있을 때 곧 갱신을 보낼 것입니다.

2. 2026년 8월 25일 오후 3:58 UTCresolved

   모든 일반 결제 파일, 종합 보고서 및 판매자 결제 파일이 이제 사용할 수 있습니다 이 사건은 해결됩니다.

공식 인시던트 업데이트를 자동 번역했습니다.

1. 2026년 5월 29일 오후 2:15 UTCinvestigating

   ProPay is aware of an issue that is preventing some transactions from being processed. They are actively working to resolve the issue. As soon as additional information is known, we will let you know.

2. 2026년 5월 29일 오후 4:52 UTCresolved

   ProPay implemented a fix and transactions are no longer intermittently timing out. A total of 38 transactions were affected between 9:05 a.m.-10:35 a.m. eastern. This incident is resolved.

1. 2026년 5월 1일 오후 12:33 UTCinvestigating

   ProPay has identified an ongoing issue impacting chargebacks. An internal change made late last week caused disruptions that prevented some chargebacks from being initiated. The full scope and impact are still being assessed. ProPay’s teams are actively working to resolve the issue and restore normal processing. We will provide updates as more information becomes available.

2. 2026년 5월 1일 오후 4:09 UTCresolved

   ProPay confirmed the chargeback issue has been resolved. They are still assessing the scope and impact of the issue. We will share additional details as they become available from ProPay.

1. 2026년 4월 22일 오후 12:55 UTCinvestigating

   Regular settlement files, comprehensive reports and merchant settlement files will not be available by 9:00 a.m. eastern this morning. We will send an update as soon as we have more information and when the files are available.

2. 2026년 4월 22일 오후 10:38 UTCmonitoring

   Regular settlement files, comprehensive reports and merchant settlement files are available for all Products except OmegaFi Canada. We are actively working with ProPay to get the final missing reports. We will send an update as soon as we have more information and when the files are available.

3. 2026년 4월 22일 오후 11:23 UTCresolved

   All regular settlement files, comprehensive reports and merchant settlement files are now available. This incident is resolved.

1. 2026년 2월 10일 오후 1:45 UTCinvestigating

   Regular settlement files, comprehensive reports and merchant settlement files will not be available by 9:00 a.m. eastern this morning. We will send an update as soon as we have more information and when the files are available.

2. 2026년 2월 10일 오후 7:00 UTCresolved

   Settlement files, comprehensive reports and merchant settlement files are now available for consumption. This incident is resolved.

1. 2026년 2월 9일 오후 1:47 UTCinvestigating

   Regular settlement files, comprehensive reports and merchant settlement files will not be available by 9:00 a.m. eastern this morning. We will send an update as soon as we have more information and when the files are available.

2. 2026년 2월 9일 오후 3:43 UTCresolved

   Settlement files, comprehensive reports and merchant settlement files are now available for consumption. This incident is resolved.

1. 2025년 12월 11일 오전 12:00 UTCinvestigating

   We are aware of an issue that may impact your ability to process transactions and log in to the Togetherpay application. We are working as quickly as possible to identify the issue. Additional information will be provided when known, or when the situation is resolved.

2. 2025년 12월 11일 오전 1:50 UTCinvestigating

   Teams are still actively working on this issue. They believe they identified the cause and are working to restore service. There is no ETA on the fix at this time. We will provide further updates when more is known.

3. 2025년 12월 11일 오전 2:46 UTCresolved

   Teams implemented a fix and confirmed processing is back to normal. Access to the Togetherpay application is working again as well. This incident is resolved.

4. 2025년 12월 16일 오후 9:45 UTCpostmortem

   An effort to clean up merchant level users in Togetherpay led to the archiving of inactive users - those that had not logged in for over one year and those that have never logged in. Identified user records were archived. This inadvertently broke authentication for Togetherpay merchant API calls, because some of the archived user records were actually merchant API keys. Work to restore the archived users led to additional issues including database connectivity errors and replica host failures. The incident was resolved by reverting the affected user records and fixing database replica configurations. Teams evaluated the sequence of events and implemented steps to prevent such events from happening in the future.

1. 2025년 12월 1일 오후 5:29 UTCinvestigating

   ProPay is aware of an issue that is preventing some transactions from being processed. They are actively working to resolve the issue. As soon as additional information is known, we will let you know.

2. 2025년 12월 1일 오후 6:19 UTCresolved

   The intermittent processing issue was limited to Canadian accounts. A very limited number of transactions were affected between 10:22 a.m. - 12:27 p.m. eastern. ProPay resolved the issue. This incident is resolved.

1. 2025년 11월 24일 오후 5:04 UTCinvestigating

   ProPay is aware of an issue that may impact the ability to process transactions for Canadian merchants. They are actively working to resolve the issue. As soon as additional information is known, we will let you know.

2. 2025년 11월 24일 오후 7:05 UTCidentified

   ProPay has identified the issue and is actively working to implement a fix.

3. 2025년 11월 24일 오후 8:54 UTCresolved

   ProPay has implemented a fix and is will continue to monitor the results. At this time this incident is resolved.

1. 2025년 11월 18일 오후 9:38 UTCinvestigating

   A small percentage of Togetherpay transactions are timing out. ProPay was notified and is looking into the situation. As soon as additional information is known, we will let you know.

2. 2025년 11월 18일 오후 10:47 UTCresolved

   ProPay implemented a fix which appears to have fixed the problem. The last transaction to timeout was at 4:59 p.m. eastern. Processing is back to normal.

1. 2025년 10월 31일 오후 12:48 UTCinvestigating

   Regular settlement files and merchant settlement files will not be available by 9:00 a.m. eastern this morning. Comprehensive reports were delivered by ProPay and are already available. We will send an update as soon as we have more information and when the settlement files are available.

2. 2025년 10월 31일 오후 3:51 UTCresolved

   All regular settlement files and merchant settlement files are now available. This incident is resolved.

1. 2025년 10월 29일 오후 12:40 UTCinvestigating

   Regular settlement files, merchant settlement files, and some comprehensive reports will not be available by 9:00 a.m. eastern this morning. We will send an update as soon as we have more information and when the files are available.

2. 2025년 10월 29일 오후 3:11 UTCresolved

   All regular settlement files, merchant settlement files, and comprehensive reports are now available. This incident is resolved.

1. 2025년 10월 15일 오후 6:33 UTCinvestigating

   We are aware of an issue that is preventing some transactions from processing. We are currently investigating the cause of the issue. We will share more information as it becomes available.

2. 2025년 10월 15일 오후 6:52 UTCidentified

   ProPay is aware of the issue and is working with teams to resolve. It appears processing is back to normal. We will continue to monitor the situation until a permanent resolution is confirmed.

3. 2025년 10월 15일 오후 7:09 UTCmonitoring

   Between 2:00pm and 2:30pm Eastern Time, some transactions timed out due to connectivity issues. ProPay has identified and resolved the issue, and processing has remained stable since.

4. 2025년 10월 15일 오후 7:19 UTCresolved

   Processing has returned to normal. This incident is involved.

1. 2025년 10월 7일 오후 12:57 UTCidentified

   Regular settlement files and merchant settlement were delivered late this morning and will not be ready by 9:00am eastern. Teams are working to consume the files. We will send an update as soon as the files are available.

2. 2025년 10월 7일 오후 1:18 UTCresolved

   All settlement files and merchant settlement files are now available. This incident is resolved.

1. 2025년 9월 20일 오전 11:30 UTCinvestigating

   Regular settlement files, comprehensive reports and merchant settlement files will not be available by 9:00 a.m. eastern this morning. We will send an update as soon as we have more information and when the files are available.

2. 2025년 9월 21일 오전 1:45 UTCinvestigating

   ProPay teams have been trying to restoring service for a data source that provides daily reports but they've run into several unexpected issues. The effort is ongoing. Once the service is restored, ProPay will have to deliver/redeliver affected reports going back to when this issue first started on Friday, 9/19. There is no ETA for the fix at this time. We will continue to keep you updated as we learn more.

3. 2025년 9월 21일 오후 1:22 UTCidentified

   ProPay (Togetherpay) files are still unavailable. Affected dates include Friday (9/19), Saturday (9/20) and today, Sunday (9/21). When ProPay resolves the issue on their end and provides corrected files, work will need to be done to get the reports into Togetherpay. We will keep you updated as more is known.

4. 2025년 9월 21일 오후 5:55 UTCidentified

   ProPay is making progress toward correcting the issues affecting reporting. We are starting to see them deliver corrected reports to their SFTP. Assuming ProPay is able to deliver all missing reports today, work to consume them and deliver Togetherpay files will begin tomorrow, Monday 9/21. We will continue to keep you updated as this incident progresses.

5. 2025년 9월 22일 오후 12:20 UTCidentified

   ProPay corrected the issue causing delayed/incorrect reporting. They delivered new files for Friday (9/19), Saturday (9/20) and Sunday (9/21). Work will begin soon to consume ProPay's files and generate Togetherpay files. Today's files (Monday, 9/22) are ready and available. We will keep you posted as we continue to sort through this issue.

6. 2025년 9월 22일 오후 4:27 UTCidentified

   Togetherwork developers are working to remove incorrect files from 9/19, 9/20 and 9/21. Once removed, the process to consume ProPay's new, corrected files will begin. ETA for completion is unknown at this time. We will provide additional updates as more is known.

7. 2025년 9월 23일 오후 12:11 UTCidentified

   Comprehensive reports, settlement files, and merchant settlement files from the weekend (9/19-9/21) are still not correct in Togetherpay. Teams are still actively working on the clean-up. ETA remains unknown. Files from all other days, including today, are ready and available. We will provide additional updates as more is known.

8. 2025년 9월 24일 오후 3:20 UTCidentified

   The Togetherwork dev team is running into unexpected issues cleaning up/generating 9/19-9/21 files. Work continues to done on the issue with highest priority. ETA is still unknown. We will keep you updated as more information is known.

9. 2025년 9월 25일 오후 12:46 UTCidentified

   Teams are actively running processes to resolve the issue with 9/19-9/21 files. We are hoping to resolve the issue later today. In the meantime, a new, possibly related issue popped with today's files (9/25). The dev team is investigating this latest issue. We will provide another update as soon as we have more information.

10. 2025년 9월 25일 오후 5:09 UTCresolved

    All comprehensive reports, settlement files and merchant settlement files are now available. This includes the ones from this past weekend (9/19-9/21) as well as the ones for today (9/25). NOTE: Because ProPay was delayed in delivering files for 9/19-9/21, many and/or all of the transactions processed on those days appear in the 9/22 comprehensive report. This incident is resolved.

1. 2025년 9월 19일 오후 12:49 UTCinvestigating

   Regular settlement files, comprehensive reports and merchant settlement files will not be available by 9:00 a.m. eastern this morning. We will send an update as soon as we have more information and when the files are available.

2. 2025년 9월 19일 오후 4:27 UTCidentified

   ProPay identified the issue on their end. They are working on a fix. We will send another update when we have more information or when the files are available.

3. 2025년 9월 19일 오후 5:19 UTCidentified

   ProPay continues to work on a fix for this issue.

4. 2025년 9월 19일 오후 7:22 UTCidentified

   ProPay is still working on a fix. The issue was escalated to multiple teams. We will send another update when we have more information or when the files are available.

5. 2025년 9월 19일 오후 8:50 UTCidentified

   ProPay's issue is related to their database which they are working to restore. Today's files will not be delivered today. At the earliest, they will be delivered tomorrow, Saturday, 9/20. It is likely the delayed files will be processed by Togetherwork on Monday, 9/22. We will keep you posted as additional information is shared with our team.

6. 2025년 9월 20일 오전 3:12 UTCresolved

   All comprehensive reports, settlement files and merchant settlement files are now available. This incident is resolved.

1. 2025년 9월 10일 오후 6:54 UTCinvestigating

   ProPay reported the following: "An issue has been identified impacting ProPay Canada Direct credit card and refund transactions. Since 8/26/25, refund transactions have not processed successfully and credit card transactions have not been fully settled and posted to cardholder accounts. This has resulted in refund settlement reject transactions and cardholders seeing funds returned for transactions that should have completed. Our teams are working to implement a fix to address this issue and restore service. Cardholders seeing unexpected return of funds should not attempt to re-process their transactions; when the issue is fixed, transactions will post to cardholder accounts as previously expected. We will provide additional updates once the changes are implemented." We will send an update as soon as we have more information from ProPay.

2. 2025년 9월 10일 오후 8:03 UTCmonitoring

   ProPay provided the following update: "A fix has been implemented for the credit card transactions and we are monitoring the behavior of the processing of the settlement transactions. We are still working on some additional steps that are required to address processing the refunds." We will send another update when we receive more information from ProPay.

3. 2025년 9월 11일 오후 12:40 UTCresolved

   According to ProPay, missed Canadian refunds have been processed. This incident is resolved.

1. 2025년 7월 14일 오후 5:41 UTCmonitoring

   Both sandbox and integration are currently unavailable. ProPay informed us they will be down until they are able to apply necessary security updates - ETA unknown. As soon as we have more information and/or when the environments are back up and running, we will let you know.

2. 2025년 7월 14일 오후 7:22 UTCresolved

   ProPay concluded their maintenance - both sandbox and integration are now available. This incident is resolved.

1. 2025년 7월 11일 오후 4:38 UTCidentified

   ProPay informed us that 7/9/2025 ACH Payment transactions were delayed in being submitted to NACHA. The effect of this delay is that some ACH payments made on 7/8 and 7/9 were not debited from payer's bank accounts yesterday (7/10), and will be debited today (7/11). Merchants were already funded for the proceeds of the ACH Payment transactions, but may receive inquiries from payers whose funds were not debited as expected.

2. 2025년 7월 11일 오후 4:39 UTCresolved

   This incident has been resolved.