51 Togetherwork incidents · 2023年8月 — official updates, affected components, duration and resolution details.
定時決済ファイル、総合レポート、商取引決済ファイルは午前9時～午後8時の間は利用できません。 より詳しい情報やファイルが利用可能になったらただちにアップデートをお送りします.
定期的な決済ファイル、包括的なレポート、マーチャント決済ファイルが利用可能になりました この事件は解決しました.
公式のインシデント更新を自動翻訳しています。
ProPay is aware of an issue that is preventing some transactions from being processed. They are actively working to resolve the issue. As soon as additional information is known, we will let you know.
ProPay implemented a fix and transactions are no longer intermittently timing out. A total of 38 transactions were affected between 9:05 a.m.-10:35 a.m. eastern. This incident is resolved.
ProPay has identified an ongoing issue impacting chargebacks. An internal change made late last week caused disruptions that prevented some chargebacks from being initiated. The full scope and impact are still being assessed. ProPay’s teams are actively working to resolve the issue and restore normal processing. We will provide updates as more information becomes available.
ProPay confirmed the chargeback issue has been resolved. They are still assessing the scope and impact of the issue. We will share additional details as they become available from ProPay.
Regular settlement files, comprehensive reports and merchant settlement files will not be available by 9:00 a.m. eastern this morning. We will send an update as soon as we have more information and when the files are available.
Regular settlement files, comprehensive reports and merchant settlement files are available for all Products except OmegaFi Canada. We are actively working with ProPay to get the final missing reports. We will send an update as soon as we have more information and when the files are available.
All regular settlement files, comprehensive reports and merchant settlement files are now available. This incident is resolved.
Regular settlement files, comprehensive reports and merchant settlement files will not be available by 9:00 a.m. eastern this morning. We will send an update as soon as we have more information and when the files are available.
Settlement files, comprehensive reports and merchant settlement files are now available for consumption. This incident is resolved.
Regular settlement files, comprehensive reports and merchant settlement files will not be available by 9:00 a.m. eastern this morning. We will send an update as soon as we have more information and when the files are available.
Settlement files, comprehensive reports and merchant settlement files are now available for consumption. This incident is resolved.
We are aware of an issue that may impact your ability to process transactions and log in to the Togetherpay application. We are working as quickly as possible to identify the issue. Additional information will be provided when known, or when the situation is resolved.
Teams are still actively working on this issue. They believe they identified the cause and are working to restore service. There is no ETA on the fix at this time. We will provide further updates when more is known.
Teams implemented a fix and confirmed processing is back to normal. Access to the Togetherpay application is working again as well. This incident is resolved.
An effort to clean up merchant level users in Togetherpay led to the archiving of inactive users - those that had not logged in for over one year and those that have never logged in. Identified user records were archived. This inadvertently broke authentication for Togetherpay merchant API calls, because some of the archived user records were actually merchant API keys. Work to restore the archived users led to additional issues including database connectivity errors and replica host failures. The incident was resolved by reverting the affected user records and fixing database replica configurations. Teams evaluated the sequence of events and implemented steps to prevent such events from happening in the future.
ProPay is aware of an issue that is preventing some transactions from being processed. They are actively working to resolve the issue. As soon as additional information is known, we will let you know.
The intermittent processing issue was limited to Canadian accounts. A very limited number of transactions were affected between 10:22 a.m. - 12:27 p.m. eastern. ProPay resolved the issue. This incident is resolved.
ProPay is aware of an issue that may impact the ability to process transactions for Canadian merchants. They are actively working to resolve the issue. As soon as additional information is known, we will let you know.
ProPay has identified the issue and is actively working to implement a fix.
ProPay has implemented a fix and is will continue to monitor the results. At this time this incident is resolved.
A small percentage of Togetherpay transactions are timing out. ProPay was notified and is looking into the situation. As soon as additional information is known, we will let you know.
ProPay implemented a fix which appears to have fixed the problem. The last transaction to timeout was at 4:59 p.m. eastern. Processing is back to normal.
Regular settlement files and merchant settlement files will not be available by 9:00 a.m. eastern this morning. Comprehensive reports were delivered by ProPay and are already available. We will send an update as soon as we have more information and when the settlement files are available.
All regular settlement files and merchant settlement files are now available. This incident is resolved.
Regular settlement files, merchant settlement files, and some comprehensive reports will not be available by 9:00 a.m. eastern this morning. We will send an update as soon as we have more information and when the files are available.
All regular settlement files, merchant settlement files, and comprehensive reports are now available. This incident is resolved.
We are aware of an issue that is preventing some transactions from processing. We are currently investigating the cause of the issue. We will share more information as it becomes available.
ProPay is aware of the issue and is working with teams to resolve. It appears processing is back to normal. We will continue to monitor the situation until a permanent resolution is confirmed.
Between 2:00pm and 2:30pm Eastern Time, some transactions timed out due to connectivity issues. ProPay has identified and resolved the issue, and processing has remained stable since.
Processing has returned to normal. This incident is involved.
Regular settlement files and merchant settlement were delivered late this morning and will not be ready by 9:00am eastern. Teams are working to consume the files. We will send an update as soon as the files are available.
All settlement files and merchant settlement files are now available. This incident is resolved.
Regular settlement files, comprehensive reports and merchant settlement files will not be available by 9:00 a.m. eastern this morning. We will send an update as soon as we have more information and when the files are available.
ProPay teams have been trying to restoring service for a data source that provides daily reports but they've run into several unexpected issues. The effort is ongoing. Once the service is restored, ProPay will have to deliver/redeliver affected reports going back to when this issue first started on Friday, 9/19. There is no ETA for the fix at this time. We will continue to keep you updated as we learn more.
ProPay (Togetherpay) files are still unavailable. Affected dates include Friday (9/19), Saturday (9/20) and today, Sunday (9/21). When ProPay resolves the issue on their end and provides corrected files, work will need to be done to get the reports into Togetherpay. We will keep you updated as more is known.
ProPay is making progress toward correcting the issues affecting reporting. We are starting to see them deliver corrected reports to their SFTP. Assuming ProPay is able to deliver all missing reports today, work to consume them and deliver Togetherpay files will begin tomorrow, Monday 9/21. We will continue to keep you updated as this incident progresses.
ProPay corrected the issue causing delayed/incorrect reporting. They delivered new files for Friday (9/19), Saturday (9/20) and Sunday (9/21). Work will begin soon to consume ProPay's files and generate Togetherpay files. Today's files (Monday, 9/22) are ready and available. We will keep you posted as we continue to sort through this issue.
Togetherwork developers are working to remove incorrect files from 9/19, 9/20 and 9/21. Once removed, the process to consume ProPay's new, corrected files will begin. ETA for completion is unknown at this time. We will provide additional updates as more is known.
Comprehensive reports, settlement files, and merchant settlement files from the weekend (9/19-9/21) are still not correct in Togetherpay. Teams are still actively working on the clean-up. ETA remains unknown. Files from all other days, including today, are ready and available. We will provide additional updates as more is known.
The Togetherwork dev team is running into unexpected issues cleaning up/generating 9/19-9/21 files. Work continues to done on the issue with highest priority. ETA is still unknown. We will keep you updated as more information is known.
Teams are actively running processes to resolve the issue with 9/19-9/21 files. We are hoping to resolve the issue later today. In the meantime, a new, possibly related issue popped with today's files (9/25). The dev team is investigating this latest issue. We will provide another update as soon as we have more information.
All comprehensive reports, settlement files and merchant settlement files are now available. This includes the ones from this past weekend (9/19-9/21) as well as the ones for today (9/25). NOTE: Because ProPay was delayed in delivering files for 9/19-9/21, many and/or all of the transactions processed on those days appear in the 9/22 comprehensive report. This incident is resolved.
Regular settlement files, comprehensive reports and merchant settlement files will not be available by 9:00 a.m. eastern this morning. We will send an update as soon as we have more information and when the files are available.
ProPay identified the issue on their end. They are working on a fix. We will send another update when we have more information or when the files are available.
ProPay continues to work on a fix for this issue.
ProPay is still working on a fix. The issue was escalated to multiple teams. We will send another update when we have more information or when the files are available.
ProPay's issue is related to their database which they are working to restore. Today's files will not be delivered today. At the earliest, they will be delivered tomorrow, Saturday, 9/20. It is likely the delayed files will be processed by Togetherwork on Monday, 9/22. We will keep you posted as additional information is shared with our team.
All comprehensive reports, settlement files and merchant settlement files are now available. This incident is resolved.
ProPay reported the following: "An issue has been identified impacting ProPay Canada Direct credit card and refund transactions. Since 8/26/25, refund transactions have not processed successfully and credit card transactions have not been fully settled and posted to cardholder accounts. This has resulted in refund settlement reject transactions and cardholders seeing funds returned for transactions that should have completed. Our teams are working to implement a fix to address this issue and restore service. Cardholders seeing unexpected return of funds should not attempt to re-process their transactions; when the issue is fixed, transactions will post to cardholder accounts as previously expected. We will provide additional updates once the changes are implemented." We will send an update as soon as we have more information from ProPay.
ProPay provided the following update: "A fix has been implemented for the credit card transactions and we are monitoring the behavior of the processing of the settlement transactions. We are still working on some additional steps that are required to address processing the refunds." We will send another update when we receive more information from ProPay.
According to ProPay, missed Canadian refunds have been processed. This incident is resolved.
Both sandbox and integration are currently unavailable. ProPay informed us they will be down until they are able to apply necessary security updates - ETA unknown. As soon as we have more information and/or when the environments are back up and running, we will let you know.
ProPay concluded their maintenance - both sandbox and integration are now available. This incident is resolved.
ProPay informed us that 7/9/2025 ACH Payment transactions were delayed in being submitted to NACHA. The effect of this delay is that some ACH payments made on 7/8 and 7/9 were not debited from payer's bank accounts yesterday (7/10), and will be debited today (7/11). Merchants were already funded for the proceeds of the ACH Payment transactions, but may receive inquiries from payers whose funds were not debited as expected.
This incident has been resolved.
ProPay informed us that 7/9/2025 ACH Payment transactions were delayed in being submitted to NACHA. The effect of this delay is that some ACH payments made on 7/8 and 7/9 were not debited from payer's bank accounts yesterday (7/10), and will be debited today (7/11). Merchants were already funded for the proceeds of the ACH Payment transactions, but may receive inquiries from payers whose funds were not debited as expected.