28 Buddy Punch incidents · June 2016 — official updates, affected components, duration and resolution details.
We're experiencing an elevated level of errors and are currently looking into the issue.
A fix has been implemented and we are monitoring the results.
This incident has been resolved.
Our partner Cloudflare has identified the problem and mentions that the issues are being worked on. We’re monitoring the situation. https://www.cloudflarestatus.com/incidents/8gmgl950y3h7
We are continuing to monitor for any further issues.
Cloudflare has posted an update, they are still mitigating several issues after their latest fix https://www.cloudflarestatus.com/incidents/8gmgl950y3h7
Cloudflare has seen errors and latency return to normal levels, but hasn’t marked its issue as resolved yet. We will continue to monitor the situation, but we expect the issue to be fully resolved shortly.
Cloudflare services are currently operating normally. We are no longer observing elevated errors.
The issue has been identified and a fix is being implemented.
A fix has been implemented and we're monitoring the results
This incident has been resolved.
There is an issue with our web host that they are resolving. This affects buddypunch.com, but not app.buddypunch.com or any of our mobile apps. Users can still use our apps without issue. This is just our marketing site, buddypunch.com, that is affected.
Our website is back up and running.
There is an issue with our web host that they are resolving. This affects buddypunch.com, but not app.buddypunch.com or any of our mobile apps. Users can still use our apps without issue. This is just our marketing site, buddypunch.com, that is affected.
This incident has been resolved.
We have identified the issue and are working to get the login page back online.
Issue has been resolved.
This incident has been resolved.
Due to an issue with our banking provider, employee & contractor funds for payrolls that were meant to be paid today are delayed. We are confident that payments for your employees & contractors will land today. We will follow up with more details around specific payment timing as we receive confirmation. We apologize for this inconvenience. Nothing is more important to our service than processing timely and accurate payments for you. We will work with our banking provider to identify the issue and resolve it on a go forward basis.
We have continued to receive some positive reports that employees & contractors have received their funds. We remain committed to paying all employees & contractors today and will send out any additional payments, if needed, by latest the final Same Day ACH submission window at 4:45pm ET. We appreciate your continued understanding and patience. We will follow up between 2:45-3:30pm ET with an update.
We are continuing to work closely with our banking partner to ensure payments go out today. We have identified all employees & contractors who have yet to be paid. We have now provided all required information to their team to create and submit the ACH file required to send payments, and are actively working with them to ensure that file is submitted on time. We jointly expect to meet the 4:45pm ET Same Day ACH window. Funds will settle with the receiving bank by 6pm local time; note that while funds are often made available immediately, it is up to the discretion of the bank itself on when they make those funds available to the employee / contractor in their bank account. By law it is Midnight local time, but timing varies bank by bank. We appreciate your continued understanding and patience. We will follow up with more details no later than 5:00pm ET.
Great news. All remaining payments that were not sent earlier have now been fully released to the Federal Reserve. These payments will go out in the 4:45pm ET Same Day ACH window. As a reminder, funds will settle with the receiving bank by 6pm local time; note that while funds are often made available immediately, it is up to the discretion of the bank itself on when they make those funds available to the employee / contractor in their bank account. By law it is Midnight local time, but timing varies bank by bank. In the meantime, we will continue to actively monitor the status of these payments to ensure smooth delivery. Thank you for your patience and support.
This incident has been resolved.
We have isolated the issue to one of our banking providers and are actively investigating root cause and resolution paths with that provider. We are simultaneously exploring other means to send employee payments today. We remain confident that employee payments will land today. We will send an updated status within the next hour or if we have meaningful updates to share in the interim.
We have confirmed our ACH file has been received. All Direct Deposits dated for today will be posted by the bank and funds will be posted at 5pm local time. While this should resolve the issue and remit payments to affected employees, we will continue to monitor to confirm that the payments successfully land in accounts. We sincerely apologize for this delay.
Our push notification provider is having a partial outage and are working on resolving the issue. Some push notifications may be delayed.
The incident was resolved, all push notifications sending normally.
Some users were not able to login. Investigated and resolved by 5:40pm central time, or 12 minutes after incident created.
We are currently investigating this issue.
A fix has been implemented and we are monitoring the results.
This incident has been resolved.
We are currently investigating this issue.
The issue has been identified and a fix is being implemented.
A fix has been implemented and we are monitoring the results.
We are continuing to monitor for any further issues.
This incident has been resolved.
Our email processing infrastructure is running behind which is causing delays. We are switching to another email processor.
We are currently investigating the issue.
The issue has been identified and a fix is being implemented.
This incident has been resolved.
We are aware of an issue with connections to the website and app. We are working to resolve it as quickly as possible.
The issue has been resolved.
We are aware of an issue with Time Entries (duration) when accessing them via a browser. We are working to resolve this issue. In the meantime we would recommend adding time entries from the Mobile Apps, they are working as expected.
This issue is now resolved. You will be able to add time entries as expected.
We are currently investigating a performance issue. You may have trouble accessing the site while we are investigating.
Performance issue has been resolved. You should now be able to login normally.
We are investigating some failed logins, time outs and slow response times.
An issue with our cloud hosting provider is causing some degraded performance. The mobile apps appear to be working better than the website at this time.
The website and mobile apps are starting to respond as normal. We will continue to monitor the situation.
The issue has been resolved
We are investigating the slow performance of Buddy Punch
The performance issue has been resolved
Buddy Punch is having DNS issues that is causing a partial outage. We are working with our provider to resolve this issue as quickly as possible.
We're continuing to work on this issue and hope to have a resolution soon. We apologize for the inconvenience.
We are continuing to work on this issue. BuddyPunch.com is completely down at this time. App.BuddyPunch.com and the mobile apps are starting to come available as the DNS changes propagate. Similarly Support.BuddyPunch.com and Buddy Punch email is coming back as well. We will update the status here as it comes available.
We are starting to see our websites and application coming back online. We will continue to monitor the situation.
The issue has been resolved.