34 Bitfinex incidents · november 2016 — official updates, affected components, duration and resolution details.
We are investigating issues with the platform connectivity. We will keep everyone updated on here and our X account https://x.com/bitfinex as we know more.
The issue has been identified and a fix is being implemented.
A fix has been implemented and we are monitoring the results.
This incident has been resolved.
We are investigating issues with reduced platform performances and connectivity. We will keep everyone updated on here and our Twitter account https://twitter.com/bitfinex as we know more.
A fix has been implemented and we are monitoring the results.
This incident has been resolved.
We are investigating issues with platform reduced performances and have temporarily halted trading. We will keep everyone updated on here and our twitter account https://twitter.com/bitfinex as we know more.
The issue has been identified and a fix is being implemented.
Our maintenance is nearing a successful completion and the Bitfinex platform will be returning in view-only mode with the option to cancel orders at 4:05 AM UTC, before trading opens at 4:10 AM UTC. Thank you for your patience.
This incident has been resolved.
We are experiencing email delivery issues. We are investigating and are working to resolve them as soon as possible. We apologise for the inconvenience.
A fix has been implemented and we are monitoring the results.
This incident has been resolved.
We are investigating issues with deposits, withdrawals and reporting. Trading is not affected. We will keep everyone updated on here and our Twitter account https://twitter.com/bitfinex as we know more.
A fix has been implemented and we are monitoring the results.
This incident has been resolved.
We are investigating issues with deposits, withdrawals and reporting. Trading is not affected. We will keep everyone updated on here and our Twitter account https://twitter.com/bitfinex as we know more.
A fix has been implemented and we are monitoring the results.
This incident has been resolved.
We are investigating issues with reduced platform performances. We will keep everyone updated on here and our Twitter account https://twitter.com/bitfinex as we know more. We apologise for the inconvenience.
The issue has been identified and a fix has been implemented. We expect the platform to return to normal performance operations within the next 30 minutes.
We are investigating performance issues with the Bitfinex platform. The system is undergoing unscheduled maintenance. We will keep everyone updated on here and our Twitter account https://twitter.com/bitfinex as we know more. We apologise for the inconvenience.
Our intervention is nearing successful completion and the Bitfinex platform will be returning in view-only mode at 5:50 PM UTC. Starting from 5:55 PM UTC, it will be possible to cancel orders before trading opens at 6:00 PM UTC. Thank you for your patience.
This incident has been resolved.
We are investigating connectivity issues with the Bitfinex platform. We will keep everyone updated on here and our twitter account https://twitter.com/bitfinex as we know more.
The cause has been identified. The platform is returning to normal operations. We will keep monitoring closely.
This incident has been resolved.
We are investigating issues with platform reduced performances and have temporarily halted trading. We will keep everyone updated here as soon as we know more. Please monitor https://twitter.com/bitfinex and https://bitfinex.statuspage.io for updates. We apologies for the inconvenience.
We are continuing to investigate this issue.
The cause has been identified and we are working to restore trading activities. All funds are safe. We will keep everyone updated via https://twitter.com/bitfinex and https://bitfinex.statuspage.io. Thanks for your patience.
Thanks for your patience thus far. In 30 mins we will provide an ETA for re-opening trading-activities.
Our intervention is nearing a successful completion and the Bitfinex platform will be returning in view-only mode with the option to cancel open orders at 1:30 AM UTC, while trading will open after 10 minutes.
This incident has been resolved.
Bitfinex is currently not accessible, our admins are currently looking into this. We apologize for the inconvenience caused.
The issue has been located and is being resolved as quickly as possible. We will confirm when full platform functionality has resumed.
We are continuing to work on a fix for this issue.
Thank you all for your patience today. Bitfinex will open at 10:30AM UTC as view only, and trading will restart at 10:35AM UTC.
Full functionality has resumed.
The platform is encountering connectivity issues with one of the servers. As a precaution we had to suspend trading temporarily. We are working hard to have the platform return to normal operations as soon as possible. We will post updates on the situation on https://bitfinex.statuspage.io and on https://twitter.com/bitfinex
Our matching engine server was restarted by our hosting provider without notice. We are in the process of restarting the server and returning the platform to normal operations. We expect this process to take at least 30 more minutes. Apologies for any inconvenience.
We are close to be able to reopen trading. Please stand by.
The platform is back to normal operations. We will keep monitoring closely.
The platform is back to normal operations.
Bitfinex experienced connectivity issues for some users over the last 15 minutes due to a network traffic routing problem. The issue has now been resolved. Apologies for any inconvenience this caused.
The platform is under extreme load. We are investigating. Seems a DDoS attack was launched soon after we relaunched the platform.
The cause of the outage has been identified. A DDoS attack was launched soon after we restarted operations. The previous outage was caused by issues with one of our infrastructure providers. While the platform was recovering, the attack caused extreme load on the servers. We are adjusting the DDoS protection measures to fend off the attack and be able to relaunch. Currently we are running tests to make sure we can safely restart operations. As soon as we have a clearer ETA on when operations will restart we will report.
We are finishing the steps to restart operations. We expect we can return to normal operations within the next 15 minutes. Please stand by.
The platform is returning to normal operations. We will keep monitoring the situation closely.
The platform is back to normal operations.
The platform is experiencing issues in the trading engine, our admins are aware and are working on bringing the platform back to normal operations. We will publish updates on https://bitfinex.statuspage.io and on https://twitter.com/bitfinex to keep users updated.
The cause of the platform outage has been identified. The platform admins are addressing the issue as we speak and will bring the platform back online as soon as possible.
We are continuing to work on a fix for this issue. We are close to being able to relaunch the platform. The admins are running checks to be able to resume normal operations shortly
Bringing back the platform back online is taking longer than expected. We are running tests in order to safely resume normal operations. If no issues are detected, relaunch can be within the next minutes, it can take longer if we do encounter unexpected outcomes of the tests. We fully understand users wish to receive a clearer ETA, but at this point, we cannot be more specific. Apologies for any inconvenience caused.
We are close to relaunch, we expect within the next few minutes
The platform is back online. The cause of the issues was with our infrastructure provider. We will closely monitor the platform. Apologies for the inconvenience.
The platform is back to normal operations. The cause of the outage was an issue with our infrastructure provider. This has been addressed.
Bitfinex is currently undergoing planned platform maintenance and will be unavailable for approximately 60 minutes. During maintenance trading and funding features will be unavailable. Users can stay up to date via https://twitter.com/bitfinex/ and https://bitfinex.statuspage.io throughout the upgrade. Thank you for your patience.
Maintenance is taking longer than expected. We expect the platform will be unavailable for approximately 30 more minutes.
The platform has returned to normal operations. Thank you for your patience.
Bitfinex is currently undergoing planned platform maintenance and will be unavailable for the next 2 hours. Please monitor https://bitfinex.statuspage.io and https://twitter.com/bitfinex for updates. Why do you need to take Bitfinex offline? The vast majority of all maintenance and updates are executed without the need to suspend trading. Unfortunately, there are occasions where we need to roll out updates that require the platform to be suspended. We actively try to minimise this; unfortunately once or twice per year, an update requires the platform to be paused. Why are you executing maintenance while the markets are active? Crypto markets are active all day, every day, all year. Regardless of what hour of the day we choose to perform upgrades, the markets will be active. Unlike traditional markets, we are not given the luxury of daily breaks that would allow us to roll out updates without suspending trading. There is no perfect moment to execute an update like this. What is so important that it justifies needing to suspend trading for up to 2 hours? Today we are rolling out major optimisations to our trading engine. These changes will result in being able to better cope with platform load during volatile markets. Furthermore, these changes lay the foundation for future scalability as the crypto markets continue to grow. We will publish more details on the improvements later this week. What benefits will users see from this? Today's update will bring about a number of engine performance improvements, including improved scalability and reduced latency. In addition to this, it will lay the core foundation for all future platform improvements.
Unfortunately, the maintenance is taking longer than anticipated. We expect to have the platform online again in about one hour. Apologies for any inconvenience.
The platform has returned to normal operations. Thank you for your patience.
We are investigating issues with the platform. We will keep everyone updated on here and twitter @bitfinex as we know more.
The cause has been identified. We expect the platform to return to normal operation within the next 15-30 minutes.
The platform is returning to normal operations. We will keep monitoring closely.
The platform has returned to normal operations.
We are currently under heavy DDOS. API is also down. We are working on further mitigation.
Some services returning online with reduced performance. Continuing work to mitigate the attack.
Progress is being made to mitigate the denial of service attack. One component of the denial of service attack is to create hundreds of thousands of new accounts, causing stress on the infrastructure. For that reason, please note that new user signups have been temporarily disabled to help defend against the attackers and improve platform service for existing customers.
Platform stabilizing. The team will continue to monitor the situation closely.
Investigating a new push in the ongoing distributed denial-of-service attack against Bitfinex.
The platform has returned to normal operations.
The platform is under heavy load. We are working on bringing the platform back to normal operations.
The cause is a DDoS attack. A person or group is intentionally trying to cause the platform to not operate normally. The level of DDoS protection is being adjusted to fend off the attack.
The platform is returning to normal operations. We will keep monitoring the situation closely.
Platform returning to normal.
