50 Hivebrite incidents · 2022年11月 — official updates, affected components, duration and resolution details.
我们目前正在调查这一事件。 我们的小组正在努力查明原因并评估影响。 随着我们收集更多信息,将不断更新。 谢谢你的耐心.
我们正在继续调查这一问题.
我们从事件中恢复过来了。 我们不断密切监测,以确保局势得到全面解决。 随后将更新。 谢谢你的合作.
此事已决. 为防止今后再次发生此类事件,已经实施了各种补救措施。 谢谢你的支持和理解。 请联系我们的支援小组 如果你还有问题的话.
自动翻译自官方事件更新。
Our platform briefly experienced technical issues between 8:38am CEST and 8:50am CEST. The incident prevented access to our platform during the period of time. There were no impact on your data. We apologize for the inconvenience and thank you for your understanding.
We have identified an incident impacting the computation of Engagement Scoring on our European platform. Information displayed in the platform, pertaining to Engagement Scoring, may not be up to date, a delay can be observed before it is refreshed. Our team is working on identifying the cause and assessing the impact. Updates will follow as we gather more information. Thank you for your patience.
A fix has been implemented and deployed. We're catching up on the computation of Engagement Scoring events. Delay can still be observed on Engagement Scoring value for users. Updates will follow as we process Engagement Scoring events. Thank you for your patience.
The incident has been resolved. Engagement Scoring are now live and synchronized.
We are currently aware of an incident preventing our customers from configuring, setting or updating their Custom Domain. There is no impact to access the platform or the security of the data. This is linked to the incident from one of our vendor (https://www.cloudflarestatus.com/incidents/znll7lfnd35h). We will update this incident once we have more information from our vendor. Thank you for your patience.
The incident has been resolved. Please reach out to our support team if you have additional questions.
We have identified a latency issue affecting a part of our services. We are actively working on resolving it. Updates will be provided as progress is made. Thank you for your understanding
We are actively working on resolving the latency issue. Updates will be provided as progress is made. Thank you for your understanding.
Optimizations have been implemented to minimize impact. The latency issue is being closely monitored. Updates will follow as we track the situation. Thank you for your patience and support.
We are continuing to monitor for any further issues.
The latency issue has been resolved. Thank you for your understanding and cooperation. If you encounter further issues, please contact our support team.
This incident has been resolved.
We have identified a latency issue affecting our services. We are actively working on resolving it. Updates will be provided as progress is made. Thank you for your understanding.
The latency issue has been resolved. Thank you for your understanding and cooperation. If you encounter further issues, please contact our support team.
Our platform experienced technical issues, preventing most of our users and admins from accessing the platform, starting 11:02 CET today. We detected the incident shortly after. We identified the cause of the incident and successfully implemented mitigation measures at 11:35 CET. The platform was back online shortly after, all systems were fully working at 11:36 CET. Thank you for your support and understanding. Please reach out to our support team if you have additional questions.
We are experiencing an issue with our third-party handling our support tickets. We are currently investigating the issue. If you have any urgent tickets to create for now, please contact your CSM.
This incident has been resolved. You can submit tickets to our support team as usual. Thank you for your understanding.
Our platform is currently experiencing technical issues that are preventing users and admins from accessing the platform. There is no impact to existing customer data. The incident started at 14:40 CET. We have already identified the cause of the incident and are working on the resolution. We apologize for the inconvenience. Updates will be provided as progress is made. Thank you for your understanding.
We have recovered from the incident. We keep monitoring closely to make sure the situation is fully resolved. Updates will follow. Thank you for your cooperation.
The incident has been resolved. Thank you for your support and understanding. Please reach out to our support team if you have additional questions.
Our platform is currently experiencing technical issues that can prevent users and admins from accessing the platform. There is no impact to existing customer data. We have identified the root cause of the issue, linked to one of our third-party (https://www.cloudflarestatus.com/incidents/8gmgl950y3h7). We apologize for the inconvenience and are working to resolve this as soon as possible.
Our third-party is recovering from their outage. Our platforms are coming back up online as well since 3:36pm CET. We keep monitoring closely to make sure the situation is fully resolved. Updates will follow. Thank you for your cooperation.
The incident has been resolved. Thank you for your support and understanding. Please reach out to our support team if you have additional questions.
Our platform is currently experiencing technical issues that are preventing users and admins from accessing our US sandbox. There is no impact to existing customer data. We apologize for the inconvenience and are working to resolve this as soon as possible.
We have identified the cause of the incident and are working on the resolution. Updates will be provided as progress is made. Thank you for your understanding.
The synchronization between our search engine and the database is stopped. A fix will be implemented tomorrow morning (before 12:00PM CET).
We have recovered from the incident. We keep monitoring closely to make sure the situation is fully resolved. Updates will follow. Thank you for your cooperation.
The incident has been resolved. Fixes have been implemented to prevent future occurrences. Thank you for your support and understanding. Please reach out to our support team if you have additional questions.
We are currently investigating a latency issue affecting our services. Updates will follow as we work to identify the cause and assess the impact. Thank you for your patience.
Optimizations have been implemented to minimize impact. The latency issue is being closely monitored. Updates will follow as we track the situation. Thank you for your patience and support.
The latency issue has been resolved. Thank you for your understanding and cooperation. If you encounter further issues, please contact our support team.
The incident has been resolved. Fixes have been implemented to prevent future occurrences. Thank you for your support and understanding. Please reach out to your CSM if you have additional questions.
Our platform is currently experiencing technical issues on multiple features (delays and errors in dispatching emails, embedding content) following a third-party outage, since 9.11am Oct 20. There is no impact to existing customer data. We apologize for the inconvenience and are working to resolve this as soon as possible.
The incident has been resolved. Our third-party has mitigated their outage issue. Thank you for your support and understanding. Please reach out to your CSM if you have additional questions.
Our platform has suffered technical issues that prevented a portion of our users and admins from accessing the platform. There is no impact to existing customer data. Users and admins may have been unsuccesful in using the platform between: - October 14th, 10:30pm CEST and 11:00pm CEST; - October 15th, 1:35am CEST and 2:20am CEST. We have identified the cause of the incident, have already deployed mitigation measures and are still working on the resolution of the incident. Updates will be provided as progress is made. Thank you for your understanding. We apologize for the inconvenience and are working to resolve this as soon as possible.
We have recovered from the incident. We keep monitoring closely to make sure the situation is fully resolved. Updates will follow. Thank you for your cooperation.
The incident has been resolved. Fixes have been implemented to prevent future occurrences. Thank you for your support and understanding. Please reach out to your CSM if you have additional questions.
Our platform is currently experiencing technical issues that are preventing users and admins from accessing the platform. There is no impact to existing customer data. We apologize for the inconvenience and are working to resolve this as soon as possible.
We have identified the cause of the incident and are working on the resolution. Updates will be provided as progress is made. Thank you for your understanding.
We have recovered from the incident. We keep monitoring closely to make sure the situation is fully resolved. Updates will follow. Thank you for your cooperation.
The incident has been resolved. Fixes have been implemented to prevent future occurrences. Thank you for your support and understanding. Please reach out to your CSM if you have additional questions.
Our platform is currently experiencing technical issues that are preventing users and admins from accessing the platform. There is no impact to existing customer data. We have identified the cause of the incident and are working on the resolution. We apologize for the inconvenience.
We have recovered from the incident. We keep monitoring closely to make sure the situation is fully resolved. Updates will follow. Thank you for your cooperation.
The incident has been resolved. Fixes have been implemented to prevent future occurrences. Thank you for your support and understanding. Please reach out to your CSM if you have additional questions.
We are currently investigating the incident. Our team is working on identifying the cause and assessing the impact. Updates will follow as we gather more information. Thank you for your patience.
We have identified the cause of the incident and are working on the resolution. Updates will be provided as progress is made. Thank you for your understanding.
We have recovered from the incident. We keep monitoring closely to make sure the situation is fully resolved. Updates will follow. Thank you for your cooperation.
The incident has been resolved. Thank you for your support and understanding. Please reach out to your CSM if you have additional questions.
You might have noticed a lower quality in your header logo image. We have identified the root cause. The situation should be solved on Monday. There is no loss of data. Workaround meanwhile: you can reupload a logo if it is not ok to wait for Monday. Thank you for your understanding.
Fix was uploaded on sandboxes. We will rollout it to production environments tomorrow. The workaround is still valid while waiting for it: you can reupload a logo with a higher quality. Thank you for your patience.
This incident has been resolved.
Between 17:45 and 18:06 Jan 22 (in French time), there was a significant occurrence of 500 errors affected all US production customers, causing service disruptions.
Dear customer, You recently faced an incident on our services. We understand the impact this may have had on your experience and thus want to explain what happened. ## Incident Overview | INCIDENT PROPERTIES | | | --- | --- | | Started | Jan 22, 2025 04:45 pm UTC | | Impact Ended | Jan 22, 2025 05:06 pm UTC | | Impact Duration | 1 minutes | | Environment | Usprod | ## What Happened Between 2025-01-22T16:40:00 and 2025-01-22T17:06:00, customers on the US production platform experienced a large number of 500 errors. This was due to two simultaneous overloads of activity at the same time. 1. A large campaign led to security bot scanning flooding the platform. This is a known issue that occurs regularly and leads to repetitive micro outages \(<1minute\). 2. A big event in a wide community led to an additonnal surge of traffic. In usual times, this would not have been an issue but added to the first event, it led to such a long service disruption. ## Preventive Measures We have identified the security bot scanning issue 2 months ago and have our teams working on a long-term fix targeted for Q1 2025. We also are working to improve our autoscaling, our app bootime and our caching of public pages. This will allow our platform to reach better performance, scalability and more particularly reliability. We sincerely appreciate your understanding and are committed to continually improving our services to deliver a more resilient and reliable experience. If you have any lingering questions, do not hesitate to reach out to your CSM or our support team. Sincerely, Hivebrite
Our platform is currently experiencing technical issues that are preventing users and admins from accessing the platform. There is no impact to existing customer data. We apologize for the inconvenience and are working to resolve this as soon as possible.
The issue has been identified and a fix is being implemented.
We are continuing to work on a fix for this issue.
A fix has been implemented and we are monitoring the results.
The incident has been resolved. Please reach out to your CSM if you have any questions.
Dear customer, ## Incident Overview Our platform experienced an unexpected incident that prevented you from accessing Hivebrite for several minutes. We sincerely apologize for the inconvenience and here are more details on the incident. | INCIDENT PROPERTIES | | | --- | --- | | **Started** | Dec 23, 2024 08:26 pm UTC | | **Impact Ended** | Dec 23, 2024 08:49 pm UTC | | **Impact Duration** | 23 minutes | | **Environment** | prod | ## What Happened Our traffic handler that manages redirection to our marketing website URLs was not configured properly. Because of that, in case of worldwide high traffic, it loses the connection with our server. We had identified the issue a few weeks ago and were planning a maintenance window in January to correct it. Everything was ready for the resolution. We thought there would be no issue to wait as much as this configuration existed for one year and a half and it had never led to any issue until now. However, the probabilities went against us. ## Impact on You There was no data loss and there is no long lasting impact after this incident. ## What was done Thanks to everything being already ready, the team could react and correct the behaviour straightaway. The infrastructure has been corrected during the incident. It will not reoccur. We sincerely appreciate your patience and understanding during this time. We are committed to continually improving our services to deliver a more resilient and reliable experience. If you have any lingering concerns or questions, please do not hesitate to reach out to your CSM or our support team. Sincerely, Hivebrite
