История сбоев Seravo

1. 11 августа 2026 г. в 11:11 UTCinvestigating

   We are currently investigating this issue.

2. 11 августа 2026 г. в 11:26 UTCresolved

   This incident has been resolved.

1. 21 июля 2026 г. в 10:12 UTCinvestigating

   В настоящее время мы расследуем этот вопрос.

2. 21 июля 2026 г. в 10:32 UTCidentified

   Вопрос был выявлен. В настоящее время мы работаем над решением с нашим хост-провайдером.

3. 21 июля 2026 г. в 11:19 UTCmonitoring

   Реализовано исправление, и в настоящее время мы отслеживаем результаты.

4. 21 июля 2026 г. в 12:24 UTCresolved

   Этот инцидент был урегулирован.

Автоматический перевод официального обновления инцидента.

1. 27 июня 2026 г. в 18:42 UTCidentified

   We identified a networking issue in cluster de-dauner. Our team is working on it to fix it. We apologise for any inconvenience.

2. 27 июня 2026 г. в 19:14 UTCidentified

   We are continuing to work on a fix for this issue.

3. 27 июня 2026 г. в 19:36 UTCmonitoring

   A fix has been implemented and we are monitoring the results.

4. 27 июня 2026 г. в 20:03 UTCresolved

   This incident has been resolved.

1. 26 июня 2026 г. в 20:53 UTCinvestigating

   We are experiencing availability issues. Our team is actively investigating and resolving the situation. We apologise for any inconvenience. Thank you for your patience.

2. 26 июня 2026 г. в 21:51 UTCresolved

   This incident has been resolved.

1. 25 июня 2026 г. в 18:19 UTCidentified

   We identified a networking issue in cluster. Our team is working on it to fix it. We apologise for any inconvenience.

2. 25 июня 2026 г. в 19:07 UTCmonitoring

   A fix has been implemented and we are monitoring the results.

3. 25 июня 2026 г. в 19:20 UTCresolved

   This incident has been resolved.

1. 17 июня 2026 г. в 07:06 UTCinvestigating

   We have noticed database connectivity problems in cluster fi-tolonen. We are investigating the issue.

2. 17 июня 2026 г. в 07:09 UTCidentified

   The issue has been identified and a fix is being implemented.

3. 17 июня 2026 г. в 07:36 UTCresolved

   This incident has been resolved.

1. 15 июня 2026 г. в 13:36 UTCmonitoring

   Customers that have opted to use external DNS ( dns{1..4}triuvare-webhosting.fi) for their site might encounter availability issues with their sites. Incident does not affect customers using only Seravo-provided hosting services.

2. 15 июня 2026 г. в 19:25 UTCresolved

   This incident has been resolved.

1. 10 июня 2026 г. в 04:30 UTCidentified

   We are experiencing availability issues in cluster fi-haarla. Some websites may experience interruptions. Our team is actively investigating and resolving the situation. We apologise for any inconvenience. Thank you for your patience.

2. 10 июня 2026 г. в 04:36 UTCmonitoring

   A fix has been implemented and we are monitoring the results.

3. 10 июня 2026 г. в 04:41 UTCresolved

   This incident has been resolved.

1. 9 июня 2026 г. в 03:25 UTCidentified

   We identified a networking issue in cluster. Our team is working on it to fix it. We apologise for any inconvenience.

2. 9 июня 2026 г. в 04:23 UTCmonitoring

   A fix has been implemented and we are monitoring the results.

3. 9 июня 2026 г. в 04:23 UTCmonitoring

   We are continuing to monitor for any further issues.

4. 9 июня 2026 г. в 04:24 UTCresolved

   This incident has been resolved.

5. 9 июня 2026 г. в 10:18 UTCpostmortem

   # Häiriö Suomessa sijaitsevissa palvelinklustereissa 9.6.2026 \(English follows\) Ubuntu-käyttöjärjestelmän kehittäjä Canonical julkaisi maanantaina 8.6.2026 korjauksen www-palvelinohjelmisto Nginx:n HTTP/2 Bomb -haavoittuvuuteen \([https://ubuntu.com/security/notices/USN-8398-1](https://ubuntu.com/security/notices/USN-8398-1)\). Nginx on käytössä myös Seravolla, ja ohjelmisto päivitettiin automaattisesti aamulla 9.6.2026. Päivityksessä oli mukana regressio, joka rikkoi Seravolla käytössä olevien Nginx-moduulien yhteensopivuuden, minkä seurauksena Nginx ei toiminut normaalisti eikä pystynyt vastaamaan HTTP-pyyntöihin. Ongelma on maailmanlaajuinen, eikä Canonical ole toistaiseksi julkaissut päivityksiä ko. moduuleihin. Seravolla ongelma vaikutti suurimpaan osaan asiakkaidemme sivustoja Suomessa sijaitsevissa palvelinklustereissa, ja sen seurauksena sivustot eivät toimineet. Ongelma ei koskenut sivustoja palvelinklustereissamme, jotka sijaitsevat muissa maissa \(Ruotsi, Saksa, Yhdysvallat\). Ongelma saatiin korjattua palauttamalla väliaikaisesti käyttöön Nginx:n aiempi versio. Seuraamme saatavilla olevien korjausten tilannetta ja teemme tarvittavat päivitykset mahdollisimman pian. Ilmoitamme reaaliaikaisesti kaikista palveluitamme koskevista häiriöistä erillisellä statussivulla osoitteessa status.seravo.com. Suosittelemme häiriöilmoitusten tilaamista esim. sähköpostiin. ## Aikajana \(UTC\+3\) * 06:00 Päivitykset alkoivat * 06:13 Ensimmäinen sivustohälytys * 06:15 Seravon päivystäjä tarkistaa tilanteen * 06:21 Ongelma rajataan Nginx:ään * 06:25 Häiriöilmoitus julkaistaan \(status.seravo.com\) * 06:30 Ongelma rajataan ohjelmistopäivityksiin * 06:44 Päivystäjä eskaloi ongelman tiimin sisällä * 06:53 Käyttöön palautetaan aiempi Nginx-versio * 07:12 Kaikkien palvelimien Nginx palautettu, sivustot toiminnassa * 07:18 Ongelman leviäminen laajemmalle estetty # Incident on Finnish server clusters on June 9, 2026 On Monday, June 8, 2026, Canonical \(developer of the Ubuntu operating system\) released a security patch for the Nginx web server software to address the HTTP/2 Bomb vulnerability \([https://ubuntu.com/security/notices/USN-8398-1](https://ubuntu.com/security/notices/USN-8398-1)\). Nginx is used by Seravo, and the software was automatically updated on the morning of June 9, 2026. The patch contained a regression that broke compatibility with the Nginx modules used by Seravo. As a result, Nginx failed to handle incoming HTTP requests. The issue affects systems globally, and Canonical has not yet released updates for the affected modules. At Seravo’s hosting, the issue affected the majority of our customers’ sites hosted on server clusters located in Finland, causing downtime. Sites hosted on our server clusters in other countries \(Sweden, Germany, and the United States\) were not affected. The issue was resolved by temporarily rolling back to the previous version of Nginx. We are closely monitoring the availability of official fixes and will apply the necessary updates as soon as possible. Seravo provides real-time updates on all disruptions at status.seravo.com. We highly recommend subscribing to incident notifications via email, for example. ## Timeline \(UTC\+3\) * 06:00 Updates begin * 06:13 First site alert triggered * 06:15 Seravo’s on-call expert investigates the situation * 06:21 The issue is isolated to Nginx * 06:25 Incident notification published \(status.seravo.com\) * 06:30 The issue is limited to software updates * 06:44 On-call expert escalates the issue within the team * 06:53 Nginx is rolled back to previous version * 07:12 Nginx rollback on all servers successful, sites back in operation * 07:18 Issue successfully mitigated, further propagation prevented

1. 5 мая 2026 г. в 21:39 UTCinvestigating

   Due to a fault, there is currently limited availability to the recursive DNS resolution for "de" domains. This might affect some of our customers. More info here: https://status.hetzner.com/incident/c5e4ec2e-82b5-4f1a-a7ce-37127a6f2aa9

2. 6 мая 2026 г. в 04:01 UTCresolved

   This incident has been resolved.

1. 22 апреля 2026 г. в 11:08 UTCidentified

   We identified a networking issue in cluster fi-sestak. Our team is working on it to fix it. We apologise for any inconvenience.

2. 22 апреля 2026 г. в 11:40 UTCmonitoring

   A fix has been implemented and we are monitoring the results.

3. 22 апреля 2026 г. в 11:52 UTCresolved

   This incident has been resolved.

1. 31 марта 2026 г. в 00:13 UTCidentified

   We identified a networking issue in cluster. Our team is working on it to fix it. We apologise for any inconvenience.

2. 31 марта 2026 г. в 00:25 UTCmonitoring

   A fix has been implemented and we are monitoring the results.

3. 31 марта 2026 г. в 00:42 UTCresolved

   This incident has been resolved.

1. 25 марта 2026 г. в 11:22 UTCidentified

   We identified a networking issue in cluster us-davis. Our team is working on it to fix it. We apologise for any inconvenience.

2. 25 марта 2026 г. в 11:25 UTCmonitoring

   A fix has been implemented and we are monitoring the results.

3. 25 марта 2026 г. в 11:40 UTCresolved

   This incident has been resolved.

1. 24 марта 2026 г. в 06:14 UTCidentified

   We identified a networking issue in cluster fi-sestak. Our team is working on it to fix it. We apologise for any inconvenience.

2. 24 марта 2026 г. в 06:21 UTCmonitoring

   A fix has been implemented and we are monitoring the results.

3. 24 марта 2026 г. в 07:22 UTCresolved

   This incident has been resolved.

1. 12 марта 2026 г. в 15:45 UTCinvestigating

   We are currently investigating this issue.

2. 12 марта 2026 г. в 16:18 UTCresolved

   This incident has been resolved.

1. 12 марта 2026 г. в 03:10 UTCinvestigating

   We are currently investigating this issue.

2. 12 марта 2026 г. в 04:33 UTCidentified

   The issue has been identified and a fix is being implemented.

3. 12 марта 2026 г. в 06:21 UTCmonitoring

   A fix has been implemented and we are monitoring the results.

4. 12 марта 2026 г. в 07:47 UTCresolved

   This incident has been resolved.

5. 13 марта 2026 г. в 09:37 UTCpostmortem

   # Notice of a Server Outage on March 12, 2026 On Thursday March 12, 2026, a failure related to the server resource usage caused an outage in the cluster fi-perko. The outage was caused by a newly implemented security feature which led to increased resource usage. Monitoring failed to notice and pinpoint the increased resource usage in time, which led to the outage. The outage was aggravated by an unrelated networking change which led to delay in recovery. This caused an outage to all sites in the fi-perko cluster. The problem was noticed immediately by our on-call monitoring processes, and measures were immediately implemented to begin recovery. The disruption first began at 04:00 \(UTC\+2\), escalated at 05:00 and ended at 08:19 \(UTC\+2\). We apologise for any inconvenience caused by the disruption. ## Timeline \(all timestamps UTC\+2 \(EET\)\) * 12.3.2026 03:47 Partial outage * 12.3.2026 03:52 On-call performs initial recovery measures * 12.3.2026 04:00 Recovered from partial outage * 12.3.2026 05:00 Incident escalated again * 12.3.2026 05:10 On-call attempts recovery measures * 12.3.2026 05:15 Full outage * 12.3.2026 05:27 On-call performs recovery measures * 12.3.2026 06:17 Recovered from the outage - begin site recovery * 12.3.2026 08:19 All affected sites were back online ## Follow-Up Action As a result of the incident, we at Seravo have identified the need for the following measures: * Testing new features with extended data-sets to be able to catch issues caused by the sheer volume of processed data * Improvements to system resource monitoring

1. 12 марта 2026 г. в 01:56 UTCinvestigating

   We are currently investigating this issue.

2. 12 марта 2026 г. в 02:35 UTCresolved

   This incident has been resolved.

1. 11 марта 2026 г. в 05:19 UTCinvestigating

   We are currently investigating this issue.

2. 11 марта 2026 г. в 05:47 UTCmonitoring

   A fix has been implemented and we are monitoring the results.

3. 11 марта 2026 г. в 06:52 UTCresolved

   This incident has been resolved.

1. 5 марта 2026 г. в 15:08 UTCidentified

   We identified an upstream service provider networking issue causing slowness on some sites. We apologise for any inconvenience.

2. 5 марта 2026 г. в 16:01 UTCidentified

   We are continuing to work on a fix for this issue.

3. 5 марта 2026 г. в 16:24 UTCidentified

   The problem is related to Meta API services that slow down the sites. The sites will remain to work normally after the issue is fixed by the service provider.

4. 5 марта 2026 г. в 17:36 UTCmonitoring

   A fix has been implemented and we are monitoring the results.

5. 5 марта 2026 г. в 18:59 UTCresolved

   This incident has been resolved.

1. 25 февраля 2026 г. в 21:14 UTCinvestigating

   Customers that have opted to use external DNS for their site might encounter availability issues with their sites. Incident does not affect customers using only Seravo-provided hosting services.

2. 25 февраля 2026 г. в 21:19 UTCresolved

   This incident has been resolved.