Hevo 장애 기록

We are currently observing connection failures for Redshift sources and destinations for some teams across different regions. The issue could potentially impact Redshift connections via SSH tunnel. As a result, affected pipelines may experience delays in data ingestion or loading. Our engineering team is actively investigating the issue, and we will provide further updates.

The issue has been identified and a fix is being implemented.

We are continuing to work on a fix for this issue.

The fix is under deployment for the US (us-east-1) region. This should take another 2-3 hours for the pipelines to recover. Thanks for your patience in the meantime.

A fix has been implemented and we are monitoring the results.

This incident has been resolved.

We are currently investigating an issue affecting Facebook Ads source connectors. Customers may experience ingestion failures or delays. Our engineering team is actively investigating the issue, and we will provide further updates.

We suspect this may have been related to a Meta service disruption. Most of the affected pipelines have recovered and are functioning normally. Reference : https://metastatus.com/

This incident has been resolved.

We observed elevated error rates in the Event Consumption service between 05:02 PM and 05:25 PM IST, which resulted in delays in event processing. Our Engineering team identified the issue, mitigated the impact, and restored normal service. Event processing has resumed, and any backlog generated during the incident has been cleared. Current Status: Resolved. All services are operating normally, and event processing is functioning as expected.

We are currently investigating this issue.

We are continuing to investigate this issue.

A fix has been implemented and we are monitoring the results.

This incident has been resolved.

We experienced a Kafka connection issue triggered due to an AWS outage, which impacted processing between approximately 5:30 PM and 11:00 PM IST. The necessary corrective actions have been taken to resolve the issue, and the pipelines are expected to resume normal ingestion. We are currently moving the incident to a Monitoring state and are actively observing the system to ensure stability. A detailed RCA will be shared as soon as it is available.

This incident has been resolved.

We are investigating an issue impacting data pipelines in the US-GCP region, leading to degraded performance. Our engineering team is actively working on identifying the cause and restoring normal performance. Further updates will be shared shortly.

The issue has been identified and a fix is being implemented.

A fix has been implemented and we are monitoring the results.

This incident has been resolved.

We are currently observing failures in few of the Redshift destinations created after July 2025. Our team is actively investigating the issue and will keep you informed with the latest updates

We are continuing to work on a fix for this issue.

A fix has been implemented and we are monitoring the results.

This incident has been resolved.

We identified an issue impacting data pipelines in the US-GCP region, which resulted in degraded performance. We are investigating the issue.

We are continuing to investigate this issue.

This incident has been resolved.

We identified an issue impacting data pipelines and models in the US region, which resulted in degraded performance. we are investigating the issue.

We identified an issue impacting data pipelines and models in the US region, which resulted in degraded performance. Our engineering team investigated the root cause and has now resolved the issue. All services are currently operating normally.

We have identified an issue where Job Monitoring in the US region is currently impacted, and users may not see jobs or their proper statuses from the past two days until the issue is resolved. Rest assured, our engineering team is actively investigating the cause, and we will share updates as we make progress.

A fix has been implemented and we are monitoring the results.

This incident has been resolved.

We have identified lag buildups across pipelines for some of the teams in the US2 cluster. If you're facing some lag with data delivery, kindly rest assured that we're working on it as our topmost priority. Apologies for any inconvenience. We will share further updates here in some time.

We are continuing to investigate this issue.

The issue has been identified, and we're working on the fix. We want to ensure all the impacted users that this will be mitigated very soon.

We are continuing to work on a fix for this issue.

A fix has been implemented and we are monitoring the results.

This incident has been resolved.

We are currently experiencing issues retrieving data for the Charge and Refund objects from Stripe. Our team is actively investigating the issue.

The issue has been identified on Stripe's end, and our team is checking with Stripe's support regarding a concrete root cause. To fix any Stripe pipelines with failing objects like Charge, Refund, or Dispute, please generate a new restricted API key and configure the same in the source settings. Steps mentioned here: https://docs.hevodata.com/sources/fna-analytics/stripe/#obtaining-the-api-key

We're closing this incident as it has been resolved at our end.

Some Snowflake destinations are currently failing with the following error: “Passphrase is required for encrypted private key.” The root cause has been identified, and a fix is actively being implemented. We will provide further updates as progress continues.

We are continuing to work on a fix for this issue.

A fix has been implemented and we are monitoring the results.

This incident has been resolved.

We have identified some failures in our backend across AWS regions. Users might experience slowness with pipeline operations. Any inconvenience is deeply regretted.

We are continuing to investigate this issue.

The issue has been identified and a fix is being implemented.

We have deployed some changes at our end to mitigate the issue. We have observed the volume of errors getting reduced after the same and we will be further monitoring the results.

This incident has been resolved.

Snowflake is experiencing an outage in the US-West, AWS Europe, and AWS Asia Pacific Regions. This is impacting our Loading Job.

A fix has been implemented and we are monitoring the results.

The issue has been resolved Reference : https://status.snowflake.com/

Cluster has moved to read-only mode and ingestion is halted. We have identified the cause of the issue and working on the fix

We have patched the fix and are monitoring further.

We are continuing to monitor further.

This incident has been resolved.

We are currently investigating this issue.

The issue has been identified, and we are implementing a fix. For the next 10–15 minutes, the cluster will operate in read-only mode.

The fix has been implemented, and the cluster is now out of read-only mode. We are actively monitoring to ensure full stability.

This incident has been resolved.

We are currently investigating this issue.

A fix has been implemented and we are monitoring.

The issue persists in the US region, and we have identified ingestion and processing lags across a few pipelines. We are trying to minimize the impact as much as possible.

We are continuing to investigate this issue.

The issue has been identified and a fix is being implemented.

A fix has been implemented and we are monitoring the results.

We are continuing to monitor for any further issues.

This incident has been resolved.

The issue has been identified and a fix is being implemented by the engineering team.

The fix has been implemented, and this incident is now fully resolved. Quick Alerts are now accessible and functioning as expected.

We are currently experiencing an issue where the Test Connection and Save & Continue buttons are unresponsive while creating a pipeline configured with a BigQuery destination, or when setting up a new standalone BigQuery destination across all regions. Impact: 1. Affects users creating new BigQuery destinations or configuring a new pipelines that use BigQuery as the destination. 2. Existing BigQuery destinations continue to work normally. 3. Other destinations (e.g., Snowflake, Redshift) are not impacted. Workaround: Click on the GCS Bucket field once to auto-populate the bucket. After this, both Test Connection and Save & Continue become responsive. Current Status: Our engineering team is actively working on the issue, and the investigation is currently in progress. A fix will be deployed as soon as possible, and we will share further updates here as we make progress.

The issue has been identified and a fix is being implemented.

We are continuing to work on a fix for this issue.

This incident has been resolved.