Historia awarii Reflektive

Starting from Saturday, April 4th at 11:52 AM PST, we experienced intermittent performance issues within our infrastructure that led to a higher-than-normal error rate. During this time, some users may have encountered slowness or pages not loading as expected. Our team actively investigated the issue and identified the root cause within a specific component of our system. We have since taken corrective action by optimizing configurations and stabilizing the affected components. As a result, error rates have now returned to normal levels, and system performance has stabilized. Customers should no longer experience any disruptions. We will continue to closely monitor the system to ensure consistent performance and prevent recurrence.

We are currently experiencing performance degradation affecting the Reflektive application. This is primarily manifesting as slowness (increased latency) and intermittent data inconsistencies for many of our customers. The application remains available, but its functionality is degraded due to an ongoing issue with one of our core third-party providers. You can follow the public status of the underlying AWS issue here: https://health.aws.amazon.com/health/status

Reflektive application is back to healthy state. All the services are functional. AWS team confirmed that their operational issue is resolved. Please follow the AWS public status to know more about their operational issue and the resolution here: https://health.aws.amazon.com/health/status

The application was unavailable for about 15mins. The issue has been resolved but the root cause is yet to be determined.

Our automatic application monitors reported Partially unavailable - Reflektive Analytics Checked in logs found to be out of memory error .

This incident has been resolved

We are aware of the current lag in certain pages of the Reflektive Website like the login page, the admin page etc leading to a "spinning cycle". We continue to work on resolving this issue as our highest priority. We will update this space with further progress soon.

We identified the cause and it is expected to be normal asap.

A fix has been implemented and we are monitoring.

The incident resolved and the application back to normal.

Our Engineering and Ops teams are investigating an issue preventing some accounts from accessing/using Reflektive. This issue is causing users to see a "loading circle" when searching for users within the tool or trying to access the review page . We are working toward restoring service as quickly as possible and will provide another update soon. We apologize for the trouble!

The underlying issue has been identified and the fix is being implemented.

Reflektive service has been fully restored for affected users.

Some customers may be experiencing slower than usual response times and intermittent connectivity issues with Reviews page.

Newsfeed API is utilizing most of the DB resources and we have disabled the newsfeed api and then the app started working fine.

We are currently investigating the issue.

The incident has been resolved.

Application Slowness for some users.

Some users may be experiencing degraded performance, including timeouts while logging in. Reflektive is investigating and will post updates as more information becomes available.

We are continuing to investigate this issue.

This incident has been resolved.

Some customers may be experiencing slower than usual response times and intermittent connectivity issues. The problem linked to an incident at Reflektive hosting provider Heroku (https://status.heroku.com/incidents/2310)

The issue is identified. Waiting for it to be resolved. https://status.heroku.com/incidents/2306

This incident has been resolved.

The application is now available. Some users may experience degraded performance.

We are currently investigating this issue.

A fix has been implemented and we are monitoring the results.

Root cause determined to be environment misconfiguration. This issue has been resolved and the application is now fully operational.

Some users may be experiencing degraded performance, including timeouts. Reflektive is investigating and will post updates as more information becomes available.

Normal operation has been fully restored. The cause of the performance degradation is still under investigation.

Starting at 8:40am PST some Reflektive features/functionality began to experience severe performance degradation. Impact appears to be primarily on the administrative console. Initial investigations that this disruption is being caused by a technical incident reported by Reflektive's Cloud provider. Further investigations are underway and updates will be posted as more information becomes available.

As of 9:35am PST, Reflektive application is fully operational again.

Some customers may be experiencing slower than usual response times. Reflektive is investigating.

Problem linked to incident at Reflektive hosting provider Heroku (https://status.heroku.com/incidents/2167). Incident resolved, and no further indications of impact to Reflektive customers.

Some customers may be experiencing intermittent performance degradation or connectivity issues. The first instances of this began at approximately 7:15am PST and were last identified at approximately 9:00am PST. Reflektive is looking into the root cause and confirming resolution, and will update this incident with more information as it becomes available

No further instances of performance and connectivity issues being detected. Continuing to monitor, and to investigate cause.

Still no further instances of performance degradation or connectivity issues. Classifying this incident as resolved. Investigations on cause continue, and more information will be provided as it becomes available.

Root cause was Slack outage: [https://status.slack.com/2021-01-04](https://status.slack.com/2021-01-04) Tight coupling of Slack service integration with Reflektive application impacted performance for some Reflektive users. The Reflektive team is looking into to modifications to loosely couple Slack dependency to prevent potential reoccurrence.

Some customers may be experiencing a partial or full disruption of service. Reflektive is currently investigating this incident and will update this page as soon as there is more information.

Service has been fully restored. Reflektive's services were unavailable between 2:28 PM - 2:41 PM PST. We are still investigating root cause, but initial indications suggest an external network issue.

This morning our hosting provider experienced platform issues that affected the service they provided to their US customers. This included Reflektive's service. Though quickly resolved on their end, there was another issue on their platform with the same symptoms later the same afternoon. We are in touch with their support team to discover the root cause of the issue. Their team is actively investigating.

We are currently investigating this issue.

We are continuing to investigate this issue.

This incident has been resolved.

Our database connection count briefly hit its maximum while deploying a new version of Reflektive to our production systems. We are investigating why this happened to see if we can prevent it in the future.