Pricing
Status historyRSS updatesStatus API

Powered by Uptimus

    Datarobot kesinti geçmişi

    52 Datarobot incidents · Ekim 2024 — official updates, affected components, duration and resolution details.

    Güncel duruma dön

    Codespace Session Generative AI Playground'da Başarısızlık

    Başlangıç 18 Ağustos 2026 12:20 UTC · 2h 24m

    IssuesKüçük çaplı olay
    Etkilenen bileşenler
    APIGenerative AI VDB BuilderGenerative AI LLM PlaygroundMLOpsAutoMLAPIAI Catalog and Data IngestAI AppsPredictionsGenerative AI LLM PlaygroundMLOpsAI Catalog and Data IngestPredictionNotebooksGenerative AI VDB BuilderWebsitePredictionsNotebooksAI AppsWebsiteGenerative AI VDB BuilderMLOpsGenerative AI LLM PlaygroundAutoMLWebsiteAI AppsPipelineAI Catalog and Data IngestAutoMLAPI
    1. 18 Ağustos 2026 12:20 UTCidentified

      Generative AI Playground'daki kod alanı oturumu geçerli bir hata nedeniyle başarısız olur. Mühendislik bir düzeltme oluşturmaya çalışıyor.

    2. 18 Ağustos 2026 13:56 UTCidentified

      Mühendislik bir düzeltme uyguladı ve şu anda üretim kümeleri boyunca dağıtma üzerinde çalışıyor.

    3. 18 Ağustos 2026 14:44 UTCresolved

      Şu anda tüm Prod ortamları ve Generative AI Playground şimdi beklendiği gibi çalışıyor.

    Resmî olay güncellemesinden otomatik olarak çevrilmiştir.

    Vector Database Creation ile Sorunlar

    Başlangıç 24 Temmuz 2026 17:32 UTC · 1h 10m

    IssuesKüçük çaplı olay
    Etkilenen bileşenler
    Generative AI VDB BuilderGenerative AI VDB BuilderGenerative AI VDB Builder
    1. 24 Temmuz 2026 17:32 UTCinvestigating

      DataRobot Engineering ekibi, bir DataRobot'u ev sahipliği yaparken sorunları gözlemledi. Şu anda, bu tüm DataRobot MTS ortamları ve mühendisliği kök nedenini araştırıyor.

    2. 24 Temmuz 2026 17:44 UTCmonitoring

      Mühendislik ekibi düzeltme ve Vector Database yaratımı şimdi operasyoneldir. Takım durumu izliyor.

    3. 24 Temmuz 2026 18:42 UTCresolved

      Mühendislik ekibi, Vector Database oluşturmanın tüm DataRobot MTS ortamları boyunca operasyonel olduğunu gözlemledi. Olay yeniden çözülebilir.

    Resmî olay güncellemesinden otomatik olarak çevrilmiştir.

    Issues with prediction requests against custom model deployments

    Başlangıç 2 Temmuz 2026 13:03 UTC · 34m

    IssuesKüçük çaplı olay
    Etkilenen bileşenler
    Generative AI LLM PlaygroundAutoMLAPIAI Catalog and Data IngestGenerative AI VDB BuilderPredictionsAI AppsWebsiteMLOps
    1. 2 Temmuz 2026 13:03 UTCinvestigating

      We are investigating issues in MTSaaS within EU region impacting prediction requests against Custom Models deployments.

    2. 2 Temmuz 2026 13:20 UTCidentified

      The team root caused the issue causing HTTP 403 responses for Custom Model deployments in EU region.  Mitigations were applied and the team is verifying the fix stabilized the service.

    3. 2 Temmuz 2026 13:37 UTCresolved

      The issue is contained and the team has verified that predictions against Custom Models in all MTSaaS environments are healthy.

    Batch Jobs queued up in US MTS

    Başlangıç 29 Mayıs 2026 08:37 UTC · 5d 0h

    IssuesKüçük çaplı olay
    Etkilenen bileşenler
    Generative AI VDB BuilderAI AppsPredictionsGenerative AI LLM PlaygroundMLOpsAI Catalog and Data IngestNotebooksWebsiteAutoMLPipelineAPI
    1. 29 Mayıs 2026 08:37 UTCidentified

      Batch jobs that are currently in the queue are completed successfully; however, their completion status is not being updated correctly. As a temporary workaround, we are manually marking these jobs as completed while we work on implementing a solution.

    2. 29 Mayıs 2026 10:22 UTCidentified

      The affected jobs have been resolved and the issue is mitigated. Engineering is actively working on a permanent fix and testing is currently underway

    3. 29 Mayıs 2026 14:38 UTCmonitoring

      The remediation script has been deployed and Engineering is actively monitoring the situation. Batch jobs may take longer than usual to show as completed until a permanent fix is rolled out in the next production deployment.

    4. 29 Mayıs 2026 15:20 UTCmonitoring

      We are continuing to monitor for any further issues.

    5. 3 Haziran 2026 09:29 UTCresolved

      A fix has been deployed to production and the issue is now resolved. All systems are operating normally.

    Delay in Feature Drift Statistics Processing

    Başlangıç 28 Mayıs 2026 08:30 UTC · 1h 17m

    IssuesKüçük çaplı olay
    Etkilenen bileşenler
    MLOps
    1. 28 Mayıs 2026 09:09 UTCidentified

      Feature drift statistics are currently experiencing a processing delay of approximately 1 hour. No data has been lost, and all metrics will reflect accurate values once processing catches up. Our team is actively working to resolve this.

    2. 28 Mayıs 2026 09:47 UTCresolved

      Feature drift statistics processing has been restored to normal. All metrics are now up to date. No data was lost.

    Customers Experiencing Errors with New Custom Model Creation.

    Başlangıç 26 Mayıs 2026 05:09 UTC · 1h 9m

    IssuesKüçük çaplı olay
    Etkilenen bileşenler
    AI Catalog and Data IngestAutoMLAPI
    1. 26 Mayıs 2026 05:09 UTCinvestigating

      We are experiencing a service interruption with Custom Models functionality in US SAAS environment. Predictions to existing deployments are working fine, but users cannot create new custom models. Engineering is investigating the issue and will provide updates as we make further progress.

    2. 26 Mayıs 2026 06:01 UTCmonitoring

      Engineering has applied a fix in the US SAAS environment which resolved the issue. At the time of issue, some users might have experienced issues with Custom Apps, Data upload and custom model creation. The issue is contained.

    3. 26 Mayıs 2026 06:04 UTCmonitoring

      We are continuing to monitor for any further issues.

    4. 26 Mayıs 2026 06:18 UTCresolved

      Custom Models, Custom Applications & Data upload services are back to Operational state in US SAAS Environment. Issue is Resolved.

    Widespread intermittent service issues for new workloads in US Production

    Başlangıç 8 Mayıs 2026 00:15 UTC · 20h 6m

    IssuesKüçük çaplı olay
    Etkilenen bileşenler
    AI AppsMLOpsNotebooks
    1. 8 Mayıs 2026 03:53 UTCmonitoring

      We are currently experiencing intermittent service issues in US Production, which are primarily affecting the launch of new workloads for Notebooks, Custom models, and Custom Applications. This issue does not impact existing workloads. This disruption is strongly correlated with an ongoing AWS Availability Zone outage (https://health.aws.amazon.com/health/status), causing resource allocation failures. The team is actively monitoring the situation and tracking updates from AWS.

    2. 8 Mayıs 2026 06:13 UTCidentified

      We are continuing to experience issues launching new workloads for Custom Models and Custom Applications in US Production. This is connected to an ongoing AWS outage. Our team is exploring multiple mitigation options.

    3. 8 Mayıs 2026 13:40 UTCmonitoring

      Engineering resolved the underlying issue with workload scheduling and is monitoring the cluster.

    4. 8 Mayıs 2026 20:21 UTCresolved

      Engineering confirmed the issue is resolved and all services are restored.

    Delay in processing actual messages

    Başlangıç 10 Nisan 2026 10:24 UTC · 36m

    IssuesKüçük çaplı olay
    Etkilenen bileşenler
    MLOps
    1. 10 Nisan 2026 10:24 UTCmonitoring

      Processing actual messages on JP MTS is delayed due to autoscaling malfunction. Engineering scaled up the deployment to alleviate the issue. Root cause mitigation in progress

    2. 10 Nisan 2026 11:01 UTCresolved

      Engineering has applied the required infrastructure configuration changes. The service is operating normally and no further user impact is observed. Engineering will continue monitoring cluster health to ensure stability. The incident is now marked as Contained.

    Elevated Errors on Managed AI Cloud

    Başlangıç 9 Nisan 2026 21:56 UTC · 15h 8m

    OutageBüyük çaplı olay
    Etkilenen bileşenler
    AI AppsNotebooks
    1. 9 Nisan 2026 21:56 UTCinvestigating

      We're experiencing an elevated level of errors and are currently looking into the issue.

    2. 9 Nisan 2026 22:56 UTCmonitoring

      A fix has been implemented and we are monitoring the results.

    3. 10 Nisan 2026 11:31 UTCmonitoring

      Engineering has applied changes to mitigate the elevated error rates. Services are now operating normally. We are continuing to monitor the system while investigating the cause of the issue.

    4. 10 Nisan 2026 13:04 UTCresolved

      Engineering has implemented the required fixes to resolve the elevated error rates. Services are now operating normally, and no further user impact has been observed. The team will continue to monitor the system to ensure stability. The incident is now considered contained.

    Degraded Performance on DataRobot MTS due to Quay outage

    Başlangıç 30 Mart 2026 20:43 UTC · 12h 11m

    IssuesKüçük çaplı olay
    Etkilenen bileşenler
    APIGenerative AI VDB BuilderGenerative AI LLM PlaygroundMLOpsAutoMLAPIAI Catalog and Data IngestAI AppsPredictionsGenerative AI LLM PlaygroundMLOpsAI Catalog and Data IngestPredictionNotebooksGenerative AI VDB BuilderWebsitePredictionsNotebooksAI AppsWebsiteGenerative AI VDB BuilderMLOpsGenerative AI LLM PlaygroundAutoMLWebsiteAI AppsPipelineAI Catalog and Data IngestAutoMLAPI
    1. 30 Mart 2026 20:43 UTCidentified

      Our engineering team has found the the Quay outage currently happening is causing degraded performance across the DataRobot platform. Engineering is currently monitoring the situation.

    2. 30 Mart 2026 20:44 UTCidentified

      We are continuing to work on a fix for this issue.

    3. 31 Mart 2026 08:53 UTCresolved

      Quay.io functionality has been restored and DataRobot environments are fully stabilized.

    Performance Degradation on Managed AI Cloud

    Başlangıç 13 Mart 2026 17:49 UTC · 54m

    IssuesKüçük çaplı olay
    Etkilenen bileşenler
    API
    1. 13 Mart 2026 17:49 UTCinvestigating

      We are experiencing performance degradation on Managed AI Cloud.

    2. 13 Mart 2026 18:31 UTCmonitoring

      A fix has been implemented and we are monitoring the results.

    3. 13 Mart 2026 18:43 UTCresolved

      This incident has been resolved.

    Intermittent UI disruptions on Managed AI Cloud

    Başlangıç 11 Mart 2026 20:05 UTC · 5d 22h

    IssuesKüçük çaplı olay
    Etkilenen bileşenler
    WebsiteAPI
    1. 11 Mart 2026 20:05 UTCinvestigating

      We are currently investigating this issue.

    2. 11 Mart 2026 20:22 UTCmonitoring

      A fix has been implemented and we are monitoring the results.

    3. 17 Mart 2026 18:31 UTCmonitoring

      We are continuing to monitor for any further issues.

    4. 17 Mart 2026 18:32 UTCresolved

      This incident has been resolved.

    Network issue related to Kubernetes in US cluster

    Başlangıç 11 Mart 2026 14:36 UTC · 2h 5m

    OutageBüyük çaplı olay
    Etkilenen bileşenler
    PredictionsMLOpsPipeline
    1. 11 Mart 2026 14:36 UTCinvestigating

      DataRobot is experiencing network issue related to Kubernetes in US Cluster. This will have impact on model deployment and predictions. Engineering is investigating the root cause.

    2. 11 Mart 2026 15:06 UTCidentified

      Engineering has identified the root cause of the problem and a mitigation is put in place.

    3. 11 Mart 2026 15:19 UTCmonitoring

      The mitigation implemented by Engineering has improved the network issue. The team is continuing to monitor the environment to ensure full recovery.

    4. 11 Mart 2026 16:41 UTCresolved

      The mitigation implemented by Engineering has resolved the Kubernetes network issue, and the incident is now contained.

    Degraded Performance on the DataRobot MTS due to Quay outage

    Başlangıç 18 Şubat 2026 21:04 UTC · 16m

    IssuesKüçük çaplı olay
    Etkilenen bileşenler
    APIGenerative AI VDB BuilderGenerative AI LLM PlaygroundMLOpsAutoMLAPIAI Catalog and Data IngestAI AppsPredictionsGenerative AI LLM PlaygroundMLOpsAI Catalog and Data IngestPredictionNotebooksGenerative AI VDB BuilderWebsitePredictionsNotebooksAI AppsWebsiteGenerative AI VDB BuilderMLOpsGenerative AI LLM PlaygroundAutoMLWebsiteAI AppsPipelineAI Catalog and Data IngestAutoMLAPI
    1. 18 Şubat 2026 21:04 UTCinvestigating

      Our engineering team has found the the Quay outage currently happening is causing degraded performance across the DataRobot platform.

    2. 18 Şubat 2026 21:19 UTCresolved

      This incident is now resolved.

    LLM blueprints deployments cannot be created

    Başlangıç 17 Şubat 2026 15:48 UTC · 7m

    OutageBüyük çaplı olay
    Etkilenen bileşenler
    Generative AI LLM Playground
    1. 17 Şubat 2026 15:48 UTCidentified

      LLM blueprints deployments can not be created in JP MTS environment. Engineering is rolling back JP cluster to previous version to mitigate the issue.

    2. 17 Şubat 2026 15:55 UTCresolved

      Rollback of the JP cluster to the previous version is complete and the problem has been mitigated.

    Agent Application Template Impacted After Moderations Library Upgrade.

    Başlangıç 16 Şubat 2026 11:35 UTC · 1h 14m

    IssuesKüçük çaplı olay
    Etkilenen bileşenler
    AI AppsAI AppsAI Apps
    1. 16 Şubat 2026 11:35 UTCidentified

      Agent application template is affected with the recent moderations library upgrade, fix is identified and mitigation is in progress.

    2. 16 Şubat 2026 12:49 UTCresolved

      New version of Agentic application template is released, the issue is resolved

    Degraded Performance on the DataRobot US MTS

    Başlangıç 13 Şubat 2026 20:39 UTC · 53m

    IssuesKüçük çaplı olay
    Etkilenen bileşenler
    AI Catalog and Data IngestAPI
    1. 13 Şubat 2026 20:39 UTCinvestigating

      We are observing issues on DataRobot US MTS environment. Users may experience degraded performance using APIs and data ingest services. The engineering team is currently investigating the root cause.

    2. 13 Şubat 2026 21:31 UTCresolved

      The incident has now been resolved. All services are now operational.

    Problem connecting to DataRobot due to client browser caching

    Başlangıç 8 Ocak 2026 18:15 UTC · 13d 20h

    OutageKritik olay
    Etkilenen bileşenler
    WebsiteWebsiteWebsite
    1. 8 Ocak 2026 18:15 UTCmonitoring

      Some customers have reported issue connecting to DataRobot. Please do a hard refresh of your browser by clearing the cache and this should fix the problem. As always let us know if it continue to have issue connecting to DataRobot after clearing the cache.

    2. 8 Ocak 2026 18:16 UTCmonitoring

      We are continuing to monitor for any further issues.

    3. 22 Ocak 2026 14:19 UTCresolved

      This incident has been resolved.

    Degraded Platform Performance Due to Docker Hub Outage

    Başlangıç 17 Aralık 2025 17:00 UTC · 0m

    IssuesKüçük çaplı olay
    1. 17 Aralık 2025 17:41 UTCresolved

      Between 16:50 UTC and 17:09 UTC, one of external providers(DockerHub) had an outage that might have caused temporary delays in starting platform workloads. The issue has been resolved and normal operations have resumed. Engineering is continuing to monitor the system.

    Degraded Platform Performance Due to Docker Hub Outage

    Başlangıç 5 Aralık 2025 11:09 UTC · 26m

    IssuesKüçük çaplı olay
    Etkilenen bileşenler
    MLOpsPredictionsMLOpsPredictionPredictionsPredictionsMLOpsMLOps
    1. 5 Aralık 2025 11:09 UTCmonitoring

      Between 09:04 UTC and 09:17 UTC, one of external providers(DockerHub) had an outage that might have caused temporary delays in starting platform workloads. The issue has been resolved and normal operations have resumed. Engineering is continuing to monitor the system.

    2. 5 Aralık 2025 11:35 UTCresolved

      The engineering team has confirmed recovery across all MTS and STS environments. No further updates are expected.