Queries stuck in metadata retrieval in Dremio Cloud (EU)

Incident Report for Dremio Cloud

Resolved

This incident has been resolved.
Posted Feb 10, 2025 - 17:55 UTC

Update

One of our core indexing services that powers both discovery of sources and metadata refreshes starting queueing up. We have mitigated the issue by throttling the service.

Our initial analysis suggests that the failure may have been triggered by a recent change in our underlying infrastructure on Google. We are collaborating with our partners at Google to conduct a thorough Root Cause Analysis and identify the exact cause of the issue.
Posted Feb 10, 2025 - 17:55 UTC

Monitoring

We have identified the issue impacting queries within Dremio Cloud (EU) that causes queries to not progress past the metadata retrieval stage and applied a mitigation. We are seeing recovery of customer environments and will continue to monitor. We apologize for any inconvenience caused and will publish a post-mortem for this incident in the coming days.
Posted Feb 10, 2025 - 17:15 UTC

Update

We are continuing to investigate an issue impacting queries within Dremio Cloud (EU) that causes queries to not progress past the metadata retrieval stage. We are experiencing issues with our upstream provider causing timeouts and are working to mitigate this issue. We will provide another update within 60 minutes.
Posted Feb 10, 2025 - 15:58 UTC

Update

We are continuing to investigate an issue impacting queries within Dremio Cloud (EU) that causes queries to not progress past the metadata retrieval stage. We will provide another update within 60 minutes.
Posted Feb 10, 2025 - 14:57 UTC

Update

We are continuing to investigate an issue impacting queries within Dremio Cloud (EU) that causes queries to not progress past the metadata retrieval stage. We will provide another update within 60 minutes.
Posted Feb 10, 2025 - 13:51 UTC

Update

We are continuing to investigate an issue impacting queries within Dremio Cloud (EU) that causes queries to not progress past the metadata retrieval stage. We will provide another update within 60 minutes.
Posted Feb 10, 2025 - 12:52 UTC

Update

We are continuing to investigate an issue impacting queries within Dremio Cloud (EU) that causes queries to not progress past the metadata retrieval stage. We will provide another update within 60 minutes.
Posted Feb 10, 2025 - 11:53 UTC

Update

We are continuing to investigate an issue impacting queries within Dremio Cloud (EU) that causes queries to not progress past the metadata retrieval stage. We will provide another update within 60 minutes.
Posted Feb 10, 2025 - 10:55 UTC

Investigating

We are currently investigating an issue impacting queries within Dremio Cloud (EU) that causes queries to not progress past the metadata retrieval stage. We will provide another update within 60 minutes.
Posted Feb 10, 2025 - 10:02 UTC