Issues provisioning new nodes and clusters

Incident Report for Instaclustr

Resolved

We have confirmed the that the incident is resolved.
Posted Sep 30, 2021 - 08:52 UTC

Update

It appears a fix is in place. We are testing to confirm restored functionality.
Posted Sep 30, 2021 - 08:20 UTC

Monitoring

Our third party provider, quay.io has confirmed an issues with their service.

We have a manual workaround in place that will allow for urgent provisioning of nodes in an emergency.
Posted Sep 30, 2021 - 07:30 UTC

Identified

While the observed impact is currently limited to Azure, it appears the root cause is a DNS issue at one of our third party providers and we suspect it is has potential to spread to other providers.
Posted Sep 30, 2021 - 06:47 UTC

Investigating

We are currently experiences issues provisioning new clusters and nodes. We think the issue may be limited to Azure but we are confirming.

Existing running clusters are not impacted.
Posted Sep 30, 2021 - 06:31 UTC