CDEV and UAT - East US : Notebook services are unavailable.

Major incident UAT - East US Other Features CDEV - East US Other Features
2025-06-24 06:22 UTC · 7 hours, 15 minutes

Updates

Post-mortem

Summary:

On 24th June, a critical component in the East US production environment became unstable, leading to temporary Notebook inaccessibility for a subset of customers. The issue was caused by a system update from our cloud provider that introduced a compatibility issue affecting storage services. The cloud provider rolled back the update to restore stability, and all services have since been fully recovered.

Customer Impact:

A subset of customers were unable to access Notebook services due to a service disruption.

Root Cause:

A system update from the cloud provider introduced a compatibility issue that impacted storage service stability.

Remediations:

The cloud provider rolled back the system update to resolve the compatibility issue, which restored stability to the storage services and recovered Notebook functionality.

Future Mitigating Actions:

We are working closely with our cloud provider to improve pre-deployment validation, and to ensure early detection and prevention of similar issues in future updates.

July 2, 2025 · 10:52 UTC
Resolved

We have confirmed internally and with our customers that the Aera platform is now fully restored.

We appreciate your patience during this incident and apologise for any inconvenience that this issue may have caused. Our teams are now working on documenting a comprehensive root cause analysis which we will share with you shortly.

If you have any questions or experience any further problems please don’t hesitate to reach out to our Support team at Aera Support Portal

June 24, 2025 · 13:36 UTC
Investigating

Our engineers are continuing to investigate the root cause of the Notebook issue. We understand the business impact this issue may have and are working to restore service as quickly as possible. Again, we thank you for your continued patience and understanding.

June 24, 2025 · 12:51 UTC
Investigating

We are continuing to work towards restoring service for the Notebook. Our engineers are diligently working to narrow down the root cause. We will continue to keep you informed as the investigation progresses. We appreciate your continued patience whilst we work towards resolution.

June 24, 2025 · 12:20 UTC
Investigating

We are continuing to investigate the Notebook loading issues in both UAT and CDEV East US environments. Our engineers are actively working to restore service as quickly as possible. Thank you for bearing with us whilst we work through these issues.

June 24, 2025 · 10:06 UTC
Investigating

We are continuing to work towards restoring service for the “Notebook services are unavailable” issue. Our engineers are diligently working to narrow down the root cause. We will continue to keep you informed as the investigation progresses. We appreciate your continued patience whilst we work towards resolution.

June 24, 2025 · 08:06 UTC
Investigating

We are continuing to investigate the “Notebook services are unavailable” issue. Our engineers are actively working to restore service as quickly as possible. Thank you for bearing with us whilst we work through these issues.

June 24, 2025 · 06:50 UTC
Issue

We are continuing to investigate the Notebook accessing issues. Our engineers are actively working to restore service as quickly as possible. Thank you for bearing with us whilst we work through these issues.

June 24, 2025 · 06:22 UTC

← Back