UATIRL - Few Cortex services are unavailable

Minor incident UAT IRL (Retired) Cortex
2024-07-28 17:13 UTC · 2 hours, 55 minutes

Updates

Post-mortem

Summary:
Following recent infrastructure maintenance, an issue was identified that caused an interruption of Cortex services. The issue was escalated to the Infrastructure Engineering team, where it was identified that the unintentional loss of previous configuration changes during the maintenance led to issues. To rectify the issue, changes were reverted to their previous state, which restored service and enabled full access to Cortex services to be reinstated.

Customer Impact:
Users experienced Cortex services unavailability in UATIRL01.

Root Cause:
As identified by Infrastructure Engineering, an omission of previous configuration changes during the infrastructure maintenance resulted in disruption of Cortex services.

Remediations:
The required configuration settings were reverted allowing full functionality to be restored.

Future Mitigating Actions:
Internal change management processes have undergone review. A gap within the process was identified, and necessary updates have been made and communicated to all stakeholder teams.

August 7, 2024 · 17:50 UTC
Resolved

We have confirmed internally and with our customers that the cortex services are now fully restored.

We appreciate your patience during this incident and apologize for any inconvenience that this issue may have caused. Our teams are now working on documenting a comprehensive root cause analysis which we will share with you shortly.

If you have any questions or experience any further problems please don’t hesitate to reach out to our Support team at support@aeratechnology.com

July 28, 2024 · 20:08 UTC
Investigating

We are continuing to investigate the Cortex issues. Our engineers are actively working to restore service as quickly as possible. Thank you for bearing with us whilst we work through these issues.

July 28, 2024 · 17:50 UTC
Issue

This notice is to advise you that we are receiving reports of our customers experiencing difficulties with a few Cortex services. We are actively investigating and will provide regular updates until the issues are resolved.

Our apologies for the inconvenience this may be causing and we appreciate your patience as we investigate further.

July 28, 2024 · 17:13 UTC

← Back