Live Status\Incident History

August 27, 2024

Voice Calling Fault - AU Region

Outage

Opened: Aug 27, 2024, 4:35 AM UTC

Duration: 25m 59s

Affected services:Voice Network - Melbourne


  • Investigating
    Aug 27, 2024, 4:35 AM UTC

    We started to get notifications of a fault with inbound/outbound calling.

  • Identified
    Aug 27, 2024, 4:46 AM UTC

    Our AWS Melbourne Cluster was intermittently responding to requests. We are continuing to investigate.

  • Identified
    Aug 27, 2024, 4:51 AM UTC

    We began to remove the AWS Melbourne Cluster from our infrastructure and calls are starting to cut over to AWS Sydney Clusters.

  • Monitoring
    Aug 27, 2024, 4:59 AM UTC

    Cutover to AWS Sydney Cluster is complete and all calls slowly returning to normal patterns.

  • Resolved
    Aug 27, 2024, 5:01 AM UTC

    All calls should be returning to normal

  • Resolved
    Aug 27, 2024, 5:48 AM UTC

    We are continuing to identify the fault and monitor the AWS Sydney Cluster for stability whilst Melbourne is offline.

  • Resolved
    Aug 27, 2024, 1:35 PM UTC

    We have identified the cause of the fault with our Melbourne Cluster and have fixed the failing nodes. They will be returned to production over the weekend (31/08/2024 and 01/09/2024).

April 29, 2024

Abnormal CPU load causing call connectivity issues

Degraded Performance

Opened: Apr 29, 2024, 2:22 AM UTC

Duration: 1h 9m 12s

Affected services:Voice Network - Sydney


  • Investigating
    Apr 29, 2024, 2:22 AM UTC

    We're investigating a heightened CPU load on one of our core voice servers. This may impact inbound/outbound call connectivity.

  • Monitoring
    Apr 29, 2024, 2:36 AM UTC

    The problematic server has been removed and calls seem to be behaving normally.

  • Resolved
    Apr 29, 2024, 3:31 AM UTC

    All systems seem to be behaving as expected.

April 22, 2024

Core database upgrades

Maintenance

Posted: Apr 22, 2024, 6:00 PM UTC

Affected services:Voice Network - MelbourneVoice Network - Sydney


  • Monitoring
    Apr 22, 2024, 6:00 PM UTC

    We will be undertaking core database upgrades to improved reliability and platform performance. Please advise us of any issues after 7am AEST on 2024-04-23

  • Resolved
    Apr 22, 2024, 8:30 PM UTC

    All upgrades complete and systems operational.

August 7, 2023

Registration Servers - Maintenance

Maintenance

Posted: Aug 7, 2023, 7:15 PM UTC

Affected services:Voice Network - Sydney


  • Opened
    Aug 7, 2023, 7:15 PM UTC

    Some servers will be rotated out of availability pool while upgrades are undertaken.

  • Resolved
    Aug 7, 2023, 7:45 PM UTC

    Maintenance has been completed successfully