11.14am AEST | 23 minutes
This morning our hosted server infrastructure suffered a network outage which caused an outage to the PDS Software.
The network outage was due to a failure of a firewall cluster that sits at the heart of our service providers network. Whilst there is full redundancy built into their systems, the failover mechanism failed due to a software fault. This required a manual intervention to initiate a reset of the affected infrastructure.
The outage started at 11:14am and was fully resolved at 11:37am for a total of 23 minutes.
There was an additional maintenance window between 11pm and 12am carried out to fully diagnose the fault, additional testing of the redundancy in the firewall systems is also planned to be completed.