Call Connection Issues Tuesday 8th October 2024 4:49:00 pm

We are investigating an issue with some calls being connected.

Engineers have been on site looking at the secondary array and a plan has been made to re-join this to the primary array tomorrow evening (9th).

The service remains at risk until then but also will be at risk during the re-join.

A period of monitoring will occur after the re-join should there be any repeat of the issues seen. In such a case, it will be split again whilst we determine the next steps.

Posted 1 month ago

We believe the issue has been temporarily resolved.

The underlying cause appears to have been a disk in the secondary storage array that did not fail gracefully. This caused a knock on issue that the primary storage array was sending it data, which it was not writing to disk quick enough or correctly. This then creates blocking on the primary node.

Currently the array has been split with the primary note not replicating to secondary whilst we investigate this further.

Engineers will be on site in due course.

Posted 1 month ago

We are still working on this issue.

There has been a period of stability but the errors were seen again.

Posted 1 month ago

Our engineers are still working on the issue.

We thank you for your patience.

Posted 1 month ago

Our engineers are still investigating the cause.

Posted 1 month ago