At Risk – Huntingdon / Manchester 20/8/25

We are seeing a repeat of the issue from Saturday with a number of Virgin Media links flap multiple times. This includes a NNI for some leased lines and one of our links between Huntingdon and Manchester

Virgin are working to resolve this working with the network team here – however this issue is causing a loss of resilience for Manchester and Huntingdon

[update 21/8/25 8:30]
Virgin are continue to work on the issue here and have ordered additional spare parts to replace failed hardware on their network – we are expecting an update shortly and will update as we know more. At this point we don’t believe the issue has any customer impact but we do have reduced resilience on our network

At Risk – Huntingdon / Manchester 17/8/2025 RESOLVED

We have seen a number of Virgin Media links flap multiple times this evening. This includes a NNI for some leased lines and one of our links between Huntingdon and Manchester

Virgin are working to resolve this working with the network team here – however this issue is causing a loss of resiliance for Manchester and Huntingdon

This issue was cleared approx 3am 17/8 – our supplier replaced an optical amp on their kit to restore stability to the affected links

CityFibre Network issue – 12/03/2025

We are aware of an issue affecting CityFibre lines – this appeared to start about 2:30am and some lines are seeing increased latency and Packet Loss causing slowness and drop outs on the lines.

Cityfibre have accepted our report and a Major Service Issue has been raised their side. They are working hard to identify and resolve the issue. We will update this post as soon as we know more

We apologise for the issues here and will ensure this is resolved as quickly as possible

Virgin Leased Line issues 18/12/2024 [resolved]

We have become aware during the day of an increasing number of drop outs on one of our Virgin Media Bearers which provides service for approx 30 leased lines. Virgin are aware of this and are actively working to identify and resolve the fault. Note this does not affect all lines  just those terminating on the affected handover in Huntingdon. Note lines are not hard down but we are seeing multiple drops for 30-90 seconds.

We will update this as we have a further update

[Update 22/12/2024]
Virgin Media have been working to resolve this issue – however we are still seeing ongoing drops on this line. There was a longer outage earlier today to swap out a number of cross connects and cards – however we are still seeing very brief drops on this link. Virgin Media are performing more work this evening to investigate the cause here and we will update more as soon as we know more.

[Update 23/12/24]
Virgin replaced some kit in one of their POPs last night however the issue is still ongoing with 5-10 second drops on links on one of our backhaul links (note this only affects a sub-set of our circuits). Virgin have asked for an extended downtime to perform a full end to end test. Given this issue only occurs every hour or so the downtime is likely to be 2-3 hours and will take place from 10pm this evening. We have also asked Virgin Media if we can move some of the single homed lines to an alternative handover while this is investigated. We will update further as we have it

[update 24/12/24 – 9:30]
Virgin completed their work overnight – however the issue still occured after this – this has been escalated back to Virgin Media who are currently working on the next steps to restore stability. We will have a further update by 11:30am

[update 24/12/24 11:00]
We are aware these lines have just dropped and are awaiting an update from Virgin. We are aware they are looking to revert last nights change given that this has not resolved the issues. We have pushed for an update and will update this as soon as we have it. As I type this I can see the service has just come back – we will update this further as we have it. Expect the next update by 13:00 at the latest

[update 24/12/24 13:00]
Virgin Media have moved this circuit to a new card / hardware just before 11am and then reverted last nights change at 11:50 which caused the longer drops this morning, We have not seen any further drops seen but both Virgin and ourselves are keeping a close eye on this. We will update again by 16:00 if there is no news or developments before then

[update 24/12/24 13:20]
Virgin have now confirmed they have completed their changes on this line for now and they and we are monitoring this for stability. We will update at 18:00 if there are no changes or drops. Virgin are keeping th fault open for a number of days to ensure this stays stable

[update 24/12/24 16:20]
The link has remained stable since just before midday. Both Virgin and ourselves continue to monitor this closely for any further drops. We will update this by 20:00 unless there are any significant changes

[update 24/12/24 19:00]
The link has remained stable since just before midday. Both Virgin and ourselves continue to monitor this closely for any further drops. We will not provide any further updates until 27/12 unless there is any significant change however we will be monitoring the link closely

[update 27/12/24 07:00]
The link has remained stable since the change by Virgin Media just before midday on the 24th. We are waiting for the RFO from Virgin but believe this issue is now resolved. Sorry for any issues this may have caused

OFNL Outage – 2/9/24 [Resolved]

We are aware of an outage affecting multiple OFNL based connections starting at approx 9:48 – we are awaiting an update from OFNL on the cause as this appears to be an issue on their network as opposed to ours.

We will update this as we know more

[Update 12:30]
We have started to see connections restore and the OFNL site itself is now back up. We have been informed that they have worked round the issue – however there may be a reduction in network capacity (and therefore some slow speeds) while work continues to fully resolve the issue

We will continue to update this post as we know more

[Resolved 14:30]
We have been monitoring the service all afternoon and can confirm that since we saw the service restore approx 12:30 we have not seen any further issues. OFNL have also confirmed the fault is cleared from their side. We & they are sorry for the issues that affected our customers today

OUTAGE – Telehouse North [resolved]

We are aware of an outage affecting our core switch in Telehouse North. This initially was a wider issue however we have now isolated this issue to services directly connected in Telehouse North.

We have an engineer en route (eta should be less than 30 minutes) and we will then have a clearer picture of the cause – and hope that service will be restored shortly thereafter

We will update this as soon as we have it

[resolved]
This issue was fully by 17:35 – One of our switches in Telehouse North had crashed – the route cause will be investigated and worked on if needed. We apologise for the issue seen here