At Risk Planned Work – UPS Maintanance Huntingdon 20/7/2023

During the day of 20th July we will have specialist engineers working on our UPS system at our Huntingdon Data Centre.

This should not impact services at all as we have a N+1 redundant system. However there is always a slight risk and we will have slightly lower redundancy during the work

We will update this as the work progresses and completes

Customer Leased Line Router Upgrades – 19/7/23 – 21/7/23

Our router vendor used for customer leased line routers has released a number of firmware updates. Over these three evenings we will upgrade the firmare on most customer routers. Each router will see aprrox 5 minutes downtime while the router reboots after the upgrade.

We will confirm as the work progresses and completes

At Risk – DWDM Update – 17/7/23 [completed]

We are planning a small upgrade to our links between Telehouse North and Telehouse West and Telehouse Noth and harbour Exchange quare on the evening of Monday 17th July

This will leave the sites at risk and some potential very brief blips in connectivity as the fibres on these buildings are moved over to our new DWDM platform.

We will update this post once the work completes

[completed]
This work completed as planned with minimal impact – the DWDM fibre links are now working as expeted

At Risk – Telehouse West Power Upgrades and Fibre Check 19/5/2023 [completed]

Our engineers along with Telehouse will be working to upgrade the Power Supply to our rack in Telehouse West this evening to allow expansion and additional equipment to be installed. The rack had two resiliant feeds and all core equipment is connected to both feeds.

During the work one Power bar will be replaced at a time – reducing meaning there will for a short period be no resilience on the power in the rack. We do not anticipate any impact but the service should be considered at risk

We also have a fibre link between Telehouse West and Telehouse North which is showing some low level errors. Last week Telehouse tested the fibre which passed – while on site we will replace the optics on this link to see if this clears the issue – if not we will ask Telehouse to run further checks on this fibre. While this is being done again there will be a brief loss of resilience on our fibre ring but we do not expect any customer impact

We will update this if anything changes – and on completion of the work

[completed]

This work completed on Friday evening – we did see two issues through this work. The router that is usd for some OFNL connections for Air customers had an issue for about an hour due to an unplanned powercycle and not re-starting correctly. A few fibre NNIs also bounced. This also affected one of our Name servers. We are sorry for any service disruption from this.

 

 

OFNL Emergency Maintenance 16/03/23 [completed]

With the recent migrations from Air Broadband to Merula we need to perform a router reload and to add additional IP addresses to our routers pool to enable a large number of migrations. This should also clear the issue that has been seen the last few days.

Note this maintenance will only affect customers where we have ‘adopted’ the Air router as opposed to moving to our own setup. We anticipate this will be the last change we need to make for some time.

The plan for this evening is

1) Upgrade Router to latest firmware and reboot
2) Add additional IP Address Pools

Due to the nature of this customers on this router may see a longer initial outage from the upgrade / reboot (approx 10-20 minuites), followed by a few shorter drops as the extra IPs are applied and the router interface reset.

We will start this work shortly and update once complete

 

[completed]
This work is now completed and we can see the sessions that dropped back and we see traffic passing. If you do see any issues – please let us know

 

Leased Line Router Upgrades 20/2/23 and 21/2/23

Our Router vendor has released a new firmware for the routers we install at our customer premises

Over the two dated above we will perform a rolling upgrade to all of our Leased Line customer routers.

Each affected customer will see a 5-10 minute drop on their service while their router upgrades and reboots. Upgrades will start after 10pm each evening and complete in the early hours of the following day.

If you have any questions please do email the support team