Nov 15, 2023 | Uncategorized
Our provider for one of our core links between London and Manchester has a fibre break meaning that our core link between London and Manchester is currently down.
This is not currently causing any issue but it does mean that we have a lack of resilience to both the Manchester and Huntingdon sites.
Our supplier have identified the fibre break location caused by a digger and are working to repair the damage currently.
We will update this as we know more
[resolved[
The fibre damage was resolved yesterday and the link has remained stable since
Jul 18, 2023 | Planned Work
During the day of 20th July we will have specialist engineers working on our Generator system at our Huntingdon Data Centre.
This should not impact services at all as as even in the case of a power failure we have a UPS system. However there is always a slight risk and we will have slightly lower redundancy during the work
We will update this as the work progresses and completes
Jul 18, 2023 | Planned Work
During the day of 20th July we will have specialist engineers working on our UPS system at our Huntingdon Data Centre.
This should not impact services at all as we have a N+1 redundant system. However there is always a slight risk and we will have slightly lower redundancy during the work
We will update this as the work progresses and completes
Jul 12, 2023 | Planned Work
Our router vendor used for customer leased line routers has released a number of firmware updates. Over these three evenings we will upgrade the firmare on most customer routers. Each router will see aprrox 5 minutes downtime while the router reboots after the upgrade.
We will confirm as the work progresses and completes
Jul 12, 2023 | Planned Work
We are planning a small upgrade to our links between Telehouse North and Telehouse West and Telehouse Noth and harbour Exchange quare on the evening of Monday 17th July
This will leave the sites at risk and some potential very brief blips in connectivity as the fibres on these buildings are moved over to our new DWDM platform.
We will update this post once the work completes
[completed]
This work completed as planned with minimal impact – the DWDM fibre links are now working as expeted
Jun 4, 2023 | Outages
We saw loss of connectivity to some of the servers in Huntingdon between 3pm and 4pm this afternoon. This was due to an issue with one power feed to a core rack.
Most of our new network is now dual fed- however some of the legacy network on the older Cisco switches is single fed. We saw one switch down during the issue.
Our engineers attended site and resolved the issue – we are performing further checks and will continue the replace the older switches as quickly as we can.
We apologise for any issues
May 19, 2023 | Planned Work
Our engineers along with Telehouse will be working to upgrade the Power Supply to our rack in Telehouse West this evening to allow expansion and additional equipment to be installed. The rack had two resiliant feeds and all core equipment is connected to both feeds.
During the work one Power bar will be replaced at a time – reducing meaning there will for a short period be no resilience on the power in the rack. We do not anticipate any impact but the service should be considered at risk
We also have a fibre link between Telehouse West and Telehouse North which is showing some low level errors. Last week Telehouse tested the fibre which passed – while on site we will replace the optics on this link to see if this clears the issue – if not we will ask Telehouse to run further checks on this fibre. While this is being done again there will be a brief loss of resilience on our fibre ring but we do not expect any customer impact
We will update this if anything changes – and on completion of the work
[completed]
This work completed on Friday evening – we did see two issues through this work. The router that is usd for some OFNL connections for Air customers had an issue for about an hour due to an unplanned powercycle and not re-starting correctly. A few fibre NNIs also bounced. This also affected one of our Name servers. We are sorry for any service disruption from this.
May 11, 2023 | Information
We have had an alert of one of our fibre links between Cloud House and Telehouse is currently down, At this point it is not affecting the merula Core netwoek but does mean that we have a loss of resiliance between sites.
This is service impacting to customers taking a wave service between these two sites
The issue has been raised to the fibre provider who are actively working on the issue
We will update as we know more here
[update 11/5/23 8:00]
The fibre provider found the cause of the break and restores service on this link approx 1:45am. We have been monitoring this link since and all appears stable.
Mar 16, 2023 | Planned Work
With the recent migrations from Air Broadband to Merula we need to perform a router reload and to add additional IP addresses to our routers pool to enable a large number of migrations. This should also clear the issue that has been seen the last few days.
Note this maintenance will only affect customers where we have ‘adopted’ the Air router as opposed to moving to our own setup. We anticipate this will be the last change we need to make for some time.
The plan for this evening is
1) Upgrade Router to latest firmware and reboot
2) Add additional IP Address Pools
Due to the nature of this customers on this router may see a longer initial outage from the upgrade / reboot (approx 10-20 minuites), followed by a few shorter drops as the extra IPs are applied and the router interface reset.
We will start this work shortly and update once complete
[completed]
This work is now completed and we can see the sessions that dropped back and we see traffic passing. If you do see any issues – please let us know
Feb 13, 2023 | Planned Work
Our Router vendor has released a new firmware for the routers we install at our customer premises
Over the two dated above we will perform a rolling upgrade to all of our Leased Line customer routers.
Each affected customer will see a 5-10 minute drop on their service while their router upgrades and reboots. Upgrades will start after 10pm each evening and complete in the early hours of the following day.
If you have any questions please do email the support team
