Nov 15, 2013 | Outages
At approx 4:15pm Friday the UPS in our Huntingdon data centre totally failed. Rather than switching to bypass power (raw mains) as it should have done it turned off all power fed from it.
Our core network in Huntingdon has a separate UPS which stayed on but many servers did power down.
We switched over to raw (unprotected) mains within 10-15 minutes and a majority of servers had their services restored. We did have one rack with a failed network switch which was replaced approx 9pm and a number of servers which needed manually bringing back to service.
Thanks to our UPS service company a replacement 80KVA UPS was installed during the day yesterday (Saturday) and all load was switched back to this restoring service ans resilience to all servers there.
There are a few final jobs to do but these should not be customer affecting. IF you are still seeing any issues please do let us know
Note this outage should NOT have affected ADSL customers as long as you are using the recommended DNS servers as these are not located in Huntingdon – the only services affected *should* have been those that are there.
If you have any questions at all please contact support
We are sorry for anyone affected by this issue
Aug 8, 2013 | Outages
We are aware of an issue affecting C&W / Vodafone based ADSL Connections. Many of these are currently down.
We have reported this and they are aware of an issue in Telehouse North that should be resolved overnight.
While this issue is in place any C&W connections will see sync BUT no Internet connectivity.
This issue was caused by a fibre break and was cleared early Friday morning.
May 31, 2013 | Outages
BT have informed us of a known issue on their network affecting some of our ADSL services.
This is affecting many ISPs not just ourselves.
We are awaiting an update with more details.
BT reported this issue closed approx 10pm 31/05/2013 – We can’t see any real impact to our users thankfully.
If you do have any issues please contact support via the normal routes
May 27, 2013 | Outages, Unplanned downtime
We are aware of a network issue that occurred this morning. This appears to have been caused by one of our routers crashing.
We do have multiple routers so normally this would not cause a problem – however in this case it would appear that while the router stopped routing some traffic properly it was still advertising the route to our other routers.
We have now reset the failed router which so far seems stable – we are monitoring the router for any signs of issues
We are sorry for any problems caused by this issue.
Mar 11, 2013 | Outages
There was an issue involving BT ADSL connections between approx 1:30am and 3:40am this morning [11/03/2012].
Working with BT we now believe these issues are resolved and can see most connections back on line.
If you are still seeing an issue please reboot your router and if this still continues please call or email support in the normal way.
We are sorry for any problems this may have caused
Dec 31, 2012 | Outages
At approx 3:30pm today there was a power outage from the raw mains to our Huntingdon Data Centre which resulted in the loss of a single phase of the mains feed.
While we have a UPS and Generator backup to the data centre the actual failure coincided with a surge from the data we have here – this lead to our UPS protecting itself and our servers and consequently taking down the power feed to all servers in the data centre.
As soon as we were sure of the cause we manually transferred the power feed to our generator and restored power to all affected routers and servers – most were restored within 20-30 minutes. We are currently going through all remaining servers and checking their status.
We now believe that the main issue has been resolved and all public facing services and co-location servers are back and accessible.
IF you are still seeing an issue please call or email support the normal way and we will investigate and resolve the problem.
We are sorry for any issues that have been caused by this outage
