Due to a memory leak one of our core routers (thn-gw2) has just rebooted. We are seeing all services back as they should be.
As this is one of a resilient pair of routers there should not have been any outage – BUT there may have been a brief ‘blip’ while the network switched over top the backup router (and another when thn-gw2 returned to service).
We are monitoring the issue and will update this post if we see any further issues
UPDATE:
Through investigations Level3 isolated the trouble to overutilization on a link from Toronto to Chicago. Traffic was rerouted to avoid the trouble and services are now restored. Level3 will continue monitoring services to ensure continued stability.
Please be advised that one of our transit providers, Level3, are experiencing an issue that may result in packet loss to some destinations. We will keep you updated as and when we receive more information. If necessary, we will disable this link until they resolve the problem
Between 23:00 and 05:00 on the night of 14th running into 15th, one of our back-haul providers is making some configuration changes. At some point during this window there may be a brief (30 second or so) increase in lost packets but there should be no loss of Internet connectivity. During this same brief window, the connections to any servers hosted at our Manchester POP will be at risk.
Our supplier is undertaking their regular maintenance & checking work on our main UPS at the Huntingdon data-centre on this date. There should be no impact on the day to day operations and this is informational only.
Following the problems we’re still seeing as part of the over-running planned upgrade to our email infrastructure, we’ve decided that it’s necessary to take the mail-servers off-line at 5pm today for a period of up to 2 hours to allow this syncing to proceed quickly to completion.
Once that has occurred and run to completion, we’re confident that the new system will respond correctly as planned.
Update: The primary server is now back in service with all emails – We will be working on the backup server tomorrow – however we do not expect this to be service affecting.
Update: The mail servers are now back as a resilient pair – initial testing has shown this to be much faster and reliable – any issues please contact support
We had to reboot one of our core ADSL routers as we were aware of various problems affecting a significant number of lines and we took the decision that a very short outage was needed to allow these sessions to be cleared down. We have seen all of the affected lines come back successfully, so believe that this is now resloved. Apologies to anyone who briefly lost their connection.