We are aware of some issues on the LINX peering network. While this is not affecting our network at present some sites and locations may be slow as a side effect of this. We are awaiting more details from LINX and will update this as more is known
We have identified an issue with the reporting from our primary UPS in the Huntingdon Data Centre. We have specialist engineers arriving on site with the necessary spares to fully test and resolve this issue.
During the work there will be times when the data centre will be powered via mains power rather than via the UPS system. This means that in the unlikely event of a problem with mains power to the building there may be issues with some services here.
We do not anticipate any issues but wanted to advise our customers of this work due to the slight risk associated with it.
This work has now been completed with the replacement of the main board in our UPS which appears to have resolved all issues
We are aware of reports of a bug affecting Juniper core routers affecting some ISPs and large interconnects that are causing these routers to crash. Symptoms include increased latency and slow speeds when attempting to load websites. Please be aware of this as it may affect your own connections if any of the intermediate links depend on these ISPs or routers.
We apologise for this brief window of down-time caused by a misconfiguration on a third party suppliers link. This meant that a network loop was introduced into our network today causing a brief outage for some users.
The core switch here recovered automatically after about 10 minutes and took the link out of action and we have left it down while we investigate the cause in more detail.
We will post more as soon as we know.
We have identified a battery issue with a UPS at this site. A third party engineer will therefore be replacing all batteries in this unit tomorrow.
This maintenance is not likely to cause any outage or issue however the site should be considered ‘at risk’ thought the works
Thios work has now been completed and the UPS is now fully working
This may affect some customers but the router should re-connect and authenticate after the work is completed:
This Pew PW177211 is an emergency pew that will affect WMBC shared end users who are connected to the Leeds 21c POP.
The impact will be that end users at Leeds will experience down time between 02:00 and up to 06:00 .
The CP’s whose end users are on this site will see authentication requests but the end users will be unable to connect to their WBMC shared CP.
It appears that the BT outage that occurred a few days ago has just reoccurred with virtually all BT ADSL circuits going down.
As I type we are seeing ADSL sessions returning so we hope but can not guarantee that this may be a small blip. We will update you as we know more.
BT have confirmed an issue in London so far.
UPDATE3:
BT have finally reported that this has been cleared. We still have a few users not logged in correctly. The fix for this is either a router re-boot and leave it switched off for at least 30 minutes, or, if that’s been tried and still fails to establish a connection, we can arrange for a line reset. If you’re in this position, please drop an email to support@merula.net or call in on the helpline and we’ll get that working for you.
We’ll advise here when BT confirm exactly what went wrong. The emergency work was completed around 5pm and this had caused overnight instability. At 5.30, the Stepney Green system went down again. And stayed like that until a few minutes ago.
Again, our apologies if you were affected.
UPDATE2: BT have confirmed that this is still an outstanding loss of service which they’re still working on. The last update was at 9.30 with no time to fix agreed then. We apologise to those customers still affected. Please keep revisiting this page for updates.
UPDATE: BT undertook emergency work in the Stepney Green area which should have
been completed by 4am. This is however still causing issues with
authentication. We’re waiting for a definitive answer from them on “time
to fix”.
A router re-boot has worked for some people but not all.
We’re aware of reports of outages for ADSL users both in the Merula network and elsewhere. We are investigating and will report back.
During this engineering window LINX (a major UK connection point used by numerous ISPs) are upgrading their routers at Telehouse North. This may lead to periods of routing issues overnight as various ISPs including us are moved between the old and the new hardware. This might also mean that some sites are unavailable or slow for short periods of time at various times during this period. If you are still seeing problems after this time please log a support call or ticket in the normal manner.
We are in the process of updating one of the gateway ADSL routers as we’ve been made aware of an urgent security issue that requires new firmware. Current connections are being made & authenticated against the backup router. We now have to re-boot the one under maintenance and this will mean a brief window where users may see an outage of around a second. Any new sessions will not be affected.