Jun 15, 2011 | Planned Work
At 11pm tonight, we intend making a small config change to the UPS system acting as the backup for one of our more important racks here in Huntingdon. Whilst moving this from bypass should not affect the rack in anyway, we are however advising customers that there may be a window of downtime of a maximum of 30 minutes if this fails to switchover correctly or causes other cascading issues.
Services that could be affected:
Merula website & associated sites.
A small number of servers hosted in Huntingdon.
To make sure that this is the maximum downtime, we have current backups of the configs of the core routers here as well as suitably specified and tested fall-over units available to use should any of the live ones fail to come back up for any reason. Again, we have no reason to expect this to be a problem but want to ensure that worst case is prepared for.
Apr 24, 2011 | Outages
Due to a hardware fault on a single server which was temporarily hosting a number of internal systems, some users may have seen an issue on Saturday night.
Systems affected were RADIUS authentication for ADSL (users who were connected were fine, though those that had to reconnect would have had problems), one of our DNS Servers and the Merula webite and portal, since these were all being hosted as virtual servers on the same physical box until the new hardware for each of these, which we were in the process of installing that day, went live.
The cause turned out to be two faulty Hard Drives and appears to be due to a bad batch of drives. Service was restored to some degree by about 2pm and after that we moved the services and servers, one at a time to their new hardware. We believe that all services are now running fully but if you are seeing any remaining issues please call or email support in the normal way.
Apr 7, 2011 | Outages
Last night the mains power failed to the building and kept tripping in and out. The UPS immediately took over and the generator kicked in as planned. Because of the up and down nature of the electrical supply we left the building running on generator until we were happy that the supply company had resolved the power problem which took a number of hours.
Unfortunately, over the last week or so we’ve had approx. 6 similar (albeit lesser) power feed issues and that’s apparently drained the UPS batteries. The engineer attended this morning and advised us that the expected life would be 8-10 years. However, we are now advised after diagnostic tests, that most of the 60-odd cells need replacing now (after only 2-3 years usage). This we’re arranging over the course of the next few days.
The effect of these problems last night was that connectivity with a few servers was lost and not restored until this morning but these we found to be internal issues with dirty file systems not allowing booting and other services on client servers failing to re-start correctly. As far as we can see, apart from the building UPS batteries reaching “end of life” far earlier than we expected, all our systems reacted correctly.
Mar 18, 2011 | Outages
We are aware of some network issues overnight. These afeected connectivity to our Huntingdon Data Centre and some servers in London.
From the information we have it seems that most ADSL sessions that were active were OK but some new sessions did not connect properly until 2am. Initial investigation seems to show a DOS against our network and while we have put in place some blocks for this we are investigating further to get to the root cause and ensure it does not re-occur
Nov 21, 2010 | Outages, Planned Work
BT are working at the exchange that our ADSL central pipe connects to overnight tonight. This is a major upgrade. While we do not have too many details at this point there is a posibility that there may be an outage on our ADSL network between midnight and 6am tomorrow.
This will not affect any of our LLU offerings but may affect any or all of our BT ADSL offerings
Oct 27, 2010 | Planned Work
After a long wait we are pleased to announce that our new 1G link to BT for ADSL is now live. This means we can now offer ADSL2+, FTTC anf FTTP products as well as standard ADSL1 based BT products.
As the final part of the installation we will be moving our existing users to the new infrastructure tomorrow at some point after 2pm.
This should not have any impact on your service other than a single reset when your connection will drop from the old service and reconnect to the new link.
We will be announcing a range of new peoducts very shortly
Oct 23, 2010 | Outages
Some users may have seen an outage with their ADSL between 5:30 and approx 7:45am this morning. We are still investigating the cause of this issue although the problem appears to be upstream from us at this point. Full service was restored by 8am and we are monitoring the situation to ensure all is well.
If you are still seeing an issue please contact support in the normal way.
Oct 2, 2010 | Outages
Between approx 4pm and 6pm today a small number of servers were down on the Merula network. This was due to a Power Supply on one server failing and tripping the power to one of the racks.
Our engineers were on site as fast as possible and all services were resumed very quickly.
If there are any ongoing issues please contact support
Mar 31, 2010 | Planned Work, Uncategorized
Some users may have spotted issues reaching some of our services and with some of our ADSL connections between 0:30 and 1am. It appears that due to an error by a third party a a network loop was created causing some routing to get a little confused.
The issue seemed to have righted itself while we were investigating. We are reasonably confident that all services and servers are now fully working but we are investigating the root cause here to try and protect ourself against a reoccurred
Mar 24, 2010 | Planned Work, Uncategorized
Some ADSL users may have seen an issue from approx 8:45 and 9:00 this was due to an engineer on site making a change to our ADSL routers that caused a temporary loss of connection for some users. As soon as the problem was spotted the issue was resolved.
We are sorry for any issues resulting from this and will ensure this does no happen again
