Apr 15, 2021 | Uncategorized
Good morning.
In an issue unrelated to those seen over the past couple of days, a beaconing problem on one of our ports at LINX, meant that for a few minutes this morning, between approx. 9:15 and 9:45, a small number of sessions were affected and they saw increased packet loss and increased ping times. The port was reset and traffic went back to normal. Our apologies to those customers affected who may have seen RDP (and similar) sessions drop or response times degrade for that period. And we’re sorry that this came so soon after the earlier ones.
We believe all traffic is back to normal now across LINX but please contact support in the normal manner if you’re seeing any ongoing problems.
Apr 14, 2021 | Information, Outages, Planned Work, Unplanned downtime
Once again, please accept our apologies for the problems you’ve seen over the previous couple of days. We realise that this has caused you all serious issues and for that, we’re very sorry.
Various internal changes have been implemented over the last 48 hours and currently, we believe that the network and associated services are now stable and will remain that way. We continue to monitor the situation closely to ensure that our network remains stable and there’s no further impact to your services.
Please email us in the normal way if you have any question or concerns. Thanks again for your support through this incident.
Apr 14, 2021 | Uncategorized
We are aware of ongoing problems caused by another attack flooding the networks; we are working on these as before and sincerely apologise that we’re not able to confirm a final resolution just yet. Please bear with us and we will keep updating the status page here as work moves on.
Apr 14, 2021 | Uncategorized
As you’re no doubt aware, we’re still seeing issues from this ongoing attack which are affecting the same services as yesterday. We are working hard to mitigate this but it is the cause of many issues being reported into our support team. As you’ll appreciate, the lines are very busy at the moment and ticket volumes are very high, so please bear with us if replies are delayed a little.
We will continue to update here as we work on this problem.
Apr 14, 2021 | Uncategorized
We are aware of issues still ongoing; we are actively working on these as before to mitigate their effects. We don’t have an ETA at the moment but we will update the status page as soon was we do.
Apr 14, 2021 | Uncategorized
Good morning.
We continue to monitor and manage this issue with assistance from our network team and we aim to provide a further update by 11am.
Thanks for your patience and once again, our apologies for the issues seen.
Apr 13, 2021 | Information, Outages, Unplanned downtime
23:30 Again, our apologies
We continue to undertake remedial work to mitigate this ongoing attack.
We will update here as usual.
————
We are currently seeing a new, large-scale DDoS attack against our IP range. We are working to mitigate this but some services are being affected, with packet loss, routing failures or intermittent outages. Some email delivery will be queued until this is resolved.
We will update here as usual.
13:06 UPDATE
We are mitigating a large portion of this attack traffic but currently, the transit links remain saturated which is causing the current ongoing problems. We continue to work to resolve this as quickly as possible & apologise for the ongoing inconvenience caused.
13:44 UPDATE
We are seeing most services recovering. The attack target remains offline but we believe that this incident is now contained. We apologise again for this interruption in service. If you are still seeing issues, please restart your equipment. Tickets can be raised now in the normal manner & the support line remains ready to assist.
17:43 UPDATE
The offsite server that hosts the status NOC site went down during the afternoon. Purely coincidental, but it meant we weren’t able to access it to add more frequent updates. It’s now back and we’ll update the status on the DDoS attack issues shortly. Our apologies that this wasn’t available when it was needed the most.
Apr 10, 2021 | Information, Outages, Unplanned downtime
We are currently seeing a large scale DDoS attack against our IP range.
This will lead to significant packet loss and access issues to our customers. Our NOC team are already at work to mitigate this. We will post a further update as soon as we have it
[Update 11/04/21 – 10:00am]
We believe the issue cleared shortly after 7pm yesterday. We are still monitoring this closely however we do not believe there is currently any ongoing customer impact
Mar 9, 2021 | Outages, Unplanned downtime, Update
We have seen alerts that some circuits from Virgin Media have dropped. We believe this is a Virgin Media issue but are currently investigating.
We will update this status as soon as we know more and within the hour at the latest.
UPDATE: 16:09
Virgin have confirmed an issue at one of their hub sites affecting some parts of Hertfordshire. Senior engineers and the Core Incident team are working on this at the moment.
We will have another update — if it’s not restored — within approx 30 minutes.
UPDATE: 16:20
We are seeing the affected circuits back on line – at this point we don’t have an ‘all clear’ so they should be seen at risk – but we hope this is resolved
RESOLVED 16:20
We have received the following update from Virgin Media
Please be advised that @ 16:22
Restoration Details:IOM Card 2 and MDA Card 1 remotely reseated on T0090 Luton Metnet 2a.
restoring all services.
This appears to have been a card failure at one of the Virgin Media Hub Sites – we apologise for the issues that occured here
Feb 8, 2021 | Uncategorized
In the early hours of this morning a single PDU failed taking approx 5 servers down in our data centre – including one of our two mail servers (which work as a mirror) and a couple of other customer servers.
The PDU has been replaced and we are just checking that all servers return as they should.
Note that no email etc has been lost here.
We will update this as we have confirmation all servers are back up and operational
[Update 10:30]
All affected services & servers are now back up and running after the PDU replacement – several VMsneeded a manual boot and some services needed a manual start. It’s possible that some older email may take a little while to sync but no email has been lost
We are sorry for the issues here
