Outages Archives

Tonight's outage

Our Burchett Place datacenter suffered a power outage at approximately 22:30 GMT tonight.

Our backup systems kicked in and kept most of the network up but we lost some connectively and some services.

Rather than risk draining our backup systems completely we decided to shut down everything and wait for the power to be restored which it was about 5 minutes ago.

We're still checking the final few systems are back online but all services from Inca, Zapotec and Nazca are now back online. No other servers were affected.

Inca back online

We took Inca online at 14:46 this afternoon to move her to a different datacenter, as mentioned in our previous post, to the one where Maya is currently located.

The move has now been pretty much complete. We got her back online at about 17:00, maybe slightly before, but services have been going up and down as we played around with the network setup.

All services have now been restored and are available to use once again.

Inca datacenter move 2

We are once again moving Inca to a different datacenter, the one that Maya is now located at.

This will involve several hours of downtime during the afternoon today (Sunday). Only users who use the services on Inca will be affected, everthing else will be running as normal.

Inca power outage

Due to a fault discovered with the building, we are having to turn the power off for several hours starting at 13:00 BST today. During this time Inca will be offline.

Inca datacenter move

Inca will be down for scheduled downtime later today as we move her to a different datacenter. We expect the move to start at around 16:00 and last approximately 2-3 hours.

We will also be completing some maintenance before it goes offline to bring everything up to date and ensure everything is running. This should not affect any services however.

MySQL server outage

Our primary MySQL server failed in the early hours of the morning. It has now been repaired and the databases are back online.

Possible outages on 13 February

Anyone who uses services on Inca server should be aware that there will be a maintenance window on Tuesday 13 February 2007 between 07:00 and 09:00.

Some service distruption may occur.

Our web servers and email servers will be unaffected.

Minor server outage

Our server was down between 8:17 and 8:27 this morning. Luckily we managed to catch the problem almost immediately and restore it within 10 minutes.

Web server down

Last night our web server was taken offline by abuse caused by an insecure script being run by a client on the server.

The account has now been suspended and the web server has now been brought back online.