Blog
This is an early notice that there will be some scheduled downtime for Olmec, Nazca and Aztec this Sunday morning. We need to alter the power network and so will have to disconnect some of the servers in order to do this.
We'll post an update shortly before we take it offline. The outage window should only be about 15 minutes, possibly even faster if there are no issues but then there often are in these situations.
Futher more there will be another outage approximately a week later in order to carry out further maintenance to the power network. We will also be using this window to carry out some software upgrades and so expect the window to last an hour.
Finally, in the time between the two maintenance windows we will be running on limited uninterruptible power systems and so while we don't expect to have any outages, if the local power does fail the servers will be taken offline quickly.
Olmec is now back online, all services should be once again up and running. As far as we can tell there was no damaged resulting from the outage.
First of all, we're aware Olmec is offline. We don't yet however know why. It lost network connectivity and when we restarted it, it output a series of beeps and refused to boot up. We're taking it out of the rack for a proper look now.
There is a maintenance window between 23:00 8 February and 04:00 9 February which will affect a few of our web servers. The actual downtime is not expected to be more than 15 minutes.
There will be maintenance carried out on some of the web servers on Friday 1 February. The servers affected are Sarah Jane, Jennifer (currently hosting this site) and Charlotte.
The window will be between 23:00 on the Thursday night and 02:00 on Friday. There should only actually be 10-15 minutes of downtime however.
First up we have finished the maintenance on Inca! We've restored all the data so data is now available once again as are all the other services.
Secondly this means that Inca is now running at gigabit speed (it was one of the few machines we have that wasn't yet) so you should see a slight improvement of speed.
Secondly, now that phrase one has been completed we can begin phase two - the work on Olmec. So although all the data on Inca is now available, you won't be able to access it via FTP as we're taking the FTP server offline :p.
Seriously, Olmec is being taken offline while we conduct some maintenance. We're making lots of hardware and software changes so it could be offline for an extended period of time. We'll keep you up to date.
We're finishing this maintenance window as we need some of the services back online. As usual there are a few complications though (would we really have it any other way with computers :p).
We're half way through getting everything set up. At the moment we have brought all the services up so all the communication services are back. The only thing we are missing is the data store due to the hard drive replacement (as I write the new one is formatting).
If all goes well we shouldn't actually require any more downtime as everything we need to do now can be done while the server is live. Watch this space for more updates.
Inca will be offline for the next hour as we carry out some maintenance. As well as bringing everything up to date on the system we are doing some hardware maintenance so there may be more downtime to come if things don't all go to plan.
We're increasing the network connectively by adding another network port and replacing one of the hard drives so it's no easy task. Once it is back online it will take us some time to restore the data. If everything goes to plan it will all be back by tomorrow morning. If not, we'll let you know :p.
Inca and Olmec will both be down for a short period this evening as maintenence work is carried out on them to bring them up to date. It should be finished by 21:00 GMT at the latest.
You may have noticed a lot of our sites have been online over the weekend. This is because of some security issues we ran into that were serious enough for us to pull the main web server until they had been resolved.
The aftermath of which is that we still have a lot of work to do in checking over our network to ensure everything is secure. This also leads onto the a wider problem which means we are going to have to make some changes.
Unfortunately there are a lot of people out there who are just simply bad people. This people thrive on other people's misery, hacking, destroying and spamming. They are the scum of the earth up, up there with pedophiles and people who talk at the theatre.
The Worfolk Online network as always had a philosophy of keeping our legacy sites online so people have access to as much content as possible and because the internet currently suffers from big problems in terms of content only being available for short periods. How many pages have existed for more than 18 months? Not many. This results in many dead links as pages appear and disappear while annoys and flustrates all of us.
Unfortunately we simply can't keep a network the size of ours secure and safe from from all the scum out there. So we're going to begin culling our network quite dramatically. Our important sites will be kept online of course and we hope to keep most of them online. But a lot will disappear. So enjoy them while you can.
|