FUBAR

For the past two years, I have been running a small personal server out of my house. Well, I guess “small” is a relative term. To be more specific, it was a Fedora 8 server with 2 terabytes of storage for my backups, music, and Subversion repositories. Along with my desktop, it was my pride and joy; everything was custom-built, the distro was actively maintained, and all of the configuration was done by a two-factor encrypted console.

Notice the use of the past tense. Was. On Monday I noticed that I was getting read errors on my drives, although I wasn’t sure which one (I had 4 drives). Although I went to bed with a (mostly) working server, I woke up to a system that wouldn’t boot up because the partition information. After fumbling with different recovery methods to try and get my data off, I came to the conclusion that I wasn’t going to get the data off; it was gone, possibly because of my recovery actions.

Needless to say, I was more than a little devastated. Although I can rerip my music, I can’t get back the Subversion repositories; those are all gone, along with all of the revisions I’ve made on projects.

Despite my demotivation, I took this as one huge learning experience. Although I had made backups of some of my work, it was still on the same drive and partition, and I should have considered them just as vulnerable as the originals. When you can’t make consistent backups on a different system, RAID your drives.

I’ve since reinstalled my server as a 1TB RAID10. Alrhough this means I have half the space to work with, it also means that I have 100% redundancy. So, if one of my drives fails like what happened to me, all I have to do is pull out the drive, put a replacement in, and the system will copy all of the data over to the new drive. The best part about all of this is that this all happens on-the-fly; no downtime, no rebooting, and no manual work except for adding the drive to the RAID configuration.

In short, if you take one thing away from this, remember to back up your stuff frequently, even if it’s just on a flash drive or external hard drive. When your original fails, you’ll thank yourself for that backup.

Tagged with: , , , ,
Posted in Rants, Technology

Leave a Reply