Behind the scenes at Sony's network operations center
If keeping just one computer running and up-to-date is a hassle, imagine keeping six to seven thousand of them going, 24/7, with any unexpected downtime sure to draw the anger of extremely vocal gamers. That's the challenge faced every day by SOE's Director of Technology Operations, Mark Rizzo. Rizzo cut his teeth running the back-end for MMO legend Ultima Online. Back then, he and his team were building things by hand and learning as they went. Now, things are a lot more complicated. With eight games already and more coming online all the time, handling all the users and simultaneous transactions is more like working in the data center for a stock exchange rather than your typical web-hosting service.
Says Rizzo, "We did an April Fools' prank in one of the games and we had to have some server code updated to pull the prank off. Change management allowed us to know who approved it, and know where it's from, and where it's going." It's said that if you like sausage or law, you should never see it being made. This peek behind the curtain at the code and hardware that keeps swords flashing and spells weaving just deepens our appreciation of this difficult task.
[Via Slashdot]
