quality assurance
Latest
EVE dev blog charts much improved customer support experiences
Long petition queues, particularly related to expansions, has long been a problem in EVE Online. These long waits may very well be a thing of the past, according to GM Nova, Senior Game Master for EVE Online. GM Nova's latest dev blog, "Such stuff as dreams are made on," deals with the deployment of the Empyrean Age 1.1 patch in early September, as seen from a Customer Support perspective. "We at Customer Support, being at the front lines so to speak, are in a unique position to judge or evaluate whether a patch was successfully deployed and if ther is any fallout or unexpected problems involved, as the potential torrent of problems are directed at us to pass on," he said.GM Nova points out how that 'torrent of problems' has slowed down to a trickle, using graph data of the Trinity expansion deployment (predictably an insane amount of petitions), the subsequent Empyrean Age 1.0 patch (so smooth they thought their petition system had crashed), and finally Empyrean Age 1.1. The trend evidenced by the graphs is that their patch deployments are becoming less fraught with complications, meaning happier players in the long run. GM Nova goes on to discuss some of the structural changes made to CCP's Customer Support department that improve petition response time, saying,"We are happy to announce that our average petition age is currently two days with most normal requests handled in hours. We hope our efforts shine through in the level of support we are able to offer." Would you agree with GM Nova's assessment, and have your own petitions of late in EVE Online been resolved in a reasonable amount of time?
Izuna 2 QA causes a lot of pink hair pulling
Izuna 2: The Unemployed Ninja Returns is about more than mini-posters and sexy ninjas -- a lot of work goes into getting a game like this localized. Not only does a good localization team have to focus on the translation, but they also need to fix any bugs or problems that gamers found in the Japanese release. Apparently, fixing bugs for a roguelike is especially hard and frustrating, as you might have guessed.Here's the Quality Assurance stat breakdown, according to Atlus: Number of testers on Izuna 2: 6 Number of DS systems almost thrown against the wall: 6 Number of system-type bugs our testers reported: 104 Number of text bugs our testers reported: 259 Number of times the testers nearly gave the project lead a heart attack with a fake system bug: 3 Number of bugs our testers reported to which we responded: "That's not a bug, that's the way this game works:" 17 Number of monkeys we could have hired to do their job: 0 The production diary is actually a really interesting read that not only Izuna fans, but also people interested in the localization process should give a look. Besides, we always appreciate more insight on how the other side of the gaming industry works. Gallery: Izuna 2
Meet Champions Online's Q&A lead
Say hello to Alan Salmassian. He's the man in charge of ridding Champions Online of those pesky code bugs everyone hates encountering. Sure, it may not be the most glamorous job on the team, but it's definitely got some benefits. We're not sure what those benefits are -- presumably you get to laugh at crazy bugs that make inanimate objects flee in terror -- but we're sure that they're great. Also, it sounds like being a Q&A lead requires you to have tons of management skills, which means we could never do the job. All right, we're removing our tongue from its resting place in our cheek now. Like all the other people developing Champions Online Alan is equally important. If it wasn't for him and his team we'd all end up playing a game that crashed whenever we tried to open a door in-game or press the 'G' key. Also, we think that Alan's got a killer smile.
My Eye Media enters Blu-ray quality control arena with Blu-Qual
After seeing a wave of faulty Blu-ray Discs a few months back, we've heard relatively little about further mishaps. Still, that's not stopping firms from hoping in the quickly-expanding quality control arena. On the docket today is My Eye Media, which is broadening its service portfolio with Blu-Qual, a BD testing solution "designed to analyze the complexities" of the format. More specifically, it's out to "identify impairments, artifacts and technical anomalies much earlier in the production process than traditional optical media testing methodologies have allowed," and while you'll likely never know what titles it touches, we're all for making sure shipping products work as advertised.
BluFocus working with studios to ensure Blu-ray disc quality
Barely a month after Microsoft revealed the Xbox 360 HD DVD Emulator in hopes of speeding up development of HDi, we're seeing a new company emerge with bolstering Blu-ray Disc quality as its top priority. Of course, anyone paying attention over the past few weeks would realize that something like this is sorely overdue. Reportedly, BluFocus is already working with a number of studios in order to ensure that BD-J / BD Live functionality is properly implemented and that discs arrive to end-users sans issues. The company (accurately) points out that mastering Blu-ray titles is a much more involved process than mastering a vanilla DVD, and considering just how much interactivity is being mixed in, there's a lot more room for error than in days past. Notably, we're not told exactly which studios BluFocus is currently working with, but here's to hoping we find fewer reasons to plead for replacement discs in the future.[Via Blu-ray, image courtesy of DailyGame]
US chooses two hopefuls to review for future e-voting tests
Just days after the US government decided to bar Ciber from testing anymore e-voting terminals due to its perpetual negligence, it now seems that a pair of Colorado-based outfits are next in line to take over those duties. The National Institute of Standards and Technology (NIST) has recently recommended that iBeta Quality Assurance and SysTest Labs "be granted final clearance to test the systems" after a "comprehensive technical evaluation of the laboratories' processes based on the international standard ISO/IEC 17025, which covers general requirements for the competence of testing and calibration laboratories." Now it seems the final hammer resides in the hands of the US Election Assistance Commission, which is "a federal agency that has sole authority to grant full accreditation to the labs." SysTest Labs isn't new to this e-voting QA game, as the firm was already granted "interim" accreditation and is now awaiting the official seal to keep up the (presumably) good work. Notably, the EAC stated that they would be focusing their efforts now on "non-technical issues such as conflict of interest policies, organizational structure, and record-keeping protocols," but we're not so confident all the hardware checks are as robust as they should be just yet. Nevertheless, we shouldn't count on hearing anything final for quite some time, as this apparently lengthy "review process" somehow takes between 9 and 18 months to complete, so in the meantime we'll just see how many more Americans ditch the whole "voting" idea due to issues like voting in triplicate, getting distracted by board games, or simply obliterating their machine in frustration. [Warning: PDF read link][Via Slashdot]
Prospective QA manager shuns Sony practices, Microsoft too
Sparked by uproar over a "game-killing" bug in Genji, Ritual Entertainment QA manager Michael Russell recalls a job interview for FPQA Manager, held at Sony's San Diego offices. There he caught a glimpse of Sony's QA process, which, according to Russell, "allows creativity to squash quality" -- he promptly removed himself from consideration for the job.Before Ritual, Russell was a lead tester at Microsoft Game Studios. He claims his previous employer is also failing at quality assurance, but from the other end of the spectrum: "At Microsoft, the stringent QA processes often strangle creativity."Russell calls for some middle ground to be walked, lest the industry fall into turmoil, but neglects to offer any advice to Sony or Microsoft. Are we to be doomed by bugs and boredom?[Thanks, SickNic]
Are We All Just Beta Testers?
GameDaily has an interesting article up about how game developers seem to be using players as beta testers. Buggy code is released as a final product to the public with the thought that it can always be fixed with a later patch. And, while the article specifically discusses single player games, the argument is perhaps even more applicable to large MMO's in which regular patches to add content (and fix old bugs) are the norm. While it's understandable to an extent - World of Warcraft is a massive game, and it would be impossible to test every race, class, and talent spec in every situation - some of the bugs are sufficiently obvious that they make one wonder how much testing happens at all. However, perhaps MMO's are so expansive that it's imposible to give them the full quality assurance treatment in the traditional sense - which is why we've ended up with test servers and a regular patch cycle. What do you think - are we beta testing the software we're paying for? And should we be?
