Netflix outsources translation to third-party services, all with different recruiting practices, "so it's nearly impossible for Netflix to maintain a standard across all of them," it wrote in its Hermes launch post. To improve quality control, Netflix said it took a "Hollywood meets Silicon Valley" approach to solving it.
Hermes grills candidates on their ability to understand English, the root language of most of its films. It also tests their ability to "translate idiomatic phrases into their target language" without linguistic or technical errors. For instance, "they are very shrewd and made a killing" is ripe for mistranslation if the subtitler isn't familiar with double-meaning of "made a killing." There are over 4,000 such expressions in English, Netflix says, so it's important to find a translation that's "culturally accurate" while keeping the color of the original.
After taking the tests, each captioner will be assigned an "H-Number" that tells Netflix their skill level. That way, it can use its best people for, say, Out of Africa, while those with lower skills could handle Mama Mia!
The H-Number, which Netflix will require of every subtitler by this summer, will also help it to match the quality of a translation to the person who did it. "Perhaps they consider themselves a horror aficionado, but they excel at subtitling romantic comedies -- theoretically, we can make this match so they're able to do their best quality work," Netflix says. It adds that soon English "won't be the primary viewing experience on Netflix," making the work increasingly important for a company that's keen on expansion.