Latest in Benchmarks

Image credit:

Microsoft Research team shatters data sorting record, wrenches trophy from Yahoo

Alexis Santos
05.22.12
59 Shares
Share
Tweet
Share
Save

Sponsored Links

Bruise inducing high-fives, anyone? They're handing them out in Redmond, according to one mildly injured researcher, after breaking a data sorting record Yahoo set in 2009. The ruckus surrounds a benchmark called MinuteSort, which measures how much data can be sorted in 60 seconds. Microsoft's Distributed Systems group utilized a new file system architecture, dubbed Flat Datacenter Storage, over a full bisection bandwidth network to burn through the competition.

Not only did the nine-person crew best the old record nearly by a factor of three, it gave itself a handicap -- sorting 1,401 GB of data at 2 GB/s over a remote file system, forcing the system to crunch data at a slower speed than the technique is capable of. It's not all about bragging rights, however, Bing has its eye on the newfangled file system in hopes of boosting its RPM. Microsoft suspects the tech could also pick up the pace of machine learning and churn through large data sets in a jiffy. You can catch Microsoft Research's detailed explanation in all its glory at the source.

Update: Commenter Mark Streich points out that while 2 GB/s may sound fast, it's certainly not speedy enough to sort 1,401 gigabytes in a single minute. To achieve that performance, simultaneous input and output speeds could hit 2GB/s on each computer used.

All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission.
Share
59 Shares
Share
Tweet
Share
Save

Popular on Engadget

Engadget's Guide to Privacy

Engadget's Guide to Privacy

View
AMD delays 16-core Ryzen 9 CPU to November

AMD delays 16-core Ryzen 9 CPU to November

View
Erica's modular synth helps you make music with preset cards

Erica's modular synth helps you make music with preset cards

View
TiVo gave its unannounced Edge DVR to a customer

TiVo gave its unannounced Edge DVR to a customer

View
Facebook will shut down Group Stories on September 26th

Facebook will shut down Group Stories on September 26th

View

From around the web

Page 1Page 1ear iconeye iconFill 23text filevr