NaturalUserInterface
Latest
Microsoft launches Bing platform for developers
Microsoft wants developers to make Bing a central part of their apps, and it's powering that with a new developer platform unveiled today at Build. The Bing kit will let programmers tap the search engine's wealth of knowledge, providing direct information and translations when they're relevant. It should also grant access to natural interfaces, such as gestures, as well as real-world map data. Microsoft showed the platform at work in both Windows 8.1 and Windows Phone 8, so it's clear that developers who want Bing's resources won't be locked into any one device type.
The Distro Interview: Microsoft Principal Researcher Bill Buxton
Bill Buxton has spent most of his career getting between humans and computers. While his initial focus was on music and digital instruments, that eventually led to an interest in human-computer interaction, and pioneering work with multitouch systems and other user interfaces. He worked with the famed hotbed of innovation Xerox PARC in the late 1980s and early 90s, and was later Chief Scientist for software firm Alias Wavefront before claiming the same title at SGI Inc. when that company acquired the former in 1995. After a time running his own Toronto-based design and consulting firm, he moved on to Microsoft Research in 2005, where he continues to serve as the organization's Principal Researcher. We recently had a chance to pick his brain and get his thoughts on a range of issues, including state of design at Microsoft, the future of natural user interfaces, and whether we're really entering a "post-PC" era.
Microsoft strikes deal with 24/7, promises to 'redefine' customer service
A partnership between Microsoft and customer service company 24/7 may not exactly sound like the most exciting proposition on the face of things, but the two are making some fairly lofty promises, and Microsoft seems to be making a serious investment in the initiative. As ZDNet's Mary Jo Foley reports, part of the deal will see Microsoft send at least some of the 400 employees it brought on in its 2007 acquisition of TellMe Networks to 24/7, and it will also license some of its speech-related IP to the company (in addition to taking an equity stake in it). The goal there being to combine natural user interfaces with a cloud-based customer service platform, which Microsoft promises will "redefine what customer service looks like." To that end, it gives the example of a credit card company getting in touch with you to report suspicious behavior; rather than a phone call, you could get a notification with all the pertinent details sent directly to your phone, which could anticipate a number of potential actions and let you respond by voice (or touch, presumably). Unfortunately, while the two are talking plenty about the future of customer service, there's not a lot of word as to when that might arrive.
Microsoft HoloDesk: when you need to juggle something that isn't there (video)
If you'd thought that OmniTouch and PocketTouch were the end of Microsoft Research's natural user interface projects, think again. It's now released a video of the HoloDesk, a tool that lets you manipulate virtual 3D objects with your bare hands. Looking through a transparent display, the objects react nearly instantly, rolling from a sheet of real paper into a real cup and falling into shadow if you block the virtual light-source. The Cambridge lab that developed the tool sees uses in remote working, collaboration or device prototyping. If you hadn't guessed, there's a hacked Kinect at the heart of HoloDesk's DNA, which makes us wonder how long it'll be before we can use it to play Halo.
KinectNUI enables Minority Report style interaction in Windows sans gloves (video)
When Microsoft released its Kinect SDK we marveled at the impact it could have on desktop interaction; sure enough, Kevin Connolly's Kinect Natural User Interface has made our geeky pipe-dreams a reality. His inspiration for project? Not surprisingly, the Minority Report UI (aka g-speak). Similar projects like MIT's hack do exist, but it's brilliant knowing that another emulation has been made rather quickly with Redmond's tools. In a brief video using the Kinect on Windows 7, he demos various ways of manipulating on-screen content with hand gestures and body tracking -- neglecting his mouse in the process. It's still a work in progress, but the results are already quite striking, so take that ancient input device and click past the break for the full demo.
Microsoft messes with 'natural' user interface, featuring eye tracking, voice control and wild body gestures
While today's Windows might not look completely out of place next to a Windows of yore, Microsoft Research certainly has some wild ideas for how to progress computer interaction. In a talk during Microsoft's college tour, Craig Mundle has been touting his research wares, including some pretty reasonable advances like auto completion of common concepts; automatic, intelligent sorting of large amounts of data; and a movable, modular work surface. One of the odder demos involves moving the LCD so it's flat on the desk and then using huge arm movements to manipulate a 3D model projected onto a piece of glass, and the demonstration of eye-tracking is intriguing while not altogether convincing. Of course, we've got a while before we'll see any of this stuff in real products, but perhaps we won't have to wait so long as ten years for that "2019" vision of the future to come to pass. Hit up the read link for the videos.
