microsoft research
Latest
TouchStudio from Microsoft Research tests users' willingness to code solely on their phone
While touchscreens bring imagery and ideas to unprecedented personal levels, unsurprisingly, they have remained entirely inadequate for building the programs that enable this humane experience. Now, a project from Microsoft Research aims to shatter this axiom with the TouchStudio development environment for Windows Phone. Enterprising coders may get their hands on the initial release of this paradigm buster in the Marketplace, where they're invited to try their hand at coding applications using only fingers on glass. The SDK includes a handful of sample scripts to get you going, along with the proper hooks to access many of the phone's built-in sensors. While this dev kit won't let you to build the next killer app by simply dragging and poking haphazardly, if you happen to prove us wrong, we really want to hear about it. [Thanks, Fred T.]
Switched On: Pen again
Each week Ross Rubin contributes Switched On, a column about consumer technology. Last week's Switched On discussed how some next wave notions from a decade ago were trying to reinvent themselves. Here's one more. Surging smartphone vendor HTC is seeking to bring back an input method that many wrote off long ago with its forthcoming Flyer tablet and EVO View 4G comrade-in-arms: the stylus. A fixture of early Palm and Psion PDAs, Pocket PCs and Windows Mobile handsets, slim, compact styli were once the most popular thing to slip down a well since Timmy. Then, users would poke the cheap, simple sticks at similarly inexpensive resistive touchscreens. After the debut of tablet PCs, though, more companies started to use active digitizer systems like the one inside the Flyer. Active pens offer more precision, which can help with tasks such as handwriting recognition, and support "hovering" above a screen, the functional equivalent of a mouseover. On the other hand, they are also thicker, more expensive, and need to be charged. (Update: as some have pointed out in comments, Wacom's tablets generate tiny electromagnetic fields that power active digitization, and don't require the pen to store electricity itself.) And, of course, just like passive styli, active pens take up space and can be misplaced. The 2004 debut of the Nintendo DS -- the ancestor of the just-released 3DS -- marked the beginning of what has become the last mass-market consumer electronics product series to integrate stylus input. The rising popularity of capacitive touch screens and multitouch have replaced styli with fingers as the main user interface elements. Instead of using a precise point for tasks such as placing an insertion point in text, we now expand the text dynamically to accommodate our oily instruments. On-screen buttons have also grown, as have the screens themselves, all in the name of losing a contrivance.
Microsoft's SpecNet promises to seek out unused wireless spectrum
Microsoft's been toying around with hardware for so-called white space spectrum for some time now, and it's now back with another fairly ambitious scheme. Dubbed "SpecNet," the hardware in this case in actually a network of spectrum analyzers that would seek out and map where spectrum is available and where it's not, and let unlicensed devices use it when it's available. Of course, that's still all a bit theoretical, and it does face a few significant hurdles. Those spectrum analyzers, for instance would cost between $10,000 and $40,000 apiece, and you'd obviously need a lot of them for a nationwide network, although Microsoft suggests that they could be set up on an ad hoc basis and assigned to different areas for a specific time period. Those interested in the finer technical details can dive into Microsoft's full paper on the subject at the source link below.
Microsoft researchers show off intuitive stylus, don't know how to hold a pencil (video)
At this week's Microsoft promotional bonanza, otherwise known as TechFest 2011, a team of researchers debuted a rather shabby looking capacitive stylus that switches between functions based on your grip -- an interesting addition to a rather stagnant market, sure, but there are still a few kinks to be worked out. The multi-purpose tool enlists capacitive multi-touch and orientation sensors to respond to how you hold the thing, allowing you to perform a number of different tasks with a simple repositioning. A demo video of the stylus at work shows a disembodied hand switching between a pen, an airbrush, a compass, and even a virtual flute with ease, but while the project stresses the "naturalness" of the experience, we're pretty sure nobody sketches quite like that. Check out the video after the break to see what we mean.
Microsoft Research shows the possible future of split-screen technology
Of all the projects teased by Microsoft Research's Applied Sciences branch, we certainly hope that this is the one that makes it to market. In the video demonstration posted after the jump, Steven Bathiche shows off a few of the interfaces and displays the company's currently researching -- the coolest of which is a "wedge" lens which allows the screen to generate and overlap individual images directed at your eyes, creating a holographic-esque image. As radical as that sounds, Bathiche took the science one step further: The display can also track two viewers using Kinect, and show each of them a seperate image on the same screen. Considering the number of times we've had to strain our eyes to get our couch co-op Halo: Reach on, the possibility of split-screen gaming that doesn't actually split the screen is infinitely titilating. Check out the video demonstration below!
Microsoft Research shows off next-generation gesture interfaces, Kinect integration, other neato stuff (video)
Leave it to Microsoft Research to show off some cool stuff that may or may not actually happen on any thing you ever actually buy. Check out the video after the break to see the latest, Director of Microsoft Applied Sciences Steven "Stevie B" Bathiche showing off a variety of interesting interfaces. It all starts with gesture controls that take you well beyond the touchscreen, relying on a retro-reflective sash and a camera to detect hand position. But, things quickly progress to a flat lens called a wedge that can enable holographic-like imagery. Pair that with a Kinect and perspective shifts come into play, tracking your face to enable you to peer around like looking out a window. It's all just waiting for you below -- and maybe IRL sometime in the future.
Microsoft Research teases Windows Phones controlling Surfaces and crazy desktop UIs
Hey, look, at this point, we just want ourselves some good, old-fashioned copy and paste -- but we'll give Microsoft some credit for looking a year (or two, or ten) beyond that watermark at what could be coming down the pike for human-machine interaction -- and specifically, how phones could play a role. In a presentation and promotional video pulled together this week, Microsoft Research boss Craig Mundie shows how you could tilt your smartphone to control a bubbly, colorful look into your personal life on your desktop machine and how you could snap a photo and then drop the handset onto a Surface for instant transfer (perhaps a bit like HP's Touch to Share), among other gems. Of course, this is all pure research at this point -- it's any guess whether these comments could make the jump to production, and if so, when -- but it's fun to watch. Follow the break for video. [Thanks, Jake]
Bing 2.0 brings better Facebook integration and the impressive Streetside to iPhone (video)
Microsoft just released -- or should we say, Apple just approved -- version 2.0 of the Bing search app for iOS devices. In addition to several other new features including integrated Facebook Likes on search results (really!?) and in-app checkins to Facebook and Foursquare, Bing now comes packing Streetside, something that first blew us away as Street Slide when it was still in the labs at Microsoft Research. Unlike Google's Streetview that requires a lot of forward- and back-clicking and turning in order to get a feel for a location, Streetslide provides a more comprehensive view of the shops and businesses in an area by letting you strafe down the sidewalk while zooming in and out of the buildings located on each side of the street. We took it for a brief spin (literally) and came away impressed. You won't find Streetside implemented for all locations yet (for example, San Francisco's Make-out Room was found on Streetside but the Slanted Door restaurant wasn't) but they do seem to have large swaths of major cities covered based on our brief testing of Chicago, Seattle, New York, and San Francisco. Sorry, nothing yet in London and Amsterdam but maybe you'll have better success searching your own neighborhoods. See the full list of what's new after the break in addition to a Streetside demo from Bing's architect Blaise Aguera y Arcas -- unfortunately, we're not seeing the impressive Panaroma feature he mentions in this release. Update: We've been told that Facebook Likes, like Panaroma, like totally didn't make it into the app release. It's a web search results feature only for the time being.
Microsoft aims to improve maps with GPS data from 33,000 Beijing cab drivers
Microsoft's already added a Taxi Fare Calculator to Bing Maps to help keep your cabbie in check, and it's now actually enlisted the help of some 33,000 Beijing cab drivers in an effort to further improve driving directions. More specifically, it's relying on GPS data collected from the cab drivers' cars over a period of three months, which has since been funneled into a system called T-Drive created by a team at Microsoft Research Asia. Just how big a difference can a bit of local know-how make? Apparently, about a 16 percent cut in time on average, or roughly a savings of five minutes for every 30 minutes of driving. Of course, it won't do anyone outside of Beijing much good at the moment, but there's plenty more GPS-equipped cabs out there if Microsoft ever decides to expand things.
Microsoft LightSpace brings Surface (plus shadows) to any table (video)
It's hard not to love the crazy stuff happening at Microsoft Research, but it's also hard to imagine when any of it is going to actually start changing the way we interact with our PCs. Surface was bested by SecondLight as the coolest tech we can't buy, and now here comes another successor: LightSpace. This gets rid of the expensive table in favor of a (surely not cheap) series of projectors hanging from the ceiling paired to a 3D camera. The camera detects the relative position of things and instructs a projector to apply a Surface-like interface onto any flat surface. From there a user can literally grab any file they like and carry it over to another surface, where it will be displayed. It's all demonstrated quite handily in the video below, and while the system does look a wee bit rough at the moment, the potential is surely there. Just like it was with SecondLight, and Surface, and Courier...
Microsoft Adaptive Keyboard prototype debuts at center of UIST Student Innovation Contest
No, it's not the mystery device that Microsoft has been teasing as of late, but we have a feeling that plenty of folks will be wishing that the company's so-called "Adaptive Keyboard" was it. Unfortunately, it's just a prototype, and Microsoft apparently has no plans to turn it into an actual product. It will, however, be landing in the hands of a few lucky students participating in this year's UIST Student Innovation Contest, who will be given free reign to do whatever they like with the keyboard and possibly be rewarded with a $2,000 or $500 prize for their hard work. As for the keyboard itself, it's basically Microsoft's take on something like the Optimus Maximus, and consists of a large touchscreen display on top that "extends" to the keys below -- opening up a whole range of possibilities for different configurations and other shenanigans (no further technical details just yet, unfortunately). Head on past the break for a pair of demo videos and, if you're a student, hit up the source link below for the complete contest details -- act fast though, the deadline for applications is August 17th.
Microsoft Research reveals RearType, puts QWERTY back where it belongs
We've seen a few wacky split keyboards in our day, and even the occasional back-typing peripheral, but Microsoft Research has just congealed the core ideas into a why-didn't-I-think-of-that device for mobile use. Dubbed RearType, the QWERTY solution literally sticks a three-row keyboard on the back of a tablet PC, allowing users to have the same physical sensation as on laptop or desktop without taking up valuable touchscreen real estate. While there's still a few kinks to be worked out of the system (like how to set it down without triggering input) and no plans yet for commercial availability, a brief study showed users could attain 15WPM speeds on average with a single hour of training, and one participant managed to eke out a healthy 47WPM in the same timeframe. We imagine a certain Motorola device is feeling a mite jealous right about now. See the front of the (non-Microsoft) tablet right after the break, and read the full study at our more coverage link.
Microsoft's Menlo is a Windows CE device, nothing to see here folks
Mary Jo Foley had us all fired up about the potential of Microsoft's mysterious Menlo, but it appears that the project's not yet a groundbreaking mobile OS -- it's just a prototype slate. Menlo V1 made its cameo debut in a Microsoft Research paper destined for MobileHCI 2010, where it's listed as a 4.1-inch device with a 800 x 480 capacitive touch screen, a 3-axis accelerometer (and a barometer, for some reason) all running on the comparatively boring Windows CE 6.0 R2. According to the paper, which tested out a Silverlight-based app that allowed users to follow a trail of virtual breadcrumbs back to their parked car, the device didn't even have a magnetometer at the time of testing -- thus the throwback compass you see immediately above -- and it's actually never referred to as a phone. We'll keep you abreast of any future developments, but even if the project were leagues more exciting we're not sure if we'd put our hearts on the line. Once burned, twice shy.
Microsoft's experimental English-Chinese dictionary mines the web for data (video)
When it comes to quick and dirty machine translation it may not supplant Google Translate anytime soon, but for those who would actually learn another language, Microsoft's working on some fairly impressive tools. Engkoo is an search engine for Chinese speakers that scours the web for its data, finding articles that are written in both Chinese and English to create an continually-updated lexicon, plus provide interactive (and audible) sample sentences that explain nuances of the language. See a rundown (in English) of what's possible so far in a Silverlight video after the break, and try it out for yourself at our source link -- if you must, you can even search for "tiananmen."
Microsoft algorithm uses six-axis motion sensors to fix blurry snapshots, inadvertently pimping your ride
Trying to snap a shot of your cherry red Mazda, but can't keep your hands still? You'll find all the tech you need to smooth things out in an iPhone 4 or (MotionPlus-equipped) Nintendo Wiimote. Experimenting with 6DOF inertial measurement sensor packages, scientists at Microsoft Research have developed a software algorithm that literally records your exposure-destroying shake via accelerometer and gyroscope, then magically removes the blur by canceling it out. While the technique still isn't perfect -- spot ghostly line above some of those background cars -- the Microsoft researchers compared their results to other in-progress algorithms, and we think you'll agree this new solution presents the best results by far. It's a shame Microsoft doesn't say when we'll see the tech in a spiffy DSLR attachment, or better yet a cameraphone. See before and after animated GIFs after the break, and find high-res comparison images and much more at our source link.
Microsoft Street Slide: it's electric! (video)
Remember the first time you used Google Street View? Amazing, right? Thing is, traversing a busy urban street in a 360-degree photographic bubble can be disorienting, especially when searching for a specific address or business. So check this: Microsoft Research has developed a rather nifty solution it calls Street Slide. Zoom out of your panoramic bubble and the street is presented as a dynamic, multi-perspective "strip" giving you an instant visual summary of the surroundings -- similar to viewing the entire street from a distance. Fortunately, Microsoft took advantage of what would otherwise be the unused letterboxed screen above and below the strip to add navigational and informational aids like clickable business logos and building numbers. Pretty impressive, and Microsoft is already working on taking Street Slide mobile with an iPhone port, and no doubt a version for the upcoming Windows Phone 7 series of devices. Unfortunately, don't expect this to be released anytime soon as the team has only processed about 2400 panoramas so far covering just 4 kilometers of streets. Check the video after the break, you'll be glad you did.
Microsoft Research toys with the cosmos... using forefinger and thumb (video)
We've always been suckers for Minority Report tech, and Microsoft Research's latest attempt is not to be missed. Thought pinch-to-zoom was quaint? Try pinching the sky in this geodesic dome. Though the cardboard-and-paper-clip structure isn't all that (unless you're the arts and crafts type), the inside houses a projectiondesign DLP unit with a custom infrared camera system that can turn simple hand gestures into virtual interstellar travel, 360-degree video teleconferencing and more. You'll find a pair of videos demonstrating the concept after the break, but try not to get too attached -- if you're anything like us, your poor heart can't handle another Courier axing.
Microsoft's Manual Deskterity project reveals pen and touch input, Courier's future?
Apple may have made its thoughts on the stylus clearer than ever at its iPhone OS 4 event, but it looks like Microsoft Research is intent on redefining what's possible with a little pen-based input and, if this recently-revealed video is any indication, we're not about to stop them. Dubbed Manual Deskterity, the project is currently based around a Microsoft Surface device, and shows how pen and touch input can be combined for a range of tasks that wouldn't be possible with just one or the other -- using a photo as a straight-edge (as seen above), for example, or using the pen as an X-acto knife to cut a photo while you hold it in place with your finger. Of course, while the project is currently using a Surface, it's hard not to see how it could also be applied to something like Courier, especially considering the strong emphasis on creativity that echoes the Courier demo videos. Head on past the break to check out the whole thing for yourself.
Hands-on: The Path of Go (XBLA)
Ready to frustrate yourself forever? Learn the game of Go. It's an ancient Chinese game that's over four thousand years old, and games can last up to 16 hours in tournaments. Sounds just perfect for an adaptation into the frenetic world of video games, right?! Well, your wish is granted. The Path of Go or How We Came Up With A Proprietary Name For The Public Domain Game of Go is being developed in-house by Microsoft at the likewise excitingly named Microsoft Research Cambridge division. We played the game briefly at GDC, and it's actually very robust. It includes a tutorial where your avatar has some faux back and forth dialogue with an ancient Go master, in which he really does teach you the game. I tried reading an old instruction manual for a set of Go I found at a thrift shop once, and was so confused by terms like "ko" and proper stone placement that I just re-thrifted the set. Now, I'm ready to take on Russell Crowe in A Beautiful Mind and kick his ass. Additionally, the game features single player or two player both locally and through Xbox Live, multiple backgrounds, and full 3D environments where you can control the camera. There's also an actual story mode in here, where you learn the nuances of the game in "beat the situation" scenarios while heading down a path. The ... wait for it ... Path of Go. %Gallery-87790%
Microsoft Research working on portable Surface
Microsoft's Surface has managed to carve out a small niche for itself, but there's only so many places that a large, touchscreen installation can find a home (a yacht, for instance). Microsoft Research seems to be aware of that, and it's apparently been hard at work on a more portable Surface for some time now. As you can see above (and in the video after the break), the so-called Mobile Surface would rely on a combination of a projector and a camera (and mobile phone, in this instance), which would offer about the same level of interaction as a regular Surface, and even a few advantages -- like being able to use a pair of drumsticks to play the drums. If this all seems a little familiar, it should, as Light Blue Optics and others have already employed nearly identical systems to turn any surface into a touchscreen display. Curiously, Microsoft Research has since pulled the Mobile Surface page from its website, but you can find all the pertinent details by diving into the links below.
