Microsoft reading minds to improve UIs

Microsoft is apparently going sci-fi in the battle with Apple for UI supremacy -- the company filed a patent application in August for an EEG system that can classify a user's "brain states" as they work with an interface, sorting them into one of eight categories: interruptability, cognitive workload, task engagement, communication mediation, interpreting and predicting system response, surprise, satisfaction, and frustration. According to the patent application, Microsoft believes that "human beings are often poor reporters of their own actions," and that properly filtered and classified EEG data provides a "less interruptive and more informative technique of determining user interface effectiveness." The patent also describes using the brain state data in real time to adapt the interface to the user, which sounds like it could be a revolution or a terrifying mashup of Clippy and the Lawnmower Man. No word on whether Redmond is already using this tech, but that new Zune interface certainly looks pretty slick, doesn't it?

[Via New Scientist]

[mnit @ Oct 16th 2007 7:54AM]

When a software company has to apply for patents for mind reading software in order to figure out what their customers want, you know they're out of touch...

[lordofthedirectrix @ Oct 16th 2007 6:19PM]

I lol'd irl :)

[Luigi193 @ Oct 16th 2007 7:56AM]

NIce zune complement! Been reading the comment section???

[aaron @ Oct 16th 2007 8:30AM]

Very much agree. I was waiting for the last second microsoft bash, and then, surprise, something nice!...I...don't...understand...is this engadget?!

[Andir3.0 @ Oct 16th 2007 8:02AM]

I think Microsoft is very well aware that my mind has nothing but contempt for Microsoft.

[DickHardknocks @ Oct 16th 2007 8:08AM]

Considering how many murderers,rapists,childmolesters,serialkillers,schizophrenics,closetedgays,racists,sexists,retards,crackheads,drugadddicts,terrorists and assorted other human trash are out there, IT SURE MAKES SENSE TO GO TO THEM SO WE CAN DECIDE HOW TO MAKE COMPUTERS BETTER.


Well, I for one welcome graphicaly improved user interfaces on our cybernetic overlords.

[Joe @ Oct 16th 2007 8:15AM]

It's Binky from Help Desk! (ubersoft.net)

[Ryan @ Oct 16th 2007 8:21AM]

EVERYTHING is wrong with what Microsoft wants to do here....i mean come on .....did the paper clip in word really help us figure out what we wanted?........."less interruptive and more informative technique of determining user interface effectiveness."....yea right....i can see it all now...your brain hooked up to a Microsoft OS hahaha....."Windows has detected that your brain wants to open Word"........"Your brain has encountered an error"...."Your brain will now shut down" hahaha Brain Blue Screen of death!

[Rytr23 @ Oct 16th 2007 8:29AM]

How is this patentable? Scientists have been doing this for a while now. furthermore, this is nothing unusual, the mechanisms for doing this *might* be patentable..but the idea of a mind interface? Ridiculous..been development for years.. stupid stupid stupid

[John @ Oct 16th 2007 12:16PM]

They would be patenting software that classifies the user's "state of mind" as interpreted with EEG data that then changes the UI of a related piece of software. Fairly specific.

[aaron @ Oct 16th 2007 8:33AM]

Yeah, Apple is much more simplistic and basic; easier for you to understand i'm sure. Ok, ready? It's story time andir!

[Andir3.0 @ Oct 16th 2007 9:17AM]

Nice try, but I don't own an Apple.

[Evan @ Oct 16th 2007 8:39AM]

Microsoft believes that "human beings are often poor reporters of their own actions"

Should read:

Human beings believe that "Microsoft software is often poor reporters of their own actions"

[Andir3.0 @ Oct 16th 2007 9:30AM]

It should basically read that Microsoft would rather change the way people think instead of making an OS that they want.

[L. Cyphre @ Oct 16th 2007 8:39AM]

I, for one, am extremely happy to welcome our mind con- uhhh caring and benevolent Microsoft overlords! I would furthermore like to stress that this statement is in no way influenced by any form of mind control, brainwashing or direct corporeal threat, and that any allegations of this would be treated as slander towards the Company and dealt with by specially trained black ope- Customer Care Officers. Thank you for hearing out this message from a humble member of the Microsoft Collec- I I mean a private citizen who has never had any contact at all with Microsoft. Thank you.

[Michael @ Oct 16th 2007 9:00AM]

The Lawnmower Man was an awesome movie. I owned 3 copies on VHS in the mid 90's when I was a teenager. And on DVD now.

[Hollywood Ron @ Oct 16th 2007 9:01AM]

So does the Blue Screen of Death lead to Actual Death?

[L.Rawlins @ Oct 16th 2007 10:51AM]

So when I'm drunk at the helm it'll deny me access to the administrator account, yes?

Nifty.

[Moff @ Oct 16th 2007 9:58AM]

Ahh.. when some of my best computer work gets done.. The drunken programmer.

[L. Cyphre @ Oct 16th 2007 9:23AM]

It'll allow you admin access ONLY if you're drunk.
Gotta keep the standards you know.

[j @ Oct 16th 2007 10:17AM]

Having spent many sessions in microsoft Usabilty studies aimed at improving UIs for Microsoft (Server products only, don't blame me for any UI problems with desktop products). I can assure you that they put a lot of time an research into trying to improve the ease of use. However the current method involves reading scripts and trying to execute tasks that are specified in those scripts. While doing so you are asked to vocalize all of your internal thoughts so that they can get an idea of what you might be thinking or why you are frustrated. Meanwhile you have numerous cameras pointed at you, and folks behind a two way mirror directing you through an intercom. It is not easy, and often distracting to vocalize every last thought. As a reult, the participants who are best at it end up having more influence in how the product is designed. Is it a surprise then that the geeks who excel at this have influenced the products to be more complex and difficult to use for those that might have difficulty talking and clicking at the same time? Mind reading for emotion and confusion could be a great boon to UI improvement in that it could provide less articulate an multi-task oriented participants to have their voice heard (even if it is their inner monologue).

[Todd @ Oct 16th 2007 10:50AM]

I would like to nominate the graphic for this post ( Clippy + Lawnmower Man ) as the Funniest of the Year.

[PostScript @ Oct 16th 2007 10:53AM]

Personally I think that this is a genius move by Microsoft. This is an apparent next step in computer technology. Unfortunately, some individuals are simply too narrow to see the real world applications (see above). As opposed to using this to "gauge" what the consumer wants, it could be used as a method to control and interact with the user interface. Such methods of control are already in place in some psychotherapy procedures where clients "play" a game with their mind (via EEG decreasing beta wave activity). The game requires the client to increase specific neural patterns to perform a task (i.e. fly an airplane). Now if Microsoft did their homework and could make logical transitions from mental state and user interface interaction, then it may be possible to forgo the use of a mouse, for a much more efficient navigation tool -- your mind. Now this may be the realm of science fiction, but honestly if done right -- I don't see how this would not be a remarkable improvement to user interfaces (ethical concerns aside -- like a company gaining access to your "brain habits" as opposed to your browsing habits).

[Wayde @ Oct 16th 2007 11:39AM]

Now if this was an Apple post about them developing this very same thing, most of you would be giving them praise. They are not market leaders for nothing.

[Andir3.0 @ Oct 16th 2007 1:18PM]

Yeah! They successfully bullied and bought their way into every home in the world through underhanded tactics and monopolistic abuse!

[Z @ Oct 16th 2007 1:19PM]

"...According to the patent application, Microsoft believes that "human beings are often poor reporters of their own actions", and that properly filtered and classified EEG data provides a "less interruptive and more informative technique of determining user interface effectiveness.""

I agree with this. It's not that we can't describe what we feel or experience with any degree of accuracy, but in my belief, Microsoft utilizing EEG to determine true response factors is very smart and will prove to be very useful, as long as certain filters are put into place.

[Seth @ Oct 16th 2007 10:18PM]

90% of the above posts are completely missing the point. Microsoft is not seeking to create an OS which will allow the use of a human mind as an input device. Rather, Microsoft is using this technology in Usability testing labs, where they have users try out new interface designs to figure out what is wrong with them and how to improve them.

As pointed out by the only logical post above, usability testing today involves users following scripts to complete "tasks", and vocalizing their thoughts along the way. This "mind reading" technique will help remove (though not eliminate) the burden on users to vocalize every last detail of their experience.

For example, if you are trying to find an option in a menu and it takes you 2 seconds longer than it should to find it, you may not vocalize this problem. However, this "mind reading" technique might be able to pick up on that, and notify the usability engineers that they should reconsider the placement of the menu item.