VoiceControl
Latest
LG's Magic Remote enables voice control for its smart TVs
LG was quick to introduce Wii-style motion controls and pointing to its smart TV controllers, but its new Magic Remote also adds voice recognition, allowing you to enter search terms without ever contemplating the alphabet. In a radical move, it also conjures up a scroll wheel -- perhaps for no reason other than to spite Samsung's now dowdy-looking QWERTY rival. The fact that it can control your LG Cinema 3D TV without forcing you to star-jump is a happy bonus. There's a full PR after the break, although no sign yet of availability or pricing.
Rumor: Google working on Siri competitor codenamed "Majel"
Android and Me has reportedly come across some secret details regarding "Majel," which is Google's voice control project that sounds very similar to the popular Siri. Before you start crying foul that Google is jumping on the voice control bandwagon, don't forget that Google actually included voice controlled actions and search in its own iOS app already, and Android has had functions like voice-to-txt baked in for a while. Of course, those kind of interactions don't hold a candle to the kinds of things that Siri can do, which is why Google is reportedly working on putting together "Majel." The system is named after Majel Barrett-Roddenberry, the wife of Star Trek creator Gene Roddenberry, and the voice for many of the computer interfaces in the sci-fi series. The project is being developed by Google's Google X experimental labs, and when it does finally appear in a way the public can use it, it will likely only do Google Searches. But the final plan is, according to a Google rep in a previous interview, that "every piece of computing surface, everything is voice-aware. It's not that there's a personality, it doesn't have a name, it's just Computer." Sounds interesting. Competition for Siri is a good thing for us users. It sounds like Google is taking a slightly different approach than Apple, and given that Apple actually bought Siri instead of trying to develop it from scratch, odds are that whatever Google puts together might won't exceed Apple's offerings in innovation. But that's fine -- if Google comes up with something really cool, odds are we'll still be able to run both on our iOS devices anyway.
Xbox 360 Dashboard update review (fall 2011)
Kiss that old "New Xbox Experience" goodbye -- the Xbox Dashboard just went full Metro. Microsoft teased the console's latest overhaul back at E3, promising to "change living room entertainment forever." The following months saw leaks, previews and betas, all leading up to today, the eve of the Xbox 360's Fall Dashboard update. Is the new dash the game-changer it hopes to be? Hit the break, and we'll find out together.%Gallery-141009%
Siri lends a hand via your Bluetooth-enabled car stereo, reminds you to buy milk (video)
Sure, we've seen Siri used to do a host of things, including controlling the temperature in a hacker's home. But the folks over at Autoblog were curious to know just how well the virtual assistant would work with Bluetooth-enabled car stereos. Once your iPhone 4S is properly tethered, holding down the handset's home button will activate Siri. Treating her as an incoming call, your Notorious B.I.G. playlist will pause before the ready-for-command chime sounds. The in-car assistant was tested on two Mercedes-Benz automobiles, a Chrysler 300, a Dodge Charger and a Nissan Maxima, with the Maxima showcasing the best results. It comes as no surprise that mic placement on each stereo and in-cabin background noise provided a noticeable difference in Siri's listening abilities during the test. For a glimpse of the action before trying it out yourself, hit the video just past the break.
Developer teases voice control of Zune, using PC and Windows Phone (video)
The great thinkers of the world have long known a secret that we're now happy to disclose: it's not necessity that's the mother invention, but rather laziness. Fortunately, expending a great deal of effort on a project -- simply to perform a task effortlessly -- sometimes brings very cool results. A concept app known as ZuneVoice easily passes muster in this realm, which is used to control Zune software on the PC with only a standard microphone and spoken commands. As you can see in the demo video, its creator, keyboardp, is able to play individual songs, issue commands such a "pause" or "next song", and even display full-screen music videos from YouTube. The developer even crafted an app for his Lumia 800 known as PhoneZune, which serves as a remote control for times when he's away from the box. Neither application is yet publicly available, though feedback is welcome. Next, we're told to expect Kinect integration. Perhaps one day, these gems will see the light of day.
SiriProxy enables voice control of third-party apps (video)
If you'll rewind your mind in time to earlier this week, you might remember a clever proxy server from @plamoni that enabled Siri's control of a thermostat through spoken commands. Now, the same bit of engineering has been exploited to enable voice control of third-party applications. In this example, FastPdfKit Reader is manipulated by various commands with SiriProxy acting in the middle. A plugin is used to add new commands to the ones recognized by Siri, and finally, the proxy then sends the final commands to the app. Those hoping to get hacking will find a complete list of instructions from the source link below. For everyone else, you'll find the true magic after the break.
Developer creates proxy server for Siri, controls thermostat with his voice (video)
Now that Siri's protocol has been freshly dissected and laid bare for the world to behold, hackers have been busy finding ways to move Apple's personal assistant beyond the realm of the iPhone 4S. That task may be getting easier, however, now that a developer has created his very own third-party proxy server, designed specifically for Siri. The dev, known by his Twitter handle @plamoni, demonstrated his brainchild in a recent video clip, using a plug-in to control a WiFi thermostat with only voice commands. As @plamoni explains, the hack won't require users to jailbreak their iPhone 4S, but it won't let them port Siri over to earlier iPhones or iPod Touch models, either -- not yet, at least. The idea, according to the developer, is to make it easier for other hackers to experiment with and build upon Siri's functionality. Head past the break to see the demo video for yourself, or if you're up for it, grab the source code and instructions on how to create your own server, at the source link below. [Thanks to everyone who sent this in]
MyFord Touch Upgrade inbound, brings 'faster, simpler, easier' infotainment to your late-model whip
For better or worse, Ford owners have been basking in the overzealous infotainment ways of MyFord Touch for over a year now. Since then, the service's been updated with amenities such as integrated Nuance voice recognition for SYNC, but now the Dearborn-based automobile monolith is taking things a few steps forward. Penned for release "early next year," the MyFord Touch Upgrade will usher in a massive revamp across every nook and cranny of the system as a whole. Starting with the 2013 model year Flex, Taurus and Escape, drivers will be greeted by over 1,000 revised screens implementing an "improved look," with an up to 40 percent increase in font sizes, a simpler -- and more cohesive -- GUI focused displaying only important info (for less clutter) and notably, doubly fast response times for touch and voice-based inputs. And oh yes, it gets even better. Those with tablets will be pleased to know that multimedia playback will be supported via USB, while mobile phones will benefit from quicker automatic Bluetooth pairing and better echo and noise-cancellation. Ford has also baked-in voice support for sports buffs with Sirius Game Finder, as well as bibliophiles with Audible.com integration (which can also be touch controlled, should you desire it). Best of all, you'll no longer need to recite any parenthetical or bracketed album info your music tracks may have, or the direction of street names when inputting addresses for directions. Speaking of, the TeleNav-enabled nav system will have further map detail courtesy of Navteq, with enhancements like more 3D imaging, "photorealistic" signage and better route planning thanks to "a database of historical traffic patterns." If you've already got some miles on an existing MyFord Touch-enabled ride, no worries -- Ford will give your system the upgrade pro bono when it's available, taking all but a (hopefully) quick visit to your local dealer. Potential and current Ford owners will find more visuals in the gallery below and full details in the press release past break. Update: Ford has let us know that existing owners will not be required to visit their dealer for the upgrade, and will be receiving a USB drive allowing for a self-install in the mail. That said, you can still drop by your dealer after getting it to have the install done there. %Gallery-138462%
Siri being tested in jailbroken iPad 1
It's been ten days since Siri hit the scene and the virtual assistant is in the process of being torn apart by the hacking community. Siri, as it exists on the iPhone 4S, has been ported to the iPhone 4 and now the iPad 1. Developer Steven Troughton-Smith, who worked on the iPhone 4 port, has shared his progress with @jackoplane who has successfully ported the app to the iPad 1. Several images of Siri running on the tablet device document this achievement. Unfortunately, neither the iPhone 4 nor the iPad port is fully functional at this point. Siri still needs to connect to Apple's servers to work and the servers are configured to accept requests only from the iPhone 4S. Potentially, these devices could be spoofed to look like an iPhone 4S which could open this functionality to jailbroken devices. Jailbreaking and porting may be the only solution for owners of older hardware who want Siri on their iOS devices. It's doubtful that Apple will bring Siri to the iPad 1 or the iPhone 3GS. Apple may not want to support this older hardware and these models may also lack the processing power required for the voice assistant. But as some of you pointed out in one of our latest "You're The Pundit" posts, Apple could decide to bring Siri to the iPhone 4 and the iPad 2 once it comes out of beta. [Via Jailbreakstory]
Dear Aunt TUAW: What is this "Voice Control" thing?
Dear Aunt TUAW, I discovered by accident that I can hold down the home button on the iPhone 4 and it brings up Voice Control. I don't remember this being there before. Is this some sort of Siri light functionality for the iPhone 4? I can use it to makes calls and FaceTime someone, but not much else. Your loving nephew, Douglas Dear Douglas, Think of Voice Control as Siri's, well, not Mom...maybe Siri's Aunt? Yeah. Exactly. Voice Control is basically an older, less stylish version of Siri -- far more approachable, slightly less sexy. And with a worse sense of humor. First introduced on the iPhone 3GS, Voice Control offers hand-free dialing and basic music controls. As with Siri, you can press and hold the Home button to bring up the assistant. There you can say "Call Dave at Home" or "FaceTime Steve" or "Next Track" or "Play Songs by Parry Gripp" (Auntie is a huge Parry Gripp fan). When Voice Control is running, recommended, speakable phrases scroll across the screen. You can use Voice Control on the 3GS and later and on newer model iPod touches. If you disable Siri on the 4S or haven't gotten around to enabling it, the 4S uses Voice Control instead. Apple has never really done the whole hands-free thing on the iPad, which is a shame because Auntie thinks that Siri would rock on the iPad, but that's the topic for a whole different post. Hugs, Auntie T.
Kinect voice control reaches Australia, Harold Bishop and Donald Fisher will be pleased
Holy dooley! (oh my!) Microsoft's being a big-note oneself (bragging) about getting Xbox 360 voice control working for the Aussies (Australians.) It's invited all the journos (journalists) to a rage (party) down under (in Australia) to show off the system that had difficulty understanding Australian English. Haven't a clue why.
Beeri: Siri's new best friend cracks open a cold one (video)
We already know that Siri can send texts, check the weather or find you a restaurant, but did you know she can also fetch you a beer. Well, sort of... with a little hacking. The folks at Redpepper dreamed up Beeri, an RC truck that cracks open a can of brew whenever it receives a tweet instructing it to "pour." Since you can text updates to Twitter (40404) and Siri can text, that means it's perfectly simple to tell Beeri it's Miller time. Whenever the Arduino embedded in the truck detects a mention with the word "pour," it drives forward, slamming a beer can into a puncture wall that drips into a funnel, filling a cup beneath the table top. It's a pretty ingenious system, and you can see it in action after the break. We just hope Beeri has a day job -- looking at all that head, it's clear she wouldn't last a day as a bartender.
Siri gets lost internationally, promises to do better next year
The iPhone 4S' Siri integration may be a potential game changer, but she's not quite the world traveler some of us would like her to be. In fact, it seems she's as lost outside of US borders as any unprepared tourist. Looking for a pub in London? Better find a traditional map. Need to know the time of day in Canada? Siri admits she has no idea, go buy a watch. Business search (via Yelp), directions, and traffic data search all appear to be US-only features for now, and Wolfram Alpha only works in English-speaking countries. The automated assistant's international failings aren't too big of a surprise, however -- Apple's own Siri page outs the service as a beta, noting that some features may vary by area. Stuck with sub-par international support? Sit tight, it's coming: Apple's Siri FAQ states that additional language support (including Japanese, Chinese, Korean, Italian and Spanish), maps and local search content are set to go international in 2012. Update: Wolfram Alpha works outside the US in English speaking countries, thanks to everyone in the comments for the clarification.
Why Siri should (and probably will) come to iPad 2
Since the iPhone 4S features the same A5 processor as the iPad 2, owners of Apple's current-gen tablet have wondered if it's possible that Siri, Apple's new voice assistant, might be offered on the iPad 2. While my colleague Erica Sadun's answer to that is "Don't hold your breath," I only agree with her up to a point: I don't think there are any technical hurdles whatsoever to running Siri on an iPad 2, and the fact that the device doesn't currently feature voice controls is meaningless. I think Siri will come to the iPad 2 eventually -- certainly not right away, but possibly within the next six months. Voice Control as it now exists on the iPhone 3GS and iPhone 4 doesn't function on the iPad or iPad 2, but there's a reason for that: the existing commands would be essentially useless on those devices. The pre-Siri version of Voice Control allows you to use voice commands to control music playback, dial phone numbers or initiate FaceTime calls, and ask the device for information about the current time or currently playing song. That's about all Voice Control does. Those functions are all useful features on a device that spends much of its time in your pocket, but on an iPad they make very little sense. On the other hand, Siri's commands would be immensely useful on the iPad. The same things Apple showed off at the "Let's talk iPhone" event, like setting up Reminders and Calendar events or looking up information on Wikipedia or Wolfram Alpha, would be very handy to have -- so handy that I don't see why Apple wouldn't offer them. Apple has long been a company that designs products its own workers want to use, and it's hard to imagine that no one in Cupertino has thought about how Siri could vastly expand the power and capability of the iPad 2. Since the iPad 2 has both a microphone and the same A5 as the iPhone 4S, there shouldn't be any technical reason why Siri wouldn't function well on that device. Some have speculated that the iPhone 4S has 1 GB of RAM to the iPad 2's 512 MB (a claim that will have to wait for an iFixit teardown before it can be proven or disproven), but my TUAW colleagues don't believe that Siri's functions should be so RAM-intensive that they require such massive amounts of memory. In fact, we've done some digging into Siri and found that most of the actual work of understanding voice commands gets offloaded to external servers. In essence, the iPhone 4S and its built-in processing functions determine what you said, while Apple's servers translate that into what you meant and send that information back to your iPhone. The pre-processing that takes place on the device itself may be too taxing for an A4 processor, but the iPad 2's A5 should theoretically be able to handle it just fine. Perhaps even better -- Apple has a habit of underclocking CPUs for the iPhone in the interest of power management, so the iPad 2's A5 is likely to outperform that of the iPhone 4S for many functions. The fact that Apple hasn't yet said one way or another whether Siri will come to devices other than the iPhone 4S also doesn't mean much. The iPhone 4, 3GS, and newer iPod touch models had an exclusive on multitasking for almost exactly six months before iOS 4.2 debuted and brought that feature to the iPad, and the same thing may end up being true for Siri. Here's what I think is the most likely scenario: Siri will remain an iPhone 4S exclusive at least until the third tier of international rollouts completes in December. In fact, Apple will probably wait until after the end of the holiday quarter and bring Siri to the iPad 2 in the first quarter of 2012. Not only will this give market incentive for people to buy the iPhone 4S by having Siri as a device-exclusive feature during the holiday period, it'll also give Apple's servers and Siri's algorithms time to adjust and scale to the number of inquiries it'll receive. Once Siri's beta period ends and international rollouts for the iPhone 4S are reasonably complete, that's the perfect time to bring Siri to the iPad 2 in a dot-update to iOS 5. By that time Siri and its supporting infrastructure will be more mature and able to handle the extra load of adding support for one more device type, and it should also help alleviate the typical post-holiday quarter sales slump. As for the other devices in Apple's iOS stable, like the iPod touch, iPhone 4, and iPhone 3GS, I don't expect them to ever see support for Siri. Siri's developers have already confirmed that many compromises were required to get the service running on the iPhone 3GS, and it's probably the same story for iOS devices with an A4 processor. The 2012 model iPod touch will likely be updated to an A5 processor, however, so we might see Siri support for next year's iPod touch. For the time being, Siri remains an iPhone 4S exclusive and one we have yet to test for ourselves. We look forward to putting this innovative feature under our interrogation lights once the iPhone 4S is released on October 14.
Microsoft reveals new TV providers including Verizon and Comcast coming to Xbox 360 (video)
Just as the rumors indicated, Microsoft is bringing video from a number of providers beyond the ones it initially announced to the Xbox 360 in its fall update, including big guns like Verizon and Comcast. While Verizon is promising "a selection" of its live TV channels on the Xbox 360 as expected, Comcast is only bringing its Xfinity TV video on-demand offerings (no AnyPlay powered live TV -- yet) to subscribers when it launches "in the coming months." Other notable providers include Lovefilm (UK, Germany), BBC TV (UK), HBO Go, and Syfy. As promised during E3, the services integrated with Xbox will offer support for search across all available video, as well as support for Kinect voice and gesture controls. The universal search is looking good since it pulls together various services into one UI (as we discussed on our podcast yesterday), but the reality is content providers and geographical limits on what services you can pick from are still throwing up walls between users and content. Check after the break for PR detailing what you'll be able to access and where, as well as a video intro to all the tasty new TV services. %Gallery-135845%
Apple (re)introduces Siri as iPhone voice control assistant for iPhone 4S
Apple picked up mobile assistant app Siri quite a while ago, but only at today's event did we finally see why. The company is relaunching the app as official, though it will keep the name Siri. To access it, all you'll have to do is hold down the home button, and then a little purple mic will pop up, listening in to whatever question you ask. From your question, Siri will then find any and all pertinent information, including data about the weather, stock and clock information, and even searches for local restaurants and businesses. You can ask for directions and get them right away, or even get messages read off to you via Bluetooth, and create calendar appointments and replies right inside the Siri system. The whole thing is very impressive, and if it works as well as Siri did, Apple's phone has yet another killer feature on it. Unfortunately, Apple said that Siri is "the coolest feature of the new iPhone 4S," so presumably you'll need the new handset to make use of the feature. We'll double-check on that going forward, but all indications are that Siri will be 4S-only.
Apple brings Siri voice control to the iPhone 4S
You've heard the rumors, and Apple has now confirmed that it will be bringing Siri voice control to its new iPhone 4S -- and, yes, it will still be called Siri. That will let you use natural language to perform tasks like asking for a weather forecast or getting directions, setting an alarm or making a calendar appointment, and searching Wikipedia or Wolfram Alpha for information (among many other possibilities). Described as a "humble personal assistant," Siri will work in English (including the UK and Australia), French and German for now, and it'll work with all built-in apps and over both 3G and WiFi. It'll also be a beta to start with, and Apple promises that it "gets better" as it learns your voice. Unfortunately for current iPhone owners, however, it looks like Siri will only be available on the iPhone 4S (at least initially). Update: Perhaps not surprisingly, Apple appears to have pulled the existing Siri Assistant app from the App Store. There's also somewhat curiously no mention of Siri at all on Apple's Canadian website, although the Siri app itself was never available in Canada to begin with. [Thanks to everyone who sent this in] Update 2: Already enjoying the fruits of a voice navigated lifestyle with Siri on your iPhone? Don't get used to it, as users are receiving messages like this one indicating it will shut down for the non-iPhone 4S owning plebeians as of October 15th. [Thanks Shawn & Lloyd] %Gallery-135726%
Rumor: Next iPhone to feature powerful Assistant, 1 GB of RAM (Updated)
Last week a reliable source (who asked not to be named) approached TUAW with information about upcoming iPhone features that sounded incredible. We didn't run the post at that time, however, both out of concern for the source and because we couldn't corroborate the details. This morning, 9to5 Mac posted pretty much exactly what we heard from our source -- that the next iPhone is going to feature an amazing voice control and device navigation system called Assistant. That's not all -- the source (who may or may not be the same person who talked with 9to5) told us that the iPhone will come packed with 1 GB of RAM and the Apple A5 dual-core processor, as well as a vastly improved 8 MP camera. 9to5 reported some details TUAW didn't get, including that the new phone will contain Qualcomm's Gobi Baseband chipset for use as a true world phone (GSM and CDMA). The Assistant, however, is a game-changer. Assistant is an outgrowth of Voice Control, which was introduced with the iPhone 3GS in 2009. It is based on technology from Siri, a company that was purchased by Apple last year. The Assistant requires the power of the A5 CPU as well as the 1 GB of RAM, which is why existing iPhones will not be able to take advantage of the new feature. The speech interface is launched by holding the home button for several seconds, after which a microphone interface slides up from the bottom of the screen, covering only about a quarter of the display. In contrast to the existing iPhone Voice Control capabilities, Assistant can help you with just about anything. Want to send an iMessage without typing? I could just say "send a text to Barb saying I'm going to the bank" and the message is created and sent. You can also use Assistant with the location-based reminder feature in the iOS Reminders app, by using commands like "Remind me to buy Vitamin D when I'm at Whole Foods Market." Voice requests for directions are also a feature -- asking "How do I get to Carnegie Hall?" won't result in the expected response ("practice, practice, practice") but directions from your current location to 881 7th Avenue in New York City. Assistant also has a conversation view, in which the system literally converses with the user in order to provide the best results. Let's say set up a meeting with Tim Cook on October 4th. You'd say "Set up a meeting with Tim Cook," and the iPhone would respond by asking "Which email address should Tim Cook be notified at, home or work?" When you'd respond "Work,", the iPhone would ask the time and date you want to schedule the meeting for. At the end of the conversation, you'd be shown the details of the calendar event for confirmation. We're told that you can speak to the Assistant in your normal tone and speed of voice; it's that accurate. Assistant is also integrated with Wolfram Alpha, so you could also ask your iPhone questions like "Convert 10.2 acres to hectares" or "What's the cube root of 924?" and get an immediate answer. One more fascinating feature that is likely to be packed with privacy settings is "Find my Friends." With this feature, you could ask your phone "Where's Erica Sadun?" and (provided she's made her location information available to me) the iPhone would display her location. This could be very useful for finding TUAW teammates at Macworld Expo 2012. As with any leaked information, this could all be a ploy by Apple to a) figure out who is leaking to the Apple press or b) get all of us excited about an upcoming announcement. Well, we're already quivering with anticipation about the announcement, and if the new device(s) are anything remotely like what we've heard about, Apple will have another winner on its hands. Update: A slightly less reputable source adds that the upcoming iPhone also features AirPlay mirroring, which is found on the iPad 2 but not on the iPhone 4. This feature allows any app to be viewed via AirPlay video streaming to be mirrored full-screen to an Apple TV -- as though the device were connected with an HDMI cable straight to the TV.
Hands-on with Toyota's Prius plug-in hybrid (video)
Yesterday we attended Toyota's Green Drive Expo where we were given the opportunity to take the production version of the Prius plug-in hybrid (PHV) -- and its smorgasbord of technology -- for a spin. We spent a couple hours driving interfacing with the computers aboard the Advanced model, which besides being outlet-friendly, includes some unique features within the Prius lineup. Explore our gallery below, and hit the break for our impressions and hands-on videos with the latest incarnation of Toyota's iconic vehicle.%Gallery-134091%
Xbox Live Fall 2011 Dashboard update preview: Bing search, voice control, and a Metro overhaul
Autumn is fast approaching -- and you know what that means: it's round about time for an Xbox Dashboard update. Sure, we got a peek of Microsoft's upcoming harvest back at E3, but the good folks from Redmond invited us to take a closer look at what they're calling the "most significant update to the Dashboard since NXE." Senior project Manager Terry Ferrell was on-site to walk us through an early engineering beta and show us how an updated Metro UI, Bing search and deeper Kinect integration is going to change the way folks manage their entertainment content.
