voice control
Latest
Developer creates proxy server for Siri, controls thermostat with his voice (video)
Now that Siri's protocol has been freshly dissected and laid bare for the world to behold, hackers have been busy finding ways to move Apple's personal assistant beyond the realm of the iPhone 4S. That task may be getting easier, however, now that a developer has created his very own third-party proxy server, designed specifically for Siri. The dev, known by his Twitter handle @plamoni, demonstrated his brainchild in a recent video clip, using a plug-in to control a WiFi thermostat with only voice commands. As @plamoni explains, the hack won't require users to jailbreak their iPhone 4S, but it won't let them port Siri over to earlier iPhones or iPod Touch models, either -- not yet, at least. The idea, according to the developer, is to make it easier for other hackers to experiment with and build upon Siri's functionality. Head past the break to see the demo video for yourself, or if you're up for it, grab the source code and instructions on how to create your own server, at the source link below. [Thanks to everyone who sent this in]
MyFord Touch Upgrade inbound, brings 'faster, simpler, easier' infotainment to your late-model whip
For better or worse, Ford owners have been basking in the overzealous infotainment ways of MyFord Touch for over a year now. Since then, the service's been updated with amenities such as integrated Nuance voice recognition for SYNC, but now the Dearborn-based automobile monolith is taking things a few steps forward. Penned for release "early next year," the MyFord Touch Upgrade will usher in a massive revamp across every nook and cranny of the system as a whole. Starting with the 2013 model year Flex, Taurus and Escape, drivers will be greeted by over 1,000 revised screens implementing an "improved look," with an up to 40 percent increase in font sizes, a simpler -- and more cohesive -- GUI focused displaying only important info (for less clutter) and notably, doubly fast response times for touch and voice-based inputs. And oh yes, it gets even better. Those with tablets will be pleased to know that multimedia playback will be supported via USB, while mobile phones will benefit from quicker automatic Bluetooth pairing and better echo and noise-cancellation. Ford has also baked-in voice support for sports buffs with Sirius Game Finder, as well as bibliophiles with Audible.com integration (which can also be touch controlled, should you desire it). Best of all, you'll no longer need to recite any parenthetical or bracketed album info your music tracks may have, or the direction of street names when inputting addresses for directions. Speaking of, the TeleNav-enabled nav system will have further map detail courtesy of Navteq, with enhancements like more 3D imaging, "photorealistic" signage and better route planning thanks to "a database of historical traffic patterns." If you've already got some miles on an existing MyFord Touch-enabled ride, no worries -- Ford will give your system the upgrade pro bono when it's available, taking all but a (hopefully) quick visit to your local dealer. Potential and current Ford owners will find more visuals in the gallery below and full details in the press release past break. Update: Ford has let us know that existing owners will not be required to visit their dealer for the upgrade, and will be receiving a USB drive allowing for a self-install in the mail. That said, you can still drop by your dealer after getting it to have the install done there. %Gallery-138462%
Siri being tested in jailbroken iPad 1
It's been ten days since Siri hit the scene and the virtual assistant is in the process of being torn apart by the hacking community. Siri, as it exists on the iPhone 4S, has been ported to the iPhone 4 and now the iPad 1. Developer Steven Troughton-Smith, who worked on the iPhone 4 port, has shared his progress with @jackoplane who has successfully ported the app to the iPad 1. Several images of Siri running on the tablet device document this achievement. Unfortunately, neither the iPhone 4 nor the iPad port is fully functional at this point. Siri still needs to connect to Apple's servers to work and the servers are configured to accept requests only from the iPhone 4S. Potentially, these devices could be spoofed to look like an iPhone 4S which could open this functionality to jailbroken devices. Jailbreaking and porting may be the only solution for owners of older hardware who want Siri on their iOS devices. It's doubtful that Apple will bring Siri to the iPad 1 or the iPhone 3GS. Apple may not want to support this older hardware and these models may also lack the processing power required for the voice assistant. But as some of you pointed out in one of our latest "You're The Pundit" posts, Apple could decide to bring Siri to the iPhone 4 and the iPad 2 once it comes out of beta. [Via Jailbreakstory]
Dear Aunt TUAW: What is this "Voice Control" thing?
Dear Aunt TUAW, I discovered by accident that I can hold down the home button on the iPhone 4 and it brings up Voice Control. I don't remember this being there before. Is this some sort of Siri light functionality for the iPhone 4? I can use it to makes calls and FaceTime someone, but not much else. Your loving nephew, Douglas Dear Douglas, Think of Voice Control as Siri's, well, not Mom...maybe Siri's Aunt? Yeah. Exactly. Voice Control is basically an older, less stylish version of Siri -- far more approachable, slightly less sexy. And with a worse sense of humor. First introduced on the iPhone 3GS, Voice Control offers hand-free dialing and basic music controls. As with Siri, you can press and hold the Home button to bring up the assistant. There you can say "Call Dave at Home" or "FaceTime Steve" or "Next Track" or "Play Songs by Parry Gripp" (Auntie is a huge Parry Gripp fan). When Voice Control is running, recommended, speakable phrases scroll across the screen. You can use Voice Control on the 3GS and later and on newer model iPod touches. If you disable Siri on the 4S or haven't gotten around to enabling it, the 4S uses Voice Control instead. Apple has never really done the whole hands-free thing on the iPad, which is a shame because Auntie thinks that Siri would rock on the iPad, but that's the topic for a whole different post. Hugs, Auntie T.
Kinect voice control reaches Australia, Harold Bishop and Donald Fisher will be pleased
Holy dooley! (oh my!) Microsoft's being a big-note oneself (bragging) about getting Xbox 360 voice control working for the Aussies (Australians.) It's invited all the journos (journalists) to a rage (party) down under (in Australia) to show off the system that had difficulty understanding Australian English. Haven't a clue why.
Beeri: Siri's new best friend cracks open a cold one (video)
We already know that Siri can send texts, check the weather or find you a restaurant, but did you know she can also fetch you a beer. Well, sort of... with a little hacking. The folks at Redpepper dreamed up Beeri, an RC truck that cracks open a can of brew whenever it receives a tweet instructing it to "pour." Since you can text updates to Twitter (40404) and Siri can text, that means it's perfectly simple to tell Beeri it's Miller time. Whenever the Arduino embedded in the truck detects a mention with the word "pour," it drives forward, slamming a beer can into a puncture wall that drips into a funnel, filling a cup beneath the table top. It's a pretty ingenious system, and you can see it in action after the break. We just hope Beeri has a day job -- looking at all that head, it's clear she wouldn't last a day as a bartender.
Siri gets lost internationally, promises to do better next year
The iPhone 4S' Siri integration may be a potential game changer, but she's not quite the world traveler some of us would like her to be. In fact, it seems she's as lost outside of US borders as any unprepared tourist. Looking for a pub in London? Better find a traditional map. Need to know the time of day in Canada? Siri admits she has no idea, go buy a watch. Business search (via Yelp), directions, and traffic data search all appear to be US-only features for now, and Wolfram Alpha only works in English-speaking countries. The automated assistant's international failings aren't too big of a surprise, however -- Apple's own Siri page outs the service as a beta, noting that some features may vary by area. Stuck with sub-par international support? Sit tight, it's coming: Apple's Siri FAQ states that additional language support (including Japanese, Chinese, Korean, Italian and Spanish), maps and local search content are set to go international in 2012. Update: Wolfram Alpha works outside the US in English speaking countries, thanks to everyone in the comments for the clarification.
Why Siri should (and probably will) come to iPad 2
Since the iPhone 4S features the same A5 processor as the iPad 2, owners of Apple's current-gen tablet have wondered if it's possible that Siri, Apple's new voice assistant, might be offered on the iPad 2. While my colleague Erica Sadun's answer to that is "Don't hold your breath," I only agree with her up to a point: I don't think there are any technical hurdles whatsoever to running Siri on an iPad 2, and the fact that the device doesn't currently feature voice controls is meaningless. I think Siri will come to the iPad 2 eventually -- certainly not right away, but possibly within the next six months. Voice Control as it now exists on the iPhone 3GS and iPhone 4 doesn't function on the iPad or iPad 2, but there's a reason for that: the existing commands would be essentially useless on those devices. The pre-Siri version of Voice Control allows you to use voice commands to control music playback, dial phone numbers or initiate FaceTime calls, and ask the device for information about the current time or currently playing song. That's about all Voice Control does. Those functions are all useful features on a device that spends much of its time in your pocket, but on an iPad they make very little sense. On the other hand, Siri's commands would be immensely useful on the iPad. The same things Apple showed off at the "Let's talk iPhone" event, like setting up Reminders and Calendar events or looking up information on Wikipedia or Wolfram Alpha, would be very handy to have -- so handy that I don't see why Apple wouldn't offer them. Apple has long been a company that designs products its own workers want to use, and it's hard to imagine that no one in Cupertino has thought about how Siri could vastly expand the power and capability of the iPad 2. Since the iPad 2 has both a microphone and the same A5 as the iPhone 4S, there shouldn't be any technical reason why Siri wouldn't function well on that device. Some have speculated that the iPhone 4S has 1 GB of RAM to the iPad 2's 512 MB (a claim that will have to wait for an iFixit teardown before it can be proven or disproven), but my TUAW colleagues don't believe that Siri's functions should be so RAM-intensive that they require such massive amounts of memory. In fact, we've done some digging into Siri and found that most of the actual work of understanding voice commands gets offloaded to external servers. In essence, the iPhone 4S and its built-in processing functions determine what you said, while Apple's servers translate that into what you meant and send that information back to your iPhone. The pre-processing that takes place on the device itself may be too taxing for an A4 processor, but the iPad 2's A5 should theoretically be able to handle it just fine. Perhaps even better -- Apple has a habit of underclocking CPUs for the iPhone in the interest of power management, so the iPad 2's A5 is likely to outperform that of the iPhone 4S for many functions. The fact that Apple hasn't yet said one way or another whether Siri will come to devices other than the iPhone 4S also doesn't mean much. The iPhone 4, 3GS, and newer iPod touch models had an exclusive on multitasking for almost exactly six months before iOS 4.2 debuted and brought that feature to the iPad, and the same thing may end up being true for Siri. Here's what I think is the most likely scenario: Siri will remain an iPhone 4S exclusive at least until the third tier of international rollouts completes in December. In fact, Apple will probably wait until after the end of the holiday quarter and bring Siri to the iPad 2 in the first quarter of 2012. Not only will this give market incentive for people to buy the iPhone 4S by having Siri as a device-exclusive feature during the holiday period, it'll also give Apple's servers and Siri's algorithms time to adjust and scale to the number of inquiries it'll receive. Once Siri's beta period ends and international rollouts for the iPhone 4S are reasonably complete, that's the perfect time to bring Siri to the iPad 2 in a dot-update to iOS 5. By that time Siri and its supporting infrastructure will be more mature and able to handle the extra load of adding support for one more device type, and it should also help alleviate the typical post-holiday quarter sales slump. As for the other devices in Apple's iOS stable, like the iPod touch, iPhone 4, and iPhone 3GS, I don't expect them to ever see support for Siri. Siri's developers have already confirmed that many compromises were required to get the service running on the iPhone 3GS, and it's probably the same story for iOS devices with an A4 processor. The 2012 model iPod touch will likely be updated to an A5 processor, however, so we might see Siri support for next year's iPod touch. For the time being, Siri remains an iPhone 4S exclusive and one we have yet to test for ourselves. We look forward to putting this innovative feature under our interrogation lights once the iPhone 4S is released on October 14.
Microsoft reveals new TV providers including Verizon and Comcast coming to Xbox 360 (video)
Just as the rumors indicated, Microsoft is bringing video from a number of providers beyond the ones it initially announced to the Xbox 360 in its fall update, including big guns like Verizon and Comcast. While Verizon is promising "a selection" of its live TV channels on the Xbox 360 as expected, Comcast is only bringing its Xfinity TV video on-demand offerings (no AnyPlay powered live TV -- yet) to subscribers when it launches "in the coming months." Other notable providers include Lovefilm (UK, Germany), BBC TV (UK), HBO Go, and Syfy. As promised during E3, the services integrated with Xbox will offer support for search across all available video, as well as support for Kinect voice and gesture controls. The universal search is looking good since it pulls together various services into one UI (as we discussed on our podcast yesterday), but the reality is content providers and geographical limits on what services you can pick from are still throwing up walls between users and content. Check after the break for PR detailing what you'll be able to access and where, as well as a video intro to all the tasty new TV services. %Gallery-135845%
Original Siri service is dead, long live Apple Siri
If you scoffed at the news that Apple's Siri would only be available on the iPhone 4S, thinking that you could just use the standard Siri app that was still available on the App Store, then scoff no more. The freely available Siri app has been removed from the App Store completely, and as TechCrunch reports, the whole service is being taken down in advance of the official debut of the app as part of iOS 5. TUAW reader Luc reports that the current app now gives a note as it starts up that the app will be "leaving for home" on October 15th, so you have until then to enjoy the app as is if you happen to still have it installed. Presumably at that point, the old service will end, and you'll have to buy an iPhone 4S if you want access to the new service. This basically makes sense: Apple's trying to sell devices, and it wouldn't really work to have a version of the service out there running around for free, even if that service isn't as integrated. Apple's done the same thing with other companies they've picked up and made official, including CoverFlow back in the day. Unfortunately, if you're currently a big Siri user, then you'll have to upgrade your handset to keep using the service as is -- there is no built-in plan to let you keep using the current app.
Apple (re)introduces Siri as iPhone voice control assistant for iPhone 4S
Apple picked up mobile assistant app Siri quite a while ago, but only at today's event did we finally see why. The company is relaunching the app as official, though it will keep the name Siri. To access it, all you'll have to do is hold down the home button, and then a little purple mic will pop up, listening in to whatever question you ask. From your question, Siri will then find any and all pertinent information, including data about the weather, stock and clock information, and even searches for local restaurants and businesses. You can ask for directions and get them right away, or even get messages read off to you via Bluetooth, and create calendar appointments and replies right inside the Siri system. The whole thing is very impressive, and if it works as well as Siri did, Apple's phone has yet another killer feature on it. Unfortunately, Apple said that Siri is "the coolest feature of the new iPhone 4S," so presumably you'll need the new handset to make use of the feature. We'll double-check on that going forward, but all indications are that Siri will be 4S-only.
Apple brings Siri voice control to the iPhone 4S
You've heard the rumors, and Apple has now confirmed that it will be bringing Siri voice control to its new iPhone 4S -- and, yes, it will still be called Siri. That will let you use natural language to perform tasks like asking for a weather forecast or getting directions, setting an alarm or making a calendar appointment, and searching Wikipedia or Wolfram Alpha for information (among many other possibilities). Described as a "humble personal assistant," Siri will work in English (including the UK and Australia), French and German for now, and it'll work with all built-in apps and over both 3G and WiFi. It'll also be a beta to start with, and Apple promises that it "gets better" as it learns your voice. Unfortunately for current iPhone owners, however, it looks like Siri will only be available on the iPhone 4S (at least initially). Update: Perhaps not surprisingly, Apple appears to have pulled the existing Siri Assistant app from the App Store. There's also somewhat curiously no mention of Siri at all on Apple's Canadian website, although the Siri app itself was never available in Canada to begin with. [Thanks to everyone who sent this in] Update 2: Already enjoying the fruits of a voice navigated lifestyle with Siri on your iPhone? Don't get used to it, as users are receiving messages like this one indicating it will shut down for the non-iPhone 4S owning plebeians as of October 15th. [Thanks Shawn & Lloyd] %Gallery-135726%
Rumor: Next iPhone to feature powerful Assistant, 1 GB of RAM (Updated)
Last week a reliable source (who asked not to be named) approached TUAW with information about upcoming iPhone features that sounded incredible. We didn't run the post at that time, however, both out of concern for the source and because we couldn't corroborate the details. This morning, 9to5 Mac posted pretty much exactly what we heard from our source -- that the next iPhone is going to feature an amazing voice control and device navigation system called Assistant. That's not all -- the source (who may or may not be the same person who talked with 9to5) told us that the iPhone will come packed with 1 GB of RAM and the Apple A5 dual-core processor, as well as a vastly improved 8 MP camera. 9to5 reported some details TUAW didn't get, including that the new phone will contain Qualcomm's Gobi Baseband chipset for use as a true world phone (GSM and CDMA). The Assistant, however, is a game-changer. Assistant is an outgrowth of Voice Control, which was introduced with the iPhone 3GS in 2009. It is based on technology from Siri, a company that was purchased by Apple last year. The Assistant requires the power of the A5 CPU as well as the 1 GB of RAM, which is why existing iPhones will not be able to take advantage of the new feature. The speech interface is launched by holding the home button for several seconds, after which a microphone interface slides up from the bottom of the screen, covering only about a quarter of the display. In contrast to the existing iPhone Voice Control capabilities, Assistant can help you with just about anything. Want to send an iMessage without typing? I could just say "send a text to Barb saying I'm going to the bank" and the message is created and sent. You can also use Assistant with the location-based reminder feature in the iOS Reminders app, by using commands like "Remind me to buy Vitamin D when I'm at Whole Foods Market." Voice requests for directions are also a feature -- asking "How do I get to Carnegie Hall?" won't result in the expected response ("practice, practice, practice") but directions from your current location to 881 7th Avenue in New York City. Assistant also has a conversation view, in which the system literally converses with the user in order to provide the best results. Let's say set up a meeting with Tim Cook on October 4th. You'd say "Set up a meeting with Tim Cook," and the iPhone would respond by asking "Which email address should Tim Cook be notified at, home or work?" When you'd respond "Work,", the iPhone would ask the time and date you want to schedule the meeting for. At the end of the conversation, you'd be shown the details of the calendar event for confirmation. We're told that you can speak to the Assistant in your normal tone and speed of voice; it's that accurate. Assistant is also integrated with Wolfram Alpha, so you could also ask your iPhone questions like "Convert 10.2 acres to hectares" or "What's the cube root of 924?" and get an immediate answer. One more fascinating feature that is likely to be packed with privacy settings is "Find my Friends." With this feature, you could ask your phone "Where's Erica Sadun?" and (provided she's made her location information available to me) the iPhone would display her location. This could be very useful for finding TUAW teammates at Macworld Expo 2012. As with any leaked information, this could all be a ploy by Apple to a) figure out who is leaking to the Apple press or b) get all of us excited about an upcoming announcement. Well, we're already quivering with anticipation about the announcement, and if the new device(s) are anything remotely like what we've heard about, Apple will have another winner on its hands. Update: A slightly less reputable source adds that the upcoming iPhone also features AirPlay mirroring, which is found on the iPad 2 but not on the iPhone 4. This feature allows any app to be viewed via AirPlay video streaming to be mirrored full-screen to an Apple TV -- as though the device were connected with an HDMI cable straight to the TV.
Hands-on with Toyota's Prius plug-in hybrid (video)
Yesterday we attended Toyota's Green Drive Expo where we were given the opportunity to take the production version of the Prius plug-in hybrid (PHV) -- and its smorgasbord of technology -- for a spin. We spent a couple hours driving interfacing with the computers aboard the Advanced model, which besides being outlet-friendly, includes some unique features within the Prius lineup. Explore our gallery below, and hit the break for our impressions and hands-on videos with the latest incarnation of Toyota's iconic vehicle.%Gallery-134091%
Xbox Live Fall 2011 Dashboard update preview: Bing search, voice control, and a Metro overhaul
Autumn is fast approaching -- and you know what that means: it's round about time for an Xbox Dashboard update. Sure, we got a peek of Microsoft's upcoming harvest back at E3, but the good folks from Redmond invited us to take a closer look at what they're calling the "most significant update to the Dashboard since NXE." Senior project Manager Terry Ferrell was on-site to walk us through an early engineering beta and show us how an updated Metro UI, Bing search and deeper Kinect integration is going to change the way folks manage their entertainment content.
Xbox 360's ESPN3 app updated with more voice control, split screen and more
The PlayStation 3 may have NFL Sunday Ticket but the Xbox 360 still has exclusive access to ESPN3's slate of games, shows and replays, and today the app was updated with a new look and a few new features. Viewers can designate their favorite sports and teams to bring related content right to the front, while a new mini-guide gives easy access to other streams while you watch. If you're trying to keep track of more than one game there's also support for split screen viewing (with independent control of each stream) and upgraded voice control for Kinect owners. Other tweaks include a college football scoreboard to keep track of all the games at once, reminders, live alerts on score changes and the addition of ESPN's BottomLine. Unchanged is the restriction that you need to subscribe to a TV provider that includes ESPN3 in its package, but if you do have the service (and shell out for XBL, of course) it should be available the next time you load up your console. Check out the YouTube videos embedded above and after the break along with a press release for a runthrough of some of the new features.
Amulet shows off Kinect voice control for Windows Media Center (video)
The Amulet Devices team has been pushing voice control for Windows Media Center through its remote accessory, but now it's dived into the pool of Kinect hacks with a demo (video embedded after the break) using the Xbox 360 add-on instead. The company blog breaks down some of the hardware capabilities of the device that make it ideal for voice control (as previously seen in the Xbox apps for ESPN3, Hulu Plus and Netflix) and also details some of the efforts used to make it work here. If there's enough interest it may release the demo software for free, and already plans to bring out a full version when Microsoft unleashes a commercial version of the Kinect SDK. We're still not sure if voice control is ready to take over for standard remotes but at least talking to the TV is less of a strain than gesture control on our weak made-for-blogging arms.
Ford bringing SYNC systems to base trim levels, drops from $395 to $295
Ford's been pushing SYNC in its autos since 2007, but you wouldn't have known it had you opted for the base trim level on your ride. Thankfully for those who appreciate the basics, that's a-changing. The automaker is aiming to entice more potential owners by offering the voice-activated infotainment systems across all levels for $295 (down from $395, where optional), starting with its 2012 Edge and Explorer models. To sweeten the deal even further, it'll also become standard on SEL variants for the first time -- before, it was a luxury previously reserved for Limited and Sport. Ford plans to roll out the system across its entire lineup in three years time, bringing the 2013 Ford Taurus, Focus, Escape and Flex into the fold. You know, options for all of you who aren't hip on the all-American, gas-guzzling SUV. Full PR past the break.
Pioneer solicits Whodoo guinea pigs for speech-based Android assistant (video)
Ever wish you could have a personal attendant living inside your Android smartphone? You know... one you can boss around without incurring human rights or labor law violations? Apparently Pioneer shares your vision, because its voice-controlled social assistant named Whodoo is seemingly ready to "hop to" at a moment's notice -- willing to locate a restaurant and send it to friends, route the appropriate directions, and announce your intentions to Facebook or Twitter -- all based on your verbal commands (and ostensibly perfect for in-dash navigation). The company is seeking bossy applicants for its closed beta experiment, which involves completing a lengthy application, providing considerable feedback, and submitting audio samples that are gathered by Whodoo. Think you've got the chops? Just follow the source, where you're free to convince Pioneer of the same.
Microsoft's NUAds interactive advertising to harness powers of Kinect, 'change television as we know it'
The folks over at Microsoft Advertising are quite fond of their latest brainchild, so much so that they're calling the Kinect-enabled advertising platform "irresistibly interactive." NUAds -- which snaked the NU in NUI -- feeds off our need for interactivity, allowing advertisers to lure us in by enabling points of gesture and voice control. Think the latest Snuggie spot is super cool? Just say "Xbox, Tweet," and all your friends will know it. Want to know more about Mariah Carey's latest fragrance? Say "Xbox, More," and the info is all yours. Wondering where you can pick up a box of Nad's edible hair remover? Say "Xbox, Near Me," and you'll get a text with the location of the closest Nad's retailer. Want to vote on the hottest new Bratz doll? Give your girl a thumbs up. So Microsoft may have engaged a host of more respectable partners, namely Adidas, NBC, and Coca Cola, for its demo of the voice and gesture-enabled advertising platform yesterday, and NUAds does indeed serve up promotions in an entirely new way, but will it really change how we view the boob tube for good? Check out the video demo after the break, and weigh in the comments below.
