While sitting in the back of the Uber, I could look at an iPad mounted to show the riders some details on the car. You can see how far you've driven autonomously, the current speed and a graphic showing the movements of the steering wheel and when the brakes are applied. But most interesting was a view of what the car's radar system is seeing at any given moment. You can see cars, buildings, pedestrians and anything else in range of the car. It'll satisfy the curiosity of people interested in how the car works as well as provide some transparency and possible security to people skeptical about the system.
After cruising around Pittsburgh for a bit, I was offered my own chance to get behind the wheel. At first, I thought I was just getting a look at what the driver sees while they're behind the wheel, but nope -- I was getting a chance to sit up front while the car drove me around. The most interesting thing about that experience was the strange awareness I needed to keep while letting the car do its thing. I was tempted to look around and take in the sights of the city because I felt totally comfortable letting the car do its thing.
Getting behind the wheel wasn't any more nerve-wracking than riding in the back, because I was in complete control of the car.
Of course, the system is not even close to ready to have a driver totally check out, so I kept my hands touching the wheel and a foot ready to tap the gas or brake so I could take over. Fortunately, it's dead-simple to take control of the car: Moving the steering wheel or applying any pressure to the brake or gas will deactivate the autonomous driving system. I took over the car a few times, mostly just to see how it worked, and it was easy to both drive as normal and then hit a button near the shifter to put the car back into autonomous mode.
It's not surprising that full manual control is so easy to activate, but it makes sense that Uber would want the press to see first-hand how easy it is to snap the car into your control. That said, I could definitely see a situation in which a "safety driver" couldn't help but tune out a bit during a long shift behind the wheel. It's also not the easiest thing to keep your foot hovering over a pedal and hands lightly gripping the wheel without accidentally engaging with them.

The fundamentals appear to be in place for Uber, here in Pittsburgh, at least. But there's a long way to go before its cars can navigate all of the city, let alone other cities. A number of Uber engineers and spokespeople I talked to made it clear the focus was to build out Pittsburgh first, both in terms of increasing the area that autonomous cars could travel as well as fixing little oddities like its performance at four-way stop signs. Other cities will likely come in the future, depending on how the pilot goes, but right now all thoughts are focused on Pittsburgh.
One of the big challenges for Uber will be learning more about how the cars deal with inclement weather. That's one of the reasons it's testing in Pittsburgh -- between the complexity of the old city's layout (small streets, lots of one-way roads, lots of congestion) and the fact that it sees all kinds of weather, there will be a lot to learn from testing here. Uber engineers feel that if they can master Pittsburgh, they can make the system work pretty much anywhere. (I'm thinking both Boston and Manhattan will make for a serious challenge.)
Good luck mapping out Boston and Manhattan, Uber.
But it's not clear exactly how Uber will deal with bad weather. The team said they've tested in rain and had success thus far, but I wasn't able to get a straight answer when I asked about how it'll recognize and account for snow. It seems that it'll be up to the safety driver to decide when to engage the autonomous features, and I have a feeling that in the winter these cars will be operated in traditional fashion to be on the safe side.
As much as the pilot is to gauge Uber's technical prowess, it'll also be a judge to how the public reacts to self-driving cars. In some ways, it's like Google's very public beta of Glass -- except that no one was going to die if Glass went horribly wrong. Consumers will understandably be a bit nervous the first time they get into one of these vehicles. But with a human being behind the wheel and the cars operating at relatively low speeds around the city, the potential for true disaster seems pretty low.
The 1.3 million people who Uber said die every year in car accidents around the world is a big part of why they're doing this in the first place. The company says 94 percent of those accidents are caused by some variety of human error, and it believes that self-driving cars can see and process more than humans, making them safer. There's a lot to be done before that's a reality, and Uber's definitely starting small. But right now, it has a lead on just about every other company working on self-driving cars.