What's your favorite everyday camera?
That said, the Fuji X100S and X-E2 offer a different shooting experience that more similar to rangefinder shooting.
If you want an ILC I think the OM-D E-M10 is a great choice. But again, a different style of shooting from the X100S.
The s100 (or s110 & s120) is a good deal smaller, but will still let you shoot raw, and full manual. The s100/110/120 is much cheaper, and you can also get an amazing waterproof case for them. I've shot a BUNCH of stuff with the s100 and in daylight to dusk scenarios its a great camera. It will get noisy in low light situations, but some of this can be fixed in post if you're shooting raw. The Canon s100 is that little camera that you can always always have with you. It takes up hardly any space, has a decent zoom and is a very capable camera for its size and cost.
The x100s is unreal in lowlight, and its lens/sensor combination is fantastic. Out of the camera jpegs are amazing, and in low light, its really really really good. It does have its faults though. Its quirky - its a little slow in some aspects of focus, it eats up batteries and its pokey when writing to the card, but its image quality makes up for it. Its not a small camera, which is a good thing or a bad thing depending on your needs. You're also faced with only ONE focal length, which comes with its own challenges/charm.
My 'big' camera is a Sony NEX-5N, and I'd probably get an A6000 if I had to buy now. I generally like both the feel and Sony's image processing. It's not all that pocketable unless you have a pancake lens, but it'll fit into a messenger bag alongside other gear.
That said, I think it depends if it's going to be a primary or secondary camera. If you're looking for something that's going to be your only camera then something like the X-Pro1 or XT-1 is probably better as it gives you more scope and room to grow with interchangeable lenses. Both have that retro-styling and same sensor and the Pro1 can usually be picked up for a similar price to the 100S.