Funnily enough when we got our 500 in 2010 my missus felt the same, she thought the Abarth looked a bit aggressive and it kinda spolied the cute look. As such we went for the most powerful alternative which was the mjd lounge, with 70% of the power and equal torque to the abarth.
These days though I'm not sure if the 500 quite cuts it. It was introduced in 2007, had a fair few real modifications in late 2009 (including suspension improvements), and since then all updates seem to be merely cosmetic or better tech/ finish, etc. It's off the pace.
While the 500x is closer to the competition and I'm willing to allow this slight dropoff in overall package to get a classier italian car with great looks, I'm not sure i'd feel the same these days with the 500 vs rivals. For example the VW Up! GTI looks a funky car, and I do think it would be a lot better all round than the 500. Saying that I wouldn't buy one myself.
Also take note of real vs list prices. In the real world buying brand new and paying in full, the price of a 595 (145hp) auto Abarth is about £17k, the same price as a 500x Cross Plus 170hp auto. I know which I'd choose.