He hated all minorities equally. The Jewish and those of Jewish descent were the easiest to target at first, though, because people already had a dislike of them. From there it was simply his version of the perfect human (ie, eugenics). Anyone not fit to model as adonis was disenfranchised, and many more than just Jewish ended up in concentration camps.
The thing is, though, that without Hitler, I don't know that Germany wouldn't have done what it did - perhaps on a different scale, but even the UK and America were taking concrete steps toward a "better race" by adopting options such as sterilization of people not "fit" to have children.
Without the stark example provided by Hitler, we may today think eugenics is a reasonable way to speed up human evolution.