Always' is your key word. It shows that you are over-generalizing from one or two instances. It is dangerous and will not serve you well. It may be that 'jerks' you refer to are those with a charismatic personality but poor ethics; someone who sets out to charm but once a person is trapped into a relationship, treats them badly. If this has happened to you, my sympathies, but learn to be cautious.
We do have a tendency to be attracted by a particular combination of looks and personality so that a person's partners often bear close similarity with each other. The element of danger in a person whose ethics are dodgy can seem exciting. Then the outcome is miserable. We have to be self-aware. Why do I like him? Would my elders like him? if not, why not, and does it matter?