If I'm not a virgin, does that give him the right to sleep around?

The so-called "virgin complex", sometimes it's not the man who really cares, but the woman herself can't get over that hurdle, harboring a subconscious "chastity sentiment."