That is your assumption. In reality, there are about a billion other explanations as to why someone in a position of incredible power over someone else would have sex with them.
And yet the world is full of weak, small, and non-aggressive men today. Now how could that have ever happened? Interestingly, things worked out such that a lot of weak, small, and non-aggressive men are a hell of a lot more successful than you are. What a strange happenstance.
But we get it, you'd rather live like the rest of the apes. The great thing about humans is that they adapt and use their intellect to better themselves over merely responding to their primal urges and instincts. And with that, they gradually respond to conditions changing and the old way being obsolete. I mean, think about how many women are attracted to success today. I'm sure in your mind that's the same thing as being attracted to strength and even violence, but in reality it's something that's taken on an entirely different form.
Oh, and for your information, prior to agriculture most nutritional needs were met by foraging, not hunting. And the smart humans were the ones who moved away from the mammoths rather than spending all their energy hunting them.