This is the digression I didn't really want to go into, but here we go:Where did those "inherent rights" come from in the first place?
The notion of those writing the Constitution was that they wanted to enumerate that certain rights exist for all peoples, regardless of who they are, where they were born, etc. Those are things that a government, any government, cannot take away. It was an expression of freedom, and a statement that everyone should have what Americans have, per this Constitution.
They don't 'come from' anywhere, they just are. If someone doesn't have them, it's because they were taken away.
That's the notion, anyhow.