An AGP 1 port has it's notch in a certain place, and AGP 2 port has it's notch somewhere else.
So it depends on the card. To have a card fit in AGP4x only, you make the one notch. But if you put the second notch in it will still work fine in 4X or 1X/2X, but without it physicially will not go into the older slots.
That's why you see a "Universal" AGP4x connector (on a video card) has it's AGP connector cut into 3 pieces (or has 2 nothces).
1 notch is in the place so it will fit in an AGP 1.0 slot, the other notch is for the AGP 4x.
AGP 4x port itself has no dividers, but it uses the locations of the notches to set voltage to the card.
So a 1x/2x card should work in an AGP4x port because it will detect the missing second notch and set itself to 1x/2x mode.
An AGP4x card can be made without the second notch and then will not fit in a 1x/2x slot. Though I've never seen it done it is technically possible.
Also even if they put both notches in the card might not be capable of operating in 1x/2x mode. Again not something I've ever seen.
AGP 2.0 is designed so that with proper manufacturing on the motherboard and video card AGP 1.x and 2.0 are interchangable, but it can be made so they aren't.