Between 3400g and the 4x and 5x chips, there is a revision of the VEGA architecture. Raven ridge is based on VEGA64/56 CUs and Renoir up is based on VEGA VII. That may not seem like a big difference, but, there's a shader model update, some internal caches were changed, and the architecture was modified for higher clock speeds. When you overclock the Raven Ridge iGPU against the Renoir iGPU with a similar CU count and similar ram, Renoir still does better, though its not night and day.
Once you get to the 4750g vs the 5700g, you are facing a modified memory architecture. Cezanne has twice the L3, reducing dram bus contention. In addition, it has a single CCX as opposed to a pair of smaller ones, further simplifying internal data movement. Its not a huge difference again, but it does add up. I dare say that, for all of them, having a better CPU core running their drivers each generation doesn't hurt their performance either.
I suspect that Phoenix will see a notable performance increase due to the Zen 4 core improvements as well as the larger L2 that's available. I suspect that the larger internal caches of the iGPU won't hurt either. However, eventually, without enough VRAM bandwidth, the gpu will run out of things to do. I think that that is a big part of why rembrandt underperforms compared to its grunt, it just doesn't have enough memory bandwidth.