Don't worry. You should be safe.
I've been running my 12700K @ 5.1 GHz all core using Intel XTU and I was able to get higher benchmark scores with little to no issues (the physics test in Passmark CPU test failed to complete once. Ran the CPU Mark test again and it was fine).
You do preferably need a huge air cooler or AIO to hit anything above 4.5 GHz all core, though. Some tests in Geekbench AI regressed, for example, at 5.1 GHz all core due to thermal throttling despite the CPU dissipating the heat through the giant IceSleet G6 cooler.