Exactly - people don't look at the benchmark sites much, if they look at all they're actually more likely to be reading reviews on bestbuy.com or amazon.com than even engadget and theverge.
With that said, one of the biggest things on any high end mobile device SoC is its GPU. There's a reason for that - the buggers are higher rez now than most people's desktop monitors, and smooth scrolling UI along with decent 3D is high on the list of user experience needs when you're using a touch screen.
AMD may now be better positioned in that regard, but I don't think either Intel or AMD are doing anything outstanding. They get knocked around pretty hard by the A7, high end Qualcomm chips, and even the older A6X in the iPad 4.
So to your point about high end parts - Bay Trail isn't it, and I doubt Kaveri is either. Look at where the iPad 4 (A6X), iPad Air (A7), and SnapDragon 800 sit in relation to the Z3470 Asus T100 \ BayTrail FFRD :
i.e. :