Now if that team stayed at Apple they likely would have advanced with way more daring changes in that same time, the base already existing and all. But Apple apparently put too little effort in retaining them. It's quite telling that they all thought leaving Apple to form a startup was worth the risk.
I'm not sure it is fair to say "Apple put too little effort into retaining them". Reportedly they wanted to do a server CPU, and Apple had no interest in pursuing that. They left to form their own company that would design an ARM based server CPU.
No doubt Apple paid them well enough they were quite comfortable. It would be impossible to pay them as much as they could have and actually did end up making from starting their own company and having it purchased by Qualcomm - though of course there was some risk involved on their end if it had failed and gone under.
What I find odd is they wanted to do a server CPU and were well along on that path, then Qualcomm bought them out. It seems that ambition has been shelved as there are apparently no plans to release a server CPU. They are back to designing for the exact same market segment they were designing for at Apple. Will they get an itch to go back out on their own and try again? This time with enough money in their pockets they could truly be their own bosses (i.e. don't have to be under the thumb of VCs looking for a quick exit)
Or are they happy to be designing the same mobile/PC CPUs at Qualcomm they did at Apple, and the whole "we want to design server CPUs" was just a cover story for some underlying reason they were unhappy at Apple? If so we will probably never know, but if they stick around at Qualcomm for much longer (they may have made a contractual commitment to remain at Qualcomm for some period as part of the acquisition) one has to wonder.