Yes, but I have ulterior motives
Guess that's one way to look at it. Here's my perspective. Unlike Qualcomm who's mostly just sitting on all that cash Intel is investing their profits. Yes the cost of fab building and process R&D continues to increase with every new node, but profits are still keeping up with that pace thanks to the large gains in total revenue last year. (Yes revenues are down in comparison... but that's after how many straight quarters of increase, and going from $35B in 2009 to $43B in 2010 to $54B in 2011.) Intel still has quite a bit of buffer before it has to start slowing down in that regard.
As for what would happen to Qualcomm if Intel took 50% of their chip business... how would they not flinch? Unless you're restricting that statement to only Qualcomm's Snapdragon line? Qualcomm's chip business (reported in their earnings as QCT) is responsible for about three quarters of their revenue. And through their Infineon acquisition Intel has competitive offerings for the majority of Qualcomm's chip business.
Lastly, how do the foundries fit into your picture? Because it's not just Qualcomm vs Intel, it's Qualcomm + their foundries vs Intel. Qualcomm may well be sitting pretty and easily be able to mitigate the damage Intel can cause them directly (that's actually something I agree with) but the same can't be said for their foundry partner(s). How badly would TSMC be hurt if 50% of Qualcomm's orders suddenly disappeared and they had leading edge fabs sitting idle? It's the foundries that are Qualcomm's Achilles heel as they have to make the same kind of massive investments into infrastructure and research as Intel but without the huge cash flow/margins cushion.