You cant compare GPU loads to CPU loads that way. Then I could tell you CPUs can already scale to unlimited amount of cores and the problem is solved. You just need an unlimited amount of concurrent users on the same system.
It simply doesnt work that way.
Consoles dont use 8 cores for gaming. They can only use 6. The last 2 are dedicated for other tasks. And just because a game can use 6, doesnt mean it will.
Also you had 6+ threads on the PS3/Xbox360. That didnt change much did it? 7-8 years later and all we got is BF4.
Example of cpu parellism in action, with a number of different applications, scaling across as many as a million cores
I don't know how read up on google, their software implementations, and the hardware they use, to achieve the results, you are ?
They encountered exactly the same sort of problems that you have been raising.
E.g. They had a new e-mail and/or Search and/or
facebook google+ and/or etc/etc.
It may well have worked just great on one computer, with one user, messing with one small file, on their $10,000 (or whatever they use) single user workstation, with massage chair room nearby.
But when they try to scale it up, to work with say (all figures huge estimates, and may be widely wrong) 100,000 computers, spread around their world-wide computer centres, they find that it usually bottle-necks at certain place(s).
(In many cases they have kindly released publicly available document(s), explaining how/why/what they did, to solve the various computing problems that they solved). Some of the stuff is commercially secret, as well.
One example that comes to mind, is that it needed extensive database access, to something which had to run on just one machine. I.e. 100,000 computers could run the software, but the database itself, had to run on a single computer, even if it had a few multi-core processors inside it.
They solved problems like that, by using a completely different database system, which readily allowed multiple computers, to work independently on the "massive" database.
------------------
The purpose of the above examples, are my attempt at trying to explain (to you) that multi-core computing problems "CAN" be solved, given the technical time and engineering.
I.e. Saying "Amdahls law" ... so it is absolutely IMPOSSIBLE for any (non-GPU) cpu software, to ever go above quad/4 cores, ever, in the next 2,000 years or so, may be missing out of the true capabilities of mega-multi-cored cpus/computers, which we are likely to increasing have available in the foreseeable future.
Question for you ?
If "Amdahls law" is so unyielding, how come google have been able to very successfully scale up their computer/software systems, to something like, millions of cores (I DON'T know how many cores, google has, in total) ?