I don't think GP100 will ever get a consumer release. With so much more emphasis in DP (proportional to the chip) vs. GK110 and GF114, coupled with dedicated transistors to new features specific to HPC, I think the GP102 rumors will prove true. I never believed the GK102/112 rumors, either. A mythical GP102 could be 50% more than GP104 in cores and memory bus, come in at 450mm2, and end up faster than GP100 in graphics.
GP102 can exist when 16nm FF is more mature and volume is even higher. TSMC in their recent financial conference said only this year will they hit their ~20% revenue target from 16nm FF.
Last year, they were saying, they are on track to be ~30% by this year. So we can see they overestimate, all the time. That's their track record.
Now reality hits and every major mobile and network chip makers are competing with NVIDIA for 16nm wafers.
Under this wafer supply limited scenario, what makes more sense?
1. Use most of the wafers you get to make GP100, sell 8x (harvested chip even!) chips for $127K.
2. Use some wafers for GP102 that's gaming focused and sell each of those as $1K Titan SKUs, the rest harvested for $799 and $599 GTX SKU?
A major point to consider:
GP104 has a good FP32 performance, with it's smaller die size, it will yield much better than GP102 will. If a Deep Learning Tesla based only on FP32 is required, GP104 will be the better choice for profits. A 2x GP104 Tesla could also squeeze into the 300W limit and offer amazing FP32 performance for the HPC market that requires it.
Maybe we will see GP102 sometime next year.