ComputerBase & GameGPURise of the Tomb Raider: DX11 vs DX12 + VXAO Tested

[Sweepr]

ComputerBase

www.computerbase.de/2016-03/rise-of-the-tomb-raider-directx-12-benchmark/


GameGPU

http://gamegpu.com/action-/-fps-/-tps/rise-of-the-tomb-raider-v-rezhime-directx-12-test-gpu.html


User Results

Hey i have few more benchmarks in CPU bottleneck scenario.I underclock 6700K to 2.5Ghz and run some benchmarks in most CPU intensive area-geothermal valley village.

I dont know if its 6700k just that super fast, but even at 2.5Ghz a have 60fps in worst CPU bottleneck scene..i read village is nightmare for cpu but not much to 6700k.Still i needed lower resolution to 1280x720 to be CPU bottleneck even at 2.5Ghz with GTX970 1500/8000

Anyway results
1920x1080/1280x720 all max + low textures and HBAO+
First fraps 60s run
1920x1080
DX11 Avg: 59.103 - Min: 49 - Max: 80
DX12 Avg: 59.641 - Min: 49 - Max: 78

1280x720
DX11 Avg: 76.913 - Min: 53 - Max: 125
DX12 Avg: 84.331 - Min: 70 - Max: 126

CPU bottleneck scene screenshot at same place
DX11 58.6Fps

DX12 77fps

Under dx12 there is 31% FPS increase on test screenshot.But if you have good CPU DX12 is pointless.

 

[ShintaiDK]

GTX970 beating a Fury X in DX12

Oh wait, it doesn't count as DX12 then :|

Thread crapping is not allowed here and you know that very well by now yet you still never listen.

-Rvenger

 

[jantjeuh]

So basically all cards regress under DX12? How did they manage to muck up so bad?

 

[ShintaiDK]

So basically all cards regress under DX12? How did they manage to muck up so bad?

DX12 is faster if you got a weak CPU.

 

[Arachnotronic]

Sweepr, doesn't count, obviously. Anything that shows NVIDIA possibly being good for future DX12 titles is clearly not a "true" DX12 title, don't you know?

(obviously this is playful sarcasm, thanks for sharing Sweepr!)

 

[raghu78]

DX12 is faster if you got a weak CPU.

So does that mean DX12 is slower if you have a fast CPU. If the DX12 version of a game is not performing better than the DX11 version then its not the API at fault but the developer. The key here is developers ought to put in the effort to write a robust DX12 codepath which exploits the low CPU overhead and multithreaded design of the DX12 API and provides better performance than DX11. We saw that with AOTS and Hitman. Rise of the Tomb Raider does not do that.

 

[Head1985]

Dont even try very high TEXTURES with DX12 on GTX970....3.5Gb cant handle that.Under dx11 there is zero problem, but under dx12 there is masive performance drop.Game need more than 1GB VRam more under dx12.

1920x1080 ALL MAX HBAO.
Test scene 60s run in geothermal valley
GTX970 1500/8000

DX11 very High textures Avg: 54.089 - Min: 46 - Max: 73
Frametimes http://abload.de/img/dx11vhighlca1p.jpg
DX11 Low textures Avg: 59.620 - Min: 50 - Max: 82
Frametimes http://abload.de/img/dx11low3tyl3.jpg

DX12 Very HIGH textures Avg: 41.663 - Min: 32 - Max: 50
Frametimes http://abload.de/img/dx12veryhigh46z09.jpg
DX12 Low textures Avg: 59.502 - Min: 49 - Max: 78
Frametimes http://abload.de/img/dx12lowy1xyt.jpg

DX11+VXAO Very HIGH textures
Avg: 44.536 - Min: 37 - Max: 59
Frametimes
http://abload.de/img/vxaotps5q.jpg

 

[IllogicalGlory]

Sweepr, doesn't count, obviously. Anything that shows NVIDIA possibly being good for future DX12 titles is clearly not a "true" DX12 title, don't you know?

(obviously this is playful sarcasm, thanks for sharing Sweepr!)

Yes, performance regressions are obviously a very good thing for NV going forward, so is VXAO which causes a huge performance hit and barely looks any different compared to HBAO+. Excellent showcase for what NV can do under DX12, in a sponsored game no less.

 

[ShintaiDK]

So does that mean DX12 is slower if you have a fast CPU. If the DX12 version of a game is not performing better than the DX11 version then its not the API at fault but the developer. The key here is developers ought to put in the effort to write a robust DX12 codepath which exploits the low CPU overhead and multithreaded design of the DX12 API and provides better performance than DX11. We saw that with AOTS and Hitman. Rise of the Tomb Raider does not do that.

Assuming you are not CPU limited in any way (Theoretical unlimited CPU performance). Why would DX12 be faster? The entire point with DX12 is to reduce CPU overhead.

 

[raghu78]

Sweepr, doesn't count, obviously. Anything that shows NVIDIA possibly being good for future DX12 titles is clearly not a "true" DX12 title, don't you know?

(obviously this is playful sarcasm, thanks for sharing Sweepr!)

The question is if all the cards are performing lower with DX12 than DX11 do you really want to call it a true DX12 title.

AMD partners are showing Nvidia partners "The way its meant to be developed".

 

[boozzer]

so why did dx12 lowered the performance of amd cards by 20%+???

did the article state why? has the developer said anything? that is a huge drop. with other games, we knew why NV gpus performed badly.

 

[jantjeuh]

Assuming you are not CPU limited in any way (Theoretical unlimited CPU performance). Why would DX12 be faster? The entire point with DX12 is to reduce CPU overhead.

So what you're saying is that DX12 somehow reduces CPU overhead at the expense of GPU performance?

 

[raghu78]

Assuming you are not CPU limited in any way (Theoretical unlimited CPU performance). Why would DX12 be faster? The entire point with DX12 is to reduce CPU overhead.

http://www.pcper.com/reviews/Graphics-Cards/3DMark-API-Overhead-Feature-Test-Early-DX12-Performance

I suggest you read up on DX12 to find out why its faster than DX11.

So what you're saying is that DX12 somehow reduces CPU overhead at the expense of GPU performance?

I guess he does not understand what he is saying.

 

[Arachnotronic]

The question is if all the cards are performing lower with DX12 than DX11 do you really want to call it a true DX12 title.

AMD partners are showing Nvidia partners "The way its meant to be developed".

Sounds like a "true DX12 title to me." I would bet you a lot of money that most mainstream graphics programmers will struggle with the "freedom" (i.e. responsibility) that DX12 requires. Only the best-of-the-best engine dev teams will, IMO, be able to wring out advantages relative to DX11, at least for quite some time.

If I were starting a game studio tomorrow and wasn't planning to use an off-the-shelf engine, I would stick with DX11.

 

[Erenhardt]

Assuming you are not CPU limited in any way (Theoretical unlimited CPU performance). Why would DX12 be faster? The entire point with DX12 is to reduce CPU overhead.

Wrong.
In dx12 (some )GPUs can do multiple things at the same time, that would have to be done one after another in dx11

 

[Erenhardt]

If I were starting a game studio tomorrow and wasn't planning to use an off-the-shelf engine,

Question is, why wouldn;t you? Plenty of excellent dx12 engines that will be available for f(r)ee.
If you can't do proper dx12, chances are you can't do good engine altogether.

 

[boozzer]

Sounds like a "true DX12 title to me." I would bet you a lot of money that most mainstream graphics programmers will struggle with the "freedom" (i.e. responsibility) that DX12 requires. Only the best-of-the-best engine dev teams will, IMO, be able to wring out advantages relative to DX11, at least for quite some time.

If I were starting a game studio tomorrow and wasn't planning to use an off-the-shelf engine, I would stick with DX11.

is that why tomb raider dev messed up their release?

 

[Sweepr]

is that why tomb raider dev messed up their release?

Why? Low-end CPUs are performing better with DX12.

 

[boozzer]

Why? Low-end CPUs are performing better with DX12.

I went to the website, saw the graphs, why did the amd gpus dropped fps by 20% or more? did it explain why? does the reviewer know?

 

[raghu78]

Sounds like a "true DX12 title to me." I would bet you a lot of money that most mainstream graphics programmers will struggle with the "freedom" (i.e. responsibility) that DX12 requires. Only the best-of-the-best engine dev teams will, IMO, be able to wring out advantages relative to DX11, at least for quite some time.

If I were starting a game studio tomorrow and wasn't planning to use an off-the-shelf engine, I would stick with DX11.

Its very simple. If you are launching a game like ROTR with DX11 at launch thats perfect. The idea is when you do release a DX12 version or patch it needs to be worth it. Both for the developer and the gamer. Whats the point in releasing an underperforming DX12 version ?

btw if you are launching a studio tomorrow its all the more reason to just go for DX12/Vulkan from start. See AOTS is a classic example. The studio started 3 years back and designed their game around new APIs like Mantle and later DX12/Vulkan. The performance benefits are just phenomenal. We see fantastic scaling across even 16 threads. For engine licensees its much easier. This year we will see Frostbite, Cryengine, UE4 and Unity all incorporate robust DX12 codepaths which provide superior performance than their DX11 versions.

Johan Andersson even said he wanted DX12 and Win 10 as the minimum spec for Holiday 2016 Frostbite games.

http://hexus.net/tech/news/software/82300-frostbite-tech-director-wants-dx12-mandatory-2016/

 

[Game_dev]

GTX970 beating a Fury X in DX12 <img src="images/smilies/familiar/wink.png" border="0" alt="" title="Wink" smilieid="46" class="inlineimg" /><br />
<br />
Oh wait, it doesn't count as DX12 then <img src="images/smilies/familiar/meh.png" border="0" alt="" title="Meh" smilieid="32" class="inlineimg" />

For 80% of the market it does

 

[Arachnotronic]

Question is, why wouldn;t you? Plenty of excellent dx12 engines that will be available for f(r)ee.

If I were doing a 3D game for the PC or console, I would absolutely use an off-the-shelf engine, very likely Unreal Engine 4.

If you can't do proper dx12, chances are you can't do good engine altogether.

The case for rolling your own engine these days unless you are backed by a lot of $$$ (think EA with Battlefield or Activision w/ CoD) is pretty flimsy. Unreal Engine 4 has all of the features the vast majority of devs, esp. smaller and medium sized ones, could ever hope to have.

 

[Zanovar]

80% of the market my arse.do you honestly think that?.

 

[PhonakV30]

Sounds like a "true DX12 title to me." I would bet you a lot of money that most mainstream graphics programmers will struggle with the "freedom" (i.e. responsibility) that DX12 requires. Only the best-of-the-best engine dev teams will, IMO, be able to wring out advantages relative to DX11, at least for quite some time.

If I were starting a game studio tomorrow and wasn't planning to use an off-the-shelf engine, I would stick with DX11.

True DX12? So hitman and Atos aren't True DX12? a True DX12 will not screw game engine performance.

 

[Azix]

ranking best dx12 implementations so far

ashes
hitman


tomb raider





gears of war

People won't accept the tomb raider results because only nvidia has shown consistent loss in performance from dx12 so far, yet TR shows AMD losing performance across the board as well. I wonder why they put out the dx12 patch really. They made no announcement of it, nothing. No feature. Just patch, here you go, may or may not work.

I doubt we will hear more from them on this. You would think with their blog post it would be performance increase all around. Nothing fancy, just better/smoother gameplay. nope. whats the point? What is common between this and gears... nvidia. Can it never just work if they are involved? They better patch it up.