What's new
  • Please do not post any links until you have 3 posts as they will automatically be rejected to prevent SPAM. Many words are also blocked due to being used in SPAM Messages. Thanks!

Your Guide to the Hardware Canucks GPU Benchmarking Process

Status
Not open for further replies.

SKYMTL

HardwareCanuck Review Editor
Staff member
Joined
Feb 26, 2007
Messages
13,264
Location
Montreal

Your Guide to the Hardware Canucks GPU Benchmarking Process



Introduction


In our GPU Benchmarking Methods Investigated article, we made the commitment to open up our GPU benchmarking process to the public. This is so users could see exactly which scenes we used for benchmarking, why we used them and could repeat the results (or a close approximation thereof) themselves. In this evolving article, we will do exactly as promised: show you the sequences we are using for benchmarking purposes

As we saw, there are countless ways to benchmark a game but some methods will lead to results that are much more representative of real-world gameplay than others. The goal of this process is to be as transparent as possible when it comes to our methodologies and why we have decided on certain courses of action when it comes to reviewing GPUs.

When we choose to add a game to our stable of benchmarkable titles, the first thing that’s done is a full play-through in order to determine what typical performance is like. With the help of FRAPS, a “worst case” scenario is derived from this playthrough which we will use for the basis of our benchmark run or to help determine if a built-in benchmark holds any foundation in reality. One important thing we should mention is that all benchmarks use at least one combat sequence if possible since it is within these where most games are the most demanding. Unfortunately, the randomness of combat means we have to repeat every benchmark three times in order to get an accurate picture of performance.

We only use built-in benchmarks if we have determined they are representative of an actual gameplay scenario and stand-alone benchmarks or demo versions of games are NEVER USED. This is because applications that operate outside of the actual final game engine will not have the developer-prescribed patches applied which could lead to relatively large performance shortfalls.

In the following pages, you will find videos of our benchmark sequences (if applicable) as well as save game files, timedemos, graphics setting screenshots and even guides to show you how to set everything up. This will also be a constantly evolving article since as new games are introduced, their benchmarking methods will be added.

We are hoping our readers and the readers of other sites understand the reasoning behind our push for openness. For Hardware Canucks, the days of not showing you EXACTLY what we are benchmarking are now over. Naturally, we are also hoping this will push for a more open-minded approach to GPU reviewing in general.

If you have any games you would like to see added or have any general commentary for improving our benchmarking process, please post in our dedicated Forum Thread.


Important:
- All instructions are based on Windows 7 x64 installations
- All files scanned for viruses prior to uploading.
- In order for some instructions to work, you MUST have enabled viewing of hidden folders
 
Last edited:

SKYMTL

HardwareCanuck Review Editor
Staff member
Joined
Feb 26, 2007
Messages
13,264
Location
Montreal
Aliens versus Predator (DX11)

Aliens versus Predator (DX11)


Level: The Refinery
Runthrough Time: 3:30
Save Game File: CLICK HERE FOR DIRECT DOWNLOAD
Instructions (Steam Version): Place files contained in the .RAR linked above directly into the following folder C:\Users\your computer name\AppData\Local\AliensVsPredator


Game Settings:





Gameplay Sequence

<object width="640" height="385"><param name="movie" value="http://www.youtube.com/v/9Nk4Nwvz2O8&hl=en_US&fs=1&color1=0x3a3a3a&color2=0x999999"></param><param name="allowFullScreen" value="true"></param><param name="allowscriptaccess" value="always"></param><embed src="http://www.youtube.com/v/9Nk4Nwvz2O8&hl=en_US&fs=1&color1=0x3a3a3a&color2=0x999999" type="application/x-shockwave-flash" allowscriptaccess="always" allowfullscreen="true" width="640" height="385"></embed></object>​
 

SKYMTL

HardwareCanuck Review Editor
Staff member
Joined
Feb 26, 2007
Messages
13,264
Location
Montreal
BattleField: Bad Company 2 (DX11) / DIRT 2 (DX11)

BattleField: Bad Company 2 (DX11)


Level: Cold War
Runthrough Time: 4:40
Save Game File: CLICK HERE FOR DIRECT DOWNLOAD
Instructions: Place file contained in the .RAR linked above directly into the following folder C:\Users\your computer name\Documents\BFBC2 and use it to replace the existing gamesettings file.

*WARNING* Replacing the gamesettings file will eliminate ALL of your previous saves and overwrite all of your game information. Do this AT YOUR OWN RISK.


Game Settings:


Gameplay Sequence

<object width="640" height="385"><param name="movie" value="http://www.youtube.com/v/B6Xtk7QNvbs&hl=en_US&fs=1&color1=0x3a3a3a&color2=0x999999"></param><param name="allowFullScreen" value="true"></param><param name="allowscriptaccess" value="always"></param><embed src="http://www.youtube.com/v/B6Xtk7QNvbs&hl=en_US&fs=1&color1=0x3a3a3a&color2=0x999999" type="application/x-shockwave-flash" allowscriptaccess="always" allowfullscreen="true" width="640" height="385"></embed></object>​



DIRT 2 (DX11)


Level: Built-In Benchmark (Battersea-Air)
Runthrough Time: Demo length

Please note that in order to ensure that DX11 and High Shadows are both enabled when the game loads, navigate to the C:\Users\your computer name\Documents\My Games\DiRT2\hardwaresettings folder and open up (with Notepad) the _config file. Adjust the two items to reflect what we have underlined and save the file:



Game Settings:


 
Last edited:

SKYMTL

HardwareCanuck Review Editor
Staff member
Joined
Feb 26, 2007
Messages
13,264
Location
Montreal
Far Cry 2 (DX10) / Lost Planet (DX11)

Far Cry 2 (DX10)


Level: Village Assault
Runthrough Time: 3:30
Timedemo File: CLICK HERE FOR DIRECT DOWNLOAD
Instructions : Open attached .RAR file and place all files into your Documents\My Games\Far Cry 2\Benchmarks\Playbacks folder. The benchmark utility is located in the C:\Program Files (x86)\Ubisoft\Far Cry 2\bin folder. In order to use the timedemo, select the General tab and from the drop-down menu select HWC-Test.


Game Settings:



Gameplay Sequence

<object width="640" height="385"><param name="movie" value="http://www.youtube.com/v/Wz2Yo2wlq58&hl=en_US&fs=1&color1=0x3a3a3a&color2=0x999999"></param><param name="allowFullScreen" value="true"></param><param name="allowscriptaccess" value="always"></param><embed src="http://www.youtube.com/v/Wz2Yo2wlq58&hl=en_US&fs=1&color1=0x3a3a3a&color2=0x999999" type="application/x-shockwave-flash" allowscriptaccess="always" allowfullscreen="true" width="640" height="385"></embed></object>​



Lost Planet (DX11)


Level: Episode 1, Chapter 2
Runthrough Time: 2:00


Game Settings:



Gameplay Sequence

<object width="640" height="385"><param name="movie" value="http://www.youtube.com/v/SMI6KmQzNEI?fs=1&hl=en_US&rel=0&color1=0x5d1719&color2=0xcd311b"></param><param name="allowFullScreen" value="true"></param><param name="allowscriptaccess" value="always"></param><embed src="http://www.youtube.com/v/SMI6KmQzNEI?fs=1&hl=en_US&rel=0&color1=0x5d1719&color2=0xcd311b" type="application/x-shockwave-flash" allowscriptaccess="always" allowfullscreen="true" width="640" height="385"></embed></object>​
 
Last edited:

SKYMTL

HardwareCanuck Review Editor
Staff member
Joined
Feb 26, 2007
Messages
13,264
Location
Montreal
Just Cause 2 (DX10)

Just Cause 2 (DX10)


Level: Casino Assault (car chase sequence)
Runthrough Time: 3:30
Save Game File: CLICK HERE FOR DIRECT DOWNLOAD
Instructions (for Steam version): Open attached .RAR file and place all files into your C:\Program Files (x86)\Steam\userdata\*****\****\remote folder. Please note the “***” is seemingly random so it may take some searching to find the Just Cause 2 save game file location.


Game Settings:



Gameplay Sequence

<object width="640" height="385"><param name="movie" value="http://www.youtube.com/v/oWKaD0slhhg&hl=en_US&fs=1&color1=0x3a3a3a&color2=0x999999"></param><param name="allowFullScreen" value="true"></param><param name="allowscriptaccess" value="always"></param><embed src="http://www.youtube.com/v/oWKaD0slhhg&hl=en_US&fs=1&color1=0x3a3a3a&color2=0x999999" type="application/x-shockwave-flash" allowscriptaccess="always" allowfullscreen="true" width="640" height="385"></embed></object>​
 

SKYMTL

HardwareCanuck Review Editor
Staff member
Joined
Feb 26, 2007
Messages
13,264
Location
Montreal
Metro 2033 (DX11) / Unigine: Heaven (DX11)

Metro 2033 (DX11)


Level: Bridge
Runthrough Time: 2:00
Save Game File: CLICK HERE FOR DIRECT DOWNLOAD
Instructions (for Steam version): Open attached .RAR file and place all files into your \Documents\4A Games\Metro 2033 folder. Includes levels beyond Bridge as well.


Game Settings:





Gameplay Sequence

<object width="640" height="385"><param name="movie" value="http://www.youtube.com/v/8aZA5f8l-9E&hl=en_US&fs=1&color1=0x3a3a3a&color2=0x999999"></param><param name="allowFullScreen" value="true"></param><param name="allowscriptaccess" value="always"></param><embed src="http://www.youtube.com/v/8aZA5f8l-9E&hl=en_US&fs=1&color1=0x3a3a3a&color2=0x999999" type="application/x-shockwave-flash" allowscriptaccess="always" allowfullscreen="true" width="640 height="480"></embed></object>​



Unigine: Heaven (DX11)



Settings:

 
Last edited:
Status
Not open for further replies.

Latest posts

Twitter

Top