NCQ Desktop Performance Test.
Date of test: 9/24/4004
1.0.0
Introduction:
The purpose of this test is to examine desktop performance of hard drives with Native Command Queuing (NCQ). This test will not cover NCQ performance in a server or heavy duty workstation environment. This will not be a formal test, but a simple comparison with various benchmark tools and common applications.
There have been claims being mentioned that a NCQ drive will outperform a Raptor. I think the rumor started by people doing merely headline reads and not reading entire articles. See article as example.
http://www.seagate.com/cda/newsinfo/newsroom/releases/article/0,1121,2102^,00.html
I don't feel that this is Seagate's fault. If you read the article you clearly see that this was a query intense test. It is an interesting test and a good accomplishment to make a drive more efficient.
1.0.1
What is NCQ?
http://cache-www.intel.com/cd/00/00/06/60/66002_66002.pdf
1.0.2
Differences between NCQ and TCQ.
Download the following zipped file.
The Advantage of Serial ATA Native Command Queing
1.1.0
Test Setup:
Asus P5AD2 Premium MB BIOS 1006
LGA775 530 CPU
2X 512 Corsair CM2X512-5400C4
Asus EAX600XT
Lite-On SOHW-1633S
1 WD360GD
1 ST3160827AS
Win XP SP2
AHCI driver 4.5.0.6515 for NCQ - standard MS IDE driver for Non NCQ test.
2.0.0
Results of Benchmark tools
Results will be shown in the order of WD360GD then ST3160827AS w/NCQ then ST3160827AS w/o NCQ.
2.1.0
ATTO
2.1.1
2.1.2
2.1.3
2.1.4
The Raptor looks strong with ATTO. The Seagate(NCQ) drive starts a bit slow at first but performs overall well for a 7200 drive. The Seagate(Non-NCQ) drive performs better at first but doesn't match the NCQ performance. Note that for Non-NCQ testing the Drive Configuration was changed in the BIOS from AHCI to Standard IDE. The system would reboot and load the standard MS IDE driver to run. This may have not been optimal but not sure of an easy way to just disable NCQ feature (see 2.2.4 below).
2.2.0
HDTach3
2.2.1
2.2.2
2.2.3
2.2.4
Note with the Raptor the Random access time. This will show the advantage in the application testing. The Raptor was no match for the burst speed likely do to platter differences. Did not like the spikes with the Non-NCQ performance and not sure if this was driver related. Note that no delays or disk issues were noted.
Note that it appears that Intel tested this in a similar fashion. See:
http://www.intel.com/design/chipsets/applnots/30264801.pdf
2.3.0
PCMark04
2.3.1
WD360GD
2.3.2
ST3160827AS
2.3.3
ST3160827AS Non NCQ
2.3.4
Test was performed five times for each drive. All results were reasonably close for each drive. Literally get a stair step for each drive.
2.4.0
WinBench99
2.4.1
WD360GD
2.4.2
ST3160827AS
2.4.3
ST3160827AS Non NCQ
2.4.4
Note with WinBench99 the tests were a bit erratic. Some of the individual results varied by over twenty percent. At first five test per drive were done and increased to eight. Took what appeared to be the best average for each.
2.5.0
Bootvis
2.5.1
WD360GD
2.5.2
ST3160827AS
2.5.3
ST3160827AS Non NCQ
2.5.4
Bootvis is a good troubleshooting tool, but can show some interesting bits on XP startup. Note the longer disk and driver initialization times.
3.0.0
Application Load Times
This is where the practical results are observed. Benchmarks give trends and indications for performance, but measuring real application performance is the bottom line. Note that some game results will be given in this test. Thanks to MikeC for lending those for a few days.
3.1.0
Doom 3
Game was selected from taskbar and timed. First result is initial load to main menu. The second result is a saved game loaded from a save right at start of game and transferred to other drives for testing. The third result is time reported from console (Crtl-Alt-~). Average of five results.
3.1.1
WD360GD
Initial load=29.51 sec
Game load=29.64 sec
Console=26281 msec
3.1.2
ST3160827AS
Initial load=29.88 sec
Game load=32.15 sec
Console=28632 msec
3.1.3
ST3160827AS(Non-NCQ)
Initial load=30.14 sec
Game load=33.24 sec
Console=29887 msec
3.1.4
3.2.0
Unreal Tournament 2004
Game was load with patch 33.23. No CD was necessary for game loading. The nVidia intro was eliminated by Nvidia intro was disabled by changing LocalMap=NvidiaLogo.ut2 to LocalMap=NoIntro.ut2i n the ut2004.ini file. This would have game load right to the main menu. Game timed from selecting in taskbar to main menu. Average of five times given.
3.2.1
WD360GD
Load time=17.92 sec
3.2.2
ST3160827AS
Load time=20.56 sec
3.2.3
ST3160827AS (Non-NCQ)
Load time=22.16 sec
3.2.4
3.3.0
Star Wars Knights of the Old Republic
Movie intros were disabled in the configuration utility. First load was program initial load to the main menu. Second load was from a game saved at the very start and transferred to the other drives.
3.3.1
Wd360GD
Initial load=14.41 sec
Game load=9.24 sec
3.3.2
ST3160827AS
Initial load=15.22 sec
Game load=10.27 sec
3.3.3
ST3160827AS (Non-NCQ)
Initial load=15.92 sec
Game load=10.43 sec
3.4.0
MS Flight Simulator 2004
Two times were measured. The initial program load to main screen and then the 1903 Wright Flyer flight.
3.4.1
WD360GD
Initial load=22.24 sec
Flight load=20.75 sec
3.4.2
ST3160827AS
Initial load=34.69 sec
Flight load=22.82 sec
3.4.3
ST3160827AS (Non-NCQ)
Initial load=36.12 sec
Flight load=23.45 sec
3.4.4
A profound difference was measured between the drives here.
3.5.0
Adobe Photoshop CS
A 37.9 TIFF was added to taskbar and associated with Photoshop. It was then selected and timed. Average of five tests.
3.5.1
WD360GD
Load time=11.23 sec
3.5.2
ST3160827AS
Load time=12.85 sec
3.5.3
ST3160827AS (Non-NCQ)
Load time=13.38 sec
3.5.4
Note that this is not the best way to evaluate this but does give a realistic idea on performance for the desktop user.
3.6.0
MS Word 2003
A 4.3 Word document was added to taskbar and load time measured three times.
3.6.1
WD360GD
Load time=5.48 sec
3.6.2
ST3160827AS
Load time=5.93 sec
3.6.3
ST3160827AS (Non-NCQ)
Load time=5.62 sec
3.6.4
With the smaller files, NCQ does not appear to help performance.
3.7.0
MS Visio Pro 2003
A nine page file of a network file size 2.18 MB was loaded and measured three times.
3.7.1
WD360GD
Load time=8.64 sec
3.7.2
ST3160827AS
Load time=9.15 sec
3.7.3
ST3160827AS (Non-NCQ)
Load time=9.17 sec
3.7.4
The difference is really nill between the NCQ and Non-NCQ performance here.
3.8.0
Reserved
3.9.0
Reserved
4.0.0
Initial conclusions:
4.0.1
Testing
This is really the first time I have tested gaming applications with the exception of a few demos for video cards. I felt that this was important to include, as games are applications used by a great many PC users. I did note that gaming application disk I/O is unique as other applications used by users. Doom 3 for example while being one of the most video card intense applications was actually one of the lightest for disk I/O.
I consider this initial testing as I had hoped to test some other apps. It would have been nice to have another controller to compare as well. One other note is that there are really no other reviews or comparisons as of this test date to compare to. The one exception is the Intel paper linked above.
4.0.2
Opinion of the ST3160827AS
The tests show that the drive is no match for a Raptor with desktop performance. For a 7200 RPM drive however, it is a solid performer and much more storage capacity for about the same cost. The drive did perform better with NCQ.
(Note: These costs will change and are for reference)
WD360GD=34.4 GB Cost at Newegg=$113 Cost per GB=$3.28
ST3160827AS=149 GB Cost at Newegg=$116 Cost per GB=.78 cents
ST3160023AS=149 GB Cost at Newegg=$109 Cost per GB=.73 cents
There is no question you do pay the price for performance between a 10K and 7.2K drive. The cost difference between a NCQ and Non-NCQ drive though are very close and as NCQ becomes standard, they will likely be cheaper than a Non-NCQ drive. I think the other thing to consider is future compatibility. It is likely that NCQ will be a common feature on all controllers. Even though the controllers for example on AMD motherboards do not currently support NCQ, it is highly likely that they will.
If you are in the market for a 7200 drive, the ST3160827AS is worth strong consideration for performance and future compatibility.
4.0.3
Reserved
TIS