PDA

View Full Version : Rev F Dual Dual core Opteron Quad SLI


Pages : [1] 2

Venturi
08-18-06, 10:39 AM
Since the NDA is lifted here are a few comments and pics on my new rev F opteron build.

Dual Opteron Dual Core 2218s
Tyan s2915
Quad SLI (2) 7950 XFX 570/1550
16GB Ram DDR-2 ECC Reg
6 terabytes (8x750GB drives) Raid ex8350 pci-e controller
Dual linked 750W power supplies
Apple 30" Cinema LCD at 2560x1600
Windows Enterprise Server 2003 64-bit
Suse 10.1 64-bit
Stacker CM server case
Deck Legend Keyboard

http://img64.imageshack.us/img64/2526/img1600zr2.th.jpg (http://img64.imageshack.us/my.php?image=img1600zr2.jpg)

http://img64.imageshack.us/img64/2350/img1601fi4.th.jpg (http://img64.imageshack.us/my.php?image=img1601fi4.jpg)

http://img64.imageshack.us/img64/1970/img1602lv6.th.jpg (http://img64.imageshack.us/my.php?image=img1602lv6.jpg)

http://img64.imageshack.us/img64/1466/img1603wt4.th.jpg (http://img64.imageshack.us/my.php?image=img1603wt4.jpg)

http://img64.imageshack.us/img64/480/img1604co4.th.jpg (http://img64.imageshack.us/my.php?image=img1604co4.jpg)

http://img64.imageshack.us/img64/9451/img1605yx1.th.jpg (http://img64.imageshack.us/my.php?image=img1605yx1.jpg)

http://img64.imageshack.us/img64/5270/img1606ts3.th.jpg (http://img64.imageshack.us/my.php?image=img1606ts3.jpg)

http://img64.imageshack.us/img64/7202/img1607cx5.th.jpg (http://img64.imageshack.us/my.php?image=img1607cx5.jpg)

http://img64.imageshack.us/img64/3461/img1608da8.th.jpg (http://img64.imageshack.us/my.php?image=img1608da8.jpg)

http://img78.imageshack.us/img78/6066/img1609om9.th.jpg (http://img78.imageshack.us/my.php?image=img1609om9.jpg)

http://img78.imageshack.us/img78/377/img1610de1.th.jpg (http://img78.imageshack.us/my.php?image=img1610de1.jpg)

http://img53.imageshack.us/img53/7425/img1611bo1.th.jpg (http://img53.imageshack.us/my.php?image=img1611bo1.jpg)


I did some really careful comparisons between the opteron F and the Woodcrest. Rather than inviting a debate hear over one another, in my humble opinion I selecte the opteron F platform.

Currently using a pre-release 91.47 64-bit beta driver for quad SLI.

Its running windows server 2003 64-bit. There are a few cusatomizations to the OS to tweak it well past the performance of xp 32 and 64.

No errant unnecesarry services, the correct drivers, correct video and mb bioses, PLL clocks, correct harware settings, all the normal HKLM tweaks in memory manager/session manager, L2 Cache definitions, IO holds, paging, remove performance counters, file attribute monikers, page file removal, ram optimizations, disc optimizations, remove ctf.mon, mdm.exe, cgdss, wmi (etc etc. pages worth of the normal stuff, that's why it takes a few hours to get an OS configured correctly)

I'm assuming that games were prepped accordingly:
As much as eye candy as possible at the largest resolution possible, then game optimizations such as sata r_smp 1, cache, megs, mink, LOD, perf, text attrb, pre-loads, clamp, etc etc.


2nd. A friend of mine built a 16GB woodcrest and we benched it against the rev f. We found that if we ran the tests with 2 or 4 GB of ram, the woodcrest outperformed the rev F, by less than 2%. When we added video tests, 16gb of ram, and some general openGl games, the rev F was ahead by almost 11% in doom3, quake4, prey and Painkiller BOH. His build had dual pci-e slots but we don't think they go to 16x, and we could not get the 7950s to ever get recognized for Quad SLI. Using the 91.47 driver or the 91.31 driver.

In honesty, we ran the games at a resolution too high (2560x1600) to really point to cpu bottlenecks, the only real conclusion was that the a single 7950 ran games 11% faster than it did on Woodcrest.

As for professional apps that are not dependent on the 3d graphics cards. We did the photoshop test (same one in the multiprocessor forum at HardOCP) where an image is re rendered under the actions settings, the test is a time to complete evaluation.

The Opterons 285, same amount of ram (16), 24.9 seconds
Woodcrest, same amount of ram (16), 44 seconds
Rev F Opterons, same amount of ram (16), 21.1 seconds.

For that test, ram is relativly critical, so maybe that is not a fair test for Woodcrest. In addition, NUMA seems to shine on the rev F, but I have not seen it of benefit to the woodcrest and I'm not even sure if it is supported by woodcrest.

Last, all tests are performed with Windows 2003 Ent Srv 64-bit.

So, I'm sure that Woodcrests is a formidable competitor; I approached the project with the attitude of "1st, if money was an object, which platform will do high level computing, databases, and games better? ..and which would have the gratest upgradability without replacing the motherboard or reloading the OS? 2nd, which platform would run OpenGL better? Quad SLI? Quad cores? 3rd, which platform can run the quietest without invoking watercooling?

Wood crest was indeed attractive on many levels, but on my own personal score sheet, the ref F opterons seemed to win. That is only my humble opinion, it does not mean that the woodcrest is not a better choice for others.


Memory bandwith:

http://img212.imageshack.us/img212/9299/membndwthfr5.th.jpg (http://img212.imageshack.us/my.php?image=membndwthfr5.jpg)

MUYA
08-18-06, 10:44 AM
MAn cheers for the quick summary..but boy do you have a lot of moolah to be throwing stuff on. Donate me a spare GX2 if u have one lying around ;)

Venturi
08-18-06, 01:21 PM
Sorry Muya, (omg) the spare GX2 was in the prior rig I just gave away.... LOL

Roadhog
08-18-06, 03:06 PM
wow... nice system... I think I just wet myself a bit.

Roadhog
08-18-06, 03:21 PM
even for AUTOCAD it a waste of money his machine is nice, just think it a waste. I am a Engineer myseft but this guy just throw away a lot of money, and is posting pic of this machine on the wrong and from reading his post and seeing what harddrive he using seagate 750 drives he using this mostly for gaming and those drive got to go go with SCSI Enterprise level drives, they are faster and last longer. And a large Enterprise machine in your home ? Occupation:Medical WHAT THE HELL WOULD YOU NEED TO DO TO USE THIS MACHINE.


what he does with the medical stuff really puts his machine to use. Plus, why do you seem to care so much? Its his money he can buy what he wants with it.

Roadhog
08-18-06, 03:34 PM
A lot of people in this forums I know want a different built and think they need it because of this guy this it not the place to post a server on here a gaming machine yes, if I know we could post server on here I would have posted all 3 of mines on here, but I don't because of respect of everyone else machines and for medical stuff you don't need this at all, I know i setup offices all the time.


Uhh, I dont see anywhere where it says you cant post about your server? This is posted in the general hardware and he is clearly talking about the new opterons. But you are to busy ripping on him about his hd's to pay attention.

XServer
08-18-06, 03:39 PM
he is clearly talking about the new opterons. But you are to busy ripping on him about his hd's to pay attention.rev F Opteron are nice didn't complain about that but for the machine he sure have when with SCSI 320 drives instead.

rflair
08-18-06, 03:48 PM
Venturi I always love seeing your system, nice job and thanks for your little personal benchmarks.

XServer
08-18-06, 04:33 PM
Sorry for the ripping early, you do use this as a server saw it on 2cpu.com. but need to now where you got those Dual linked 750W power supplies, planning on builting a new rig soon with those Rev F Dual core Opteron and two 7950 GX2

spoop
08-18-06, 05:02 PM
Wow, thats an awesome rig.

Roliath
08-18-06, 06:37 PM
Wow, nice rig there. What are the volts and clocks on those optys?
And, personally I liked your lian li better but this one aint too bad either :-)

EDIT: And if i'm not mistaken, doesn't Venturi use this for radiology?

XServer
08-18-06, 07:48 PM
lian li was a better looking case, but last pic of his case second power supply wasn't screw into case.

K007
08-18-06, 09:36 PM
Wow..thx for the screenshots..always wondered what those motherboards with stuff in it looks like..

How is it for games btw? Does having all that ram have a negative effect? Like with the ram timings etc? Do those quad cores benefit in games btw?

Venturi
08-18-06, 10:54 PM
Folks the machine runs some very extensive radiology imaging software and my OCD for gaming at high rez.

Medical imaging software 101.

If I open a mammo, ct, mri, angio, dx, etc study film with a few thousand cross sectional images, I can assure you the 16GB of ram gets used.

Sometimes you can have a study with 4800 high rez images that you want to render into a 3d reconstruction in seconds, not days. Hence the raw processing power.

Sometime you just want to play Prey or Fear at 2560x1600 with all the eye candy on at playable frame rates.

Hence, does it really matter what I use the machine for?
Server, workstation, or gaming rig?


Why do you climb a mountain? Because it is there!

LOL

XServer
08-18-06, 11:08 PM
Folks the machine runs some very extensive radiology imaging software and my OCD for gaming at high rez.

Medical imaging software 101.

If I open a mammo, ct, mri, angio, dx, etc study film with a few thousand cross sectional images, I can assure you the 16GB of ram gets used.

Sometimes you can have a study with 4800 high rez images that you want to render into a 3d reconstruction in seconds, not days. Hence the raw processing power.

Sometime you just want to play Prey or Fear at 2560x1600 with all the eye candy on at playable frame rates.

Hence, does it really matter what I use the machine for?
Server, workstation, or gaming rig?


Why do you climb a mountain? Because it is there!

LOLYou do make a good point there just wondering that all, at less you put your machine to work and is happy with it that all that matter, but why no raptors or SCSI harddrives. I use them in any rig I built, you will see the performance?

MUYA
08-18-06, 11:54 PM
Sorry Muya, (omg) the spare GX2 was in the prior rig I just gave away.... LOL
U gave it away to who??? :thumbdwn: waah!

U could have given it to me!!! :D heheh

Nice rig dude as always. You get your top notch stuff to show off and give us here in the forums a reason to drool. :)

Venturi
08-19-06, 07:07 AM
Wow..thx for the screenshots..always wondered what those motherboards with stuff in it looks like..

How is it for games btw? Does having all that ram have a negative effect? Like with the ram timings etc? Do those quad cores benefit in games btw?

I believe (and have backed this up through benchies, screenshots, perfs, etc) that my frame rates and eye candy ratio is higher than any xp build. However, the 2004 srv 64 requires a little more effort to set up as a workstation/game rig. I always get more than 60fps at 2560x1600 with all the eye candy turned on. Anything higher than a low base of 60fps is not as significant. However, to indulge the appetite for fps, Painkiller BOH gets 322FPS at 2560x1600 with all the eye candy on when I run the built in bechmarks.

a12ctic
08-19-06, 01:25 PM
why does somebody always flame this guy... they must be jelous :p

XServer
08-19-06, 02:21 PM
I didn't flame him to get upset, just thing some raptors or SCSI drives would be a good idea in that system.

Venturi
08-19-06, 04:24 PM
Its Ok.

I did consider scsi drives and I benched then as well.

I wanted storage space and I found the perpendicular write SATA to be faster than the other solutions when 8 drives are raided together.

8 drives in a raid will outperform scsi and raptors when storage space and price are considered.

Plus, I don't believe the storage capacity of scsi is even half that of sata II drives.

In addition, I built a quiet PC, the scsi was really loud.

I have a dedicated hardware raid controller that is using the pci-e connection.

Quite happy with speed and storage.

As for the raptors: 300 US dollars for for 150GB drive seemed excessive.

Hope that helps.

XServer
08-19-06, 04:50 PM
Plus, I don't believe the storage capacity of scsi is even half that of sata II drives.

In addition, I built a quiet PC, the scsi was really loud.They are loud I have to say that is very true, That why I when raptors for deaktop built.


As for the raptors: 300 US dollars for for 150GB drive seemed excessive.

Hope that helps. raptors are costly that the only thing I reget about them and the fact you lose a lot of space compare to other harddrives. But there do perform good.

ProCoder
08-19-06, 07:49 PM
Nice Rig

Venturi
08-20-06, 06:45 AM
Here are some optimizations to get server 2003 64-bit to perform as a workstation, but with the stability and muscle .


http://img205.imageshack.us/img205/1576/services1ye5.th.jpg (http://img205.imageshack.us/my.php?image=services1ye5.jpg)
http://img213.imageshack.us/img213/2519/services2wj3.th.jpg (http://img213.imageshack.us/my.php?image=services2wj3.jpg)

also remember some basics:

http://img204.imageshack.us/img204/3149/errorreplh3.th.jpg (http://img204.imageshack.us/my.php?image=errorreplh3.jpg)

use large size memory settings and remove the page file completely:
http://img213.imageshack.us/img213/864/advscrbl0.th.jpg (http://img213.imageshack.us/my.php?image=advscrbl0.jpg)

include tweak UI speed "optimizations"
http://img204.imageshack.us/img204/1594/tweakuiul9.th.jpg (http://img204.imageshack.us/my.php?image=tweakuiul9.jpg)

there are several free utilities to help you customize server:
http://img204.imageshack.us/img204/9476/optiapprv1.th.jpg (http://img204.imageshack.us/my.php?image=optiapprv1.jpg)

and of course enable the quad features for sli:
http://img213.imageshack.us/img213/4551/quadmz4.th.jpg (http://img213.imageshack.us/my.php?image=quadmz4.jpg)

Don't forget to remove from the regisry all instances of mdm, mdm.exe and machine debug manager,

remove the ctf.mon

in hklm enable the correct L2 cache size per core

remember what I said about the rest in the earlier post.


This will be a good start for you, there are some more complicated tweaks in the registry, but we will get to those later.


http://img64.imageshack.us/img64/480/img1604co4.th.jpg (http://img64.imageshack.us/my.php?image=img1604co4.jpg)


Venturi

Venturi
08-20-06, 05:30 PM
by request:

Memory bandwith:

http://img212.imageshack.us/img212/9299/membndwthfr5.th.jpg (http://img212.imageshack.us/my.php?image=membndwthfr5.jpg)

X-Server
08-20-06, 06:48 PM
Not bad for memory timing 5.5.5.13 and it being ECC.