Go Back   nV News Forums > Hardware Forums > Benchmarking And Overclocking

Newegg Daily Deals

Reply
 
Thread Tools
Old 05-18-03, 11:21 AM   #1
jimmyjames123
Registered User
 
Join Date: May 2003
Posts: 665
Default My thoughts on "Optimization"

I have been reading about this 3dmark03 "Rendering Issue".

For one, I think the journalism at Extremetech and Beyond3d was a bit odd. Never do they mention the following relevant points:

1) Image quality was NOT compromised with the new FX 44.03 driver. In fact, most people have noted improvements in Image Quality, even in 3dmark03.

2) All images in 3dmark03 that we actually SEE are rendered correctly.

These points might sound obvious to some, but to someone casually reading or to someone who isn't very familiar with graphics card terminology, these points wouldn't be so obvious.

Now, ask yourself this question:

If we can get smoother and faster performance, without any loss of image quality, isn't that a good thing?

If I had an FX NVIDIA card, I would be happy that NVIDIA could "optimize" for 3dmark03 without any loss of image quality and without affecting any images that we actually see on screen

It is no secret that both NVIDIA and ATI "optimize" their drivers for a benchmark like 3dmark03. If they can do it without compromising image quality, all the better (IMO).

Some other points that are worth noting:

1) NVIDIA does not have authorized access to the developer's build of 3dmark, while ATI (and Extremetech, Beyond3d, etc) does, where they can roam around anywhere even off-center of the actual image displayed.

2) Futuremark strangely only allows WHQL certified drivers for published online results for their 3dmark program, but they allow overclocked graphics cards and cpu's (and note how Futuremark buries the Detonator FX driver underneath the others on their homepage annoucements, not even mentioning about how it is WHQL certified for GeForce FX cards).

3) [H]OCP talked with ATI privately about the quake/quack driver cheat issue for more than a month before writing their article. ATI repeatedly denied cheating, and [H]OCP released their article after they proved them wrong (showing that image quality was compromised on Quake 3 while enhancing performance).

4) The NVIDIA FX Detonator driver increased both performance and IQ noticeably for a variety of benchmarks and games on the FX graphics cards, not simply 3dmark03.

5) The Doom3 benchmark's used in the latest tests were chosen by ID and were not seen by NVIDIA in advance.

All in all, it boils down to what one considers an "optimization" vs. a "cheat". If a graphics card company can make performance smoother and faster without compromising image quality and without affecting what we actually see, then I would say this is a good thing (especially considering that NVIDIA and ATI both optimize for benchmarks in the first place).
jimmyjames123 is offline   Reply With Quote
Old 05-18-03, 11:26 AM   #2
Dazz
"TOON ARMY!"
 
Join Date: Jul 2002
Location: Newcastle, United Kingdom
Posts: 5,138
Send a message via AIM to Dazz
Default

LMAO who the hells gonna admit they are cheating LMFAO
__________________
"Never interupt your enemy when he is making a mistake."

Processor: AMD Phenom II X6 1090T Black Edition @ 4.25GHz
Motherboard: Gigabyte GA-990FXA-UD3
Graphics: ASUS ENGTX470
Memory: 4GB Kingston HyperX Blu PC12800 DDR3
Monitor: LG E2260V-PN Full HD WLED 22" & DELL 20" 2005FPW,
Power: Coolermaster Silent Pro Modular 850w PSU
Sound: Logitech Z5500 Digital.
Cooling: Thermalright Silver Arrow.
1st Storage: Kingston V100 SSDNow128GB SSD
2nd Storage: Samsung Spinpoint F1 750GB
Dazz is offline   Reply With Quote
Old 05-18-03, 11:26 AM   #3
digitalwanderer
 
digitalwanderer's Avatar
 
Join Date: Jul 2002
Location: Highland, IN USA
Posts: 4,944
Default Re: My thoughts on "Optimization"

Quote:
Originally posted by jimmyjames123
1) Image quality was NOT compromised with the new FX 44.03 driver. In fact, most people have noted improvements in Image Quality, even in 3dmark03.

2) All images in 3dmark03 that we actually SEE are rendered correctly.
Well, that is definately a nice summation of one popular point of view around here. There seems to be just about as many people though who'd jump up and say something like, "But it is a BENCHMARK, and it is meant to be run in a certain way so as to give an accurate comparison of performance. nVidia's driver cheats compromise that by bypassing the benchmark's parameters, which is NOT optimizing but is fraudulently inflating their scores to sell more cards."

I'm one of them people.

Now if this were a GAME we were talking about I would agree with you, as optimizations that don't affect image quality/what you see ARE pure optimizations and nothing but a benefit to the consumer....but this ain't a game and the cheating is cheeseball.
__________________
[SIZE=1][I]"It was very important to us that NVIDIA did not know exactly where to aim. As a result they seem to have over-engineered in some aspects creating a power-hungry monster which is going to be very expensive for them to manufacture. We have a beautifully balanced piece of hardware that beats them on pure performance, cost, scalability, future mobile relevance, etc. That's all because they didn't know what to aim at."
-R.Huddy[/I] [/SIZE]
digitalwanderer is offline   Reply With Quote
Old 05-18-03, 11:28 AM   #4
reever2
Registered User
 
reever2's Avatar
 
Join Date: Apr 2003
Posts: 489
Default

Why dont people understand that this optimization can only be done in a benchmark? Static clip planes can not be put into games, if at any time the camera in 3dmark turned around you would see the clipping, i would say not being able to see 3/4 of the environment a huge detrimental effect to IQ
reever2 is offline   Reply With Quote
Old 05-18-03, 11:35 AM   #5
jimmyjames123
Registered User
 
Join Date: May 2003
Posts: 665
Default

Quote:
"But it is a BENCHMARK, and it is meant to be run in a certain way so as to give an accurate comparison of performance. nVidia's driver cheats compromise that by bypassing the benchmark's parameters, which is NOT optimizing but is fraudulently inflating their scores to sell more cards."
Trust me, I fully understand this point of view. However, we all know that NVIDIA and ATI actively "optimize" their drivers for enhanced performance in 3dmark programs. This alone undercuts the argument about an "accurate comparision of performance", because it has been repeatedly shown that driver "optimizations" alone can (sometimes significantly) improve performance.

There is also the issue about what is an "optimization" and what is a "cheat". There is no agreement about what this distinction is. If NVIDIA (or ATI for that matter) can improve performance without compromising image quality, I'd like to think of that as an "optimization".

If anything, maybe this will help Futuremark to create a benchmark that is less susceptible to "optimizations", assuming that they truly want to create an "impartial" benchmarking program.
jimmyjames123 is offline   Reply With Quote
Old 05-18-03, 11:41 AM   #6
jimmyjames123
Registered User
 
Join Date: May 2003
Posts: 665
Default

Quote:
if at any time the camera in 3dmark turned around you would see the clipping, i would say not being able to see 3/4 of the environment a huge detrimental effect to IQ
The fact of the matter is that the cameras in 3dmark don't get turned around. So NVIDIA is "optimizing" for this particular benchmark. It is certainly no secret that both NVIDIA and ATI optimize for this benchmark. Users of FX cards now get smoother and faster performance and better image quality in 3dmark03 in what we can see. This whole issue is a matter of perspective.
jimmyjames123 is offline   Reply With Quote
Old 05-18-03, 11:46 AM   #7
dpollard55
Registered User
 
Join Date: May 2003
Location: Hillsborough, N.C.
Posts: 36
Default

Quote:
Originally posted by jimmyjames123
The fact of the matter is that the cameras in 3dmark don't get turned around. So NVIDIA is "optimizing" for this particular benchmark. It is certainly no secret that both NVIDIA and ATI optimize for this benchmark. Users of FX cards now get smoother and faster performance and better image quality in 3dmark03 in what we can see. This whole issue is a matter of perspective.
Well said, and my thoughts exactly.
__________________
David
Geforce FX 5200 PCI
dpollard55 is offline   Reply With Quote
Old 05-18-03, 11:47 AM   #8
digitalwanderer
 
digitalwanderer's Avatar
 
Join Date: Jul 2002
Location: Highland, IN USA
Posts: 4,944
Default

Quote:
Originally posted by jimmyjames123
Trust me, I fully understand this point of view. However, we all know that NVIDIA and ATI actively "optimize" their drivers for enhanced performance in 3dmark programs. This alone undercuts the argument about an "accurate comparision of performance", because it has been repeatedly shown that driver "optimizations" alone can (sometimes significantly) improve performance.

There is also the issue about what is an "optimization" and what is a "cheat". There is no agreement about what this distinction is. If NVIDIA (or ATI for that matter) can improve performance without compromising image quality, I'd like to think of that as an "optimization".

If anything, maybe this will help Futuremark to create a benchmark that is less susceptible to "optimizations", assuming that they truly want to create an "impartial" benchmarking program.
Just because nVidia got busted with a flat-out cheat it does NOT invalidate 3dm2k3 as a benchmark, it invalidates nVidia as a trusted manufacturer.
__________________
[SIZE=1][I]"It was very important to us that NVIDIA did not know exactly where to aim. As a result they seem to have over-engineered in some aspects creating a power-hungry monster which is going to be very expensive for them to manufacture. We have a beautifully balanced piece of hardware that beats them on pure performance, cost, scalability, future mobile relevance, etc. That's all because they didn't know what to aim at."
-R.Huddy[/I] [/SIZE]
digitalwanderer is offline   Reply With Quote

Old 05-18-03, 11:53 AM   #9
jimmyjames123
Registered User
 
Join Date: May 2003
Posts: 665
Default

Quote:
Just because nVidia got busted with a flat-out cheat it does NOT invalidate 3dm2k3 as a benchmark, it invalidates nVidia as a trusted manufacturer.
According to that logic, ATI should not have been a trusted manufacturer ever since the quake/quack fiasco. As for 3dmark03 as a benchmark, I think there has already been enough talk about the shortcomings of this program as an "accurate" real-world benchmark tool. Also, we are back at the issue of "optimization" vs. "cheat".

I don't know how many times this has to be repeated, but here we go again: It is certainly no secret that both NVIDIA and ATI optimize for this benchmark. Users of FX cards now get smoother and faster performance and better image quality in 3dmark03 in what we can see.
jimmyjames123 is offline   Reply With Quote
Old 05-18-03, 11:57 AM   #10
John Reynolds
Registered User
 
Join Date: Aug 2002
Posts: 365
Default

Quote:
Originally posted by jimmyjames123
I don't know how many times this has to be repeated, but here we go again: It is certainly no secret that both NVIDIA and ATI optimize for this benchmark. Users of FX cards now get smoother and faster performance and better image quality in 3dmark03 in what we can see.
Someone started a thread on this forum before the ET article was published stating that they were seeing pixel smearing in 3DMark.

Plain and simple, whether you want to call it a cheat or an optimization, Nvidia boards are not rendering this synthetic correctly. The human eye might have a hard time detecting this, but it's there nonetheless.
John Reynolds is offline   Reply With Quote
Old 05-18-03, 12:02 PM   #11
jimmyjames123
Registered User
 
Join Date: May 2003
Posts: 665
Default

Quote:
Someone started a thread on this forum before the ET article was published stating that they were seeing pixel smearing in 3DMark. Plain and simple, whether you want to call it a cheat or an optimization, Nvidia boards are not rendering this synthetic correctly. The human eye might have a hard time detecting this, but it's there nonetheless.
I've read several reviews on the FX 5900 Ultra, and no reviewer has mentioned any corruption of image quality with 3dmark03 using the new Detonator FX 44.03 drivers with what we can actually see. In fact, it seems that both Image quality and performance are improved, sometimes significantly. Also, I read somewhere about how there was a pixel smear due to a video capture error, not an smearing of the image in the actual demo.
jimmyjames123 is offline   Reply With Quote
Old 05-18-03, 12:04 PM   #12
Dazz
"TOON ARMY!"
 
Join Date: Jul 2002
Location: Newcastle, United Kingdom
Posts: 5,138
Send a message via AIM to Dazz
Default

Quote:
Originally posted by jimmyjames123
I've read several reviews on the FX 5900 Ultra, and no reviewer has mentioned any corruption of image quality with 3dmark03 using the new Detonator FX 44.03 drivers. In fact, it seems that both Image quality and performance are improved, sometimes significantly.
Thats due to people leaving the bench running while they are away from the computer.
__________________
"Never interupt your enemy when he is making a mistake."

Processor: AMD Phenom II X6 1090T Black Edition @ 4.25GHz
Motherboard: Gigabyte GA-990FXA-UD3
Graphics: ASUS ENGTX470
Memory: 4GB Kingston HyperX Blu PC12800 DDR3
Monitor: LG E2260V-PN Full HD WLED 22" & DELL 20" 2005FPW,
Power: Coolermaster Silent Pro Modular 850w PSU
Sound: Logitech Z5500 Digital.
Cooling: Thermalright Silver Arrow.
1st Storage: Kingston V100 SSDNow128GB SSD
2nd Storage: Samsung Spinpoint F1 750GB
Dazz is offline   Reply With Quote
Reply


Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump


Similar Threads
Thread Thread Starter Forum Replies Last Post
Bored, impressed, and giddy: Our final thoughts on E3 2012 (with photos) News Archived News Items 0 06-13-12 06:00 AM
Thoughts from console owners on NVIDIA's GEFORCE GRID MikeC Console World 11 05-27-12 08:43 AM
Looking for a good 21"/22" Monitor...any thoughts? Guuts General Hardware 13 09-22-02 11:04 AM
Thoughts on the command line as an interface. lunix Microsoft Windows XP And Vista 10 09-12-02 08:44 PM
GTA Thoughts? Typedef Enum Gaming Central 5 09-03-02 04:51 PM

All times are GMT -5. The time now is 12:40 AM.


Powered by vBulletin® Version 3.7.1
Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.
Copyright 1998 - 2014, nV News.