Well, it needn't be specifically optimized for every piece of hardware. It should just be as good as competing compilers for most hardware. Other companies will get on the bandwagon if it becomes viable for them to do so (i.e. if Cg gains wide acceptance among software developers).
"Physics is like sex. Sure, it may give some practical results, but that's not why we do it." - Richard P. Feynman