Maybe, you wont see earth shattering performance increases though. Your best increases will come from media apps. Try using the --target option to make sure it's compiled and optimised for your architecture:
rpmbuild --rebuild --target=ARCH *.src.rpm
where ARCH is your architecture; e.g. i686 for P3, i586 for P2 & P1, athlon for athlons...