Perhaps the old gcc is left somewhere else on your system. (That happens sometimes for backwards compatibility)
Are you sure you are already using that new gcc 3.x? (for distributions which didn't come with 3.x they sometimes give the gcc binary another name like gcc3 or gcc-3.)
Else you need to install the old gcc.