If you install the kernel from source (which is what you'd have to do once you upgraded the system compiler), then you don't have to worry about installing anything else -- you already have the equivalent of kernel-source installed. It's even configured. What a deal.
Well, just don't delete the source tree.
The only time you have to worry about a kernel-source package or something is if you upgrade via some tool your distro uses.