Originally Posted by kwynjunk
Is there a way to do this with windows firewall?
No. Windows firewall only fights half the battle. It can block only incoming connections.
Although I think this will change in Windows Vista.
In XP, outgoing connections can be blocked with IPSec rules, but it's a severe pain. You're better off downloading and setting up a third party firewall.