The thing is, a lot of web sites will only be fully functional with Internet Explorer whether you like it or lump it. Like when I was doing configurations and ordering for my laptop, I couldn't use any browser but IE because the links wouldn't work properly with either Mozilla or Opera.
For generic web surfing, I would absolutely use an alternative browser. I personally prefer Mozilla to Opera but the two are very close.
Tomorrow morning I'll definitely head over and download Mozilla 1.1b, though MyIE2 is working out exceptionally well for me.