Re: New user.
Advanced Task Killer was useful until Gingerbread, but like Q said, since ICS, it's not only useless, but can actually cause some problems.
If you hold the Home button for a few seconds, it will show you all the apps that are running and you can kill them manually by swiping.
Some more apps that haven't been mentioned and I find very useful.
ES File Manager