If you ever need to completely remove Xcode due to application issues or future upgrades, you can run a single command from Terminal to remove it.

sudo /Developer/Library/uninstall-devtools --mode=all

Of course, /Developer is dependant on where you installed Xcode to.