Removing TeX Live
To remove Tex Live, type the following in a console:
sudo apt-get remove texlive
For me, LnxSlck's solution seemed somehow insufficient. I then did a apt-get purge texlive-base (though not sure if I should have) and then apt-get autoclean and then I was totally texlive free.