vlc depends on vlc-nox which installs the vlc command that you see. Remove it specifically, or use autoremove:

apt-get autoremove
# or
apt-get remove vlc-nox

None of the above will actually remove all vlc packages, (usually 6-7). Better to do -

sudo apt-get purge vlc-data