How to remove kdewallet?

Following disabling kdewallet. Open and edit ~/.kde/share/config/kwalletrc as shown below.

[$Version]
update_info=kwallet-4.13.upd:kde4.13

[Auto Allow]
kdewallet=kwalletmanager

[Auto Deny]
kdewallet="Google Chrome"

[Wallet]
Enabled=false
Launch Manager=false

You can remove kwalletmanager with

sudo apt-get purge kwalletmanager

note: its kwalletmanager not kdewalletmanager

If you want to disable it, just open it and go to Settings > Configure Wallet and uncheck the "Enable the KDE wallet subsystem" box