delete key prints "~" in putty
Have you tried changing your options in the PuTTY keyboard pannel?
Alternatively, you can try to create a ~/.inputrc file on the RH box, with the following contents:
"\e[3~": delete-char
Once you've created the ~/.inputrc file, restart the shell.