Exit silent mode without vibrate

Go into Settings --> Sounds and then turn off vibrate on ring

Use the hardware switch and re-enable vibrate on ring