How do I summon a villager that only makes noise when hit?

The only way to do this is to make a resource pack, with the villager sounds being sound files that have no audio. Another option is to add the Silent tag, and then use /playsound to play a hurt sound effect.