General term for punctuation that surrounds a word or phrase?
I'd go with delimiters. While other things could be considered delimiters, such as (unpaired) periods delimiting sentences, I think the word suitably captures the essence of what you're after.
As mentioned in this related question, enclosures might be an alternative.