Collocation 'bolt upright'

Like you said, it's an adverb.

bolt : ...(adverb) 26. Archaic. with sudden meeting or collision; suddenly.

Wiktionary defines:

bolt: suddenly; straight; unbendingly. e.g. "The soldiers stood bolt upright for inspection."