Adverb Meaning so as not to damage something delicate or fragile

I would suggest the word lurking in your own question : delicately.

In a way that is sensitive or responsive to the slightest influences; sensitively; with nice exactness.

OED

The instruments employed should be fine and the operation delicately performed ...

The Principles and Practice of Operative Surgery