Idiom for re-raising an old ugly affair better left alone
Some pertinent idioms:
To do this is to open old wounds.
To advise someone not to do this: Let sleeping dogs lie.
To "open a can of worms"? I think not -- the unpleasant matter figuratively referred to there might be a new one rather than an old one.