Having completed and after having completed
There is perhaps a slight difference in nuance.
"Having completed his work, he left the office", suggests that the work completion was necessary, in order that he might leave.
However "After having completed his work, he left the office", does not suggest as strong a connection between the two events. At least that is the way the senses of the two sentences differ to my (UK) ear. But it is a very fine distinction and I would be interested to hear other opinions.