In art, what do we call a painting within a painting and the painter painting himself?

Solution 1:

The usual name is the Droste effect:

the effect of a picture recursively appearing within itself