How can I disable Photos Agent on High Sierra (10.13.4)?

From personal experience, I can say that letting it finish once (it processes photos in the Photos app) makes it end forever.

But you can speed up that process by removing iCloud photos syncing.