Ubuntu 20.04 with KDE is laggy on 4k monitor
If anyone also encounters this problem: I was not able to fix it. It seems that there is a bug when using an NVIDIA graphics card with Aurorae window decorations.
I've noticed that I only had issues when I was using literally any other theme in KDE plasma than Breeze or Breeze dark. So I simply switched to using Breeze and now everything's working great.