Ubuntu 21.04 remove trash, user and drive icon from desktop?
Thanks to @Levente's comment I found out the solution.
There is an application called "Extensions" which lets you manage the Gnome Extensions. You can just disable the pre-installed extension called "Desktop Icons NG (DING)" and the icons will disappear:
gnome-extensions disable [email protected]