Minecraft drops fps below 30 while cpu and gpu arent fully utilized

I recently installed minecraft and I noticed alot of FPS drops happening very commonly, while the CPU and the GPU arent fully utilized. I tried turning off some settings in the Nvidia controlpanel but that didnt do anything.

Here is a screenshot of both programs.

Any idea what I can do to fully utilize my resources for the game ?

Minecraft isn't... super well programmed, unfortunately it (mostly) only runs on a single core of your processor.

You seem to have a quad-core processor from your screenshot, 25% of that is one core fully utilized, so your CPU is maxed out on a single core. GPU usage is capped by your CPU (and minecraft isn't super GPU intensive anyway).