Azure DevOps: Maven is not installed on agent
So after much head scratching it turns out the issue was with the JDK version that I was using.
When I swapped from:
jdk-16.0.1_linux-aarch64_bin.tar.gz
to
jdk-16.0.1_linux-x64_bin.tar.gz
it just started working. Hope this helps someone in the future