Password reset with Filevault recovery key not working

So it turns out you can ignore the shaking and select 'restart' after which the new password works. After logging in with it you'll be presented with another reset password screen but this one works.