https://github.com/Homebrew/homebrew-cask/issues/50413

The solution was described as going to: /usr/local/Caskroom/CASKNAME/.metadata/CASKVERSION/WEIRDIDENTIFIER/Casks/CASKNAME.rb

And then from there I can remove the line that attempts to remove the login item. Then it uninstalls successfully and I can manually remove the login item.