Cannot remove a repository that complains it has no public key
Try modifying the sources.list file directly and either remove or comment out (probably the better solution). The sources file should be located at /etc/apt/sources.list.
See also the Official Ubuntu documentation on package repository configuration.