RRSet with DNS name foo. is not permitted in zone bar
Solution 1:
Turns out I misunderstood the format I needed to use when entering arguments.
To add the record foo.bar.website.net, I was setting the name field to foo. I actually needed to set it to foo.bar.website.net - I was caught off guard because in the AWS Route 53 console one simply needs to type the leading material.