Solution 1:

You'll need to add quotes around the command you pass via ssh:

ssh -qt -p2123 [email protected] "rsync -az --delete 
--rsh='ssh -p2122 -qt' 
/home/user36/public_html/ [email protected]:/home/user36/public_html/"

This will keep the single-quotes from getting stripped out before rsync runs on the remote host.