fast VNC server on Linux
TightVNC over SSH has a decent reputation for speed. I don't know if you're going to notice a lot of difference among different implementations though.
try nomachine or its free / gpl implementation free nx. you'll not think about vnc twice after you switch.