Solution 1:

Dropping caches after rsync seem to fix the problem:

sudo sh -c "sync; echo 3 > /proc/sys/vm/drop_caches"

See also here.

Though, I do not find this very convenient....