Do kittens continue to improve at jobs that aren't doing any work?

Yes. Any kitten assigned to a job will gain experience in that skill. They will also slowly lose experience in skills they are not assigned to, so you really shouldn't reassign them right now if you want them to remain top-quality scholars.