How to rebuild all my Ruby gems?

You can rebuild all your gems with:

gem pristine --all

Assuming there is no issue with your Ruby or Rubygems installation and only with the gems, you shouldn't need to use rvm at all. If however you need to upgrade your Rubygems, you can try this command to upgrade it to the latest version:

rvm rubygems latest