Will other perks level up when not active?
Yes, you can level up non-selected perks, provided you're using a proper weapon (or healing others).
On low difficulties I commonly pick up a Bullpup no matter what Perk I'm currently using, to avoid "wasting" stalker kills.
A perk will gain experience whenever the specified action occurs. Whether or not the perk is active doesn't matter.