How to add a language pack without adding a keyboard layout

You may assign a shortcut to a keyboard layout for quickly switching layouts.

Finding it will require some clicking. You will find it in Settings > Time & Language > Language > Spelling, typing, & keyboard settings > Advanced keyboard settings > Language bar options > Advanced Key Settings.

Click a layout and press Change Key Sequence...