How to select idle worker without the screen jumping to the worker?

Every time I select "idle worker", the screen jumps to the worker. This completely throws me off during, say, an attack. Is there a way I can select my workers and tell them to harvest minerals without looking at them? Shift-click, I believe, selects them all, but there is still the unnecessary jump.

Solution 1:

If you select all idle workers, then use a location hotkey, you can make the scvs extremely fast. Set the location hotkeys to each base and when you make buildings use the location hotkeys to rally the scv back to mining every time. Then just double click hotkeyed army to get right back. It's a little distracting but worth it.