What is the idiom/phrase you can use when someone tells you to do (the work) that he is assigned to do (in reality it is assigned to him)?

Solution 1:

You mentioned that it's Joe's job to do it, so strictly following your fill-in-the-blank example, I'd say:

Joe you are responsible for that/checking the passes.

or

Joe you cannot expect me to do this.

or

Joe you cannot unload this on me.

However it may be more natural to say:

"Joe, that's your job."

Or more explicitly:

"Joe, I asked you to check if the visitors' passes are valid, not send me a spreadsheet."

Joe would be shirking (not very colloquial):

v.tr. To avoid or neglect (a duty or responsibility).
v.intr. To avoid work or duty.
American Heritage Dictionary

or passing the buck (idiom)

Shift responsibility or blame elsewhere
American Heritage Dictionary of Idioms

Or just simply being lazy. If this is part of Joe's job responsibilities then this would be avoiding his duties and may be a case of workplace "misconduct."

Also, he may be being "insubordinate" if he's supposed to follow instructions from Mike, who may be his superior.