I can't move or dump items that were dropped by Dwarfs interrupted in a task

If the "build a wall here" designation/order is still standing, the blocks are marked as being "in use" for this task. The quickest way is to abort the build order using t, navigating to the not yet built walls, and pressing x to abort their construction. Then you can order them re-built if you want to.