What is the stick, dug with young plants for support, called?

It is just called a "stake".

A piece of wood or other material, usually long and slender, pointed at one end so as to be easily driven into the ground as a marker or a support or stay.