Can't disable Language bar in Toolbars from Taskbar

Solution 1:

Check the Control Panel language settings. There are options to show the language bar under certain scenarios; disable the language bar there and it should banish, never to return. (It took me forever to find this in the past, too.)

This blog post from Paul Stubbs describes behavior much like what you are experiencing, and links to this Knowledge Base article with the nitty gritty details.

Solution 2:

Instead of right clicking on the task bar and unchecking the language bar, right click on the language bar itself. From there, select preferences, and unselect "display language bar".