What are the disadvantages of removing the application directories instead of using uninstallers?

Solution 1:

Sometimes installers put required files in system directories. Uninstallers has knowledge of where these files are and all registry values to be removed. Unless you are sure you know all the directories where these files are, better leave the uninstallation to the uninstaller.

Removing programs by removing directories will almost always result in "leftover" files. This is bad practice since over time these wasted files will accumulate and occupy disk space. This in time fragments data in your hard disk. Then, the more fragmented your hard disk is, the slower your disk read operations get.

Solution 2:

when you do not use the uninstaller, you [maybe] leaving out all the registry entries, appdata files and many other junk in your system
The program installation consists of:
[always] copy files to program directory
[optional]
register the program with OS
add shortcuts, links etc
register certain files with program via registry or other eg doc with word
add custom program info into registry like serial key, program user info and so on
add one or more files into system directories such as %appdata% on windows that saves program data
add one or more startup entries and service entries that start on events such as boot

an uninstaller is a program that has track records of all the actions the program has done and every file created on installation. its job is to remove this data safely and to completely remove all traces of changes the program made to sytem.
when you do not use the uninstaller, you [maybe] leaving out all the registry entries, appdata files and many other junk in your system which [can] slow down your system or cause some problems.
to avoid all this problems and to have the system in a safe state, an uninstall is done.

Solution 3:

adding to what everyone has said:

Besides leftover files and registry entries, you might be unable to install the program again if you need to..
The installer may simply show you that the program is already installed when if fact you don't have the program files...

I remember this happening to me with spiderman game, a few year back.