Can a great improvement (ex: Manufactory) be removed by automated workers?

Yes, it is possible. In the future, you should turn on the option "automatic workers leave old improvements" in the options, which will prevent issues like this from happening