Not replacing deleted config file /etc/default/burg?

Solution 1:

Purge the package,

Run dpkg -P burg

Reinstall