Is it safe to delete files with extensions containing non-alphanumeric characters?
No, temporary file handling is entirely determined by the application that manages the files; there are no rules or even conventions across apps.
Not in general. In case of Eagle .b#1 and .s#1 files are created when you save your design, so they are backups. You can delete them.