How to prevent browser from prompting for a client certificate and allow the IIS to accept it (not require it)?
From the comments it turned out, your service consisted of a few specific files, but you set the Accept Client Certificate setting for the whole application.
Use the settings on just the files (or folder) for your service, not on the application level.