Should I be concerned about attackers spraying for vulnerabilities on our webserver?
Solution 1:
This is perfectly normal internet background noise. As long as you keep your applications updated and endpoints known, there is no need to worry.
If you want to filter the traffic from entering your server at all, then you can use CloudFlare for example. They have a Web Application Firewall, which filters most common web scans.