Inherit proxy_set_header when using it in location block
Solution 1:
Create a file to include in each block that sets the headers you want. (So a common inc-http-headers.conf) that you include in the http block and all of the location blocks that need the common headers.