Nginx does not return css / js for subpaths
So as @mdaniel advised, moving from alias to root instead, plus fixing the path in my frontend application fixed the overall problem. This helped in case you stumble upon this thread: https://stackoverflow.com/questions/53207059/react-nginx-routing-to-subdirectory