In Apple Music (Big Sur), how can I 'go to current song playing' in the context of the main library?

Click Cmd + L. This will show you the album that is currently playing. Then click on 'songs' in the sidebar. This will take you to the current song in library view. (What used to be a one-step process is now two steps).