How can I find which games are available in the Microsoft PC Game Pass?

At least on xbox.com, you can filter the games by Xbox Game Pass and then click PC games as shown in this screenshot below (marked the filter with yellow)

enter image description here

The whole thing is in beta anyway so expect the Windows Store and all related apps to be gradually updated. Till then you can use the site to check what games are available.