How can I use Apple Music without my iCloud Library?

The best solution to your problem is to set up direct synchronization between your PC and your phone. Once that happens, you can manually synch the two albums to your phone from your PC using iTunes.

Setting up iPhone to iTunes syncing

Once that happens, resetting your iCloud music account won't be necessary.