How to convert .pem into .key?

I assume you want the DER encoded version of your PEM private key.

openssl rsa -outform der -in private.pem -out private.key

openssl rsa -in privkey.pem -out private.key does the job.