Upgrading to iPhone 11 Pro Max from iPhone 8 Plus w/o visiting the Apple Store
I did same, moving from iPhone 6 to 11. All I needed to do was take out SIM card and put in new device. SIM card was same size. I recommend you purchase the 'sim-free' or unlocked phone from Apple. It costs the same, and does not lock you into a carrier. It also supports AT&T towers (as well as verizon etc). If you purchase the AT&T phone, they generally want you to change your plan, update it or hassle you to death :)
There is no need to contact AT&T, as they do not require registration or activation as does say Verizon. I don't know if this is technical or just policy, but no need to call or configure anything, just put in the SIM Card.
Be sure to backup your old phone to either iCloud or to iTunes on your Mac/PC. If you use iCloud, simply sign into iCloud on new phone, and iCloud will load all your apps and preferences from the old phone. If you use iTunes, simply attach your new phone to your PC/Mac and restore your data to the new phone. If you are using iTunes for backup, be sure backup using a password/encryption. If you do not, any passwords or logins will not transfer.
Generally speaking this will work.
The SIM card sizes are the same between those two iPhones and as long as you purchase an iPhone with AT&T compatibility you can put the SIM from the iPhone 8 into the iPhone 11 Pro.
If you buy an AT&T compatible phone and have it delivered it will likely come with instructions on how to activate it. You can call 611 on the old phone and the CS rep will ask you for the SIM card number and the IMEI and do it for you or you can (likely) go here to activate it: https://www.att.com/checkmyorder/activations/activateWireless.rt.
Then all you have to do is transfer your settings, which Apple makes easy these days with phone-to phone transfer of all your stuff and download of your Apps.