How non-elite bosses from Adventurer Handbook are different from their normal versions?
They are the open world enemies
The navigate function helps you find ones that are currently available. This is helpful when you haven't marked on your map all the locations for Whopperflowers or Ruin guards. If you are having trouble finding a certain boss (or a certain advancement material) simply use the book to navigate.