Maximum entropy problem constraints

Solution 1:

The assumptions $p_i\geq 0$ must always be present, but depending on your setup it could be buried in some other assumptions. Can't say for sure unless you write out the full setup and optimization problem you are considering.