Proxy settings won't be saved in the Keychain
I found the solution: in fact in the proxy screen (network settings), the same IP address was stored multiple times on different lines (surprisingly the field is not limited to a single line). Since it was the same IP address, using the up and down arrow didn't show that multiple lines were entered.
I removed everything, pasted the IP a last time, and now it works :)