ToggleButton in C# WinForms
Solution 1:
You can just use a CheckBox and set its appearance to Button:
CheckBox checkBox = new System.Windows.Forms.CheckBox();
checkBox.Appearance = System.Windows.Forms.Appearance.Button;
Solution 2:
Check FlatStyle property. Setting it to "System" makes the checkbox sunken in my environment.