Why do I get "connection refused" errors connecting to a server via SSH?

It sounds like a firewall issue to me. Is this machine behind a physical firewall on a different network or on the same LAN? If it is on a different network, check both the gateway firewall and the host firewall (iptables) and make sure that port 22 is allowed.

To do this, follow these instructions:

  1. Login as the root user.

  2. Open /etc/sysconfig/iptables file, enter:

    # vi /etc/sysconfig/iptables
    
  3. Find line that read as follows:

    COMMIT
    
  4. To open port 22 (ssh), enter (before COMMIT line):

    -A RH-Firewall-1-INPUT -m state --state NEW -m tcp -p tcp --dport 22 -j ACCEPT
    
  5. Save and close the file. Restart the firewall:

    # /etc/init.d/iptables restart
    
  6. Next check to make sure the service is listening.

  7. Try issuing the command:

    netstat -vatn | grep :22 and see if port 22 is listening.

    You could also try:

    netstat -vatn | grep ssh
    

This will take care of the host-based firewall, but if there is a network-based firewall between you and the machine you are trying to remote into then you will have to consult that specific device's instructions for allowing connections to port 22 into the network.