Issue with SSH on Ubuntu - Local connection ok, remote connection - Is it me or my ISP?

I have an issue with a server running Ubuntu 12.04, I am trying to set up a remote connection so I can access the server at my work from out of town. I have installed the SSH server and all that stuff, and I have reassigned the default port from 22 to 3399.

A local connection from any OS can connect on the 192.168... address, but in no way can I get a connection on the actual IP address.

I believe my configuration is correct, and I will attach it. If I have done something wrong in the config, please tell me and I will make a change to it.

I honestly think that the Router that my ISP provided is horrible, and although the port for ssh is forwarded, it might be stopping any traffic coming inbound. Is there anything I can try to verify this? /var/log/auth does not show any error when I connect VIA our static IP. I have included all values not commented out below: (sshd_config)

Port 3399

ListenAddress 0.0.0.0
Protocol 2

HostKey /etc/ssh/ssh_host_rsa_key
HostKey /etc/ssh/ssh_host_dsa_key
HostKey /etc/ssh/ssh_host_ecdsa_key
UsePrivilegeSeparation yes
KeyRegenerationInterval 3600
ServerKeyBits 768
SyslogFacility AUTH
LogLevel INFO
LoginGraceTime 120
PermitRootLogin yes
StrictModes yes
UseDNS no
RSAAuthentication yes
IgnoreRhosts yes
RhostsRSAAuthentication no
HostbasedAuthentication no
PermitEmptyPasswords no
ChallengeResponseAuthentication no
PasswordAuthentication yes
GSSAPIAuthentication no
X11Forwarding yes
X11DisplayOffset 10
PrintMotd no
PrintLastLog yes
TCPKeepAlive yes
AcceptEnv LANG LC_*
Subsystem sftp /usr/lib/openssh/sftp-server
UsePAM yes

Am I doing this wrong?

port forwarding image

EDIT: Is there a way to check if a connection even reaches the server? I ran ssh -vvv to my IP and it says it loads my local ssh config, do I need to configure this? below v

OpenSSH_5.9p1 Debian-5ubuntu1, OpenSSL 1.0.1 14 Mar 2012
debug1: Reading configuration data /etc/ssh/ssh_config
debug1: /etc/ssh/ssh_config line 19: Applying options for *
debug2: ssh_connect: needpriv 0
debug1: Connecting to 204.191.22.127 [204.191.22.127] port 3399.
debug1: connect to address 204.191.22.127 port 3399: Connection refused

Here's the result of a ssh -vvv to my local 192.168 server

Solution 1:

On your router, ensure that you are forwarding port 3399 on your external IP to port 3399 on your internal IP. If it doesn't allow you to specify port numbers, then you'll have to change your sshd config back to run on port 22 and setup your router to forward to that.

Your sshd config looks fine. My recommendation on that is for you to create a regular user account that has full sudo access, then change PermitRootLogin to no in your sshd config and restart the sshd service. Then ssh into the server with your regular user account and use sudo for administrative purposes.