I'm able to go to other towns on ACNL, but one of my friends can't visit my town?
You are experiencing a NAT issue. Your friend's router may be set to a Moderate or Strict NAT setting. If they can, they should change it to be equivalent, or more open setting, using the router settings.
See this link for more information.
Hope this helps!