AddressBookManager using 100% CPU

My macbook pro running OSX 10.7.3 will fire up the heavy fans even if left idle with all major apps closed. In Activity Monitor, AddressBookManager is shown as taking 110% CPU, even though I have only two address in my address book (mine and apple's) and I never open the application.

I can kill AddressBookManager from Activity Monitor, but it comes back again in a few minutes.

I still have loads of free memory, and the disk doesn't seem to be being thrashed, it's just the CPU usage. I probably wouldn't even notice if it wasn't for the fans.

Suggested from the comments, here's the accounts in my address book preferences:

As you can see, nothing there untoward.

Thanks in advance and for the help already.

I solved this issue:

1. Export your AddressBook information if necessary.(I did not, because I have no import information in AddressBook)

2. Go to this directory /Users/luowensheng/Library/Application\ Support/

3. Delete the AddressBook directory, if there is synchronization, it may come back, do not care of that.

4. So, you can see the Activity monitor, does the AddressBookManager still high? if still high, delete the AddressBook directory more times.