Usually this is caused by some complex spam-fighting filters on the remote server incorrectly flagging your messages.

To solve this you should:

- Report your mail as NOT-SPAM to the remote server. There should be such an option in the mail interface of the remote server.

- Ask the recipient to add your mail address to his / her contact list in Yahoo / Hotmail / Gmail.