I would say at the point when he or she expresses disinterest, distress or dislike at the interest of said person.

UMMM you gotta tell me about this one.