Its hard to say without witnessing it.
If this happens every time you try it, it could be because your opening wrong. Are you putting too much pressure on them? maybe try being much more casual in your approach, or it could be the other side of the coin, that your not commanding there attention, in that case, be slightly more commanding. You could use the Sasha technique, if the girl walks off smiling, he'll reopen them.