If a man took a lady’s fan, it was considered a promise that he would come back and visit her again. Sending it back, as Sanekata is doing here, was a sign that he had lost interest in her and the relationship was over. As you can tell from this, the previous poem and Emon’s reply, their relationship did not end amicably.