The implication is that the man has left his fan behind at the lady’s house, and that Sanekata has discovered it. The poem is a rebuke to her for being so careless as to make it obvious what has been going on.