A fairy tale is more than just a fairy tale
When some one says to you “that’s just a fairy tale,” it generally means that what you have just said is untrue or unreal. It is a polite but deprecating way of saying that your words form a lie or gossip. Your story is make-believe and unreliable. It has nothing to do with reality and experience. Fairy tale is thus turned into some kind of trivial story.