They won't remember it accurately anyways, so it's kind of a moot point.

Though you're right - a specific scent can easily call up an ancient, forgotten memory.