Yeah and this explains why you see it in LLMs in the first place. They had to learn it from somewhere.