There are ways to tell if something is a hallucination or not if you can see all logit probabilities (hallucinations tend to be closer to noise). I'm sure there are other, more advanced statistical analysis methods.