Unlike language models, children (eventually) learn from their mistakes. Language models happily step into the same bucket an uncountable number of times.
Children prefer warmth and empathy for many reasons. Not always to their advantage. Of course a system that can deceive a human into believing it is as intelligent as they are would respond with similar feelings.
The Turing Test does not require a machine show any “sophisticated intent”, only effective deception:
“Both the computer and the human try to convince the judge that they are the human. If the judge cannot consistently tell which is which, then the computer wins the game.”
