Just like an analogy between humans fails to capture how an LLM works, so does the analogy of being "programmed".

Being "programmed" is being given a set of instructions.

This ignores explicit instructions.

It may not be magic; but it is still surprising, uncontrollable, and risky. We don't need to be doomsayers, but let's not downplay our uncertainty.