Goalposts

But that's not how LLM program actually did calculation, like not even close enough to claim variability or something. So what it does, is generated a whole load of bunk, in this example what humans could do to add two numbers. In other words, this supposed AGI can't explain what it is doing, at all.

This is in my opinion at minimum one critical sign that there is no intelligence on the other side of the glass, yet.