I. There is a lineage that runs from Spinoza through Einstein, and it is not a lineage of conclusions but of a shared refusal. Spinoza refused to separate mind from nature; he insisted that freedom is not the absence of necessity but the understanding of it. Einstein refused to accept a universe that plays dice; he believed in Spinoza’s God, the orderly harmony of what exists, not a God who concerns himself with the fates of men.

There is a simple reason I think the question “will AGI destroy humanity?” is slightly mis-specified. The question assumes that the relevant event is destruction. It may not be. The more interesting possibility is that the current political and economic equilibrium of Earth is simply not stable once there exist cognitive systems that are much more capable than the institutions containing them. That is a different claim. It does not say that AGI necessarily kills everyone.

There is a simple mathematical idea, non-commutativity, with consequences that are easy to underestimate: $$ AB\neq BA $$ The order of operations, in some cases, matter. In quantum mechanics this is encoded directly in the algebra of observables. In operator algebras it is more general: non-commutativity means that the operations available to a system cannot, in general, be reduced to simultaneous classical coordinates. The proposal here is that cognition should be treated in the same structural way.

Currently Large Language Models (LLM) coupled with Rienforcement Learning with Verifiable Rewards (RLVR) are winning math olympiads, proving theorems etc. which is to be expected, because you have Lean in math, but not the equivallent in physics. I suspect at least in short-term LLMs are unable to gain “true” physical intuition, at least not in the sense that giants like Einstein had. Nonetheless this is a collection of physics arguments framed around the reasoning that makes a strange result feel inevitable once you see it the “right way”.

1. The starting intuition, and why it’s too strong as stated # Gödel’s incompleteness theorems show that any sufficiently expressive, consistent formal system \$F\$ contains a true statement \$G\$ it cannot prove from its own axioms — informally, $$ G \leftrightarrow \neg \mathrm{Provable}_F(G). $$ It’s tempting to reach for an analogy: what if consciousness is a real physical phenomenon whose complete truth can’t be derived from whatever formal or mathematical framework we use to describe physical reality?