Why Earth is Doomed?

There is a simple reason I think the question “will AGI destroy humanity?” is slightly mis-specified. It assumes that the relevant event is destruction, and it may not be. The more interesting possibility is that the current political and economic equilibrium of Earth is not stable once there exist cognitive systems much more capable than the institutions containing them. That is a different claim. It does not say that AGI necessarily kills everyone.
Read more →

Cognition as Non-Commutative Geometry

There is a simple mathematical idea, non-commutativity, with consequences that are easy to underestimate: $$ AB\neq BA $$ The order of operations, in some cases, matter. In quantum mechanics this is encoded directly in the algebra of observables. In operator algebras it is more general: non-commutativity means that the operations available to a system cannot, in general, be reduced to simultaneous classical coordinates. The proposal here is that cognition should be treated in the same structural way.
Read more →

Physical Intuition: Something That Still Hasn’t Been Leaned Away

Currently Large Language Models (LLM) coupled with Rienforcement Learning with Verifiable Rewards (RLVR) are winning math olympiads, proving theorems etc. which is to be expected, because you have Lean in math, but not the equivallent in physics. I suspect at least in short-term LLMs are unable to gain “true” physical intuition, at least not in the sense that giants like Einstein had. Nonetheless this is a collection of physics arguments framed around the reasoning that makes a strange result feel inevitable once you see it the “right way”.
Read more →

Consciousness, Computability, Decidability, and Evolvability: A Weaker Problem Worth Attacking

1. The starting intuition, and why it’s too strong as stated # Gödel’s incompleteness theorems show that any sufficiently expressive, consistent formal system \$F\$ contains a true statement \$G\$ it cannot prove from its own axioms — informally, $$ G \leftrightarrow \neg \mathrm{Provable}_F(G). $$ It’s tempting to reach for an analogy: what if consciousness is a real physical phenomenon whose complete truth can’t be derived from whatever formal or mathematical framework we use to describe physical reality?
Read more →

Terrarium: A Lab for the Evolvability of Cognitive Proxies

This is a companion piece to Consciousness, Computability, Decidability, and Evolvability. That piece argued for attacking weaker, well-formed questions about consciousness-adjacent proxies instead of the metaphysical question directly, and singled out evolvability as the more empirically checkable of the two tracks, since a negative evolvability result can be tested against biology in a way a negative decidability result cannot. This piece works through what that actually looks like as a formal object, and what a controllable synthetic world buys you when trying to study it.
Read more →

Working with Large Language Models

Large language models are experiencing their Cambrian explosion. They may not be the path to AGI, but at least they give a taste of what it could be. The current mainstream approach to rely on scaling, may not be the sole solution, as the data runs out, and the models are plateauing in benchmarks, though we may very well see emergent behaviors that surprise us, as the bitter lesson taught us. In this article, I first review Transformers model, then summarize useful workflows with LLMs, which I intend to keep updating.
Read more →

SIMD Programming and Vector Optimizations

Essentially all modern processors have the capability to apply instructions on a vector in one processing unit cycle instead of operating on a single scalar. Language designers and compiler developers have been trying hard to leverage these hardware capabilities by compiling scalar programs into vector instructions. One possible approach is using SIMD (Single Instruction, Multiple Data) intrinsics, supported by all modern C/C++ compilers, through SSE (Streaming SIMD Extension), AVX (Advanced Vector Extensions) others for x86 architectures, and ARM NEON extensions.
Read more →

Tiled Matrix Multiplication

Tiled algorithms, in general, divide the problem into smaller, manageable tiles that fit into faster, but limited-size memory, be it cache, shared memory, or registers, to improve memory access patterns. Many problems which often involve matrices, can be broken down into tiles. This improves cache utilization which improves cache hit/miss ratio, by reusing data within smaller subproblems. In this post we implement tiled matrix multiplication.
Read more →

World Foundation Models

At CES 2025 event, NVIDIA announced, among other interesting things, including a single chip made out of72 Blackwell GPUs, with 1.5 ExaFLOPS performance, it’s first world foundation model, Cosmos. DeepMind is working on a similar model, and this is also one of xAI’s core missions. I suspect that these models are among the next frontier in scientific and AI research, following AlphaFold’s breakthroughs in protein folding prediction.
Read more →

Spack Package Manager

Recently I gave a talk/mini workshop on spack package manager at SKAO, for which I dug into the core of spack. Spack boasts itself as the package manager for HPC, and it really is. The idea is straightforward, streamline what we normally do when compiling and installing software manually on HPC systems using Python. It’s a simple idea but not at all easy to implement.
Read more →