Universal Machine Transformer (UMT)

Inside the network

One forward pass, inside 23,844 parameters

The network that runs the sieve of Eratosthenes does one thing, billions of times: it reads three tokens of the universal machine's transcript and writes what comes next. Here is one of those passes, taken live from the sieve and walked through layer by layer. Every weight is drawn, and every number the pass computes, as it computes it.

◆

The window

The transcript, around the three tokens the network is reading. It writes the token for the middle one's place in the next ring.

Forward pass–
▶

The pass

Each bar is one number: its height is the number's size, its colour the sign. Heights are scaled within each block. Drag to turn the view, scroll or pinch to zoom, and hover over a bar for its value.

Loading three.js…

    negative positive attention head 1 attention head 2
    Σ

    Where the 23,844 parameters are

    Almost all of them are the two lookup tables at the ends, one row per token. The computing in between is 832 numbers.