Similer to https://manifold.markets/Amaryllis/a-pure-binary-llm-will-exist-by-end however must also be:

- Byte level: Uses 8 bit utf8 bytes as tokens.
- RNN: Each step takes in an array of S bits of state and 8 bits input, and outputs a distribution for the next byte and S bits of state.

As before, bits per byte must be at least as good as GPT-2 (1.225 BPB) on The Pile. It does not matter how the combinational logic is created. It is permitted to unroll integer or floating point math. However the resulting logic graph must exist and be evaluable on a commodity computer with at most 1TB of RAM.