Luneidea Explore

The Residual Stream: A River Through the Layers

See the residual stream as a glowing river that every layer reads from and writes to, with attention and MLP tributaries adding features.

Machine-translated from the English original. Open English original

What You Can Explore

Explore The Residual Stream: A River Through the Layers through a 3D model, guided questions, and an interactive control panel. (Chinese (Simplified) machine translation from English.)

Interactive Elements

Switch structure, motion, and focus points to connect visible form with the underlying mechanism.

発見ステージ進行 / レイヤー切替 / attention寄与の切替 / MLP寄与の切替

Search Vocabulary

residual stream, transformer circuits, residual connection, attention and MLP, interpretability, large language models in 3D

Build the mental map

This official English draft follows the source section “一本の共有された流れ” and frames it inside The Residual Stream: A River Through the Layers. Use the 3D model, controls, and checkpoints to connect the visible parts with the underlying system.

Follow the structure

This official English draft follows the source section “支流が書き込む” and frames it inside The Residual Stream: A River Through the Layers. Use the 3D model, controls, and checkpoints to connect the visible parts with the underlying system.

Connect the system

This official English draft follows the source section “読み出してから書き足す” and frames it inside The Residual Stream: A River Through the Layers. Use the 3D model, controls, and checkpoints to connect the visible parts with the underlying system.

How is this page different from the experience itself?

This localized page is for search and orientation. The interactive 3D experience opens at the language-neutral URL.

Which languages are officially reviewed?

Japanese and English are treated as official reviewed lesson text.

How are other languages handled?

Other languages are shown as machine translations from the English source with a link back to the original.

How the Enigma Cipher Machine Works

Trace how a key press passes through the plugboard, rotors, reflector, and lampboard to become another letter.

Enter the Space

Turing-Welchman Bombe: Historical Prelude

Inspect the electromechanical Bombe that supported Enigma codebreaking before entering Turing machine theory.

Enter the Space

Turing Machine: Concept Machine

Experience computation through the minimal parts of a tape, read/write head, state, and transition rules.

Enter the Space