Luneidea Explore

Next-token Prediction: How Words Are Born

Watch logits become a probability distribution through softmax, reshape with temperature, and collapse to a single sampled word.

Machine-translated from the English original. Open English original

What You Can Explore

Explore Next-token Prediction: How Words Are Born through a 3D model, guided questions, and an interactive control panel. (Arabic machine translation from English.)

Interactive Elements

Switch structure, motion, and focus points to connect visible form with the underlying mechanism.

発見ステージ進行 / Temperature変更 / サンプリング / 分布の観察

Search Vocabulary

next-token prediction, softmax, temperature sampling, logits, probability distribution, large language models in 3D

Build the mental map

This official English draft follows the source section “次の語への点数” and frames it inside Next-token Prediction: How Words Are Born. Use the 3D model, controls, and checkpoints to connect the visible parts with the underlying system.

Follow the structure

This official English draft follows the source section “softmaxで確率に変える” and frames it inside Next-token Prediction: How Words Are Born. Use the 3D model, controls, and checkpoints to connect the visible parts with the underlying system.

Connect the system

This official English draft follows the source section “温度で山の形を変える” and frames it inside Next-token Prediction: How Words Are Born. Use the 3D model, controls, and checkpoints to connect the visible parts with the underlying system.

How is this page different from the experience itself?

This localized page is for search and orientation. The interactive 3D experience opens at the language-neutral URL.

Which languages are officially reviewed?

Japanese and English are treated as official reviewed lesson text.

How are other languages handled?

Other languages are shown as machine translations from the English source with a link back to the original.

How the Enigma Cipher Machine Works

Trace how a key press passes through the plugboard, rotors, reflector, and lampboard to become another letter.

Enter the Space

Turing-Welchman Bombe: Historical Prelude

Inspect the electromechanical Bombe that supported Enigma codebreaking before entering Turing machine theory.

Enter the Space

Turing Machine: Concept Machine

Experience computation through the minimal parts of a tape, read/write head, state, and transition rules.

Enter the Space