Luneidea Explore

LLM Attention: How Words Look at Words

Visualize self-attention as beams of light between tokens and feel how softmax(QKᵀ/√d_k) decides which word "it" is looking at.

Machine-translated from the English original. Open English original

What You Can Explore

Explore LLM Attention: How Words Look at Words through a 3D model, guided questions, and an interactive control panel. (Arabic machine translation from English.)

Interactive Elements

Switch structure, motion, and focus points to connect visible form with the underlying mechanism.

発見ステージ進行 / ヘッド切替 / 視点トークン選択 / Temperature変更 / Causal mask切替

Search Vocabulary

self-attention, transformer, softmax QK, query key value, causal mask, large language models in 3D

Build the mental map

This official English draft follows the source section “注意とは「どこを見るか」を選ぶこと” and frames it inside LLM Attention: How Words Look at Words. Use the 3D model, controls, and checkpoints to connect the visible parts with the underlying system.

Follow the structure

This official English draft follows the source section “Query・Key・Value で照合する” and frames it inside LLM Attention: How Words Look at Words. Use the 3D model, controls, and checkpoints to connect the visible parts with the underlying system.

Connect the system

This official English draft follows the source section “"it" は何を見ているか” and frames it inside LLM Attention: How Words Look at Words. Use the 3D model, controls, and checkpoints to connect the visible parts with the underlying system.

How is this page different from the experience itself?

This localized page is for search and orientation. The interactive 3D experience opens at the language-neutral URL.

Which languages are officially reviewed?

Japanese and English are treated as official reviewed lesson text.

How are other languages handled?

Other languages are shown as machine translations from the English source with a link back to the original.

How the Enigma Cipher Machine Works

Trace how a key press passes through the plugboard, rotors, reflector, and lampboard to become another letter.

Enter the Space

Turing-Welchman Bombe: Historical Prelude

Inspect the electromechanical Bombe that supported Enigma codebreaking before entering Turing machine theory.

Enter the Space

Turing Machine: Concept Machine

Experience computation through the minimal parts of a tape, read/write head, state, and transition rules.

Enter the Space