Large Language Models

Word Embeddings: Meaning as Coordinates

Explore word embeddings as a 3D nebula where nearby points mean similar words and king − man + woman ≈ queen appears as a direction.

Maskinöversatt från den engelska originaltexten. Öppna engelska originalet

Prologue · 1/4

A nebula of meaning

Inside the model, every word becomes a vector with thousands of dimensions. Here we project that into 3D and watch it as a nebula. Each point of light is a word, and the closer two points sit, the closer their meanings. Turn it slowly and get a feel for the space the words scatter across.

Turn the nebula and notice the points of light gathering into a few clusters.

NeighborhoodAnimals

種と成体/幼体の軸。dog/cat/puppy/kitten が並びます。

Word Embeddings: Meaning as Coordinates - Luneidea