Embedding

Applies to: python, general

An embedding maps a discrete item, such as a word or token, to a dense vector the model can learn from.

vec = embedding[token_id]

See also: tokenization, transformer