Token

A unit of text, such as a word or character, used by models to represent and process language data during training and inference.

Featured