Skip to content
Practice
Learning
App
Learn
Practice
Design Lab
Cheatsheets
Search lessons & concepts…
Ctrl K
Loading…
Sign in
Learn
Practice
Design Lab
Cheatsheets
Question 1 of 6
What is a token, as a language model sees it?
What is a token, as a language model sees it?
Always exactly one word
A piece of text, which can be a whole word, part of a word or punctuation, mapped to a number
A single letter, so a word is a short list of letters
A sentence, because the model reads one sentence at a time
Check answer
Sign in to save your practice and get review reminders.