CITATION — REFERENCE ENTRY
sampling-token-probability-definition · huggingface-how-to-generate-2020
- Citation
- huggingface-how-to-generate-2020
- Claim ID
- sampling-token-probability-definition
- Assertion
- In its most basic form, sampling in language model generation means randomly picking the next token according to its conditional probability distribution.
- Quote
In its most basic form, sampling means randomly picking the next word w_t according to its conditional probability distribution p(w | w_{1:t-1}).
- Quote language
- en
Available in