Temperature
Temperature is a sampling parameter that controls the randomness of a language model's output by scaling the probability distribution over possible next tokens before a token is selected.
4 resources across 2 libraries
Glossary Terms(3)
Temperature (LLM)
Temperature is a sampling parameter that controls the randomness of a language model's output by scaling the probability distribution over possible next tokens…
Top-p Sampling
Top-p sampling, also called nucleus sampling, is a decoding strategy that selects the next token from the smallest set of candidates whose cumulative probabili…
Beam Search
Beam search is a heuristic decoding algorithm that generates text by tracking the top-scoring k partial sequences (the "beam width") at each step, expanding ea…