Test Time Compute
Test-time compute refers to additional computation a language model performs at inference time — beyond a single fixed-length forward pass — such as extended reasoning, self-verification, or exploring multiple candidate solutions, to improve answer quality on harder problems.
4 resources across 1 library
Glossary Terms(4)
Speculative Decoding
Speculative decoding is an inference optimization technique that speeds up large language model text generation by using a smaller, faster "draft" model to pro…
Test-Time Compute
Test-time compute refers to additional computation a language model performs at inference time — beyond a single fixed-length forward pass — such as extended r…
Chain-of-Thought Prompting
Chain-of-thought prompting is a technique that elicits step-by-step intermediate reasoning from a language model — either by instructing it to 'think step by s…
Tree of Thoughts
Tree of Thoughts (ToT) is a prompting and inference framework that generalizes chain-of-thought reasoning by having a language model explore multiple alternati…