--- title: Temperature Scaling and Beam Search Text Generation in... description: Learn about temperature scaling and beam search in LLMs for text generation. Understand how temperature affects the predictability and entropy of LLM output... canonical: https://daily.dev/posts/temperature-scaling-and-beam-search-text-generation-in-llms-for-the-ml-adjacent-t9rvvknmh twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Temperature Scaling and Beam Search Text Generation in LLMs, for the ML-Adjacent | daily.dev og:description: Learn about temperature scaling and beam search in LLMs for text generation. Understand how temperature affects the predictability and entropy of LLM output... og:url: https://daily.dev/posts/temperature-scaling-and-beam-search-text-generation-in-llms-for-the-ml-adjacent-t9rvvknmh og:image: https://api.daily.dev/og/posts/t9RVvknmh.png og:image:alt: Temperature Scaling and Beam Search Text Generation in LLMs, for the ML-Adjacent og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Temperature Scaling and Beam Search Text Generation in LLMs, for the ML-Adjacent **[Towards Data Science](https://daily.dev/sources/tds)** · 17 min read · 0 upvotes · 0 comments ## Summary Learn about temperature scaling and beam search in LLMs for text generation. Understand how temperature affects the predictability and entropy of LLM output sequences. See examples of greedy search and beam search, and the impact of temperature on their results. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: --- Tags: [#machine-learning](https://daily.dev/tags/machine-learning), [#llm](https://daily.dev/tags/llm), [#text-generation](https://daily.dev/tags/text-generation) [View this post on daily.dev](https://daily.dev/posts/temperature-scaling-and-beam-search-text-generation-in-llms-for-the-ml-adjacent-t9rvvknmh) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Temperature Scaling and Beam Search Text Generation in LLMs, for the ML-Adjacent","url":"https://daily.dev/posts/temperature-scaling-and-beam-search-text-generation-in-llms-for-the-ml-adjacent-t9rvvknmh","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/temperature-scaling-and-beam-search-text-generation-in-llms-for-the-ml-adjacent-t9rvvknmh"},"datePublished":"2024-04-27T01:24:42.982Z","dateModified":"2024-05-09T09:30:38.138Z","description":"Learn about temperature scaling and beam search in LLMs for text generation. Understand how temperature affects the predictability and entropy of LLM output...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/741ca76c1e6bb36958f81f49919b5fe0?_a=AQAEuiZ","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/741ca76c1e6bb36958f81f49919b5fe0?_a=AQAEuiZ","isAccessibleForFree":true,"articleSection":"Towards Data Science","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Towards Data Science","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/tds","url":"https://daily.dev/sources/tds"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/temperature-scaling-and-beam-search-text-generation-in-llms-for-the-ml-adjacent-t9rvvknmh","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"machine-learning,llm,text-generation","timeRequired":"PT17M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Towards Data Science","item":"https://daily.dev/sources/tds"},{"@type":"ListItem","position":3,"name":"Temperature Scaling and Beam Search Text Generation in LLMs, for the ML-Adjacent"}]} ```