--- title: A Novel AI Approach to Enhance Language Models:... description: A new technique called multi-token prediction has been proposed for language models. It trains the model to predict multiple future tokens simultaneously,... canonical: https://daily.dev/posts/a-novel-ai-approach-to-enhance-language-models-multi-token-prediction-qh7w5rxvy twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: A Novel AI Approach to Enhance Language Models: Multi-Token Prediction | daily.dev og:description: A new technique called multi-token prediction has been proposed for language models. It trains the model to predict multiple future tokens simultaneously,... og:url: https://daily.dev/posts/a-novel-ai-approach-to-enhance-language-models-multi-token-prediction-qh7w5rxvy og:image: https://api.daily.dev/og/posts/qh7W5Rxvy.png og:image:alt: A Novel AI Approach to Enhance Language Models: Multi-Token Prediction og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # A Novel AI Approach to Enhance Language Models: Multi-Token Prediction **[Machine Learning News](https://daily.dev/sources/mlnews)** · 4 min read · 0 upvotes · 0 comments ## Summary A new technique called multi-token prediction has been proposed for language models. It trains the model to predict multiple future tokens simultaneously, leading to better performance for complex tasks. The technique reduces GPU memory usage and has shown promising results in coding and natural language tasks. It mitigates the discrepancy between training and inference, assigns higher weights to critical decision points, and captures longer-term dependencies effectively. Future improvements include automatically determining the optimal value of tokens to predict and exploring alternative prediction losses. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: --- Tags: [#ai](https://daily.dev/tags/ai), [#machine-learning](https://daily.dev/tags/machine-learning), [#nlp](https://daily.dev/tags/nlp), [#text-generation](https://daily.dev/tags/text-generation) [View this post on daily.dev](https://daily.dev/posts/a-novel-ai-approach-to-enhance-language-models-multi-token-prediction-qh7w5rxvy) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"A Novel AI Approach to Enhance Language Models: Multi-Token Prediction","url":"https://daily.dev/posts/a-novel-ai-approach-to-enhance-language-models-multi-token-prediction-qh7w5rxvy","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/a-novel-ai-approach-to-enhance-language-models-multi-token-prediction-qh7w5rxvy"},"datePublished":"2024-05-03T22:55:02.738Z","dateModified":"2024-05-09T09:28:18.744Z","description":"A new technique called multi-token prediction has been proposed for language models. It trains the model to predict multiple future tokens simultaneously,...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/d87683e0fd8b42f714f103fb68dc96c9?_a=AQAEuiZ","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/d87683e0fd8b42f714f103fb68dc96c9?_a=AQAEuiZ","isAccessibleForFree":true,"articleSection":"Machine Learning News","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Machine Learning News","logo":"https://media.daily.dev/image/upload/s--0PoEtdkd--/f_auto/v1750409401/squads/marktechpost?_a=BAMClqZW0","url":"https://daily.dev/squads/mlnews"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/a-novel-ai-approach-to-enhance-language-models-multi-token-prediction-qh7w5rxvy","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"ai,machine-learning,nlp,text-generation","timeRequired":"PT4M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Machine Learning News","item":"https://daily.dev/squads/mlnews"},{"@type":"ListItem","position":3,"name":"A Novel AI Approach to Enhance Language Models: Multi-Token Prediction"}]} ```