--- title: Meta proposes new scalable memory layers that improve... description: Meta AI researchers propose scalable memory layers to improve the factual knowledge and reduce hallucinations in large language models (LLMs) by enhancing... canonical: https://daily.dev/posts/meta-proposes-new-scalable-memory-layers-that-improve-knowledge-reduce-hallucinations-mjieunuxq twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Meta proposes new scalable memory layers that improve knowledge, reduce hallucinations | daily.dev og:description: Meta AI researchers propose scalable memory layers to improve the factual knowledge and reduce hallucinations in large language models (LLMs) by enhancing... og:url: https://daily.dev/posts/meta-proposes-new-scalable-memory-layers-that-improve-knowledge-reduce-hallucinations-mjieunuxq og:image: https://api.daily.dev/og/posts/MJieuNuXQ.png og:image:alt: Meta proposes new scalable memory layers that improve knowledge, reduce hallucinations og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Meta proposes new scalable memory layers that improve knowledge, reduce hallucinations **[Venture Beat](https://daily.dev/sources/venturebeat)** · 4 min read · 0 upvotes · 0 comments ## Summary Meta AI researchers propose scalable memory layers to improve the factual knowledge and reduce hallucinations in large language models (LLMs) by enhancing their learning capacity without additional compute resources. These layers use sparse activations and key-value lookup mechanisms, making them more memory-intensive but compute-efficient. By implementing parallelization, CUDA kernels, and parameter-sharing mechanisms, the researchers successfully integrated these layers into existing LLMs. The memory-enhanced models demonstrated significant improvements in factual knowledge tasks and efficiency compared to dense and mixture of experts (MoE) models. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: --- Tags: [#ai](https://daily.dev/tags/ai), [#machine-learning](https://daily.dev/tags/machine-learning), [#deep-learning](https://daily.dev/tags/deep-learning), [#nlp](https://daily.dev/tags/nlp) [View this post on daily.dev](https://daily.dev/posts/meta-proposes-new-scalable-memory-layers-that-improve-knowledge-reduce-hallucinations-mjieunuxq) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Meta proposes new scalable memory layers that improve knowledge, reduce hallucinations","url":"https://daily.dev/posts/meta-proposes-new-scalable-memory-layers-that-improve-knowledge-reduce-hallucinations-mjieunuxq","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/meta-proposes-new-scalable-memory-layers-that-improve-knowledge-reduce-hallucinations-mjieunuxq"},"datePublished":"2025-01-07T22:09:43.193Z","dateModified":"2025-01-07T22:10:00.372Z","description":"Meta AI researchers propose scalable memory layers to improve the factual knowledge and reduce hallucinations in large language models (LLMs) by enhancing...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/b5dac90124bf6bfff0f592360a3cd311?_a=AQAEuj9","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/b5dac90124bf6bfff0f592360a3cd311?_a=AQAEuj9","isAccessibleForFree":true,"articleSection":"Venture Beat","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Venture Beat","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/a55b09fe104a44d6b5f4c88ed0fd1315","url":"https://daily.dev/sources/venturebeat"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/meta-proposes-new-scalable-memory-layers-that-improve-knowledge-reduce-hallucinations-mjieunuxq","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"ai,machine-learning,deep-learning,nlp","timeRequired":"PT4M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Venture Beat","item":"https://daily.dev/sources/venturebeat"},{"@type":"ListItem","position":3,"name":"Meta proposes new scalable memory layers that improve knowledge, reduce hallucinations"}]} ```