--- title: Transformers News & Updates | daily.dev description: Transformers news and research on the architecture behind current language and vision models. Readers can learn about attention mechanisms and positional encoding, pretraining and fine-tuning, efficiency variants, and applications across text and multimodal tasks. canonical: https://daily.dev/tags/transformers twitter:card: summary_large_image twitter:site: @dailydotdev og:url: https://daily.dev/tags/transformers og:type: website og:site_name: daily.dev og:title: Transformers News & Updates | daily.dev og:description: Transformers news and research on the architecture behind current language and vision models. Readers can learn about attention mechanisms and positional encoding, pretraining and fine-tuning, efficiency variants, and applications across text and multimodal tasks. og:image: https://api.daily.dev/og/tags/transformers.png og:image:width: 1200 og:image:height: 630 --- ## Recommended Transformers stories ## Who to follow for Transformers [](https://daily.dev/syedmuhammadaliraza) [Syed Muhammad Ali Raza](https://daily.dev/syedmuhammadaliraza) [@syedmuhammadaliraza](https://daily.dev/syedmuhammadaliraza) Joined Jun 22\. 2024 60  Senarios Verified Software Engineer ## Top sources covering Transformers ## Most upvoted Transformers posts ## Best discussed Transformers posts ## All posts about Transformers ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@graph":[{"@type":"CollectionPage","@id":"https://daily.dev/tags/transformers#page","url":"https://daily.dev/tags/transformers","name":"Transformers News & Updates","description":"Transformers news and research on the architecture behind current language and vision models. Readers can learn about attention mechanisms and positional encoding, pretraining and fine-tuning, efficiency variants, and applications across text and multimodal tasks.","isPartOf":{"@type":"WebSite","url":"https://daily.dev"}},{"@type":"ItemList","@id":"https://daily.dev/tags/transformers#items","numberOfItems":10,"itemListElement":[{"@type":"ListItem","position":1,"url":"https://daily.dev/posts/understanding-long-rope-in-llms-tkm53bpko","name":"Understanding Long RoPE in LLMs"},{"@type":"ListItem","position":2,"url":"https://daily.dev/posts/decoding-complexity-with-transformers-researchers-from-anthropic-propose-a-novel-mathematical-frame-km4yhd242","name":"Decoding Complexity with Transformers: Researchers from Anthropic Propose a Novel Mathematical Framework for Simplifying Transformer Models"},{"@type":"ListItem","position":3,"url":"https://daily.dev/posts/the-art-of-memory-mosaics-unraveling-ai-s-compositional-prowess-uyvk4pwta","name":"The Art of Memory Mosaics: Unraveling AI’s Compositional Prowess"},{"@type":"ListItem","position":4,"url":"https://daily.dev/posts/fine-tuning-ai-models-for-extractive-question-answering-in-elixir-m1r7hnqnk","name":"Fine-Tuning AI Models for Extractive Question Answering in Elixir"},{"@type":"ListItem","position":5,"url":"https://daily.dev/posts/how-chain-of-thought-makes-transformers-smarter-4ww2ckcv8","name":"How ‘Chain of Thought’ Makes Transformers Smarter"},{"@type":"ListItem","position":6,"url":"https://daily.dev/posts/2405-00738-hlstransform-energy-efficient-llama-2-inference-on-fpgas-via-high-level-synthesis-fhdmiysof","name":"[2405.00738] HLSTransform: Energy-Efficient Llama 2 Inference on FPGAs Via High Level Synthesis"},{"@type":"ListItem","position":7,"url":"https://daily.dev/posts/data-science-unicorns-rag-pipelines-a-new-coefficient-of-correlation-and-other-april-must-reads-0mnf6x3uq","name":"Data Science Unicorns, RAG Pipelines, a New Coefficient of Correlation, and Other April Must-Reads"},{"@type":"ListItem","position":8,"url":"https://daily.dev/posts/self-attention-in-transformers-computation-logic-and-implementation-qaqwnbvh9","name":"Self-Attention in Transformers: Computation Logic and Implementation"},{"@type":"ListItem","position":9,"url":"https://daily.dev/posts/fine-tuning-llama-3-with-orpo-a-deep-dive-vnvjoourr","name":"Fine-tuning Llama-3 with ORPO: A Deep Dive"},{"@type":"ListItem","position":10,"url":"https://daily.dev/posts/hands-on-this-self-transforming-megatron-is-as-badass-as-it-is-expensive-jrgsiayz5","name":"Hands-on: this self-transforming Megatron is as badass as it is expensive"}]},{"@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Tags","item":"https://daily.dev/tags"},{"@type":"ListItem","position":3,"name":"Transformers"}]}]} ```