--- title: LLM2Vec: A Simple AI Approach to Transform Any... description: LLM2Vec is a simple AI approach that transforms any decoder-only LLM into a text encoder, achieving state-of-the-art performance on the Massive Text Embeddings... canonical: https://daily.dev/posts/llm2vec-a-simple-ai-approach-to-transform-any-decoder-only-llm-into-a-text-encoder-achieving-sota-p-jtqfsyo7x twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: LLM2Vec: A Simple AI Approach to Transform Any Decoder-Only LLM into a Text Encoder Achieving SOTA Performance on MTEB in the Unsupervised and Supervised Category | daily.dev og:description: LLM2Vec is a simple AI approach that transforms any decoder-only LLM into a text encoder, achieving state-of-the-art performance on the Massive Text Embeddings... og:url: https://daily.dev/posts/llm2vec-a-simple-ai-approach-to-transform-any-decoder-only-llm-into-a-text-encoder-achieving-sota-p-jtqfsyo7x og:image: https://api.daily.dev/og/posts/JTQFSYo7x.png og:image:alt: LLM2Vec: A Simple AI Approach to Transform Any Decoder-Only LLM into a Text Encoder Achieving SOTA Performance on MTEB in the Unsupervised and Supervised Category og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # LLM2Vec: A Simple AI Approach to Transform Any Decoder-Only LLM into a Text Encoder Achieving SOTA Performance on MTEB in the Unsupervised and Supervised Category **[Machine Learning News](https://daily.dev/sources/mlnews)** · 5 min read · 0 upvotes · 0 comments ## Summary LLM2Vec is a simple AI approach that transforms any decoder-only LLM into a text encoder, achieving state-of-the-art performance on the Massive Text Embeddings Benchmark (MTEB) in the unsupervised and supervised category. The method uses bidirectional attention, masked next token prediction, and unsupervised contrastive learning to develop robust representations. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: --- Tags: [#embeddings](https://daily.dev/tags/embeddings), [#nlp](https://daily.dev/tags/nlp), [#unsupervised-learning](https://daily.dev/tags/unsupervised-learning) [View this post on daily.dev](https://daily.dev/posts/llm2vec-a-simple-ai-approach-to-transform-any-decoder-only-llm-into-a-text-encoder-achieving-sota-p-jtqfsyo7x) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"LLM2Vec: A Simple AI Approach to Transform Any Decoder-Only LLM into a Text Encoder Achieving SOTA Performance on MTEB in the Unsupervised and Supervised Category","url":"https://daily.dev/posts/llm2vec-a-simple-ai-approach-to-transform-any-decoder-only-llm-into-a-text-encoder-achieving-sota-p-jtqfsyo7x","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/llm2vec-a-simple-ai-approach-to-transform-any-decoder-only-llm-into-a-text-encoder-achieving-sota-p-jtqfsyo7x"},"datePublished":"2024-04-12T22:06:56.305Z","dateModified":"2024-07-02T02:13:40.789Z","description":"LLM2Vec is a simple AI approach that transforms any decoder-only LLM into a text encoder, achieving state-of-the-art performance on the Massive Text Embeddings...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/111e1746a99b3cdfc45898cf1931eb05?_a=AQAEufR","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/111e1746a99b3cdfc45898cf1931eb05?_a=AQAEufR","isAccessibleForFree":true,"articleSection":"Machine Learning News","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Machine Learning News","logo":"https://media.daily.dev/image/upload/s--0PoEtdkd--/f_auto/v1750409401/squads/marktechpost?_a=BAMClqZW0","url":"https://daily.dev/squads/mlnews"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/llm2vec-a-simple-ai-approach-to-transform-any-decoder-only-llm-into-a-text-encoder-achieving-sota-p-jtqfsyo7x","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"embeddings,nlp,unsupervised-learning","timeRequired":"PT5M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Machine Learning News","item":"https://daily.dev/squads/mlnews"},{"@type":"ListItem","position":3,"name":"LLM2Vec: A Simple AI Approach to Transform Any Decoder-Only LLM into a Text Encoder Achieving SOTA Performance on MTEB in the Unsupervised and Supervised Category"}]} ```