--- title: The Building Blocks of LLMs: Vectors, Tokens, and Embeddings description: Explore the building blocks of LLMs, including vectors, tokens, and embeddings. Learn how vectors represent language mathematically, how tokens break down... canonical: https://daily.dev/posts/the-building-blocks-of-llms-vectors-tokens-and-embeddings-5bwf9mghw twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: The Building Blocks of LLMs: Vectors, Tokens, and Embeddings | daily.dev og:description: Explore the building blocks of LLMs, including vectors, tokens, and embeddings. Learn how vectors represent language mathematically, how tokens break down... og:url: https://daily.dev/posts/the-building-blocks-of-llms-vectors-tokens-and-embeddings-5bwf9mghw og:image: https://api.daily.dev/og/posts/5bwF9mGHw.png og:image:alt: The Building Blocks of LLMs: Vectors, Tokens, and Embeddings og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # The Building Blocks of LLMs: Vectors, Tokens, and Embeddings **[Python in Plain English](https://daily.dev/sources/inPlainEngHQ)** · 9 min read · 4 upvotes · 0 comments ## Summary Explore the building blocks of LLMs, including vectors, tokens, and embeddings. Learn how vectors represent language mathematically, how tokens break down language into meaningful units, and how embeddings capture semantic relationships. Discover the applications and challenges of these building blocks and the advancements in NLP. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: --- Tags: [#embeddings](https://daily.dev/tags/embeddings), [#llm](https://daily.dev/tags/llm), [#nlp](https://daily.dev/tags/nlp) [View this post on daily.dev](https://daily.dev/posts/the-building-blocks-of-llms-vectors-tokens-and-embeddings-5bwf9mghw) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"The Building Blocks of LLMs: Vectors, Tokens, and Embeddings","url":"https://daily.dev/posts/the-building-blocks-of-llms-vectors-tokens-and-embeddings-5bwf9mghw","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/the-building-blocks-of-llms-vectors-tokens-and-embeddings-5bwf9mghw"},"datePublished":"2024-05-10T21:19:17.855Z","dateModified":"2024-07-02T02:13:52.539Z","description":"Explore the building blocks of LLMs, including vectors, tokens, and embeddings. Learn how vectors represent language mathematically, how tokens break down...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/781a49aa667daaceada02cfb54e7c8e3?_a=AQAEuiZ","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/781a49aa667daaceada02cfb54e7c8e3?_a=AQAEuiZ","isAccessibleForFree":true,"articleSection":"Python in Plain English","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Python in Plain English","logo":"https://media.daily.dev/image/upload/s--Dg5QTRuI--/f_auto,q_auto/v1686665538/logos/pe","url":"https://daily.dev/sources/inPlainEngHQ"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/the-building-blocks-of-llms-vectors-tokens-and-embeddings-5bwf9mghw","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":4},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"embeddings,llm,nlp","timeRequired":"PT9M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Python in Plain English","item":"https://daily.dev/sources/inPlainEngHQ"},{"@type":"ListItem","position":3,"name":"The Building Blocks of LLMs: Vectors, Tokens, and Embeddings"}]} ```