--- title: Introducing hyperpb: 10x faster dynamic Protobuf parsing... description: Buf has released hyperpb, an open-source, fully-dynamic Protobuf parser for Go that is 10x faster than dynamicpb and even 3x faster than statically generated... canonical: https://daily.dev/posts/introducing-hyperpb-10x-faster-dynamic-protobuf-parsing-that-s-even-3x-faster-than-generated-code--3hmmjcmhk twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Introducing hyperpb: 10x faster dynamic Protobuf parsing that’s even 3x faster than generated code · Buf | daily.dev og:description: Buf has released hyperpb, an open-source, fully-dynamic Protobuf parser for Go that is 10x faster than dynamicpb and even 3x faster than statically generated... og:url: https://daily.dev/posts/introducing-hyperpb-10x-faster-dynamic-protobuf-parsing-that-s-even-3x-faster-than-generated-code--3hmmjcmhk og:image: https://api.daily.dev/og/posts/3HMMJCMhk.png og:image:alt: Introducing hyperpb: 10x faster dynamic Protobuf parsing that’s even 3x faster than generated code · Buf og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Introducing hyperpb: 10x faster dynamic Protobuf parsing that’s even 3x faster than generated code · Buf **[Buf Blog](https://daily.dev/sources/buf)** · 6 min read · 0 upvotes · 0 comments ## Summary Buf has released hyperpb, an open-source, fully-dynamic Protobuf parser for Go that is 10x faster than dynamicpb and even 3x faster than statically generated Protobuf code, matching or beating vtprotobuf in most benchmarks. It compiles a parser at runtime, using a table-driven, VM-based approach with optional profile-guided optimization for another 50-100% throughput gain. The project was built to solve a bottleneck in Buf's Bufstream product, which requires broker-side, schema-aware validation of Kafka messages, and supports proto2, proto3, and editions-mode schemas. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Questions this post answers ### What is hyperpb and how much faster is it than dynamicpb for parsing Protobuf in Go? hyperpb is a fully-dynamic Protobuf parser for Go released by Buf that is 10x faster than dynamicpb, the standard Go solution for dynamic Protobuf parsing. It is also 3x faster than parsing with statically generated code and matches or beats vtprotobuf's generated code on almost every benchmark, while supporting proto2, proto3, and editions-mode schemas. _Engineers evaluating Protobuf parsing performance track releases like hyperpb on daily.dev._ ### How does hyperpb achieve fast dynamic Protobuf parsing without code generation? hyperpb compiles a parser at runtime, similar to a regular expression engine, laying out optimized structs per message type to minimize memory use and generating a program for a specialized VM that interprets encoded Protobuf bytes as bytecode. It also supports profile-guided optimization, which tunes the parser to real-time data shapes for an additional 50-100% throughput gain. _Developers building schema-driven systems can follow runtime parsing techniques like this on daily.dev._ ### Why did Buf build hyperpb instead of relying on existing dynamic Protobuf parsers? Buf needed fast broker-side, schema-aware validation for its Bufstream Kafka product, since existing dynamic parsing like dynamicpb was too slow and resource-intensive to validate incoming Protobuf messages against schemas at scale using Protovalidate. hyperpb was built to close this performance gap so validation could run efficiently on the broker side rather than relying solely on client-side validation. _Teams weighing client-side versus broker-side data validation strategies can track this tradeoff on daily.dev._ ## Similar posts on daily.dev - [Protobuf-ES just got a lot faster · Buf](https://daily.dev/posts/protobuf-es-just-got-a-lot-faster-buf-rcovndatq) · Buf Blog · 18 upvotes · 1 comments - [Benchmark, Profile, Prove: A 12x Go Performance Win](https://daily.dev/posts/benchmark-profile-prove-a-12x-go-performance-win-an35pmwsr) · ITNEXT · 28 upvotes · 2 comments - [protobuf-py: Protobuf for Python, without compromises · Buf](https://daily.dev/posts/protobuf-py-protobuf-for-python-without-compromises-buf-twtgzw6ex) · Hacker News · 3 upvotes · 0 comments - [Packing Binary Is Fun, Actually](https://daily.dev/posts/packing-binary-is-fun-actually-mjoiqneoh) · Programming Digest · 0 upvotes · 0 comments - [Better than JSON](https://daily.dev/posts/better-than-json-d2je9kyed) · Hacker News · 250 upvotes · 22 comments --- Tags: [#performance](https://daily.dev/tags/performance), [#backend](https://daily.dev/tags/backend), [#golang](https://daily.dev/tags/golang), [#kafka](https://daily.dev/tags/kafka) [View this post on daily.dev](https://daily.dev/posts/introducing-hyperpb-10x-faster-dynamic-protobuf-parsing-that-s-even-3x-faster-than-generated-code--3hmmjcmhk) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Introducing hyperpb: 10x faster dynamic Protobuf parsing that’s even 3x faster than generated code · Buf","url":"https://daily.dev/posts/introducing-hyperpb-10x-faster-dynamic-protobuf-parsing-that-s-even-3x-faster-than-generated-code--3hmmjcmhk","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/introducing-hyperpb-10x-faster-dynamic-protobuf-parsing-that-s-even-3x-faster-than-generated-code--3hmmjcmhk"},"datePublished":"2026-08-23T07:20:11.705Z","dateModified":"2026-08-23T07:22:27.705Z","description":"Buf has released hyperpb, an open-source, fully-dynamic Protobuf parser for Go that is 10x faster than dynamicpb and even 3x faster than statically generated...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/1fa72dd180cde2dc48deab75af79f091?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/1fa72dd180cde2dc48deab75af79f091?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"Buf Blog","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Buf Blog","logo":"https://media.daily.dev/image/upload/s--2YBgo_Nm--/f_auto,q_auto/v1787469605/logos/buf?_a=BAMAMicg0","url":"https://daily.dev/sources/buf"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/introducing-hyperpb-10x-faster-dynamic-protobuf-parsing-that-s-even-3x-faster-than-generated-code--3hmmjcmhk","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"performance,backend,golang,kafka","timeRequired":"PT6M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Buf Blog","item":"https://daily.dev/sources/buf"},{"@type":"ListItem","position":3,"name":"Introducing hyperpb: 10x faster dynamic Protobuf parsing that’s even 3x faster than generated code · Buf"}]} {"@context":"https://schema.org","@type":"FAQPage","@id":"https://daily.dev/posts/introducing-hyperpb-10x-faster-dynamic-protobuf-parsing-that-s-even-3x-faster-than-generated-code--3hmmjcmhk#faq","mainEntity":[{"@type":"Question","name":"What is hyperpb and how much faster is it than dynamicpb for parsing Protobuf in Go?","acceptedAnswer":{"@type":"Answer","text":"hyperpb is a fully-dynamic Protobuf parser for Go released by Buf that is 10x faster than dynamicpb, the standard Go solution for dynamic Protobuf parsing. It is also 3x faster than parsing with statically generated code and matches or beats vtprotobuf's generated code on almost every benchmark, while supporting proto2, proto3, and editions-mode schemas. Engineers evaluating Protobuf parsing performance track releases like hyperpb on daily.dev."}},{"@type":"Question","name":"How does hyperpb achieve fast dynamic Protobuf parsing without code generation?","acceptedAnswer":{"@type":"Answer","text":"hyperpb compiles a parser at runtime, similar to a regular expression engine, laying out optimized structs per message type to minimize memory use and generating a program for a specialized VM that interprets encoded Protobuf bytes as bytecode. It also supports profile-guided optimization, which tunes the parser to real-time data shapes for an additional 50-100% throughput gain. Developers building schema-driven systems can follow runtime parsing techniques like this on daily.dev."}},{"@type":"Question","name":"Why did Buf build hyperpb instead of relying on existing dynamic Protobuf parsers?","acceptedAnswer":{"@type":"Answer","text":"Buf needed fast broker-side, schema-aware validation for its Bufstream Kafka product, since existing dynamic parsing like dynamicpb was too slow and resource-intensive to validate incoming Protobuf messages against schemas at scale using Protovalidate. hyperpb was built to close this performance gap so validation could run efficiently on the broker side rather than relying solely on client-side validation. Teams weighing client-side versus broker-side data validation strategies can track this tradeoff on daily.dev."}}]} ```