--- title: How Pinterest Built An Async Compute Platform for... description: Pinterest rebuilt their asynchronous job processing platform from Pinlater to Pacer to handle billions of daily tasks. The original system suffered from... canonical: https://daily.dev/posts/how-pinterest-built-an-async-compute-platform-for-billions-of-task-executions-krqnno7cl twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: How Pinterest Built An Async Compute Platform for Billions of Task Executions | daily.dev og:description: Pinterest rebuilt their asynchronous job processing platform from Pinlater to Pacer to handle billions of daily tasks. The original system suffered from... og:url: https://daily.dev/posts/how-pinterest-built-an-async-compute-platform-for-billions-of-task-executions-krqnno7cl og:image: https://api.daily.dev/og/posts/KRqNno7cL.png og:image:alt: How Pinterest Built An Async Compute Platform for Billions of Task Executions og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # How Pinterest Built An Async Compute Platform for Billions of Task Executions **[ByteByteGo](https://daily.dev/sources/bytebytego)** · 10 min read · 35 upvotes · 0 comments ## Summary Pinterest rebuilt their asynchronous job processing platform from Pinlater to Pacer to handle billions of daily tasks. The original system suffered from database lock contention, lack of queue isolation, and inefficient sharding. Pacer introduced dedicated dequeue broker services managed by Helix, eliminated lock contention through single-broker partition ownership, implemented in-memory caching for sub-millisecond latency, adopted adaptive sharding based on queue size, and isolated worker pods on Kubernetes with custom resource allocations per queue. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [How Pinterest Transfers Hundreds of Terabytes of Data With CDC](https://daily.dev/posts/how-pinterest-transfers-hundreds-of-terabytes-of-data-with-cdc-x1wxpwc1y) · ByteByteGo · 39 upvotes · 0 comments - [Pinterest Engineering Reduces Android CI Build Times by 36% with Runtime-Aware Sharding](https://daily.dev/posts/pinterest-engineering-reduces-android-ci-build-times-by-36-with-runtime-aware-sharding-bq3iy0uzb) · InfoQ · 0 upvotes · 0 comments - [Scaling Spark and Flink Shuffle at LinkedIn with Apache Celeborn](https://daily.dev/posts/scaling-spark-and-flink-shuffle-at-linkedin-with-apache-celeborn-ekiypbecm) · LinkedIn Engineering · 0 upvotes · 0 comments - [Apache Spark Resource Optimization: Lessons From Eight Million Jobs a Day](https://daily.dev/posts/apache-spark-resource-optimization-lessons-from-eight-million-jobs-a-day-56vchixir) · Salesforce Engineering · 7 upvotes · 0 comments --- Tags: [#career](https://daily.dev/tags/career), [#kubernetes](https://daily.dev/tags/kubernetes), [#distributed-systems](https://daily.dev/tags/distributed-systems), [#pinterest](https://daily.dev/tags/pinterest) [View this post on daily.dev](https://daily.dev/posts/how-pinterest-built-an-async-compute-platform-for-billions-of-task-executions-krqnno7cl) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"How Pinterest Built An Async Compute Platform for Billions of Task Executions","url":"https://daily.dev/posts/how-pinterest-built-an-async-compute-platform-for-billions-of-task-executions-krqnno7cl","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/how-pinterest-built-an-async-compute-platform-for-billions-of-task-executions-krqnno7cl"},"datePublished":"2026-01-20T18:49:10.353Z","dateModified":"2026-01-20T18:51:55.260Z","description":"Pinterest rebuilt their asynchronous job processing platform from Pinlater to Pacer to handle billions of daily tasks. The original system suffered from...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/a2b174530af9ade3058c972329aa241e?_a=AQAEulh","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/a2b174530af9ade3058c972329aa241e?_a=AQAEulh","isAccessibleForFree":true,"articleSection":"ByteByteGo","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"ByteByteGo","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/35be29234ee14d01a9cd049c52e12753","url":"https://daily.dev/sources/bytebytego"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/how-pinterest-built-an-async-compute-platform-for-billions-of-task-executions-krqnno7cl","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":35},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"career,kubernetes,distributed-systems,pinterest","timeRequired":"PT10M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"ByteByteGo","item":"https://daily.dev/sources/bytebytego"},{"@type":"ListItem","position":3,"name":"How Pinterest Built An Async Compute Platform for Billions of Task Executions"}]} ```