--- title: Thinking of ACE? We Can Do It with Fewer Tokens | daily.dev description: IBM Research compares ALTK-Evolve and ACE (Agentic Context Engineering), two systems that let LLM agents learn from their own past trajectories without weight... canonical: https://daily.dev/posts/thinking-of-ace-we-can-do-it-with-fewer-tokens-0stmkpisz twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Thinking of ACE? We Can Do It with Fewer Tokens | daily.dev og:description: IBM Research compares ALTK-Evolve and ACE (Agentic Context Engineering), two systems that let LLM agents learn from their own past trajectories without weight... og:url: https://daily.dev/posts/thinking-of-ace-we-can-do-it-with-fewer-tokens-0stmkpisz og:image: https://api.daily.dev/og/posts/0STmkPISz.png og:image:alt: Thinking of ACE? We Can Do It with Fewer Tokens og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Thinking of ACE? We Can Do It with Fewer Tokens **[Hugging Face](https://daily.dev/sources/huggingface)** · 8 min read · 1 upvotes · 0 comments ## Summary IBM Research compares ALTK-Evolve and ACE (Agentic Context Engineering), two systems that let LLM agents learn from their own past trajectories without weight updates. Both systems avoid compressing learned lessons into summaries, instead maintaining countable guidelines or playbooks. The key difference is delivery: ACE injects its full playbook on every inference step, while ALTK-Evolve selectively retrieves only the guidelines relevant to the current task and model capability. On the AppWorld benchmark with 168 tasks, ALTK-Evolve achieves 89.3 TGC vs ACE's 80.4 on DeepSeek-V3.2 at ~40% of ACE's token cost (263K vs 634K tokens/task). On the weaker gpt-oss-120b model, accuracy is roughly tied (56.0 vs 54.8 TGC) but ALTK-Evolve uses about one-seventh the tokens (116K vs 777K). The post argues that calibrated delivery — matching the volume of injected guidelines to what a given model can actually absorb — is the key to both efficiency and accuracy gains. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Questions this post answers ### How does ALTK-Evolve compare to ACE in token usage and accuracy on the AppWorld benchmark? On AppWorld test_normal (168 tasks) with DeepSeek-V3.2, ALTK-Evolve achieves 89.3 TGC vs ACE's 80.4 while using 263K tokens per task compared to ACE's 634K — roughly 40% of the cost. On the weaker gpt-oss-120b model, accuracy is nearly tied (56.0 vs 54.8 TGC) but ALTK-Evolve uses only 116K tokens versus ACE's 777K, about one-seventh the cost. _Teams optimizing LLM agent inference costs track benchmarks like these on daily.dev._ ### What is the difference between ACE and ALTK-Evolve in how they deliver learned lessons to an agent at inference time? ACE injects its full playbook on every inference step regardless of model or task. ALTK-Evolve treats delivery as a dial: it sends a small fixed core of high-support guidelines plus a handful selected per task via cosine or LLM-guided retrieval, or the full consolidated set when the model has sufficient capacity. This selective delivery is the primary source of ALTK-Evolve's token savings. _Developers building agentic systems find the latest research on memory and retrieval strategies on daily.dev._ ### Why does injecting fewer guidelines help weaker LLMs in agentic memory systems? A large context overwhelms a weaker model rather than helping it. On gpt-oss-120b, ACE's full playbook injection (777K tokens/task) gives it an edge on Easy and Medium tasks but falls behind on Hard tasks, where curated retrieval of ~29 guidelines (116K tokens/task) lets the model focus on the right lesson rather than wade through all of them — and Hard tasks decide the aggregate score. _Engineers choosing between agentic memory architectures for different model tiers follow this research on daily.dev._ ## Similar posts on daily.dev - [Researchers Introduce ACE, a Framework for Self-Improving LLM Contexts](https://daily.dev/posts/researchers-introduce-ace-a-framework-for-self-improving-llm-contexts-isr1ouohi) · InfoQ · 1 upvotes · 0 comments - [How Much Memory Does Your Agent Actually Need?](https://daily.dev/posts/how-much-memory-does-your-agent-actually-need--w9bapy7xf) · Hugging Face · 1 upvotes · 0 comments - [Analytics Context Engineering for LLM](https://daily.dev/posts/analytics-context-engineering-for-llm-aapm7ljoy) · Cisco · 1 upvotes · 1 comments --- Tags: [#ai-agents](https://daily.dev/tags/ai-agents), [#rag](https://daily.dev/tags/rag), [#context-engineering](https://daily.dev/tags/context-engineering) [View this post on daily.dev](https://daily.dev/posts/thinking-of-ace-we-can-do-it-with-fewer-tokens-0stmkpisz) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Thinking of ACE? We Can Do It with Fewer Tokens","url":"https://daily.dev/posts/thinking-of-ace-we-can-do-it-with-fewer-tokens-0stmkpisz","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/thinking-of-ace-we-can-do-it-with-fewer-tokens-0stmkpisz"},"datePublished":"2026-08-11T13:37:31.075Z","dateModified":"2026-08-11T13:38:06.063Z","description":"IBM Research compares ALTK-Evolve and ACE (Agentic Context Engineering), two systems that let LLM agents learn from their own past trajectories without weight...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/6a7c5e02fc3fc12792d9421941b76bd0?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/6a7c5e02fc3fc12792d9421941b76bd0?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"Hugging Face","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Hugging Face","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/f1f55c67d81a4330acf5b90b26b0c8e1","url":"https://daily.dev/sources/huggingface"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/thinking-of-ace-we-can-do-it-with-fewer-tokens-0stmkpisz","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":1},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"ai-agents,rag,context-engineering","timeRequired":"PT8M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Hugging Face","item":"https://daily.dev/sources/huggingface"},{"@type":"ListItem","position":3,"name":"Thinking of ACE? We Can Do It with Fewer Tokens"}]} {"@context":"https://schema.org","@type":"FAQPage","@id":"https://daily.dev/posts/thinking-of-ace-we-can-do-it-with-fewer-tokens-0stmkpisz#faq","mainEntity":[{"@type":"Question","name":"How does ALTK-Evolve compare to ACE in token usage and accuracy on the AppWorld benchmark?","acceptedAnswer":{"@type":"Answer","text":"On AppWorld test_normal (168 tasks) with DeepSeek-V3.2, ALTK-Evolve achieves 89.3 TGC vs ACE's 80.4 while using 263K tokens per task compared to ACE's 634K — roughly 40% of the cost. On the weaker gpt-oss-120b model, accuracy is nearly tied (56.0 vs 54.8 TGC) but ALTK-Evolve uses only 116K tokens versus ACE's 777K, about one-seventh the cost. Teams optimizing LLM agent inference costs track benchmarks like these on daily.dev."}},{"@type":"Question","name":"What is the difference between ACE and ALTK-Evolve in how they deliver learned lessons to an agent at inference time?","acceptedAnswer":{"@type":"Answer","text":"ACE injects its full playbook on every inference step regardless of model or task. ALTK-Evolve treats delivery as a dial: it sends a small fixed core of high-support guidelines plus a handful selected per task via cosine or LLM-guided retrieval, or the full consolidated set when the model has sufficient capacity. This selective delivery is the primary source of ALTK-Evolve's token savings. Developers building agentic systems find the latest research on memory and retrieval strategies on daily.dev."}},{"@type":"Question","name":"Why does injecting fewer guidelines help weaker LLMs in agentic memory systems?","acceptedAnswer":{"@type":"Answer","text":"A large context overwhelms a weaker model rather than helping it. On gpt-oss-120b, ACE's full playbook injection (777K tokens/task) gives it an edge on Easy and Medium tasks but falls behind on Hard tasks, where curated retrieval of ~29 guidelines (116K tokens/task) lets the model focus on the right lesson rather than wade through all of them — and Hard tasks decide the aggregate score. Engineers choosing between agentic memory architectures for different model tiers follow this research on daily.dev."}}]} ```