---
title: "OTel-Arrow Phase 2: From Efficient Transport to Efficient Telemetry Pipelines"
url: https://daily.dev/posts/otel-arrow-phase-2-from-efficient-transport-to-efficient-telemetry-pipelines-frqqv1tp8
source_url: https://opentelemetry.io/blog/2026/otel-arrow-phase-2
type: article
source: "OpenTelemetry"
published: 2026-06-13T00:54:58.772Z
updated: 2026-06-13T02:19:30.307Z
tags: ["rust", "observability", "opentelemetry", "apache-arrow"]
reading_time: 12
upvotes: 15
comments: 0
language: en
---

> ## Documentation Index
> Fetch the complete documentation index at: https://daily.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# OTel-Arrow Phase 2: From Efficient Transport to Efficient Telemetry Pipelines

**[OpenTelemetry](https://daily.dev/sources/opentelemetry)** · 12 min read · 15 upvotes · 0 comments

## Summary

Phase 2 of OTel-Arrow explores using Apache Arrow not just as a wire transport format but as the internal representation for telemetry pipeline processing. The team built the OTel-Arrow Dataflow Engine, a Rust runtime using a thread-per-core, shared-nothing architecture with OTAP (OpenTelemetry Arrow Protocol) as its primary data path. Benchmarks show that keeping telemetry in Arrow columnar batches dramatically reduces CPU overhead for common operations like attribute renaming — the OTAP path achieves 10–20x higher throughput than the OTLP path on the same hardware by eliminating protobuf decode/encode cycles. The engine also scales near-linearly to 16 cores (14.6x speedup) and applies backpressure to keep memory bounded under overload. The project is currently incubation-stage and not recommended for production workloads, but the team is seeking community feedback on runtime semantics, processing APIs, and real-world pipeline designs.

## Full article

daily.dev links to this article rather than hosting it. Read it at the original source: <https://opentelemetry.io/blog/2026/otel-arrow-phase-2>

## Similar posts on daily.dev

- [From OTel to Rotel: Petabyte-scale tracing with 4x greater throughput](https://daily.dev/posts/from-otel-to-rotel-petabyte-scale-tracing-with-4x-greater-throughput-ki49hldso) · ClickHouse · 5 upvotes · 0 comments

---

Tags: [#rust](https://daily.dev/tags/rust), [#observability](https://daily.dev/tags/observability), [#opentelemetry](https://daily.dev/tags/opentelemetry), [#apache-arrow](https://daily.dev/tags/apache-arrow)

[View this post on daily.dev](https://daily.dev/posts/otel-arrow-phase-2-from-efficient-transport-to-efficient-telemetry-pipelines-frqqv1tp8)