--- title: "What is InfiniBand?" url: https://daily.dev/posts/what-is-infiniband--2yfbitnsb source_url: https://ubuntu.com/blog/what-is-infiniband type: article source: "Ubuntu" published: 2026-06-02T13:23:06.199Z updated: 2026-06-02T13:23:34.559Z tags: ["distributed-systems"] reading_time: 12 upvotes: 0 comments: 0 language: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # What is InfiniBand? **[Ubuntu](https://daily.dev/sources/ubuntu)** · 12 min read · 0 upvotes · 0 comments ## Summary InfiniBand is a purpose-built network interconnect designed for high bandwidth and low, predictable latency between compute, storage, and accelerator nodes. Unlike TCP/IP stacks, it integrates RDMA natively, allowing applications to exchange messages directly into memory without CPU or kernel involvement via queue pairs and a verbs-based programming model. The fabric enforces lossless behavior through credit-based flow control, avoiding retransmissions and tail-latency spikes common in Ethernet environments. Key use cases include distributed AI training, HPC simulations, NVMe over Fabrics, and GPU Direct RDMA. Operational challenges include fat-tree topology design and cabling symmetry, Subnet Manager placement and failover, software stack alignment (OFED, kernel drivers, HCA firmware), avoiding unintended IPoIB fallback, and continuous validation using tools like ibdiagnet and perftest benchmarks. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [What is RDMA?](https://daily.dev/posts/what-is-rdma--t1vgee9hu) · Ubuntu · 0 upvotes · 0 comments - [AI in Multiple GPUs: How GPUs Communicate](https://daily.dev/posts/ai-in-multiple-gpus-how-gpus-communicate-kz6wkr6uj) · Towards Data Science · 0 upvotes · 0 comments - [NVIDIA NVLink: The Scale-Up Network for AI Factories](https://daily.dev/posts/nvidia-nvlink-the-scale-up-network-for-ai-factories-ebmkgal2a) · NVIDIA Developer · 0 upvotes · 0 comments - [Why AI inference is becoming a networking issue](https://daily.dev/posts/why-ai-inference-is-becoming-a-networking-issue-qdlmrixvx) · Cisco · 1 upvotes · 0 comments --- Tags: [#distributed-systems](https://daily.dev/tags/distributed-systems) [View this post on daily.dev](https://daily.dev/posts/what-is-infiniband--2yfbitnsb)