---
title: "Inkling by Thinking Machines now available on Modal"
url: https://daily.dev/posts/inkling-by-thinking-machines-now-available-on-modal-ck3cq5eu7
source_url: https://modal.com/blog/inkling-by-thinking-machines-labs-now-available-on-modal
type: article
source: "Modal"
published: 2026-07-15T18:52:12.710Z
updated: 2026-07-16T02:12:44.794Z
tags: ["ai-inference", "llm", "mixture-of-experts", "multimodal"]
reading_time: 4
upvotes: 0
comments: 0
language: en
---

> ## Documentation Index
> Fetch the complete documentation index at: https://daily.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# Inkling by Thinking Machines now available on Modal

**[Modal](https://daily.dev/sources/modal_labs)** · 4 min read · 0 upvotes · 0 comments

## Summary

Thinking Machines has released Inkling, a general-purpose multimodal model with 975B total parameters (41B active), a 1M token context window, and native text, image, and audio input support. Modal partnered with Thinking Machines for day-zero availability as a Managed Endpoint with token-based pricing. Inkling uses a mixture-of-experts architecture with a local attention layout — five sliding window attention layers for every one global attention layer — enabling high compute efficiency. Modal further accelerated inference using a custom DFlash speculator tuned to Inkling's architecture, achieving 250 tokens/second per user at 2.5M TPM on 8x B200 GPUs, 67% faster than the model's built-in speculative path. The DFlash speculator uses block diffusion drafting with all-local attention and causal layers for better kernel support, keeping drafter cost flat as blocks grow.

## Full article

daily.dev links to this article rather than hosting it. Read it at the original source: <https://modal.com/blog/inkling-by-thinking-machines-labs-now-available-on-modal>

---

Tags: [#ai-inference](https://daily.dev/tags/ai-inference), [#llm](https://daily.dev/tags/llm), [#mixture-of-experts](https://daily.dev/tags/mixture-of-experts), [#multimodal](https://daily.dev/tags/multimodal)

[View this post on daily.dev](https://daily.dev/posts/inkling-by-thinking-machines-now-available-on-modal-ck3cq5eu7)