ElixirStatus
Read post

Running Obscura on an NVIDIA GPU with Elixir, EXLA, and Lightning AI

A field report on validating the Obscura NLP library on an NVIDIA Tesla T4 GPU using Elixir, Nx, and EXLA on Lightning AI Studio. The author walks through a layered verification process: starting on CPU, switching to a T4, resolving an NVSHMEM ABI mismatch between the precompiled XLA archive and the Studio image, and confirming that compiled Nx operations actually execute on the GPU. Key steps include setting XLA_TARGET=cuda13, extracting a compatible NVSHMEM 3.3.24 package to fix the shared library failure, and verifying GPU execution via nvidia-smi and EXLA.Backend tensor results. The balanced and accurate Obscura profiles were both exercised, with warm inference times around 900ms and 1800ms respectively. The post is explicit about what the test proves and what it does not — it is a compatibility report, not a production benchmark.

    #webdev#elixir#cuda
Jul 30•10m read time•From hfiguera.github.io
Post cover image
Table of contents
What I wanted to proveStart on CPUSwitch to a T4 and inspect the machineEnable EXLA explicitlyThe NVSHMEM ABI failureProve CUDA before loading a modelPrepare the balanced profileExercise the accurate cascadeWhat the run provesWhat it does not proveReproduce the application path
279 Impressions
ElixirStatus's image
ElixirStatus

ElixirStatus offers insights into Elixir programming language, OTP framework, and functional program...

215 Followers

•

1.7K Upvotes

Would you recommend this post?

Copy link
WhatsApp
Facebook
X
New Squad
  • © 2026 Daily Dev Ltd.
  • Guidelines
  • Explore
  • Tags
  • Sources
  • Squads
  • Leaderboard