---
title: "Hugging Face Transformers and Habana Gaudi AWS DL1 Instances"
url: https://daily.dev/posts/hugging-face-transformers-and-habana-gaudi-aws-dl1-instances-iqe0akvrd
source_url: https://www.philschmid.de/habana-distributed-training
type: article
source: "Philipp Schmid"
published: 2026-05-31T07:41:05.077Z
updated: 2026-05-31T08:25:14.322Z
tags: ["machine-learning", "deep-learning"]
reading_time: 7
upvotes: 0
comments: 0
language: en
---

> ## Documentation Index
> Fetch the complete documentation index at: https://daily.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# Hugging Face Transformers and Habana Gaudi AWS DL1 Instances

**[Philipp Schmid](https://daily.dev/sources/philschmid)** · 7 min read · 0 upvotes · 0 comments

## Summary

A step-by-step tutorial on fine-tuning XLM-RoBERTa-large for multilingual text classification using Habana Gaudi HPUs on AWS DL1 instances. Covers environment setup, dataset preparation with the Amazon Science Massive dataset (7 languages, ~80K training samples), single-HPU training with GaudiTrainer, and scaling to distributed training across all 8 HPUs. Includes a cost-performance benchmark showing Habana Gaudi is 8.4x faster and 7.7x cheaper than a comparable NVIDIA V100-based p3.8xlarge instance for the same training job.

## Full article

daily.dev links to this article rather than hosting it. Read it at the original source: <https://www.philschmid.de/habana-distributed-training>

---

Tags: [#machine-learning](https://daily.dev/tags/machine-learning), [#deep-learning](https://daily.dev/tags/deep-learning)

[View this post on daily.dev](https://daily.dev/posts/hugging-face-transformers-and-habana-gaudi-aws-dl1-instances-iqe0akvrd)
