<!-- mobian-agent-page publisher="dailydev" canonical="https://daily.dev/posts/kerberizing-hadoop-clusters-at-twitter-ct4rcmjik" -->

---
title: Kerberizing Hadoop Clusters at Twitter | daily.dev
description: Twitter faced challenges in kerberizing their Hadoop clusters, but they were able to enforce strong Authentication, Authorization, and Accountability for...
canonical: https://daily.dev/posts/kerberizing-hadoop-clusters-at-twitter-ct4rcmjik
twitter:card: summary_large_image
twitter:site: @dailydotdev
og:type: website
og:site_name: daily.dev
og:title: Kerberizing Hadoop Clusters at Twitter | daily.dev
og:description: Twitter faced challenges in kerberizing their Hadoop clusters, but they were able to enforce strong Authentication, Authorization, and Accountability for...
og:url: https://daily.dev/posts/kerberizing-hadoop-clusters-at-twitter-ct4rcmjik
og:image: https://api.daily.dev/og/posts/Ct4RCmJik.png
og:image:alt: Kerberizing Hadoop Clusters at Twitter
og:image:width: 1200
og:image:height: 630
og:locale: en
---

> ## Documentation Index
> Fetch the complete documentation index at: https://daily.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# Kerberizing Hadoop Clusters at Twitter

**[Twitter Engineering](https://daily.dev/sources/twitter)** · 10 min read · 0 upvotes · 0 comments

## Summary

Twitter faced challenges in kerberizing their Hadoop clusters, but they were able to enforce strong Authentication, Authorization, and Accountability for Hadoop data access by making code changes, developing keytab generation and distribution services, and implementing delegation token renewal. They took a multi-pronged approach to kerberizing their clusters one at a time, with minimal disruption to customer use cases.

## Full article

daily.dev links to this article rather than hosting it. Read it at the original source: <https://blog.x.com/engineering/en_us/topics/infrastructure/2023/kerberizing-hadoop-clusters-at-twitter>

---

Tags: [#authentication](https://daily.dev/tags/authentication), [#big-data](https://daily.dev/tags/big-data), [#authorization](https://daily.dev/tags/authorization), [#apache-hadoop](https://daily.dev/tags/apache-hadoop), [#kerberos](https://daily.dev/tags/kerberos)

[View this post on daily.dev](https://daily.dev/posts/kerberizing-hadoop-clusters-at-twitter-ct4rcmjik)

```json
{"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]}
{"@context":"https://schema.org","@type":"TechArticle","headline":"Kerberizing Hadoop Clusters at Twitter","url":"https://daily.dev/posts/kerberizing-hadoop-clusters-at-twitter-ct4rcmjik","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/kerberizing-hadoop-clusters-at-twitter-ct4rcmjik"},"datePublished":"2024-02-14T00:11:09.726Z","dateModified":"2024-05-09T09:28:18.744Z","description":"Twitter faced challenges in kerberizing their Hadoop clusters, but they were able to enforce strong Authentication, Authorization, and Accountability for...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/da1628b7e034040480b783b852745e66?_a=AQAEufR","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/da1628b7e034040480b783b852745e66?_a=AQAEufR","isAccessibleForFree":true,"articleSection":"Twitter Engineering","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Twitter Engineering","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/twitter","url":"https://daily.dev/sources/twitter"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/kerberizing-hadoop-clusters-at-twitter-ct4rcmjik","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"authentication,big-data,authorization,apache-hadoop,kerberos","timeRequired":"PT10M"}
{"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Twitter Engineering","item":"https://daily.dev/sources/twitter"},{"@type":"ListItem","position":3,"name":"Kerberizing Hadoop Clusters at Twitter"}]}
```

