---
title: "Enabling near real-time data analytics on the data lake"
url: https://daily.dev/posts/enabling-near-real-time-data-analytics-on-the-data-lake-ijm6wwv1h
source_url: https://engineering.grab.com/enabling-near-realtime-data-analytics
type: article
source: "Grab Tech Blog"
published: 2024-02-23T07:08:51.939Z
updated: 2024-05-09T09:06:08.895Z
tags: ["data-science", "data-analysis", "kafka", "spark", "apache-flink", "data-lake"]
reading_time: 7
upvotes: 0
comments: 0
language: en
---

> ## Documentation Index
> Fetch the complete documentation index at: https://daily.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# Enabling near real-time data analytics on the data lake

**[Grab Tech Blog](https://daily.dev/sources/grab)** · 7 min read · 0 upvotes · 0 comments

## Summary

This post discusses the challenges of handling frequent updates in a data lake and introduces the Hudi format as a solution. It explains the configurations optimized for high and low throughput sources and how to connect to Kafka and RDS data sources. It also highlights the importance of indexing for Hudi tables and the impact of the Hudi Data Ingestion solution on business metrics and fraud detection.

## Full article

daily.dev links to this article rather than hosting it. Read it at the original source: <https://engineering.grab.com/enabling-near-realtime-data-analytics>

## Similar posts on daily.dev

- [Don’t just attend KubeCon \+ CloudNativeCon, Merge Forward your experience\!](https://daily.dev/posts/don-t-just-attend-kubecon-cloudnativecon-merge-forward-your-experience--l0rpp73x8) · CNCF · 0 upvotes · 0 comments
- [Announcing H2 2026 KCDs](https://daily.dev/posts/announcing-h2-2026-kcds-m96goajm1) · CNCF · 1 upvotes · 0 comments
- [Two months of Open Community Groups](https://daily.dev/posts/two-months-of-open-community-groups-asf52zhbs) · CNCF · 0 upvotes · 0 comments

---

Tags: [#data-science](https://daily.dev/tags/data-science), [#data-analysis](https://daily.dev/tags/data-analysis), [#kafka](https://daily.dev/tags/kafka), [#spark](https://daily.dev/tags/spark), [#apache-flink](https://daily.dev/tags/apache-flink), [#data-lake](https://daily.dev/tags/data-lake)

[View this post on daily.dev](https://daily.dev/posts/enabling-near-real-time-data-analytics-on-the-data-lake-ijm6wwv1h)