--- title: Best Big Data posts of 2022 | daily.dev description: The most upvoted Big Data posts of 2022, curated by the daily.dev community. canonical: https://daily.dev/tags/big-data/best-of/2022 twitter:card: summary_large_image twitter:site: @dailydotdev og:url: https://daily.dev/tags/big-data/best-of/2022 og:type: website og:site_name: daily.dev og:title: Best Big Data posts of 2022 | daily.dev og:description: The most upvoted Big Data posts of 2022, curated by the daily.dev community. og:image: https://media.daily.dev/image/upload/s--VAY5ToZt--/f_auto/v1724209435/public/daily.dev%20-%20open%20graph --- # Best of Big Data — 2022 1. 1 [](/posts/building-a-simple-search-api-oa4lmj5rc "Building a simple search API") Article Mercari Engineering · 5y Building a simple search API This article is for day 5 of Merpay Tech Openness Month 2021\. The solution covered would allow for a search API to be easily used in a project. Data is loaded from BigQuery (the data source to search) into Apache Solr (the search engine) The search server runs on Cloud Run. Cloud Dataflow is used for search index generation. 96 2 2. 2 [](/posts/the-guide-to-modern-data-architecture-7p2kchung "The Guide to Modern Data Architecture") Article Community Picks · 4y The Guide to Modern Data Architecture This is an updated version of a post we originally published in 2020\. We argue that core data processing systems have remained relatively stable over the past year, while supporting tools and applications have proliferated rapidly. We explore the hypothesis that platforms are beginning to emerge in the data ecosystem, and that this helps explain the particular patterns we’re seeing. 96 2 3. 3 [](/posts/the-guide-to-modern-data-architecture-06mruwxtp "The Guide to Modern Data Architecture") Article Pointer · 5y The Guide to Modern Data Architecture This is an updated version of a post we originally published in 2020\. We argue that core data processing systems have remained relatively stable over the past year, while supporting tools and applications have proliferated rapidly. We explore the hypothesis that platforms are beginning to emerge in the data ecosystem, and that this helps explain the particular patterns we’re seeing. 71 2 4. 4 [](/posts/ep36-types-of-databases-and-use-cases-lhi6tgywf "EP36: Types of Databases and Use Cases") Article ByteByteGo · 4y EP36: Types of Databases and Use Cases Ilum is the Spark cluster manager and monitoring tool. Ilum provides an all-in-one solution for: Apache Spark Cluster management and monitoring service Hadoop. The core of ElasticSearch lies in the data structure and indexing. It is important to understand how ES builds the term dictionary using LSM Tree. 50 5. 5 [](/posts/how-the-ai-behind-tiktok-works-keun4drma "How the AI Behind TikTok Works") Article DZone · 4y How the AI Behind TikTok Works TikTok is a video-sharing app that let users create and share short videos. It impresses users with its personalized "just for you’ recommendations precisely. Behind it, it is powered by artificial intelligence technologies. A range of machine learning and deep learning algorithms and techniques are applied to build models and generate recommendations. 19 1 6. 6 [](/posts/the-best-programming-conferences-to-attend-in-2022-oy6ptevba "The Best Programming Conferences to Attend in 2022") Article Honeypot · 4y The Best Programming Conferences to Attend in 2022 Developers thrive by connecting with other programmers, who may then become business partners or facilitators when looking for a job. CNBC estimates that 80% of jobs are filled thanks to networking, instead of through a traditional job opening system. Programming conferences are places to connect with people who want to dive deep into specific know-how about a programming language. 16 1 7. 7 [](/posts/anomaly-detection-in-sql-lsqi1kc4k "Anomaly Detection in SQL") Article Towards Data Science · 5y Anomaly Detection in SQL Anomaly Detection with Z-Scoring is a simple, unsupervised statistical technique for flagging outliers. Z-scoring is a powerful, minimalist anomaly detection model that can be implemented quickly and flexibly in the data warehouse. The model is based on a fictitious transaction-level table in Snowflake. 12 [See all Big Data archives](/tags/big-data/best-of) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@graph":[{"@type":"CollectionPage","@id":"https://daily.dev/tags/big-data/best-of/2022#page","url":"https://daily.dev/tags/big-data/best-of/2022","name":"Best Big Data Posts of 2022","description":"The most upvoted Big Data posts of 2022, curated by the daily.dev community.","isPartOf":{"@type":"WebSite","url":"https://daily.dev"}},{"@type":"ItemList","@id":"https://daily.dev/tags/big-data/best-of/2022#items","numberOfItems":7,"itemListElement":[{"@type":"ListItem","position":1,"url":"https://daily.dev/posts/building-a-simple-search-api-oa4lmj5rc","name":"Building a simple search API"},{"@type":"ListItem","position":2,"url":"https://daily.dev/posts/the-guide-to-modern-data-architecture-7p2kchung","name":"The Guide to Modern Data Architecture"},{"@type":"ListItem","position":3,"url":"https://daily.dev/posts/the-guide-to-modern-data-architecture-06mruwxtp","name":"The Guide to Modern Data Architecture"},{"@type":"ListItem","position":4,"url":"https://daily.dev/posts/ep36-types-of-databases-and-use-cases-lhi6tgywf","name":"EP36: Types of Databases and Use Cases"},{"@type":"ListItem","position":5,"url":"https://daily.dev/posts/how-the-ai-behind-tiktok-works-keun4drma","name":"How the AI Behind TikTok Works"},{"@type":"ListItem","position":6,"url":"https://daily.dev/posts/the-best-programming-conferences-to-attend-in-2022-oy6ptevba","name":"The Best Programming Conferences to Attend in 2022"},{"@type":"ListItem","position":7,"url":"https://daily.dev/posts/anomaly-detection-in-sql-lsqi1kc4k","name":"Anomaly Detection in SQL"}]},{"@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Tags","item":"https://daily.dev/tags"},{"@type":"ListItem","position":3,"name":"Big Data","item":"https://daily.dev/tags/big-data"},{"@type":"ListItem","position":4,"name":"Best of","item":"https://daily.dev/tags/big-data/best-of"},{"@type":"ListItem","position":5,"name":"2022"}]}]} ```