--- title: Best NoSQL posts of 2024 | daily.dev description: The most upvoted NoSQL posts of 2024, curated by the daily.dev community. canonical: https://daily.dev/tags/nosql/best-of/2024 twitter:card: summary_large_image twitter:site: @dailydotdev og:url: https://daily.dev/tags/nosql/best-of/2024 og:type: website og:site_name: daily.dev og:title: Best NoSQL posts of 2024 | daily.dev og:description: The most upvoted NoSQL posts of 2024, curated by the daily.dev community. og:image: https://media.daily.dev/image/upload/s--VAY5ToZt--/f_auto/v1724209435/public/daily.dev%20-%20open%20graph --- # Best of NoSQL — 2024 1. 1 [](/posts/system-design-interview-design-whatsapp-zmrnpocfy "System Design Interview: Design WhatsApp") Article gitconnected · 2y System Design Interview: Design WhatsApp This post outlines how to design a high-level system architecture for a messaging app similar to WhatsApp. Key points include handling 10 billion messages daily with plans to double, using RESTful APIs for compatibility, employing WebSockets for real-time communication, and using message queues like Kafka or RabbitMQ for efficient message distribution. The databases considered are NoSQL options like Cassandra and DynamoDB, emphasizing sharding and partitioning for scalability. End-to-end encryption, handling peak traffic, and future enhancements like group chats and media handling are also discussed. 1.3K 37 2. 2 [](/posts/when-to-use-sql-vs-nosql-mwipbejry "When to use SQL vs NoSQL") Article DEV · 2y When to use SQL vs NoSQL Choosing between SQL and NoSQL databases can be daunting. SQL excels in data consistency and complex querying, while NoSQL offers scalability and flexibility. Common misconceptions include inflexibility of SQL databases and the lack of transactional support in NoSQL. 166 2 3. 3 [](/posts/guide-to-choose-a-database-for-your-next-design-a8al8n7bs "Guide To Choose A Database For Your Next Design") Article DEV · 2y Guide To Choose A Database For Your Next Design Guide to choosing the right database for your next design. Discusses the differences between relational and non-relational databases, their features and drawbacks, and provides guidance on choosing the appropriate database for specific requirements. 132 3 4. 4 [](/posts/a-primer-on-databases-as51wh8qu "A Primer on Databases") Article Substack · 2y A Primer on Databases Databases have been fundamental to software development for decades. The post discusses their history, from the invention of SQL databases to the rise of unstructured and cloud-based databases. It highlights the current database landscape, including the significance of transaction processing and analytics. The piece also touches on emerging technologies like vector databases, which are crucial for AI development. The author emphasizes that while the core technology of databases is not extremely complex, distribution and platformization will be key factors for future success in the database market. 125 1 5. 5 [](/posts/why-sql-is-forever-3r3w5k5sl "Why SQL is Forever") Article swizec.com · 2y Why SQL is Forever SQL and relational databases remain fundamental for transactional data, despite the advances and popularity of NoSQL technologies over the past decades. Many NoSQL systems have either been removed, adapted to include SQL/natively support transactions, or are mainly used for caching and analytics. This demonstrates the enduring flexibility and utility of SQL, including new features like JSON support and vector databases, which relational databases have successfully integrated while maintaining ACID properties. 121 7 6. 6 [](/posts/just-use-postgres-lri3afrxh "Just use Postgres") Article Hacker News · 2y Just use Postgres When developing a new application requiring persistent data storage, Postgres should be the default choice, especially for web applications. SQLite is suitable for desktop or mobile apps but not ideal for websites. NoSQL databases like DynamoDB, MongoDB, Cassandra, and others offer performance benefits if the access patterns are well-defined beforehand but are less flexible when handling evolving access needs. Redis is efficient for caching but can be used as a primary database with some trade-offs. Datomic and XTDB present innovative approaches with specific benefits and challenges. While advanced databases like Kafka and ElasticSearch excel in niche tasks, Postgres often suffices for general needs, potentially complemented by simpler built-in search functions. 62 13 7. 7 [](/posts/65-golang---build-rest-apis-with-golang-and-mongodb-mn91bralj "#65 Golang - Build REST APIs with Golang and MongoDB") Video codeHeim · 2y #65 Golang - Build REST APIs with Golang and MongoDB Learn how to build REST APIs using Golang and MongoDB. The guide covers setting up the MongoDB Go driver, structuring the project using MVC, connecting to the database, and implementing CRUD operations for movie records. The tutorial includes examples of inserting, updating, deleting, and querying data in MongoDB. 40 1 8. 8 [](/posts/designing-data-intensive-applications-book-wrgyyarlt "Designing Data Intensive Applications Book") Article Metadata · 2y Designing Data Intensive Applications Book The post discusses the book 'Designing Data Intensive Applications' as part of a book club, focusing on the first two chapters which cover reliability, scalability, and maintainability of applications, as well as different data models and query languages. It explains the historical context and comparisons between relational and document databases, including the benefits and drawbacks of each model, and the impact of these choices on application design. 36 1 9. 10 [](/posts/a-deep-dive-into-amazon-dynamodb-architecture-1jv8cjxh1 "A Deep Dive into Amazon DynamoDB Architecture") Article ByteByteGo · 3y A Deep Dive into Amazon DynamoDB Architecture Learn about the architecture and operational requirements of Amazon DynamoDB, a highly scalable and available NoSQL cloud database service. 29 10. 11 [](/posts/persisting-llm-chat-history-to-firestore-ctqug0f6y "Persisting LLM chat history to Firestore") Article Firebase Developers · 2y Persisting LLM chat history to Firestore Learn how to persist chat history for LLM powered applications using Firestore. The post walks through maintaining in-memory chat history with LangChain's RunnableWithMessageHistory and transitioning to persistent storage using Firestore. Users will understand how to enhance their chat applications by saving session history, making conversations more context-aware and meaningful. 25 11. 12 [](/posts/understanding-database-indexing-guq1oyv70 "Understanding Database Indexing") Article AWS in Plain English · 3y Understanding Database Indexing Database indexing is used to facilitate faster data retrieval by creating a separate data structure that contains pointers or references to the actual data in a table. Indexing helps optimize disk operations and improve search performance in databases. There are different types of indexing, such as B-tree indexing and LSM tree indexing. The sequence of columns in a composite index is important for efficient searching. Certain considerations should be made when using indexes in queries. 25 1 12. 13 [](/posts/embracing-simplicity-and-composability-in-data-engineering-bujn5gafy "Embracing Simplicity and Composability in Data Engineering") Article Medium · 2y Embracing Simplicity and Composability in Data Engineering The post highlights the importance of simplicity and composability in data engineering, drawing lessons from decades of industry experience. It discusses the Unix philosophy of treating data as files, the evolution of databases and NoSQL, and the complexity introduced by new ecosystems like Hadoop and Kubernetes. The post also critiques the over-complication of agile methodologies and stresses the necessity of adhering to fundamental principles to maintain flexibility and long-term value in software systems. 24 13. 14 [](/posts/sql-vs-nosql-viability-and-comparison-4klpn1e65 "🗄️🚀 SQL vs NoSQL: Viability and Comparison") Article Community Picks · 2y 🗄️🚀 SQL vs NoSQL: Viability and Comparison SQL databases like PostgreSQL offer rigid, table-based schemas and follow ACID principles, making them ideal for structured data and applications requiring consistent transactions. NoSQL databases like MongoDB and ElasticSearch provide flexible schemas, are horizontally scalable, and are suited for unstructured data, web apps, IoT, and real-time text searching. PostgreSQL is trusted in corporate sectors for reliability, MongoDB is favored by startups for scalability, and ElasticSearch is essential for real-time observability and log analysis. 23 14. 15 [](/posts/optimizing-elasticsearch-with-custom-routing-and-handling-routing-value-changes-g0oqijkpg "Optimizing Elasticsearch with Custom Routing and Handling Routing Value Changes") Article Trendyol Tech · 2y Optimizing Elasticsearch with Custom Routing and Handling Routing Value Changes Optimizing the integration between Couchbase and Elasticsearch, this piece discusses implementing custom routing to improve search performance. It highlights the benefits of routing queries based on itemNumbers, which reduces query scope, speeds up search operations, and efficiently uses resources. The post explains how to handle changes to itemNumbers, ensuring documents are correctly routed. Key insights from load testing reveal significant performance enhancements with custom routing, achieving faster query response times and higher query volumes. 22 15. 16 [](/posts/atproto-for-distributed-systems-engineers-t9atgoozt "ATProto for distributed systems engineers") Article Hacker News · 2y ATProto for distributed systems engineers AT Protocol aims to revolutionize social networking by decentralizing backend systems, allowing for shared state and user accounts across applications. It leverages eventual consistency and stream processing architectures to achieve high scalability. Key components include NoSQL data repositories, cryptographically signed records, and public APIs for external service integration. The protocol combines high-scale systems practices with peer-to-peer technology to create a highly scalable, open network. 21 16. 17 [](/posts/counting-billions-of-content-usage-at-canva-nynnyfwdk "Counting Billions of Content Usage at Canva") Article ByteByteGo · 2y Counting Billions of Content Usage at Canva Canva faced significant challenges in accurately counting content usage for their Creators Program due to the rapidly growing data volume which was originally handled by a MySQL-based system. The MySQL design, while simple, created scalability issues. Canva explored transitioning to DynamoDB but found it wouldn't solve their processing problems. Ultimately, they moved to an OLAP-based solution with Snowflake, significantly improving latency and handling billions of records efficiently. The new architecture provided numerous benefits including reduced latency, simplified incident handling, and decreased data storage needs, though it also introduced some new complexities in data transformation and infrastructure management. 20 17. 18 [](/posts/appwrite-database-tutorial-introduction-setup-and-integration-with-next-js-tsfxe07cn "Appwrite Database Tutorial: Introduction, Setup, and Integration with Next.js") Article Collections · 2y Appwrite Database Tutorial: Introduction, Setup, and Integration with Next.js Learn how to set up and integrate Appwrite, an open-source backend-as-a-service platform, with a Next.js application. This guide provides detailed steps for setting up a project, installing necessary dependencies, creating a client connection, and saving data to an Appwrite database. 17 18. 19 [](/posts/a-tale-of-database-performance-pains-egu80zbjq "A Tale of Database Performance Pains") Article P99 Conf · 2y A Tale of Database Performance Pains The post tells the story of Patrick's challenges with database performance after starting his own online business. He learned critical lessons about selecting the right database, managing provisioned throughput, setting up observability tools, ensuring regular backups, and understanding concurrency limitations. His experiences highlight the importance of thoroughly evaluating database options, preparing for unexpected traffic spikes, and scheduling maintenance operations during low-demand periods. 17 1 19. 20 [](/posts/mongodb-essentials-what-is-mongodb-collections-and-documents--kozoe2xyg "MongoDB Essentials: What is MongoDB, Collections, and Documents?") Article Dev Squad · 2y MongoDB Essentials: What is MongoDB, Collections, and Documents? MongoDB is a NoSQL database that uses a flexible, document-oriented approach to store data instead of the traditional table-based structure. A collection in MongoDB groups together multiple documents and acts like a folder in a file system. Documents, the basic unit of data in MongoDB, are similar to records in a spreadsheet or JSON objects, containing various fields and values representing the data. 16 20. 21 [](/posts/why-now-is-the-time-to-migrate-from-redis-to-valkey-lbqua4pd0 "Why Now Is the Time to Migrate From Redis to Valkey") Article The New Stack · 2y Why Now Is the Time to Migrate From Redis to Valkey Redis has shifted away from open-source licensing, prompting many to consider migrating to Valkey, a highly compatible fork. The switch is recommended now due to low migration costs and future uncertainties with Redis's licensing. Valkey is supported by major players like AWS and Google and offers the same open-source benefits, potentially saving costs and avoiding lock-in issues associated with Redis. 14 1 21. 22 [](/posts/announcing-toasty-an-async-orm-for-rust-9x5lc8od9 "Announcing Toasty, an async ORM for Rust") Article Tokio · 2y Announcing Toasty, an async ORM for Rust Toasty is an asynchronous ORM for Rust, prioritizing ease of use for SQL and NoSQL databases like DynamoDB and Cassandra. It generates Rust code from a schema file, allowing efficient data model management. Toasty aims to balance productivity with performance by minimizing the complexity of traits and lifetimes in its generated code. While still in the early stages and not yet suitable for real-world use, Toasty hopes to bridge the gap in Rust's ecosystem for higher-level web applications. 13 22. 23 [](/posts/how-to-set-up-a-fast-api-application-with-a-nosql-database-8gk9v9vrp "How to Set Up a Fast API Application with a NoSQL Database") Article DigitalOcean Community · 2y How to Set Up a Fast API Application with a NoSQL Database Learn how to set up a FastAPI application with a NoSQL database, specifically MongoDB, on an Ubuntu server. FastAPI is known for its speed and support for asynchronous programming, making it ideal for scalable modern applications. The guide covers prerequisites, Python and pip installation, creating a virtual environment, installing necessary libraries like FastAPI, Uvicorn, and Motor, and setting up MongoDB. It includes examples of creating API routes for AI prediction and MongoDB interactions, and how to run the application using Uvicorn. The post also touches on containerizing the application using Docker Compose. 13 23. 24 [](/posts/top-use-cases-for-dynamodb-in-2024-bxhedzy5u "Top Use Cases for DynamoDB in 2024") Article Tinybird · 2y Top Use Cases for DynamoDB in 2024 Amazon DynamoDB is a high-performance, scalable NoSQL key-value database integrated within the AWS ecosystem. It offers benefits such as serverless architecture, schemaless flexibility, low-latency writes and reads, load balancing, and high availability. Common use cases include gaming, content streaming, banking, mobile and web apps, and IoT. Though efficient, it has limitations in analytical processing, complex data modeling, and cloud vendor lock-in. Alternatives like MongoDB, Apache Cassandra, and Tinybird can help in scenarios where DynamoDB isn't suitable. 12 24. 25 [](/posts/fundamentals-of-data-engineering-masterclass-eekpecujz "Fundamentals Of Data Engineering Masterclass") Video YouTube · 2y Fundamentals Of Data Engineering Masterclass This Data Engineering masterclass covers the fundamentals of Data Engineering, including the life cycle, data generation, storage, database management, data modeling, and the distinction between SQL and NoSQL. It delves into data processing systems like OLTP and OLAP, ETL processes, and building data architecture from scratch. The session also explores data warehousing, dimensional modeling, data marts, data lakes, big data, cloud services (AWS, GCP, Azure), and key tools for data engineering such as Python, SQL, Apache Spark, Databricks, Apache Airflow, and Apache Kafka. Real-world architecture case studies on AWS and GCP are discussed as well. 13 [See all NoSQL archives](/tags/nosql/best-of) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@graph":[{"@type":"CollectionPage","@id":"https://daily.dev/tags/nosql/best-of/2024#page","url":"https://daily.dev/tags/nosql/best-of/2024","name":"Best NoSQL Posts of 2024","description":"The most upvoted NoSQL posts of 2024, curated by the daily.dev community.","isPartOf":{"@type":"WebSite","url":"https://daily.dev"}},{"@type":"ItemList","@id":"https://daily.dev/tags/nosql/best-of/2024#items","numberOfItems":24,"itemListElement":[{"@type":"ListItem","position":1,"url":"https://daily.dev/posts/system-design-interview-design-whatsapp-zmrnpocfy","name":"System Design Interview: Design WhatsApp"},{"@type":"ListItem","position":2,"url":"https://daily.dev/posts/when-to-use-sql-vs-nosql-mwipbejry","name":"When to use SQL vs NoSQL"},{"@type":"ListItem","position":3,"url":"https://daily.dev/posts/guide-to-choose-a-database-for-your-next-design-a8al8n7bs","name":"Guide To Choose A Database For Your Next Design"},{"@type":"ListItem","position":4,"url":"https://daily.dev/posts/a-primer-on-databases-as51wh8qu","name":"A Primer on Databases"},{"@type":"ListItem","position":5,"url":"https://daily.dev/posts/why-sql-is-forever-3r3w5k5sl","name":"Why SQL is Forever"},{"@type":"ListItem","position":6,"url":"https://daily.dev/posts/just-use-postgres-lri3afrxh","name":"Just use Postgres"},{"@type":"ListItem","position":7,"url":"https://daily.dev/posts/65-golang---build-rest-apis-with-golang-and-mongodb-mn91bralj","name":"#65 Golang - Build REST APIs with Golang and MongoDB"},{"@type":"ListItem","position":8,"url":"https://daily.dev/posts/designing-data-intensive-applications-book-wrgyyarlt","name":"Designing Data Intensive Applications Book"},{"@type":"ListItem","position":10,"url":"https://daily.dev/posts/a-deep-dive-into-amazon-dynamodb-architecture-1jv8cjxh1","name":"A Deep Dive into Amazon DynamoDB Architecture"},{"@type":"ListItem","position":11,"url":"https://daily.dev/posts/persisting-llm-chat-history-to-firestore-ctqug0f6y","name":"Persisting LLM chat history to Firestore"},{"@type":"ListItem","position":12,"url":"https://daily.dev/posts/understanding-database-indexing-guq1oyv70","name":"Understanding Database Indexing"},{"@type":"ListItem","position":13,"url":"https://daily.dev/posts/embracing-simplicity-and-composability-in-data-engineering-bujn5gafy","name":"Embracing Simplicity and Composability in Data Engineering"},{"@type":"ListItem","position":14,"url":"https://daily.dev/posts/sql-vs-nosql-viability-and-comparison-4klpn1e65","name":"🗄️🚀 SQL vs NoSQL: Viability and Comparison"},{"@type":"ListItem","position":15,"url":"https://daily.dev/posts/optimizing-elasticsearch-with-custom-routing-and-handling-routing-value-changes-g0oqijkpg","name":"Optimizing Elasticsearch with Custom Routing and Handling Routing Value Changes"},{"@type":"ListItem","position":16,"url":"https://daily.dev/posts/atproto-for-distributed-systems-engineers-t9atgoozt","name":"ATProto for distributed systems engineers"},{"@type":"ListItem","position":17,"url":"https://daily.dev/posts/counting-billions-of-content-usage-at-canva-nynnyfwdk","name":"Counting Billions of Content Usage at Canva"},{"@type":"ListItem","position":18,"url":"https://daily.dev/posts/appwrite-database-tutorial-introduction-setup-and-integration-with-next-js-tsfxe07cn","name":"Appwrite Database Tutorial: Introduction, Setup, and Integration with Next.js"},{"@type":"ListItem","position":19,"url":"https://daily.dev/posts/a-tale-of-database-performance-pains-egu80zbjq","name":"A Tale of Database Performance Pains"},{"@type":"ListItem","position":20,"url":"https://daily.dev/posts/mongodb-essentials-what-is-mongodb-collections-and-documents--kozoe2xyg","name":"MongoDB Essentials: What is MongoDB, Collections, and Documents?"},{"@type":"ListItem","position":21,"url":"https://daily.dev/posts/why-now-is-the-time-to-migrate-from-redis-to-valkey-lbqua4pd0","name":"Why Now Is the Time to Migrate From Redis to Valkey"},{"@type":"ListItem","position":22,"url":"https://daily.dev/posts/announcing-toasty-an-async-orm-for-rust-9x5lc8od9","name":"Announcing Toasty, an async ORM for Rust"},{"@type":"ListItem","position":23,"url":"https://daily.dev/posts/how-to-set-up-a-fast-api-application-with-a-nosql-database-8gk9v9vrp","name":"How to Set Up a Fast API Application with a NoSQL Database"},{"@type":"ListItem","position":24,"url":"https://daily.dev/posts/top-use-cases-for-dynamodb-in-2024-bxhedzy5u","name":"Top Use Cases for DynamoDB in 2024"},{"@type":"ListItem","position":25,"url":"https://daily.dev/posts/fundamentals-of-data-engineering-masterclass-eekpecujz","name":"Fundamentals Of Data Engineering Masterclass"}]},{"@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Tags","item":"https://daily.dev/tags"},{"@type":"ListItem","position":3,"name":"NoSQL","item":"https://daily.dev/tags/nosql"},{"@type":"ListItem","position":4,"name":"Best of","item":"https://daily.dev/tags/nosql/best-of"},{"@type":"ListItem","position":5,"name":"2024"}]}]} ```