--- title: Medium | daily.dev description: A developer built D2C Pulse Tracker, a competitive pricing intelligence tool for Indian D2C beauty brands (Plum, Minimalist, mCaffeine, Dot & Key). The project... canonical: https://daily.dev/posts/medium-8gpu18v0q twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Medium | daily.dev og:description: A developer built D2C Pulse Tracker, a competitive pricing intelligence tool for Indian D2C beauty brands (Plum, Minimalist, mCaffeine, Dot & Key). The project... og:url: https://daily.dev/posts/medium-8gpu18v0q og:image: https://api.daily.dev/og/posts/8GPu18v0Q.png og:image:alt: Medium og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Medium **[Medium](https://daily.dev/sources/medium_js)** · 6 min read · 0 upvotes · 0 comments ## Summary A developer built D2C Pulse Tracker, a competitive pricing intelligence tool for Indian D2C beauty brands (Plum, Minimalist, mCaffeine, Dot & Key). The project leverages Shopify's public /products.json endpoint instead of fragile HTML scraping, uses Django, Celery Beat for scheduled scraping, PostgreSQL, Redis, and Docker. Key challenges included filtering fake promotional products, normalizing inconsistent vendor names, and fixing a multi-variant pricing bug. TF-IDF and KMeans clustering were attempted for product grouping but fell short due to vocabulary-based rather than category-based grouping, leading to a hybrid regex classifier approach. The final dashboard shows price history, brand comparisons, stock availability, and category browsing for ~540 products. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [A new app, The Mall, is building a universal feed for online shopping](https://daily.dev/posts/a-new-app-the-mall-is-building-a-universal-feed-for-online-shopping-hpg77p0lm) · TechCrunch · 0 upvotes · 0 comments --- Tags: [#machine-learning](https://daily.dev/tags/machine-learning), [#data-engineering](https://daily.dev/tags/data-engineering), [#django](https://daily.dev/tags/django), [#crawling](https://daily.dev/tags/crawling) [View this post on daily.dev](https://daily.dev/posts/medium-8gpu18v0q) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Medium","url":"https://daily.dev/posts/medium-8gpu18v0q","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/medium-8gpu18v0q"},"datePublished":"2026-07-22T08:10:33.521Z","dateModified":"2026-07-22T08:11:44.682Z","description":"A developer built D2C Pulse Tracker, a competitive pricing intelligence tool for Indian D2C beauty brands (Plum, Minimalist, mCaffeine, Dot & Key). The project...","image":"https://media.daily.dev/image/upload/s--OHB84bZF--/f_auto/v1722860399/public/Placeholder%2010","thumbnailUrl":"https://media.daily.dev/image/upload/s--OHB84bZF--/f_auto/v1722860399/public/Placeholder%2010","isAccessibleForFree":true,"articleSection":"Medium","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Medium","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/medium","url":"https://daily.dev/sources/medium_js"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/medium-8gpu18v0q","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"machine-learning,data-engineering,django,crawling","timeRequired":"PT6M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Medium","item":"https://daily.dev/sources/medium_js"},{"@type":"ListItem","position":3,"name":"Medium"}]} ```