--- title: Snowflake OpenFlow: How To Create Custom Processors description: Building custom processors for Snowflake OpenFlow (NiFi-based) requires handling authentication, pagination, incremental sync, and rate limiting... canonical: https://daily.dev/posts/snowflake-openflow-how-to-create-custom-processors-fy6l1uees twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Snowflake OpenFlow: How To Create Custom Processors | daily.dev og:description: Building custom processors for Snowflake OpenFlow (NiFi-based) requires handling authentication, pagination, incremental sync, and rate limiting... og:url: https://daily.dev/posts/snowflake-openflow-how-to-create-custom-processors-fy6l1uees og:image: https://api.daily.dev/og/posts/fy6l1UeES.png og:image:alt: Snowflake OpenFlow: How To Create Custom Processors og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Snowflake OpenFlow: How To Create Custom Processors **[Snowflake Community](https://daily.dev/sources/snowflake_comm)** · 15 min read · 0 upvotes · 0 comments ## Summary Building custom processors for Snowflake OpenFlow (NiFi-based) requires handling authentication, pagination, incremental sync, and rate limiting systematically. The guide walks through creating a ContactsPlusSource processor that polls REST APIs with OAuth 2.0, cursor pagination, watermark-based incremental sync, and retry logic. Key principles include computing watermarks from record timestamps (not current time), implementing a single request wrapper with exponential backoff, adding safety caps to prevent infinite loops, and persisting state only after successful emission. The article covers the complete lifecycle from API research through packaging as NAR files, with emphasis on production reliability over quick scripts. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Turbocharge Your Modern Data Pipeline Using Snowflake Openflow](https://daily.dev/posts/turbocharge-your-modern-data-pipeline-using-snowflake-openflow-xl8ziqkdf) · Snowflake Community · 0 upvotes · 0 comments - [Snowflake Openflow: A Breakthrough in Enterprise Data Integration](https://daily.dev/posts/snowflake-openflow-a-breakthrough-in-enterprise-data-integration-qgdgrzkkg) · Snowflake Community · 0 upvotes · 0 comments - [From Whiteboard to Workflow: Building Diskover’s Openflow Connector](https://daily.dev/posts/from-whiteboard-to-workflow-building-diskover-s-openflow-connector-7hxo9woje) · Snowflake Community · 0 upvotes · 0 comments --- Tags: [#python](https://daily.dev/tags/python), [#rest-api](https://daily.dev/tags/rest-api), [#data-engineering](https://daily.dev/tags/data-engineering), [#snowflake](https://daily.dev/tags/snowflake), [#etl](https://daily.dev/tags/etl) [View this post on daily.dev](https://daily.dev/posts/snowflake-openflow-how-to-create-custom-processors-fy6l1uees) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Snowflake OpenFlow: How To Create Custom Processors","url":"https://daily.dev/posts/snowflake-openflow-how-to-create-custom-processors-fy6l1uees","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/snowflake-openflow-how-to-create-custom-processors-fy6l1uees"},"datePublished":"2026-01-27T15:09:32.126Z","dateModified":"2026-01-27T15:10:04.272Z","description":"Building custom processors for Snowflake OpenFlow (NiFi-based) requires handling authentication, pagination, incremental sync, and rate limiting...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/e046c379de25ffcffbdbe91cd2eb7dab?_a=AQAEulh","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/e046c379de25ffcffbdbe91cd2eb7dab?_a=AQAEulh","isAccessibleForFree":true,"articleSection":"Snowflake Community","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Snowflake Community","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/3eb5260f70bb4653be0f9581c0d937c8","url":"https://daily.dev/sources/snowflake_comm"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/snowflake-openflow-how-to-create-custom-processors-fy6l1uees","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"python,rest-api,data-engineering,snowflake,etl","timeRequired":"PT15M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Snowflake Community","item":"https://daily.dev/sources/snowflake_comm"},{"@type":"ListItem","position":3,"name":"Snowflake OpenFlow: How To Create Custom Processors"}]} ```