--- title: Unleashing gst-python-ml: Python-powered ML analytics... description: gst-python-ml is a new pure Python framework that makes it easy to build ML-enabled GStreamer video analytics pipelines. With a few lines of Python or a single... canonical: https://daily.dev/posts/unleashing-gst-python-ml-python-powered-ml-analytics-for-gstreamer-pipelines-myboar0ue twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Unleashing gst-python-ml: Python-powered ML analytics for GStreamer pipelines | daily.dev og:description: gst-python-ml is a new pure Python framework that makes it easy to build ML-enabled GStreamer video analytics pipelines. With a few lines of Python or a single... og:url: https://daily.dev/posts/unleashing-gst-python-ml-python-powered-ml-analytics-for-gstreamer-pipelines-myboar0ue og:image: https://api.daily.dev/og/posts/mYboar0ue.png og:image:alt: Unleashing gst-python-ml: Python-powered ML analytics for GStreamer pipelines og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Unleashing gst-python-ml: Python-powered ML analytics for GStreamer pipelines **[Collabora Blog](https://daily.dev/sources/collabora)** · 4 min read · 1 upvotes · 0 comments ## Summary gst-python-ml is a new pure Python framework that makes it easy to build ML-enabled GStreamer video analytics pipelines. With a few lines of Python or a single gst-launch-1.0 command, developers can run complex models across multiple streams, supporting YOLO tracking, bird's-eye-view generation, and video captioning via hybrid vision-language models like Phi3.5 Vision. The framework is available as a PyPI package and works with GStreamer 1.24 and later on any Linux distribution. Collabora, which has contributed ONNX and LiteRT inference support to upstream GStreamer, is actively seeking contributors and partners. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Questions this post answers ### What is gst-python-ml and how do I build a Yolo tracking pipeline with GStreamer? gst-python-ml is a pure Python framework from Collabora for building ML-enabled GStreamer pipelines using standard Python packages like torch, transformers, and ultralytics. A Yolo11m tracking pipeline can be run with a single gst-launch-1.0 command using the pyml_yolo and pyml_overlay elements after installing the required GStreamer plugins and the gst-python-ml PyPI package. _Track new GStreamer ML tooling releases like this one on daily.dev as your video pipeline stack evolves._ ### Which GStreamer versions are compatible with the gst-python-ml package? gst-python-ml works with any Linux distribution's GStreamer packages starting from version 1.24 onward. It is distributed as a PyPI package and its elements function as first-class GStreamer elements that can be added to any existing GStreamer pipeline. _Developers planning GStreamer upgrades can follow compatibility notes like this on daily.dev._ ### Can GStreamer pipelines generate automatic video captions using vision-language models? Yes, gst-python-ml supports automatic video captioning using the Phi3.5 Vision model, captioning each frame and allowing further processing to summarize a game or detect significant events such as goals. Collabora states this hybrid vision plus language model capability is not available in any other GStreamer-based analytics framework, open source or commercial. _Anyone evaluating vision-language captioning tools for media pipelines can compare options via daily.dev._ ## Similar posts on daily.dev - [Introducing GstPipelineStudio 0.6.0](https://daily.dev/posts/introducing-gstpipelinestudio-0-6-0-ofhghxgo9) · Planet Igalia · 0 upvotes · 0 comments - [Building a Custom GStreamer Plugin for NVIDIA DeepStream](https://daily.dev/posts/building-a-custom-gstreamer-plugin-for-nvidia-deepstream-ndjznitko) · Towards Data Science · 0 upvotes · 0 comments - [GStreamer 1.28.1 Adds Whisper-Based Speech-To-Text, AV1 Stateful V4L2 Decoder Support](https://daily.dev/posts/gstreamer-1-28-1-adds-whisper-based-speech-to-text-av1-stateful-v4l2-decoder-support-njs5v7ce9) · Phoronix · 0 upvotes · 0 comments - [GStreamer 1.28 Released With More Rust Code](https://daily.dev/posts/gstreamer-1-28-released-with-more-rust-code-ukhdu9ibb) · Phoronix · 0 upvotes · 0 comments --- Tags: [#machine-learning](https://daily.dev/tags/machine-learning), [#python](https://daily.dev/tags/python), [#computer-vision](https://daily.dev/tags/computer-vision), [#gstreamer](https://daily.dev/tags/gstreamer) [View this post on daily.dev](https://daily.dev/posts/unleashing-gst-python-ml-python-powered-ml-analytics-for-gstreamer-pipelines-myboar0ue) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Unleashing gst-python-ml: Python-powered ML analytics for GStreamer pipelines","url":"https://daily.dev/posts/unleashing-gst-python-ml-python-powered-ml-analytics-for-gstreamer-pipelines-myboar0ue","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/unleashing-gst-python-ml-python-powered-ml-analytics-for-gstreamer-pipelines-myboar0ue"},"datePublished":"2026-08-11T08:57:24.322Z","dateModified":"2026-09-14T08:32:34.420Z","description":"gst-python-ml is a new pure Python framework that makes it easy to build ML-enabled GStreamer video analytics pipelines. With a few lines of Python or a single...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/0b9577b95aaa212e738fbb68b1447c5a?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/0b9577b95aaa212e738fbb68b1447c5a?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"Collabora Blog","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Collabora Blog","logo":"https://media.daily.dev/image/upload/s--ZGZ0FjqS--/f_auto,q_auto/v1786438306/logos/collabora?_a=BAMAMicg0","url":"https://daily.dev/sources/collabora"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/unleashing-gst-python-ml-python-powered-ml-analytics-for-gstreamer-pipelines-myboar0ue","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":1},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"machine-learning,python,computer-vision,gstreamer","timeRequired":"PT4M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Collabora Blog","item":"https://daily.dev/sources/collabora"},{"@type":"ListItem","position":3,"name":"Unleashing gst-python-ml: Python-powered ML analytics for GStreamer pipelines"}]} {"@context":"https://schema.org","@type":"FAQPage","@id":"https://daily.dev/posts/unleashing-gst-python-ml-python-powered-ml-analytics-for-gstreamer-pipelines-myboar0ue#faq","mainEntity":[{"@type":"Question","name":"What is gst-python-ml and how do I build a Yolo tracking pipeline with GStreamer?","acceptedAnswer":{"@type":"Answer","text":"gst-python-ml is a pure Python framework from Collabora for building ML-enabled GStreamer pipelines using standard Python packages like torch, transformers, and ultralytics. A Yolo11m tracking pipeline can be run with a single gst-launch-1.0 command using the pyml_yolo and pyml_overlay elements after installing the required GStreamer plugins and the gst-python-ml PyPI package. Track new GStreamer ML tooling releases like this one on daily.dev as your video pipeline stack evolves."}},{"@type":"Question","name":"Which GStreamer versions are compatible with the gst-python-ml package?","acceptedAnswer":{"@type":"Answer","text":"gst-python-ml works with any Linux distribution's GStreamer packages starting from version 1.24 onward. It is distributed as a PyPI package and its elements function as first-class GStreamer elements that can be added to any existing GStreamer pipeline. Developers planning GStreamer upgrades can follow compatibility notes like this on daily.dev."}},{"@type":"Question","name":"Can GStreamer pipelines generate automatic video captions using vision-language models?","acceptedAnswer":{"@type":"Answer","text":"Yes, gst-python-ml supports automatic video captioning using the Phi3.5 Vision model, captioning each frame and allowing further processing to summarize a game or detect significant events such as goals. Collabora states this hybrid vision plus language model capability is not available in any other GStreamer-based analytics framework, open source or commercial. Anyone evaluating vision-language captioning tools for media pipelines can compare options via daily.dev."}}]} ```