--- title: Feature Engineering with Microsoft Fabric and PySpark description: This post explores feature engineering using Microsoft Fabric and PySpark. It covers the basics of PySpark, such as reading data, combining DataFrames,... canonical: https://daily.dev/posts/feature-engineering-with-microsoft-fabric-and-pyspark-dqojxku3o twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Feature Engineering with Microsoft Fabric and PySpark | daily.dev og:description: This post explores feature engineering using Microsoft Fabric and PySpark. It covers the basics of PySpark, such as reading data, combining DataFrames,... og:url: https://daily.dev/posts/feature-engineering-with-microsoft-fabric-and-pyspark-dqojxku3o og:image: https://api.daily.dev/og/posts/dqOJxku3o.png og:image:alt: Feature Engineering with Microsoft Fabric and PySpark og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Feature Engineering with Microsoft Fabric and PySpark **[Towards Data Science](https://daily.dev/sources/tds)** · 12 min read · 0 upvotes · 0 comments ## Summary This post explores feature engineering using Microsoft Fabric and PySpark. It covers the basics of PySpark, such as reading data, combining DataFrames, selecting columns, grouping data, joining DataFrames, and using functions. The post also discusses the Elo Ratings system and demonstrates how to calculate Elo ratings for teams. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: --- Tags: [#machine-learning](https://daily.dev/tags/machine-learning), [#data-engineering](https://daily.dev/tags/data-engineering), [#feature-engineering](https://daily.dev/tags/feature-engineering), [#pyspark](https://daily.dev/tags/pyspark) [View this post on daily.dev](https://daily.dev/posts/feature-engineering-with-microsoft-fabric-and-pyspark-dqojxku3o) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Feature Engineering with Microsoft Fabric and PySpark","url":"https://daily.dev/posts/feature-engineering-with-microsoft-fabric-and-pyspark-dqojxku3o","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/feature-engineering-with-microsoft-fabric-and-pyspark-dqojxku3o"},"datePublished":"2024-04-11T15:48:32.394Z","dateModified":"2024-05-09T09:21:59.549Z","description":"This post explores feature engineering using Microsoft Fabric and PySpark. It covers the basics of PySpark, such as reading data, combining DataFrames,...","image":"https://media.daily.dev/image/upload/s--qPvKM23u--/f_auto/v1722860399/public/Placeholder%2009","thumbnailUrl":"https://media.daily.dev/image/upload/s--qPvKM23u--/f_auto/v1722860399/public/Placeholder%2009","isAccessibleForFree":true,"articleSection":"Towards Data Science","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Towards Data Science","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/tds","url":"https://daily.dev/sources/tds"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/feature-engineering-with-microsoft-fabric-and-pyspark-dqojxku3o","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"machine-learning,data-engineering,feature-engineering,pyspark","timeRequired":"PT12M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Towards Data Science","item":"https://daily.dev/sources/tds"},{"@type":"ListItem","position":3,"name":"Feature Engineering with Microsoft Fabric and PySpark"}]} ```