Microsoft Fabric Updates Blog

Introducing Data Factory in Microsoft Fabric

See Arun Ulagaratchagan’s blog post to read the full Microsoft Fabric preview announcement.

 

As organizations work through their digital transformation journeys, they are awash with data that they need to bring together to meet their analytics needs. To do this, they need to seamlessly access data from a diverse set of data sources, reshape and transform the data to the right format, and load the data into a data store like a lakehouse or data warehouse, where the data can support their analytics needs. In addition, companies are looking to stitch together different data activities (e.g., running a notebook, a stored procedure, SQL script, and more) and orchestrate specific data workflows.

 

Today, we are unveiling Data Factory in Microsoft Fabric, bringing together the best of Power Query and Azure Data Factory into a single, modern data integration experience which empowers both data and business professionals with capabilities to ingest and transform data as well as orchestrate data workflows. Our goal is to empower everyone to be able to connect to diverse data sources and bring that data to where it can best help you derive insights for better business decisions.

 

Whether you’re a citizen or professional developer, Data Factory enables you to develop enterprise-scale data integration solutions with next-generation dataflows and data pipelines. 

 

Data Factory in Fabric empowers you with: 

    • Seamless connectivity to more than 170+ data stores (including on-premises data sources, cloud databases, analytical platforms, line of business applications, and more)
    • Next-generation Power BI dataflows is now available as part of Data Factory in Fabric, providing 300+ out-of-the box data transformations, including AI transformations, and scalable data flows that run on Fabric compute. In addition, you can output the transformed data into various data destinations. 
    • Data pipelines in Fabric is an evolution of Azure Data Factory pipelines which provides you with a rich set of integration capabilities. In addition, the copy assistant enables you to jumpstart any copy task from data sources to data destinations.
    • Built-in AI enables you to accelerate and automate common data integration tasks.

For example, you might need to extract data from an unstructured data source like a web page or a text file without a well-defined format. With the help of AI, you can now use Data Factory to analyze examples you give on values you want to extract. Then, the powerful AI capabilities underneath the hood learn from the examples and create the Data Factory dataflows to extract just the data you need.

 

Watch an overview of Data Factory in Microsoft Fabric:

Explore how our customers and partners are already using Data Factory in Microsoft Fabric  

 

Hitachi Solutions 

Hitachi Solutions provides consulting services to help customers migrate their data systems into Microsoft Fabric. Their global team of IT professionals has extensive expertise using Data Factory in Fabric to seamlessly integrate data from multiple sources.

“The Data Factory experience in Microsoft Fabric has surpassed our data and analytics needs by equipping our customers with industry-leading data orchestration capabilities in an elegant, easy-to-use, code-free experience.”

Simon Nuss, Vice President of Data & Analytics, Hitachi Solutions

 

Watch the team at Hitachi Solutions using Data Factory with Fabric:

  

Delphix 

Delphix has a strong track record of delivering powerful data compliance capabilities to enterprises across industries to address their privacy mandates and cybersecurity requirements. Delphix is partnering with Microsoft to bring their proven technology to the Microsoft Fabric platform with Delphix Compliance Services for Data Factory. 

 “In collaborating with Microsoft to bring our multi-cloud data masking solution to Microsoft Fabric, Delphix is proud to deliver a comprehensive way to de-risk the cloud while accelerating the path from data to transformation.”  

Jedidiah Yueh, Delphix Founder and CEO

 

Learn more about the Delphix Compliance Services for Data Factory.

  

Get started with Microsoft Fabric

Microsoft Fabric is currently in preview. Try out everything Fabric has to offer by signing up for the free trial—no credit card information required. Everyone who signs up gets a fixed Fabric trial capacity, which may be used for any feature or capability from integrating data to creating machine learning models. Existing Power BI Premium customers can simply turn on Fabric through the Power BI admin portal. After July 1, 2023, Fabric will be enabled by default for all Power BI tenants. 

 

Sign up for the free trial. For more information read the Fabric trial docs.

 

Learn more about Data Factory in Fabric at the following Build 2023 sessions:

  

Other resources 

If you want to learn more about Microsoft Fabric, consider:   

Related blog posts

Introducing Data Factory in Microsoft Fabric

April 18, 2024 by Santhosh Kumar Ravindran

We are excited to announce a new feature which has been a long ask from Synapse Spark customers, Optimistic Job Admission for Spark in Microsoft Fabric.This feature brings in more flexibility to optimize for concurrency usage (in some cases ~12X increase) and prevents job starvation. This job admission approach aims to reduce the frequency of … Continue reading “Introducing Optimistic Job Admission for Fabric Spark”

April 16, 2024 by Ruixin Xu

We are pleased to share a set of key updates regarding the Copilot in Microsoft Fabric experiences. The information in this blog post has also been shared with Fabric tenant administrators. Below are the highlights of the changes. This change is an important milestone to eventually allow Copilot to reach GA within this year. See … Continue reading “Copilot in MS Fabric: Soon available to more users in your organization“