Microsoft Fabric Updates Blog

Data Factory Spotlight: Data pipelines

Data Factory in Microsoft Fabric brings the best of Power Query and Azure Data Factory into a single, easy-to-use, modern data integration experience to empower you to solve complex data movement scenarios.

 

Today, we will be spotlighting Data pipelines in Microsoft Fabric Data Factory to share with you how you can leverage all its capabilities to ingest, transform, and orchestrate data workflows.

  

What are Data pipelines?

For those familiar with Azure Data Factory, data pipelines in Fabric are an evolution of Azure Data Factory pipelines to provide you with a rich set of orchestration integration capabilities.

 

Data pipelines provide you with:

  • Seamless connectivity to more than 100+ data stores (including cloud databases, analytical platforms, business applications, on-premises data sources*, and more).
  • Rich orchestration with 20+ activities to create robust and powerful data integration solutions.
  • Quick data copy with the Copy assistant to jumpstart your data migration projects.
  • Built-in AI enables you to accelerate and automate common data integration tasks.

*coming soon

  

What’s new in Data Factory Data pipelines?

Seamless integration with Microsoft Fabric and more

Data pipelines within Microsoft Fabric allows you to connect to a wide variety of data stores, including on-premises data sources, cloud databases, analytical platforms, business applications, and more! In addition, data pipelines are seamlessly integrated with other Fabric artifacts so that can easily connect to your Lakehouse, Fabric Data Warehouse, or execute your Data Engineering notebooks.

 

Quick and guided data copy with the Copy assistant

The Copy assistant in data pipelines allows you to jumpstart your data copying journey through a simple guided process. You can connect to wide variety of data sources and destinations and even select from sample data sources to get started even quicker.

 

Rich orchestration capabilities

Data pipelines provides you with 20+ pipeline activities to develop powerful data integration solutions, allowing you to build complex workflows to move petabytes of data, refresh and transform data with dataflows and notebooks, define control flows, and perform many other tasks at scale.

 

Pipeline templates

Data pipelines help you get started quickly by choosing from common tasks. These pre-defined pipelines help to reduce development time with building data integration projects.  

These are just a few of the exciting new capabilities you can find within Data Factory in Microsoft Fabric!

  

Get started with Microsoft Fabric now

Microsoft Fabric is currently in preview. Try out everything Fabric has to offer by signing up for the free trial—no credit card information required. Everyone who signs up gets a fixed Fabric trial capacity, which may be used for any feature or capability from integrating data to creating machine learning models. Existing Power BI Premium customers can simply turn on Fabric through the Power BI admin portal. After July 1, 2023, Fabric will be enabled by default for all Power BI tenants. 

 

Sign up for the free trial today! For more information read the Fabric trial docs.

  

Other resources

 

Have any questions or feedback? Leave a comment below!

Related blog posts

Data Factory Spotlight: Data pipelines

April 9, 2024 by Meenal Srivastva

Create data pipelines in Fabric to access your firewall-enabled ADLS Gen2 storage accounts with ease and security. We are excited to announce a new feature in Fabric that enables you to create data pipelines to access your firewall-enabled Azure Data Lake Storage Gen2 (ADLS Gen2) accounts. This feature leverages the workspace identity to establish a … Continue reading “Introducing Trusted Workspace Access in Fabric Data Pipelines”

April 4, 2024 by Mark Kromer

We are always working on making the experience of building low-code data pipelines as easy as possible for our customers. Next week, we are going to roll-out a new experience in the Script activity in Fabric Data Factory pipelines to make it even easier to build expressions using the pipeline expression language.