Microsoft Fabric Updates Blog

Copy data to Amazon S3 & Amazon S3 Compatible via Fabric Data Factory Data Pipeline

We are happy to announce that copying data to Amazon S3 and Amazon S3 Compatible is now available in Data pipeline of Fabric Data Factory! You can use Copy assistant and Copy activity in your Data pipeline to finish this data movement.  

How to create Amazon S3 & Amazon S3 Compatible connection 

You can create an Amazon S3/Amazon S3 Compatible connection directly through Copy assistant or Copy activity destination tab. 

In Copy assistant

Amazon S3 and Amazon S3 Compatible are now available when creating new connections with the Copy assistant.

In Data pipeline

Create a new connection to Amazon S3 and Amazon S3 Compatible in your Copy data activity.
A pop-up allows you to select a new connection to Amazon S3 and Amazon S3 Compatible.

How to configure the copy destination for Amazon S3 & Amazon S3 Compatible 

To copy data directly to Amazon S3/Amazon S3 Compatible, specify the data destination folder path (required) and the file name.

If you use the Copy activity in your Data pipeline, specify the File format (required) for the destination data. Meanwhile, you can choose to use advanced features to improve copy flexibility and performance. There are options for Copy behavior that allows you to define the copy behavior when the source is a file from a file-based data store, and Max concurrent connections that allows you to indicate the upper limit of concurrent connections established to the data store during the activity run.  

For more details about the copy destination configuration, read Configure Amazon S3 in a copy activity – Microsoft Fabric | Microsoft Learn and Configure Amazon S3 Compatible in a copy activity – Microsoft Fabric | Microsoft Learn

Have any questions or feedback? Leave a comment below!

Entradas de blog relacionadas

Copy data to Amazon S3 & Amazon S3 Compatible via Fabric Data Factory Data Pipeline

octubre 29, 2024 por Leo Li

We’re excited to announce several powerful updates to the Virtual Network (VNET) Data Gateway, designed to further enhance performance and improve the overall user experience. These new features allow users to better manage increasing workloads, perform complex data transformations, and simplify log management. Expanded Cluster Size from 5 to 7 One of the key improvements … Continue reading “New Features and Enhancements for Virtual Network Data Gateway”

octubre 28, 2024 por Estera Kot

We’re thrilled to announce that the Native Execution Engine is now available at no additional cost, unlocking next-level performance and efficiency for your workloads. What’s New?  The Native Execution Engine now supports Fabric Runtime 1.3, which includes Apache Spark 3.5 and Delta Lake 3.2. This upgrade enhances Microsoft Fabric’s Data Engineering and Data Science workflows, … Continue reading “Native Execution Engine available at no additional cost!”