Welcome to the August 2023 update. We have lots of features this month including the new layout switcher for Power BI, SSD caching in Synapse Data Warehouse, in-line Python support for KQL in Synapse Real-time Analytics, lookup activity for Data Factory Dataflows, and much more. Continue reading for more details on our new features! Contents … Continue reading “Microsoft Fabric August 2023 update”
Metadata-driven pipelines in Azure Data Factory and Synapse Pipelines, and now, Microsoft Fabric, give you the capability to ingest and transform data with less code, reduced maintenance and greater scalability than writing code or pipelines for every data source that needs to be ingested and transformed. The key lies in identifying the data loading and … Continue reading “Create Metadata Driven Data Pipelines in Microsoft Fabric”
Today I am very excited to announce that Azure service principal has been added as an authentication type for a set of data sources that can be used in Dataset, Dataflow, Dataflow Gen2 and Datamart. Azure service principal is a security identity that is application based and can be assigned permissions to access your data … Continue reading “Service principal support to connect to data in Dataflow, Datamart, Dataset and Dataflow Gen 2”
AUTHOR: Guy Reginiano, Program Manager In today’s data-driven landscape, the ability to capture, analyze, and visualize vast amounts of real-time data from diverse sources is crucial for making informed decisions and gaining a competitive edge. Synapse Real-Time Analytics in Microsoft Fabric offers a comprehensive solution to this challenge. Its seamless integration with Data factory in … Continue reading “Using Data pipelines for copying data to/from KQL Databases and crafting workflows with the Lookup activity”
What is good design? In the data integration design team at Microsoft, we ask ourselves this question every day as we strive to create products that meet the needs and expectations of our customers. Design is not just about aesthetics or functionality, but about creating meaningful and relevant experiences for customers. Every design tells a story. It tells a story about people: what they want and what they need.
