Fabric Data Engineering

Andrew analyzes and writes about Microsoft's data management, business intelligence, and machine learning solutions, as well as aspects of licensing... more

Fabric Data Engineering is the Apache Spark workload in Microsoft Fabric, used to ingest, transform, and prepare large volumes of data for analytics and machine learning. Data engineers write code in notebooks and Spark job definitions, store results in lakehouses (OneLake stores of Delta tables and files), and run work on Spark pools configured through environments and versioned Fabric runtimes. Materialized lake views automate multistage transformations. The workload succeeds Spark pools in Azure Synapse Analytics and shares Fabric’s workspaces, security, and capacity.

Product: Fabric Data Engineering

Licensing: Fabric

Near-Term Updates and Roadmap (2026–2027)

Data Engineering development in 2026 focused on performance, production readiness, and AI-assisted development with numerous features being announced or reaching general availability (GA):

Updates

2026 updates expand automation, improve Spark performance, add cost-control options, and simplify connections to SQL data.

Atlas Members have full access

Get access to this and thousands of other unbiased analyses, roadmaps, decision kits, infographics, reference guides, and more, all included with membership. Comprehensive access to the most in-depth and unbiased expertise for Microsoft enterprise decision-making is waiting.

Membership Options

Already have an account? Login Now

Not a member but want to see the full content? Contact us.