In this blog, we cover:
Fabric is a cloud SaaS (software as a service) product that brings together several services — most of which have existed for some time — into a single, end-to-end data analytics platform.
From Microsoft’s perspective, Fabric is an incentive for its users to adopt more of the Microsoft Azure data ecosystem, because it brings Azure Data Factory, Azure Synapse, and Power BI together into a single product. It integrates workflows and encourages data democratization from data engineers to data analysts to business users.
The product allows users with seven different components, or “experiences”:
The foundation on which all Fabric services are built is a data lake called OneLake (also new to the scene). Think OneDrive for data. OneLake provides a SaaS experience built on top of Azure Data Lake Storage (ADLS Gen2). It provides a unified location to store all organizational data where all the above experiences operate.
OneLake is also designed to allow mounting of existing PaaS storage accounts using a Shortcut feature – without the need to migrate existing data. Shortcuts can be connected to existing data sources in ADLS Gen2 or AWS S3 buckets.
OneLake is intended to eliminate ‘data silos’ for the democratization of data. While the data assets are centralized, each developer or business unit can create their own workspace, ingest the data into their lakehouses, process, and analyze data. This architectural pattern provides one source of centralized data, which enables decentralized or distributed teams.
The good news is none of those platforms in isolation are going away. They will be available for years to come.
You can turn on a Fabric capacity, no problem. There is no migration involved there. Your content still lives in the workspace, and you have those additional experiences at your disposal. Power BI still offers the same capabilities as before — you can build datasets using import or DirectQuery, build reports, publish reports, etc. Power BI Desktop is also not going anywhere. The Power BI experience won’t fundamentally change.
This is not an obligation to change course to fit the new Fabric paradigms. But now that you have these new features available in your toolkit, you may want to consider them as options for the future.
There is no direct or automatic path to migrate today. ADF pipelines cannot be directly migrated to Fabric — though this is on the roadmap. Synapse spark workloads are easily migrated, but the underlying data still must be connected to OneLake.
The key differentiator for Synapse in Fabric is Azure Synapse is a PaaS whereas Fabric Synapse capability is SaaS, so moving from Synapse to Fabric will be fundamentally different. Fabric is considered a successor to ADF and Synapse and is intended to enhance the experiences from those platforms. This takes away the need to manage several Azure resources.
Provisioning Spark clusters will provide a significantly faster and easier experience. The compute resources you purchase are pooled with your Power BI resources. This may be perceived as a benefit to some and a detriment to others who feel it will increase total cost of ownership (TCO).
However, managing technical debt is challenging to quantify. Fabric can simplify and centralize your codebases — and that is difficult to put a price tag on.
Fabric will enhance the overall developer experience, specifically with Git integration features.
The inability to use Git for .pbix files because they are stored as compressed binary files has long been a pain point for Power BI developers.
Fabric is bringing more source control ability to workspaces. Workspaces can be linked with Azure DevOps, where the underlying data models and reports can be accessed as JSON files in a repository. With this, Power BI development is moving toward software development paradigms — models and reports can be compared in diffs, merged, and changes approved in Pull Requests.
(As of July 2023, only reports and datasets support this Git integration.)
There are two licensing components of Power BI that are critical to understanding the overall licensing model: user-based licensing and capacity-based licensing.
User-based licenses are not changing with the introduction of Fabric. Everyone in your tenant can be assigned a free license, a Pro license, or a Premium Per User License (PPU). Without going into depth of the individual features, this is basically what they mean:
Capacity-based licenses provide dedicated pools of resources measured in Compute Units (CU) (CPU, memory, etc.) for hosting your workspaces. There are three different types of SKUs for capacities:
Not necessarily. User-based licenses can be used without a capacity-based license, but capacity-based licenses cannot be used without user-based licenses.
Any developer who wants to use the workspaces in a dedicated capacity must have at least a pro license. With that in mind, not all F SKUs are created equal — they do not all provide the same sharing capability. F SKUs from F2-F32 requires Pro licenses from anyone who want to develop or engage with the content in a workspace. F64 and above is more appropriate for larger organizations when buying hundreds (or thousands) of individual licenses is not feasible.
Note: An additional capacity-based license — reserved instance (RI SKU) — which will be coming soon, will provide the same experiences as Fabric (F SKUs). The key difference is in its billing structure – billed monthly based on an annual commitment like a P SKU. An annual commitment provides some cost saving benefits. But since we don’t know exactly when that will come or how much it will cost, it’s difficult to plan for.
1. Remember that — as with any platform or technology — Fabric is not a silver bullet.
Opening your wallet for Fabric won’t immediately revolutionize your data analytics capabilities. There’s a people and a process component that can’t be ignored.
You need:
2. It’s new, so there are some gaps (as of July 2023):
If you’re not sure what value Fabric will bring to your use cases, try it out — there is no commitment. With a free PBI license you can start a 60-day free trial of Fabric. Consider how its features would fit into your data architecture needs. You can still elect to use Power BI exclusively.
For organizations new to Power BI — perhaps those with some Pro licenses — Fabric is still very accessible from a cost perspective even beyond the free trial. You can get access to everything Power BI already is along with ADF and Synapse Data engineering capability.
Talk to an expert about your Microsoft Fabric needs.