Data Factory
PlannedMeta-Data Driven Copy Task and wizard like what is available in Azure Synapse Analytics Workspaces
Todd Chittenden on 01 Apr 2024 18:31:03
If you work with Azure Data Factory inside Synapse Workspaces, you may know there is a Meta-Data driven wizard that, once completed, sets up a Control table and a three-level nested pipeline that can handle all the tables from a single source. It's a great little gem. But ONLY available in Synapse Workspaces. NOT available in classic ADF Gen 2, and certainly not available in Fabric. I would like to see that wizard added to the ADF design options in Fabric.
Oh, and Synapse Workspaces don't support connection to Fabric Warehouses, only Lakehouses. What gives?
Between ADF classic, Synapse Workspaces, and Fabric, there are THREE different design experiences for Data Factory, each has its own limitations. So frustrating that Microsoft can't get these teams together to publish a SUPERSET of features where everything is available in all three flavors.
Administrator
This is being planned as part of our CY24 product plan