Greg Galloway on 13 Oct 2023 20:46:49
If you do many separate inserts or update statements into a table in a Fabric Warehouse you can end up with lots of parquet files and poor performance. I'm not aware there is an auto-optimize feature in Fabric Warehouse yet (and if that's the plan you can potentially close this request depending on how aggressive/quick auto-optimize will be).
It would be great to allow the Azure Synapse Analytics syntax ALTER TABLE dbo.tablename REBUILD syntax to work in Fabric which would cause it to do the equivalent of a Spark "optimize" command to rewrite the parquet files to be more efficient and properly sized.
Kevin Conan (administrator)
This is has been released! Announcing: Automatic Data Compaction for Fabric Warehouse | Microsoft Fabric Blog | Microsoft Fabric