Provide continuous ingestion from OneLake

Administrator on 18 Feb 2025 23:53:12

Continous ingestion from OneLake is planned and in execution. It has quite a few aspects:

1. Picking up files landing in OneLake files foder and ingesting them into an Eventhouse table (This is coming up soon)

2. Accelerating quries over OneLake shortcuts to Delta table through caching (Available - Query acceleration over OneLake shortcuts - Microsoft Fabric | Microsoft Learn)

3. Treating deta tables as a data feed, ingesting the new records and potentially updating or deleting existing rows (not covered by this item - Please file a new idea for this one if this is interesting).