Skip to main content

Data Factory

Planned

Enable saving JSON files to Lakehouse with Dataflow Gen 2, not just tables

Vote (5) Share
Michael Shparber's profile image

Michael Shparber on 25 Jul 2023 07:41:37

I am pulling data from REST API source with Dataflow Gen 2.

One of the Columns in the Query invokes a function with an API call.


I would like to save this step as a JSON file AS-IS in a Lakehouse, without having to "expand" this column (that contains Records) to columns.

Is it possible with Dataflows Gen2? Save to Lakehouse as a file but not as a table?


Currently, when I choose Lakehouse as a source, it only prompts me for a Table name and says:


"A new table will be created in Lakehouse"


I need to save a JSON file, not a table. And I want to use the Dataflow, not Data Factory.


Please help

Administrator on 28 Nov 2023 22:37:50

Planned CY2024