Skip to main content

    Data Factory

    Planned

    Support UPSERTs and DELETEs when copying data into Lakehouse Tables from Pipeline copy activity, as opposed to Appending new rows

    Vote (106) Share
    Alexis Molteni's profile image

    Alexis Molteni on 2023-07-14 16:06:37

    be able to do incremental loading from a pipeline.

    Administrator on 7/19/2023 2:22:52 AM

    Upsert to Lakehouse Tables via Pipeline copy activity is in roadmap. 

    Comments (11) Merged Idea (1)
    Vote 7
    Mariya Miteva's profile image

    Mariya Miteva on 2023-07-14 18:55:48

    Data Factory

    Support UPSERTs and DELETEs when copying data into Lakehouse Tables from Pipeline copy activity, as opposed to Appending new rows

    My current implementation involves obtaining data from multiple APIs simultaneously every day. I want to implement a process that does not rewrite or overwrite new data but appends it, taking into consideration the possibility of duplicates in consecutive API calls.

    Merged