Skip to main content

Power BI

Completed

incremental refresh for Power BI Pro

Vote (8184) Share
Topher60657's profile image

Topher60657 on 09 May 2018 21:51:12

Enable Incremental Refresh for Power BI Pro users, not just Premium.

Administrator on 20 Feb 2020 07:50:33

Happy to let you know, incremental refresh is now in Pro. Enjoy :)

Comments (555)
Topher60657's profile image Profile Picture

Preeti on 05 Jul 2020 22:32:06

RE: incremental refresh for Power BI Pro

Tableau supports this and the data model becomes very efficient to process. It's a must have functionality for someone to move from tools like Tableau....

Topher60657's profile image Profile Picture

Vasek on 05 Jul 2020 22:31:38

RE: incremental refresh for Power BI Pro

under review ... more then 1,5 years :( ! Last 3 updates bring some good news, but incremental update (well known in SQL) and for example TOP filters will be excellent !

Topher60657's profile image Profile Picture

James Hancock on 05 Jul 2020 22:31:24

RE: incremental refresh for Power BI Pro

YES PLEASE!!!

Topher60657's profile image Profile Picture

Ivan on 05 Jul 2020 22:31:02

RE: incremental refresh for Power BI Pro

Any updates on this badly needed feature?

Topher60657's profile image Profile Picture

Jim Shoemaker on 05 Jul 2020 22:30:45

RE: incremental refresh for Power BI Pro

Incremental data refreshes are a huge time saver in Tableau when working with large imported data sets. Without the incremental refreshes, it is not practical for me to switch from Tableau to Power BI. I can't wait for complete data refreshes everytime I need the latest data in Power BI.

Topher60657's profile image Profile Picture

Power BI User on 05 Jul 2020 22:30:38

RE: incremental refresh for Power BI Pro

Any update on this feature guys? Its been under review for a long time! We need this feature!!!!

Topher60657's profile image Profile Picture

ryan-gao on 05 Jul 2020 22:30:01

RE: incremental refresh for Power BI Pro

A MUST HAVE FEATURE,请更新

Topher60657's profile image Profile Picture

Laura Edell on 05 Jul 2020 22:28:04

RE: incremental refresh for Power BI Pro

'PBI offers a breadth and depth of data connections (including many Azure platform services) which, is awesome. Most BI tools offer connection parity, but the big differentiator is the amount of custom configuration that can be set to optimize how data is loaded including whether a bulk load or incremental load is fetched during a refresh.

Azure services like HD Insights or Azure SQL DW are positioned with PBI to work in concert with each other against the most complex and large data volumes. Yet, PBI doesnt offer an incremental load setting? IMHO, that poses a conundrum.

I have a 1 tab PBI dashboard comprised of 6 charts + 2 tables. This connects to an Azure SQL DW level DWU 300 in which we have loaded a 2.5 GB slice of representative data (it's a poc). A full refresh takes 6 minutes to complete.

Within the dataset, we have 10 tables: 1 fact-like table, 8 dim tables and 1 lookup table. It's about as perfect a starflake as you can get.

So, my poc test scenario is not uniquely voluminous nor complex.

The full dataset once loaded will be 1 TB.

Dashboard refresh schedule is 1 x per 24 hour day.

Part of planning for a SQL DW includes analyzing query plans, DWU usage, et al in order to estimate performance vs. consumption cost, especially important when you are paying by the minute/hour.

So, here is my "back of napkin" math breakdown to elucidate WHY incremental refresh is absolutely necessary to truly drive PBI & Azure adoption of big data/adv analytic workloads (based off the current Azure Cost Calculator estimates):

- 2.5 GB takes 6 minutes to refresh or 2.4 min per GB
- Refresh schedule limited to 1 x per day (every 24 hours)
- 1 TB refresh would take roughly 2393 minutes or 39.88 hours
- Azure Cost Calculator estimates East2 region hourly cost = $3.63 + storage cost (not inc)

Therefore...

- $3.63 x 39.88 hrs = $144.76 per da *FULL* refresh / $4,343 per month

- Here's the kicker: a full refresh incurs same cost whether data changed or not!!!

Now, t

Topher60657's profile image Profile Picture

Moneer Jlelaty on 05 Jul 2020 22:27:21

RE: incremental refresh for Power BI Pro

A must have feature, we are loading a lot of data which will be loaded again every time. If we can only load the newest data, that will save a lot of time, please start working on it.

Topher60657's profile image Profile Picture

imran khan on 05 Jul 2020 22:25:50

RE: incremental refresh for Power BI Pro

i need to refresh the whole data set everytime i refresh please get this feature