Fix color assignments for each label

I have an issue regarding the color change for my visuals on Power BI Desktop.

When I change a color for 1 data set of my pie chart on Power BI Desktop, while the other data remains at a default color pallet state, and save the report, once reopened the color of the other data comes out changed when they aren't meant to be.
While the changed 1 data set displays as it should be, the color of the other data comes out altered by having the default color shifted by one from that 1 data set that was changed.
Although the other values are left at default color, the report has been overwritten and saved so I find it strange that the color changes when I reopen the report file.

I understand that if I want to keep the default color, I need to set it explicitly.
However, this behavior confuses the user, so the default color settings should be fixed.