Deselect category as first action using Control Click

When using a power BI reporting page, rather than filter on one category, I want to filter all except that category. At the moment to do this you have to click on another category and then ctrl click all other categories than the one I want to exclude. It would be much easier and more consistent if when you first click a visual you could use Ctrl and the visual would know to deselect that category. (Note that right click exclude does not achieve the result because that does not slice, it just affects the display of the current visual).
Fine to email me if any further explanation needed.
Regards
Justin