Ad-hoc Filtering and Highlighting should allow de-select for quick exclusion

Ad hoc filter via highlight is a great feature. You can filter easily on one dimension value and use CTRL+click to multi-select within a visual or across visuals. However, there is no way to do a quick exclude to de-select a value. For example, I may have a bar chart with 12 months and want to quickly exclude the first and/or last months. I expect CTRL+click to do this but instead it highlights the value (same behavior with and without CTRL key). Once a value has been highlighted then CTRL+click works as expected as a toggle.