The filter object when set to "Select All = OFF" still defaults to Select All. If you clear a selection, it goes back to "All".
The Select All = OFF option should make it so nothing is selected and nothing is returned. Basically a selection required option.