The Timeline Slicer already has the ability to show/hide Range Header. Add the same ability for the Granularity. Hiding both Range Header and Granularity would make the visual smaller vertically.
A workaround is to change Granularity colors (scale and slider) to white, so it is not visible, and other visuals can overlap.