Make icon "invisible"?

I have an icon visible in compact mode with a horizontal slider. The tap action on the button is set to none. When trying to swipe in the lower percentages where the icon is, the icon still acts like a touchable button, even though it doesn't have any action.

Is it possible to make it totally invisible to touches so that I can swipe through it?