Swiping is a wonderfully intuitive addition to the Apple TV remote but you don’t have to swipe if you don’t want to.
Instead, just tap near the corners of the remote’s touchpad area to navigate. This can be very useful when playing games, for example, providing an entirely new degree of accuracy.
Give it a try!
And would it blow your mind to know you can do the same on the iPad/iPhone to navigate through the launcher screens of icons? Just tap at the left or right of the dots at the bottom of the icon grid, above the dock. The screen will then scroll automatically.