I can also confirm that SFOS feels sluggish to me since the beginning on my XA2.
Especially the scrolling of lists and pages (Web browser, apps) seems to lag behind the touch input and/or the scrolled content is redrawn in an apparent and disruptive way (especially while scrolling with a low velocity/speed). The native gallery and settings apps are good examples for such sluggish scrolling.
Furthermore very often the touch input is not interpreted correctly and this is annoying as hell: Button tabs will be interpreted as swipe gestures, the pinch to zoom gesture will be interpreted as a tab/swipe and vertical and horizontal swipes are interchanged. But also just horizontally swiping back and forth in the home launcher will result in all possible swipe gestures (scrolling the eventsview, opening top menu and opening the app launcher). And the laggish keyboard input shall be not forgotten.
Another issue is that UI animations seem to have a higher priority than touch input, e.g
tapping on the home screen (the screen containing the app tiles) directly followed by a horizontal swipe will surpress the swipe gesture and first display the ui animation*.
Sometimes I am playing around with the Huawei device of my gf and I am astonished by the smooth UX (especially the scrolling), even though I do not like the walled garden OS and I am a long-time Maemo/MeeGo/SFOS user.
In summary: Jolla should put some effort in improving the whole user experience. 
Update:
*This issue has been fixed with Sailfish OS 3.4.0.xx. 
