Got the solution. To whoever has issues: The touchscreen only works with the Javascript (local or pavlovia in browser) backend. DO NOT USE THE PYTHON BACKEND IF YOU WANT PROPER TOUCH CONTROLS.
By proper I mean, no double tap or stroking. The browser version just works.