Ah, my previous solution didn't stick. THIS works for me: before swiping to answer, press and hold the answer button for 1 second, then swipe before letting go.
open