The swipe starts at the hole & moves away. Beginning the swipe as soon as the sprite disappears is more important for earning gold than the speed of the swipe. Gold > Purple > Red.
Uncle Schmedley about Personal Zen