Closes the runner and cancels pending rewinds, but not runs in flight; cancel their subscriptions first.