Do not reset Annoy index during multi-mark build-up

Do not reset (experimental) Annoy index during build-up with more than one mark #51325 (Tian Xinhui).