Site manager at parcel of land worked by Israeli farmers for decades, including 'Isle of Peace,' believes 150-strong convoy of visitors took what may be final opportunity