1 in 3 Americans is worried about the prospect of election-related clashes, according to a recent poll