Some 10,000 Palestinians demonstrated along security fence but the IDF, with a stricter open-fire policy, and Hamas, which patrolled the border, largely kept the peace