Number cited by public security minister would be highest ever for a single day, although visits to holy site were significantly shorter than normal