Foreign Ministry downplays incident, which comes despite announcement of agreement to smooth travel arrangements between two countries