Blue and White chief says PM may not wish harm to Avichai Mandelblit but he has no control over where things are headed