PM says he wouldn't want an Israel without a right, left, or Haredi camp, but adds that 'we must limit their political sway'