White House only invited 'a single-digit number' of Israeli businesspeople to conference, source says