'Behind closed doors, they sound different,' defense minister says of cabinet members who publicly sounded off after he hosted the Palestinian leader at his home