Roger Scruton, axed from housing panel, drew opprobrium for comments about Chinese authoritarianism, a 'Soros empire' in Hungary, the 'sudden invasion' of Muslim migrants to Europe