'We’re going to do it slow,' minister says at IAC conference regarding potential amendments to legislation, insists 'grandchild clause' won't be scrapped 'tomorrow morning'