Premier's wife said to have refused requests to cancel trip; some of PM's coalition partners reportedly unhappy at the optics as tourist industry hit again by restrictions