Justice minister warns there is ‘real fear of serious harm to public health’ if the court system continues as normal