Finance minister regrets saying they should find new jobs, but doubles down on assertion it's the only way forward amid ongoing COVID restrictions