United Torah Judaism's spiritual leader had put kibosh on his return to government, but apparently relented after Shas replacement resigned last week