Minister says he won't address gossip, claims Finance Ministry functioning well after director-general follows others out the door as crisis swirls over budget, virus response