Defiantly insisting that he did nothing wrong, president says he is not worried at all about prospect of Congress pursuing action against him