James Dennehy, the head of the New York FBI Field Office, has been formally removed from his position.