Congressman Barry Loudermilk says president not given opportunity to face his accusers; Democrats note he refused opportunity to testify and declined