Rev. Craig Duke asked to be relieved of his duties after appearance on inclusivity program led to attacks by congregants. He says he was heartbroken by the response