The Reverend Pat Conroy wrote his resignation letter after being indirectly asked to by Paul Ryan, the House Speaker, but then took it back.
His resignation letter was read out in the House of Representatives but his letter reversing that decision has got much more attention.
In the letter where he changed his mind, he said: "I have never been disciplined, nor reprimanded, nor have I ever heard a complaint about my ministry during my time as House Chaplain."
He recalls that Paul Ryan's Chief of Staff, Jonathan Burks, informed him that the Speaker would like his letter of resignation and added: "maybe it's time we had a chaplain that wasn't Catholic."
Mr Burks also referenced a prayer Conroy made and an interview he did with National Journal Daily.
Rev Conroy continues: "I had little choice but to resign" but says criticisms made by Paul Ryan since then accusing him of not offering adequate "spritual counselling" mean he now wishes to set the record straight.
He told the Speaker: "no such criticism has ever been levelled against me during my tenure as House Chaplain" and said "you may wish to outright 'fire' me...but should you wish to terminate my services, it will be without my offer of resignation."
He asked for confirmation of Mr Ryan's recognition of the letter by 12th May.
Paul Ryan has issued a statement in recognition of the letter, saying the chaplain will remain in his post.
Mr Ryan said: "that decision was based on my duty to ensure that the House has the kind of pastoral service it deserves" but that he intends to sit down with the Chaplain to talk it over and "move forward".
Stay up to date with the latest news stories from a Christian perspective. Sign up to our daily newsletter and receive more stories like this straight to your inbox every morning