House Speaker Paul Ryan on Tuesday conducted an impromptu swearing-in of House Chaplain Patrick Conroy, a move that which will allow him to remain in his post after Ryan asked him to resign last month.

Father Conroy protested the firing and Ryan, R-Wis., announced he would reinstate the Jesuit priest after meeting with him. Conroy had initially been slated to leave the job on May 24.