After encouraging his mistress to have an abortion, Rep. Tim Murphy, a self-described pro-life conservative, announced on Wednesday he wouldn’t seek reelection after his term expired. Apparently, that half-measure wasn’t good enough.

In a Thursday statement, Speaker Paul Ryan announced that Murphy would be leaving Congress in less than three weeks. “This afternoon I received a letter of resignation from Congressman Tim Murphy, effective October 21,” Ryan wrote. “It was Dr. Murphy’s decision to move on to the next chapter of his life, and I support it.”