President Donald Trump fired Roger Rogoff, the newly appointed U.S. attorney for the Western District of Washington, less than an hour after he was sworn into office Wednesday, setting up a potential legal fight over the president’s authority to remove a court-appointed federal prosecutor.

Rogoff, a former judge and veteran public servant, was sworn in around 8 a.m. on Wednesday. Fifty-four minutes later, while waiting to meet with former interim U.S. Attorney Charles Neil Floyd, Rogoff received an email from the Trump administration informing him he had been removed, according to the Associated Press. Rogoff said he is consulting with attorneys about potentially challenging his firing in court.