Former Trump administration adviser Steve Bannon was ordered to self-surrender for his four-month prison sentence no later than July 1, a district court judge ruled Thursday.

U.S. District Judge Carl Nichols, an appointee of former President Donald Trump, lifted his previous stay on Bannon’s four-month prison sentence while he appealed his conviction. However, Nichols did allow Bannon on Thursday to begin the process of appealing the judge’s decision to lift the pause on his sentence.

“My stay of Mr. Bannon’s obligation to self-surrender is revoked,” Nichols said from the bench of the federal district courthouse in Washington, D.C., after nearly 50 minutes of argument between defense attorneys and a lawyer for the government.