House Speaker Paul Ryan, R-Wis., defended Robert Mueller, special counsel leading the Russia investigation, on Monday and argued he is "anything but" a partisan amid ongoing concerns from the Trump administration about the direction of his investigation.

"Remember, Bob Mueller is a Republican who was appointed by a Republican who served in the Republican administration who crossed over and stayed on 'til his term ended," Ryan told Wisconsin-based radio host Jay Weber, referring to his work as FBI director under former President George W. Bush.

"I don't think many people are saying Bob Mueller is a biased partisan. He's really, sort of, anything but."

"The point is we have an investigation in the House, an investigation in the Senate and a special counsel, which sort of de-politicizes this stuff and gets it out of the political theater, and that is, I think, better to get this off to the side," Ryan said. "I think the facts will vindicate themselves, and then let's just go do our jobs."

The Wisconsin Republican told Weber that while many continue to focus on the Russia investigation, Republicans in the House are keeping their eye on the GOP agenda.

"What we're not focused on doing is spending all of our time on Russia, spending all of our time on this intrigue. We want to spend our time focusing on solving people's problems," Ryan said. "Working on the problems people care about, their problems. Not this stuff."

Ryan's comments come after a week where White House officials and outside Trump supporters escalated their rhetoric against Mueller, including Trump, who warned the special counsel not to look into his financial records as part of the probe.

Kellyanne Conway, counselor to the president, went after Mueller and his "band of Democratic donors" on Sunday.