Speaker Paul Ryan isn't worried about attacks from Breitbart and Steve Bannon as he continues to work with President Trump to get tax reform passed through the House.

Ryan said on MSNBC's "KasieDC" Sunday night he's not been paying much attention to Bannon's tour of force against the GOP establishment, which included railing against Senate Majority Leader Mitch McConnell during a speech Saturday.

Ryan said Bannon isn't helping the party, but he's not really concerned.

"I don't think it's helpful to go after fellow Republicans. What's most helpful is if we all unify around our common goals, principles and purposes and get an agenda passed," he said. "I don't think having these fights are helpful. But at the same time, I don't think it's going to deter us from doing what we say we were going to do. "

Ryan brushed off attacks from Bannon's conservative news outlet by laughing at the idea of them attacking him.

"Death, taxes and attacks from Breitbart," he said. "I'm so used to that that to be honest you don't spend time thinking about things like that in this job, things that are out of your control."

When asked about Trump's role in helping Ryan do his job as Speaker of the House, the Wisconsin Republican said Trump is a positive force on tax reform.

"He's helping us with tax reform. Do I wish he would tweet less? I course I do. He knows that. That's something out of my control and I don't think it's something that's going to change," he said.

"Is he going around and helping us sell tax reform and connecting with people? Did this president as a Republican win Wisconsin for the first time since '84 and Pennsylvania and Ohio?"