The heads of four minority House caucuses are calling on President Trump to fire three White House staffers in a letter Tuesday.

In a letter to the president, the leaders of the black, Hispanic, Asian and progressive caucuses are urging Trump to remove White House chief strategist Steve Bannon, senior policy adviser Stephen Miller, and deputy assistant to the president Sebastian Gorka after the violent white nationalist groups' rally in Charlottesville, Va., over the weekend.

"Americans deserve to know that white nationalists, white supremacists, and neo-Nazis are not in a position to influence U.S. policy," they wrote in the letter obtained by the Washington Examiner. "In this time of tumult in our country, Americans deserve a leader that will bring us all together and denounce those who seek to tear us apart."

The caucus leaders wrote that the presence of Bannon in Trump's administration is "incredibly alarming and dangerous to our nation and the world." Voicing their concerns about Miller, they wrote he "is a well-known mentee of white supremacist Richard Spencer and has a long history of both denying systemic racism and promoting multicultural segregation." While Gorka "has extensive ties to anti-Semitic hate groups," they wrote.

"The ideology and political agenda of these men have no place in the highest office in the land," they concluded.

Congressional Asian Pacific American Caucus Chairwoman Judy Chu, D-Calif., said, "President Trump's delayed denunciation of white supremacists and their violent actions in Charlottesville, Virginia this past weekend cannot be separated from this Administration's ongoing assault on racial and religious minorities." In a statement to the Washington Examiner, Chu said, "This is not surprising, as the President has filled his inner circle with known supporters of white supremacists, including Steve Bannon, Stephen Miller, and Sebastian Gorka. Their continued presence in the White House is not only an affront to communities across this nation that were threatened and attacked by the violent protests over the weekend, but is a direct contradiction to President Trump's own delayed condemnation of white supremacists, neo-Nazis, and the KKK. Actions speak louder than words. I join my colleagues and call upon President Trump to remove these white supremacists from office, and take action to defeat hate."

Rep. Barbara Lee, D-Calif., said, "The white supremacists who descended upon Charlottesville have brought vile racism, hatred and bigotry to the forefront of our political discourse once again." She added, "We cannot address the dangerous spread of white supremacy in America without honestly examining its influence on the Oval Office. President Trump has elevated hate and discrimination to the highest levels of our government. From the Muslim Ban, to raids on immigrant communities, a ban on transgender Americans serving in our military, attempts to revive the failed war on drugs and an all-out assault on civil and human rights, the influence of the alt-right is clear in the Trump Administration's policy agenda."

Calls to fire Bannon have risen after the protests in Charlottesville turned deadly. Critics of Trump's chief strategist within the White House are "making their move," according to a source close to the White House. A social media campaign, #FireBannon, also gained traction over the weekend after the violence in Charlottesville that killed one woman and injured 19 other people.

Former White House communications director Anthony Scaramucci, when asked if Bannon would be fired next week, told Stephen Colbert on Monday that "if it was up to me, he'd be gone." He added, "But, it's not up to me," it's "up to the president."

The letter was signed by: Lee; Chu; Cedric Richmond, Congressional Black Caucus chair; Michelle Lujan Grisham, Congressional Hispanic Caucus chair; Mark Pocan, Congressional Progressive Caucus co-chair; Raul Grijavla, Congressional Progressive Caucus co-chair; and David Cicilline, member of Congress.