Sen. Marco Rubio objected on Friday to the Biden administration’s decision to pause nearly all deportations.

“It is deeply troubling that one of the first actions taken by the Biden Administration could undermine the safety and security of all Americans, including immigrants here lawfully,” Rubio wrote in a letter to acting DHS Secretary David Pekoske. “I am concerned that such directives will prevent the removal of illegal immigrants with existing removal orders, including those with serious criminal records and convicted of violent crimes such as rape, sexual assault, and other aggravated felonies.”