The White House was forced into damage control Saturday as it walked back President Joe Biden’s remarks after he said Russian President Vladimir Putin “cannot remain in power.”

In an impassioned speech from Warsaw, Poland, Biden implored the people of Russia to reject Putin’s bloody invasion into neighboring Ukraine, an act that has been met with some resistance from both Russian civilians and troops. The Russian leader was “bent on violence from the start,” the president said.