The man charged with driving his car into a crowd of counter-protesters at a white supremacy rally in Charlottesville, Va., is a part of a neo-Nazi, racist group called Vanguard America, according to the Southern Poverty Law Center.

However, the group says the man is not a member.

James Alex Fields, 20, is charged with second-degree murder among other charges for allegedly plowing his Dodge Challenger into a large crowd in Charlottesville. Photographs of the rally showed Fields holding a shield among members of Vanguard America.

The group sent out a statement Sunday denying that Fields was a member.

"The shields seen do not denote membership nor does the white shirt," the group said. "The shields were freely handed out to anyone in attendance."

The Toledo Blade, an Ohio newspaper, spoke with Fields' mother and she told them he had gone to Charlottesville to participate in an "alt-right" rally that she assumed had something to do with President Trump.

"I told him to be careful," Samantha Bloom said to the Blade. "[And] if they're going to rally to make sure he's doing it peacefully."