House Republicans are considering whether to take punitive action against former Secretary of State Hillary Clinton, including the appointment of a special prosecutor, in response Clinton's careless use of classified emails during her tenure, just a day after the FBI said it wouldn't recommend criminal charges against her.

"We're not going to foreclose any options," House Speaker Paul Ryan, R-Wis., said Wednesday after meeting privately with House Republicans.

"With no indictment occurring, a discussion, or a call for administrative action, is the least we can do, given how she was so reckless in handling classified material and sending classified information on an unsecured server," Ryan said.

Ryan has said Clinton should lose her security clearance in the wake of FBI Director James Comey's damning report, which found she used her private email account and server to receive and send classified information. Comey said the actions did not warrant criminal charges, however, which most Republicans have criticized.

Ryan said House Republicans are "looking into" how Congress can respond and wouldn't rule out appointing a special prosecutor to examine Clinton's actions.

If the Obama administration takes no administrative action against Clinton, Ryan said, "we'll look into seeing if that is something we can do as well."

Republicans on the House Intelligence Committee met Wednesday morning and discussed taking legislative action, said Rep. Mike Pompeo, R-Kan., a member of the panel.

Republican members on the committee believe "as a first step" that Clinton should lose access to classified material, which she will begin receiving after the Democratic Convention when she officially becomes the party nominee. The GOP panel members believe Clinton's carelessness with classified information while serving as secretary of state put the county and in particular members of the U.S. military at risk, Pompeo said.

"We are trying to figure out if there is a legislative response to that," Pompeo told reporters. "I've read those 22 top-secret emails that she had on her private server, that Director Comey has confirmed are now likely in the hands of our enemies. If you have a family member in the military, they are less safe today as a result of what Secretary Clinton did."