A handful of House Democrats said Wednesday they would not support Nancy Pelosi’s bid to become House speaker, and insisted after a Democratic caucus meeting they have the votes to take her down.

Rep. Marcia Fudge, D-Ohio, who is working with other defectors to topple Pelosi, joked after the meeting that she “just might” put her name forward for a speaker bid.