House Speaker Paul Ryan on Thursday threw cold water on a move by conservative lawmakers to vote immediately on whether to impeach IRS Commissioner John Koskinen.

Members of the conservative House Freedom Caucus introduced a resolution on Wednesday to impeach Koskinen, who they say has withheld information from Congress and has done little to reform the agency. On Thursday morning, Rep. John Fleming, R-La., made a motion to make it a privileged resolution that deserves an immediate vote.