White House chief of staff John Kelly said he doesn’t remember saying, if it were up to him, the number of refugees that should enter the U.S. each year should be between zero and one.

“I don’t ever remember saying between zero and one,” Kelly, who previously was secretary of the Department of Homeland Security, told Fox News host Laura Ingraham Monday in response to a New York Times report from last week. “My time at DHS was definitely — we should not take refugees into the country unless we know who they are and consequently we have improved the vetting process.”