Gary Johnson’s campaign manager admitted early Wednesday that the Libertarian candidate’s fight to win the White House ended up taking votes that would have gone toward Hillary Clinton and Donald Trump.

“When we looked at the early results, we have to honestly say he was kind of pulling from both and that’s kind of how it’s moved through the campaign,” Ron Nielson told Politico. “I think these results that we’re seeing tonight, I’m not really sure who the voters are that finally ended up voting.