The Human Rights Campaign, a major gay rights organization, is standing by its endorsement of Illinois Republican Sen. Mark Kirk after he questioned whether his challenger’s ancestors fought in the Revolutionary War.

“Mark Kirk’s comments were wrong and inappropriate,” said Human Rights Campaign communications director Brandon Lorenz in a statement released Friday. “HRC endorsed Sen. Kirk on the strength of his record on LGBTQ equality, and while that remains unchanged, we believe he should rescind his comments immediately.”