Rep. Vance McAllister has tried to hold on to his House seat after a newspaper in his district on Monday published a video of him passionately embracing and kissing a staffer, earning the nickname "the kissing congressman."

The Louisiana Republican apologized, begged forgiveness and promised to win back the trust of those he'd disappointed.

That may not be enough. On Thursday, Louisiana Republican Party Chairman Roger F. Villere Jr. called on him to resign.

"Mr. McAllister's extreme hypocrisy is an example of why ordinary people are fed up with politics. A breach of trust of this magnitude can only be rectified by an immediate resignation," Villere said in a statement. "He has embarrassed our party, our state and the institution of Congress. A video showing him engaged in conduct unbecoming a member of Congress, on public time, in a public office, with one of his employees, was the focus of the national press for days. I call on Mr. McAllister to put the interests of his nation, state and party above his own and step aside."

Villere said his statement came after he had failed to resolve the matter with McAllister privately.

Meanwhile, House Speaker John Boehner said Thursday that McAllister spoke with him about the scandal.

"He's got decisions that he has to make," Boehner said.

The staffer, Melissa Peacock, a part-time scheduler in his district office, resigned after the video broke and her husband slammed McAllister in an interview with CNN.

McAllister, elected in a November special election with the support of members of the "Duck Dynasty" cast, hasn't voted in the House since the video was leaked.