After a surprise loss to a little-known primary challenger, Virginia Republican Congressman Eric Cantor is stepping down as House Majority Leader.

In his final speech as Majority Leader Thursday, Cantor thanked his colleagues on both sides of the aisle for their service and support. Most notably, he praised Speaker of the House John Boehner for his “patience” while working together during the past five years.