A frustrated House Speaker Paul Ryan called on the Republican conference to stick together and “act like a majority” at a closed-door meeting that followed Friday’s defeat of a major farm policy bill.

Ryan, R-Wis., plans to return to Wisconsin Tuesday in order to attend his son’s graduation, but he stayed in town long enough to deliver a warning to GOP lawmakers who have become increasingly defiant since he announced his intent to retire at the end of the year.