Roughly 100 Tea Party Patriots gathered outside the IRS building Tuesday to protest the IRS targeting conservative organizations.