White House physician and Rear Adm. Ronny Jackson is weighing whether to remove his name from consideration as nominee to head the Department of Veterans Affairs amid irritation with the nomination process, according to a new report.

A White House official told the Washington Post Jackson was growing exasperated and drained from the nomination process. Jackson has faced opposition from veteran advocates and lawmakers who have raised questions about his qualifications to lead the agency.