Surrounded by dated wood paneling and stacks of newspapers, Ben Carson lives out most of his days at the Department of Housing and Urban Development quietly.

His 10th-floor office in a nondescript government building in Southwest Washington could not feel further removed from the cable news green rooms and early-state coffee shops that turned the former neurosurgeon into a household name during the 2016 Republican primary.