Justice Samuel Alito began his 22nd Supreme Court term last week, but even as he insists he will remain on the bench, speculation has grown over whether it could be his final one on the high court.

Alito, who was appointed by former President George W. Bush and confirmed to the Supreme Court in January 2006, has not publicly hinted at an imminent retirement or expressed a desire to step back from his daily duties. Alito, 76, told CBS News ahead of the new term that he thought about retirement but qualified it by saying that, at his age, stepping away is something he must consider annually.