Thomas Jefferson is famous for his writing of the Declaration of Independence, however, he is also the first president to take the Oath of Office in Washington, D.C. Before Thomas Jefferson became president, the president was sworn-in in either Philadelphia or New York City. It was not until November 17, 1800 that the capital of the United States was in Washington, D.C.
Thomas Jefferson was also the first president who did not take a horse-drawn carriage to and from his inauguration. He instead chose to walk.
http://www.inaugural.senate.gov/swearing-in/event/thomas-jefferson-1801
http://www.senate.gov/reference/reference_item/Nine_Capitals_of_the_United_States.htm