He served eight years in Congress and became Governor in 1898.

During his term of office Stone eliminated a three million dollar debt by recalling back loans owed to the Commonwealth. It was largely this money that was used to finance the construction of the new Capitol building designed by Joseph Huston in 1902.

Governor Stone served as President of the Capitol Building Commission and appointed the other members of the commission, which oversaw the construction of the Capitol building until its completion in 1906. Though he was a Quay Republican, he engendered none of the same blame that other public officials did from the Capitol graft scandal.