Sherman retired from the army in 1884 and lived most of the rest of his life in New York City. He was devoted to the theater and was much in demand as a speaker at banquets, in which he indulged a fondness for quoting Shakespeare.