In 1869, President Ulysses S. Grant laid the cornerstone of the current Victorian church building, and in 1872 construction was completed and worship began.