Grafton was first settled in 1859 one mile below its present town site. In January of 1862 the town was completely washed away by a flood. The people rebuilt the town a mile further up stream at its present site. By 1864 about 28 families lived here.