The Castle Gaol, with a commanding view over the town was built as a reform gaol in 1820 on the site of the original Jethart Castle which was demolished in 1409 to keep it out of the hands of the English.