Founded in the reign of Henry I by William Bertram, Baron of Mitford as a house for Augustine canons, the exact date is not known but thought to be Brinkburn Priory somewhere between 1130 and 1135 as Henry died in this latter year. The architects responsible for Longframlington Church a few miles away are likely to have been the builders.

Tradition tells of a party of marauding Scots who were unable to find the Priory, although close by. The band failed in their bid to plunder and started off for home when they were startled to hear the sound of bells, which the monks rang in joy at their departure. The Scots returned and following the sound of the bells, forced their way through a dense wood to the Priory. Pillage was the order of the day and the Priory burned.