One of Japan's most famous and dramatically situated yama-shiro (mountain castles), Takeda-jō was built in 1441 by Ōtagaki Mitsukage. The castle was established close to Tajima Province's southern border with Harima Province in order to intercept any advance on Izushi Castle further north. The castle was conquered in 1577 by Toyotomi Hideyoshi, who installed his brother, Hidenaga, as lord afterwards. Hidenaga moved on to Izushi Castle within two years, leaving Takeda-jō in the hands of Akamatsu Hirohide. Following the siege of Tottori Castle in 1581, Hirohide committed seppuku in response to accusations of him burning down the town, and Takeda Castle was subsequently abandoned.