The fortress, overlooking the village of Talamone, was built in the mid-thirteenth century by the will of the Aldobrandeschi, with functions of sighting and defense on the landing below. Enlarged and restructured by the Sienese in the following century, it was further modified during the fifteenth century. Semi-destroyed by some pirate raids, it was restored in the second half of the 16th century.