12th Century
The original dwelling on the site is believed to have been a motte castle, probably constructed by Geoffrey Savage sometime in the period 1100 - 1135. This castle consisted of a motte and bailey, within which some form of house was erected. No details of this house now remain.

13th Century
Nothing is known of the motte castle during this period.

14th Century
Sir William Bagot, a distinguished nobleman of the time purchased the site of the former house in about 1381 and contructed the present stone castle in 1397. The castle is believed to have been on three storeys. with kitchen and store at ground level, banqueting and reception on the first floor and other accommodation rooms at the top.The castle may have looked something like the illustration here.The remains of a turreted stair remain which probably linked all three levels. The roof space would have had open areas to keep a watch on the surrounding fields, probably supplemented by watch towers at each corner. There appears to have been a moat surrounding the castle, as there remains evidence of a drawbridge to the first floor entrance on the east side.The castle would have a clear view across the River Sowe to the west, but the prospect to the north, east and south pose a mystery, since the castle appears to be in a depression on these sides.

15th Century
Sir William Bagot died in 1407 and the castle and estate were sold to Richard de Beauchamp, 13th Earl of Warwick in 1417. This was one of many residences owned by the Earl, but it is not known how much time he spent there. The Earl died in 1437 and a substantial trust was set up from his will. In 1471 the castle was acquired by the Collegiate Chruch of St Mary, Warwick. It is believed that the castle was habitable after the acquisition, but it appears to have fallen out of use thereafter.

16th Century
The caste was described in 1540 as being 'desolate'. In 1544 the castle site was purchased by Francis Goodere. This nobleman had many other properties elsewhere, some of which were in need of renovation and it is probable that he used stone from the 'desolate' Bagot's Castle for this purpose, causing the castle to fall into ruin. On his death ownership passed to his son, Henry.

17th Century
Henry Goodere had an extravagant lifestyle and to raise cash he sold the castle and its surrounding land to Sir William Bromley in 1618. The Bromley family had moved into the area and established a family home at Baginton to the north east of the castle.That became known as Baginton Hall.

18th Century
In 1706 Baginton Hall burnt down. It was rebuilt and at the same time the castle stones were covered, the site was levelled and laid out as a park and pleasure garden. In 1714 a summer summerhouse for the hall was constructed to the west of the castle with a view over the River Sowe.

19th Century The second Baginton Hall burnt down and was not replaced. The castle site, including the summerhouse, fell into disuse and vegetation started to take over, with trees and shrubs covering the site.

20th Century
The castle site was purchased from the Bromley family by Coventry Boy Scouts Association, with the intention of converting it to an adventure park, but this never materialised and the site was eventually sold to Finham Golf Club. Excavations were carried out by Coventry Archaeological Society in 1930, but nature took over again.

21st Century
David Hewer (1947 - 2023) became custodian of the Castle in 2005. A Charity was formed and the Trustees continue his restoration and conservation legacy.

This film was shot in the late 1950s. It shows the state of the castle and the Summerhouse at that time. A clip from the video shows excavation of the Saxon village remains, on one side of the landfil site that covered much of the of what is now the goats' field