The first record of the manor is from the 13th century when it was held by the Abbey of St Albans who controlled it until the Dissolution of the Monasteries.^[3] The house, which has an 18th-century core, was owned by Thomas Neate;^[2] it was then bought and expanded in the gothic style for George Woodford Thelluson, a wealthy banker, and completed in 1802.^[1][4]

Around 1800, Thelluson also built a brick sham ruin with cement rendering in the grounds.^[5] An icehouse was also brick built and covered with earth.^[6] A picturesque gothic folly with a turret was also constructed at the same time.^[7] The granary, which also dates from around 1800, has a timber frame and slate roof.^[8] The grounds were laid out by Humphry Repton.^[2] It was then acquired by Admiral Sir Charles Pole, 1st Baronet in 1812.^[9] He renamed it Aldenham Abbey.^[2]

The house passed to William Stuart, Pole's son-in-law, and then remained in the Stuart family until 1910, when it became the property of the banker J. P. Morgan Jr.^[10] The wellhead with a circular bowl with carvings on the outside, within the grounds was put in place by J. P. Morgan in the early 20th century, having been moved from a site where it has stood since the 17th century or earlier.^[11] The house and estate were then acquired by Hertfordshire County Council.^[2]

During World War I, the hall provided support for wounded soldiers with a Voluntary Aid Detachment hospital being opened in the garage.^[3] By 1916, it had been expanded to hold 30 beds, and it had increased again to 48 beds in 1917.^[12]

In Second World War, a Red Cross hospital managed by Thurstan Holland-Hibbert, 4th Viscount Knutsford, was established at Church Farm, on the estate, while the main house was as an administrative centre by the British Army and housed the War Office Selection Boards. While based at Wall Hall, the selection process was made less subjective and psychologists were brought in to develop intelligence testing and extended interviews for officer candidates.^[3]

Part of the building and estate was used by the Special Operations Executive (SOE) and designated as "STS 39". It moved to Wall Hall in 1943, and was used as a finishing school for agents under the command of Major John Hackett and then Major Walte Gallie as part of the SOE and Political Warfare Executive. Agents were trained in various potential roles including parachuting, radio operation and weapons handling, along with propaganda in preparation for deployment in German-occupied Europe, particularly France, Netherlands and Belgium.^[13] It also provided a home for Joseph P. Kennedy Sr., the United States ambassador.^[14]

After the war, the house became a teacher training college.^[4] It was later used as a residence by the University of Hertfordshire until 2003^[15] after which it was re-developed into luxury flats,^[16] and the west side of the parkland overlaid with a golf course.^[2]

The two-storey main house is built of brick with cement render and a slate roof hidden by a crenellated parapet. The front entrance consists of partially glazed double door within a porte-cochère, which was added around 1830. The door leads to an entrance hall with neo-Jacobean panelling. At either end of the front elevation are corner turrets with pinnacles; there are also three-storey turrets. Further turrets are also visible on the front wall; one being square with an octagonal bartizan and the other octagonal.^[1]

The site covers around 65 hectares (160 acres) and slopes towards the River Colne. An artificial canal from the river feeds a small lake. The remains of a kitchen garden and orchard can still be seen.^[2] A broad leaf woodland with bluebells, known as Berrygrove Woods, covers 44 hectares (110 acres) towards the south of the estate.^[17]