The origins of the present house are a mansion rebuilt and extended by William Baker for the 1st Earl of Powis in the mid-18th century. In 1771, Powis sold the estate to Robert Clive, Clive of India, who engaged William Haycock to undertake rebuilding.^[1] Following Clive's death in 1774, his son, Edward, engaged Haycock's son, John Hiram Haycock to undertake further extensions for Clive's mother, Margaret, who continued to live at the property until her death in 1817.^[2] By the time of his mother's death, Edward had been created Earl of Powis, having married Henrietta Herbert, daughter of the Henry Herbert who had sold the Oakly estate to his father. Having inherited Powis Castle through his wife, he had little need for Oakly and its use passed to his second son, Robert.

Elected Member of Parliament for Ludlow in 1818,^[a] the following year Clive commissioned his friend Charles Robert Cockerell to remodel the house. Clive and Cockerell had toured Europe together, and co-founded the Travellers Club in Pall Mall. Cockerell's subsequent work on the excavations at Bassae in Greece provided inspiration for some of the decoration at Oakly Park.^[4] Work on the house was undertaken in two stages, between 1819 and 1826, and a second phase from 1836.^[1]

Oakly Park remains the private home of the Windsor-Clive family, the house presently being home to Lord Windsor, heir to the 4th Earl of Plymouth.^[5] The house and park are not open to the public.^[6]

Oakly is of brick and ashlar, three storeys high with attics and a basement.^[7] Newman and Pevsner in their revised Shropshire volume of the Buildings of England, consider five rooms of note. The vestibule is a circular room dating from the younger Haycock's work, although Cockerell added a "saucer dome". The staircase hall is entirely his,^[4] as is the "exquisitely restrained" library.^[1] The conservatory was the last element of the first phase of building, the breakfast and dining rooms dating from the second, when Clive, by then Windsor-Clive following his marriage to Harriet Hickman, joint heiress to the Earl of Plymouth, required more space for his expanding family.^[1]

Cockerell's conservatory was demolished in the 1920s, but the remainder of the early 19th century garden and park is largely intact.^[8] Oakly Park is a Grade II* listed building^[7] as is the garden and park in which it stands.^[9] Other listed structures within the estate, all designated Grade II, include the balustrade in the forecourt,^[10] the stables,^[11] the lodge^[12] and gates at the start of the carriage drive^[13] and a bridge on the carriage drive where it crosses the River Teme.^[14]

• Newman, John; Pevsner, Nikolaus (2006). Shropshire. Buildings of England. New Haven, US and London: Yale University Press. ISBN 978-0-300-12083-7. OCLC 70671576.