Sir Joshua Reynolds' Portrait of Omai was on display at CastleHoward in North Yorkshire for more than 200 years until it was sold at Sotheby's in 2001.
The baronet claimed the family had to sell up and leave Corby Castle when Philip Howard got into financial difficulties after taking on a major part of the estate.