Joseph Peabody a rich Salem shipping merchant purchased the Danvers estate in 1812. The first section of the estate is known as the Old Fashioned Garden. The gazebo or Little Summer House was designed by Joseph Peabody's fourth son. Another descendent of Peadbody asked the Boston firm of Little, Browne and Moore extend the house in 1893. She also enlarged the garden. There is an Italian Garden designed by Joseph Chamberlain, father of Neville Chamberlain (Prime Minister of Great Britain before the Second World War). The style, related to the Arts and Crafts movement, was popular in England at the time.