The 'medieval' castle was designed by E.J. Lennox for Sir Henry Pellatt - with electricity and a telephone exchange. The stone for the outer wall came from Scotland and 'casa' is Italian for house. It became known as Pellatt's Folly after his death. The Victorian garden he built was like illustrations of nineteenth century English castle gardens and required a small army of gardeners. The bedding has been partly restored and some new theme gardens have been made in the Casa Loma Gardens.