The house was built by Daniel Deshon in 1829. Daniel had inherited the land, a working farm, and a frame structure from his father, Daniel Deshon. Daniel served as a whaling captain for a brief period between 1819 and 1824, retaining ownership in at least two vessels thereafter. In 1829, Dniel Deshon built the granite residence for his wife Fanny Thurston. Fanny was the daughter of a well-known Rhode Island Senator, George Thurston, and supposedly Daniel began building the house after being encourage to provide Fanny with a more stately home suitable for entertaining. Unfortunately it was not long after the house was finished that Fanny passed away in 1833. Soon after her death, Daniel began to reside in Hartford, losing interest in the home and advertising it for salein the Gazzette as early as the following year.
   The property would not find a buyer for some time after. Eventually the property would be purchased by Lyman Allyn in 1851. Allyn was born just north of New London in Montville on April 23, 1797. Although his family would relocate to Springfield, Massachusetts, Allyn returned to Montville by the time he was twenty-one. He began to serve as a regular sailor, serving under Captain Daniel Deshon and later as Captain for whaling vessels under the owner ship of N & W.W. Billings. By the time Allyn was thirty-seven he retired from his seafaring duties and began to develop a variety of other business ventures and holdings. He was a board member of both Lyman Law and the Whaling Bank of New London throughout the 1830s and 1840s. He was also listed as part of the board for the short-lived New London Maritime Insurance Company between 1847 and 1849. After the merger of the Willimantic, and Palmer Railroads, Lyman Allyn served as director of the newly formed New London, Willimantic and Palmer Railroad conglomerate. Allyn also served in the State Legislature, actively supporting the Democratic Party and was a member of the Episcopal Church.
    Lyman Allyn married Emma Turner, the daughter of Captain John Turner and Mary Beckwith. Together they had six children, five of which survived into adulthood. They were: Mary, Emma, Charlotte, John, and Harriet. Lyman Allyn passed away on April 18, 1874, just prior to his 75th birthday. His wife, Emma died on February 4, 1881.