On 1 Nov 1807 when Perry was 38, he first married Mary Pease, daughter of Levi Pease (ca 1739-28 Jan 1824) & Hannah Sexton (-21 Jul 1832), in Shrewsbury, MA. Born on 11 May 1779 in Somers, CT. Mary died in Shrewsbury, MA, on 2 Dec 1816; she was 37.

Mary died age 37.

On 7 Jan 1817 when Perry was 47, he second married Barbara Temple, daughter of Henry Temple (ca 1766-26 Jun 1833) & Achsah McBride (23 Nov 1767-23 Oct 1835), in Northboro, MA. Born on 8 Jan 1794 in Berlin, Worcester County, Massachusetts.687 Barbara was baptized in Berlin, Worcester County, Massachusetts, on 31 Aug 1794. Barbara died in Holden, MA, on 6 Oct 1867; she was 73.