On 17 Apr 1740 when Joseph was 24, he first married Mary Sprague (35041) , daughter of Samuel Sprague (29412) (4 May 1662-27 Dec 1738) & Sarah Green (16693) (14 Jan 1665/6-2 Feb 1743/4), in Malden, MA. Born on 1 Dec 1709 in Malden, MA. Mary died in Malden, MA, on 3 Jul 1788; she was 78.

2 Nov 1792 (Int.) Joseph second married Mary Green (35130) , daughter of Isaac Green (16719) (20 May 1690-25 Aug 1765) & Mary Pratt (6 Mar 1695-6 Aug 1760).215 Born on 12 Sep 1721 in Malden, MA.215 Mary died in Malden, MA, on 21 Dec 1806; she was 85.215

Mary first married Benoni Vinton, second Ezra Green as his third wife, third Samuel Wyman, and fourth Joseph Lynde as his second wife.

Mary and her first husband Benoni Vinton were second cousins; his maternal grandfather and her paternal grandfather were brothers. Mary and her scond husband Ezra Green were first cousins; his mother and her father were siblings.