On 20 Mar 1797 when Joseph was 25, he first married Sarah Wright in Duxbury, MA. Born on 31 Oct 1777 in Duxbury, MA. Sarah died in Duxbury, MA, on 1 Nov 1802; she was 25.

On 6 Jan 1805 when Joseph was 33, he second married Betsey Stetson (57508) , daughter of Capt. Theophilus Stetson (45187) (10 Jul 1742-) & Abigail Prince (48921) (1 Nov 1747-), in Duxbury, MA.284 Born on 24 Aug 1781 in Kingston, MA.182 At the age of 5, Betsey was baptized in Kingston, MA, on 4 Sep 1786.182

On 2 Nov 1808 when Joseph was 37, he third married Mary Holmes in Duxbury, MA. Born on 25 Nov 1781 in Duxbury, MA. Mary died in Duxbury, MA, on 3 Nov 1826; she was 44.

On 19 Nov 1800 when Ezra was 27, he married Jane Hunt (57580) , daughter of Lot Hunt (45225) (9 May 1756-17 Oct 1822) & Mary Sampson (22 Mar 1751-22 Aug 1813), in Duxbury, MA. Born on 17 Mar 1784 in Duxbury, MA. Jane died in Duxbury, MA, on 25 Aug 1864; she was 80.

Jane first married Ezra Prior, second William Joyce.

Deaths Registered in the Town of Duxbury
Jane Joyce (Hunt), d. 25 Aug 1865, æ. 81 years 4 months 14 days, at Duxbury, b. there, married, daughter of Lot & Mary Sampson of Duxbury, died of disentry & typhoid fever