On 21 Jun 1759 when Joseph was 24, he first married Keziah Parker (28223) , daughter of Andrew Parker (36335) (14 Feb 1692/3-8 Apr 1776) & Sarah Whitney (11761) (9 Apr 1705-18 Dec 1774), in Lexington, MA.232 Born ca 1740 in Lexington, MA. Keziah was baptized in Lexington, MA, on 1 Jun 1740.232 Keziah died in Lunenburg, MA on 7 Aug 1776.231 Marriage intention published on 4 May 1759 at Lunenburg, MA.231

On 8 Oct 1777 when Joseph was 42, he second married Sarah Carlton in Lunenburg, MA.