On 27 Apr 1763 when Jacob was 24, he married Sarah Potter (55047) , daughter of Ezekiel Potter (16 May 1721-29 Jun 1801) & Mary Cummings (39266) (ca 1720-16 Nov 1806), in Ipswich, MA. Born on 30 Aug 1745 in Ipswich, MA. Sarah died in Topsfield, MA, on 11 Oct 1828; she was 83.

Children of Jacob and Sarah (Potter) Peabody, born at Topsfield:
    i. Jacob Peabody, b. 10 May 1764, d. 6 Oct 1845, m. 1st 15 Nov 1785 Huldah Wildes (b. 1767, d. 30 Jun 1811), m. 2nd 4 Jul 1816 Elizabeth Perkins (d. 28 Aug 1849);
    ii. Sarah Peabody, b. 6 Jun 1769, d. 2 Mar 1845, m. 19 Mar 1786 David Burnham Balch;
    iii. Lucy Peabody, b. 10 Mar 1773, m. 27 Mar 1794 James Friend;
    iv. Lydia Peabody, b. 23 Oct 1775, d. 1832, m. 7 May 1695 Moses Bradstreet;
    v. John Potter Peabody, b. 5 Dec 1780, d. 5 Nov 1846, m. 23 Jul 1807 Esther Perkins (b. 12 Jan 1790, d. 11 Aug 1842, dau. of Robert & Esther (Gould) Perkins);
    vi. Mary Peabody, b. 14 Nov 1782, m. 29 Mar 1803 Ezra Perkins; and
    vii. Ezekiel Peabody, b. 13 Jun 1788, d. 15 Apr 1888, m. 6 Jul 1815 Mary Goodhue (b. 18 Jan 1789, d. 28 Sep 1858, dau. of Aaron & Mary (Kimball) Goodhue).