Horace John first married Caroline Elvira Stebbins, daughter of James Stebbins (31 Jan 1777-29 Mar 1869) & Eunice Tidd (23 Jan 1792-15 Apr 1838). Born on 29 Mar 1834 in Homer, Cortland County, New York. Caroline Elvira died in Moravia, Cayuga County, New York, on 25 Dec 1896; she was 62. Buried in Indian Mound Cemetery, Moravia.

Cemetery inscription:
Caroline E. wife of Horace Phelps died Dec. 25, 1896, aged 62 yrs 8 mos 25 ds

On 26 Jan 1898 when Horace John was 65, he second married Emma L. Ingram, daughter of Philip Robinson Ingram (19 Mar 1816-1 Aug 1876) & Ruth Smith (30 Mar 1819-25 May 1897), in Ilion, Cayuga County, New York. Born on 20 Dec 1855 in Fleming, Cayuga County, New York. Emma L. died in Union Springs, Cayuga County, New York, on 30 Dec 1937; she was 82. Buried in Indian Mound Cemetery, Moravia.

1880 Federal Census. Springport, Cayuga County, New York
Roll 814, page 322B
    Ruth Ingram, 60, widowed, housekeeping, b. NY, parents b. CT
    Emma Ingram, 24, daughter, b. NY, parents b. NY
    Pheba Ingram 19, daughter, b. NY, parents b. NY
    Nellie Tompkins, 13, step daughter, b. NY, father b. NY, mother b. MI

1910 Federal Census. Springport, Cayuga County, New York
Roll T624_928, page 2B
7 Homer Street, Union Springs
    Emma L. Phelps, head, 54, widowed, no children, b. NY, parents b. NY, keeper, boarding house

1920 Federal Census. Springport, Cayuga County, New York
Roll 1090, page 3B
11 Homer Street, Union Springs
    Emma Phelps, 64, head, widowed, b. NY, parents b. NY
    Laura Wilcox, 66, border, widowed, b. PA, parents b. PA
    Ella Bentley, 66, border, divorced, b. NY, parents b. NY

1930 Federal Census. Springport, Cayuga County, New York
Roll 1411, page 1B
7 Homer Street, Union Springs
    Emma L. Phelps, head, 74, widowed, b. NY, parents b. NY

Obituary, unattributed
    Rites conducted for Mrs. Phelps. Union Springs
    Last rites for Mrs. Emma L. Phelps, 83, of this village were Sunday afternoon at the home and later in the Methodist Episcopal church. Rev. Ralph L. Smith, pastor, officiated and burial was in Indian Mound cemetery, town of Moravia.
    Mrs. Phelps was the widow of Horace Phelps. She had resided here for the past 36 years. She was one of the oldest members of the Union Springs Methodist church, having joined at the age of 12. She was an active member of the local WCTU chapter.
Surviving are two sisters, Mrs. Albert Rynders, Sempronius; and Mrs. C. H. Joselyn, Sterling and several nieces and nephews.