Elisha Holbrook was born 19 August 1720 in Boston, MA the son of Abiah and Mary (Needham) Holbrook. He was the second of thirteen children born to Abiah and Mary. Elisha was baptized on 21 August 1720 in the New North Church, Boston.

He married Lydia Dresser, the daughter of Benjamin and Lydia (Vaughan) Dresser on 6 January 1739/40 in the Trinity Church, Boston. They removed to Kittery, ME about 1743 with their two children, Elisha and Lydia, who were baptized in the New North Church. Elisha and Lydia had eight more children and they were baptized in the Kittery Point Church, Kittery, ME.

Elisha bought land in Kittery Point where he lived until his death. Letter of administration of his estate was filed 12 November 1763 in York County Probate Court. Two sons, William and Samuel, served in the Revolutionary War.