Born to Epes and Esther MacCarty Sargent of Gloucester. 3 Feb 1763 married Mary Turner, daughter of John and Mary Osborne Turner of Salem, Massachusetts. From "Reminiscences of Lucius Manlius Sargent 1871": 'Mr. (Daniel) Sargent, a merchant largely concerned in the fishery business in Gloucester, moved to Boston, between 1770 and 1780. He purchased a house in Atkinson (now congress) Street, near High Street, which was consumed in the great fire of July 30, 1794; then he hired a house on Forthill of T. Elliot, and in 1797 removed to a large and splendid mansion at the corner of Essex and Lincoln Streets, at the rent of $1000 a year - a high price in those days. He afterwards bought it, and there lived till his death; soon after which it was occupied by the Female Asylum. His store was on Long Wharf, first No. 25, then 40."