His parents were Walter S. and Mary Hunn.

His first wife was Margaret J. Conyers. They married April 5, 1855 in Adams, Illinois.

Married Mrs. Ella A. Goddard in Shelby County TN on October 18th 1866 by George White, Rector Calvary Church, Memphis Tennessee.

Major Horace H. Hunn, president of the Hammett Grocery Company, one of the leading wholesale houses of Pine Bluff, Ark., was born in Connecticut in 1835. He was educated in Buffalo, NY and Milwaukee, Wisconsin. In 1862 he was appointed paymaster of the Federal army with the rank of major and with his headquarters at Louisville, Ky. At the close of the war he was called to the New York department, but resigned in 1866, returned to Louisville, where he was married to Mrs. Ella A. Goddard, and six years later he came to Pine Bluff to assume the management of a banking establishment. He soon learned the advantages of the banking business in the South, and in 1876 organized the Merchants & Planters' Bank of Pine Bluff, and was elected cashier and held the position until failing health led him to resign in 1890. He is now vice-president of the bank, which is on a sound financial basis, having a surplus fund larger than its capital stock. When the Hammett Grocery Company was organized in 1886, Mr. Hunn was elected president, and since retiring from the active duties of cashier of the bank he has devoted his time to the interests of the company. He is also largely interested in the cotton compress and is a heavy owner of Pine Bluff real estate. Major Hunn is a thoroughgoing business man and, while everything he touches does not turn to gold, he has been successful in all his undertakings. His advice is frequently sought as to the merits of some enterprise, and on such occasions his opinion is honestly given. In all his dealing he has been open and upright, and as a natural result he has the confidence of the entire community.
Source: The Province and the States...vol. VII, Weston Arthur Goodspeed, Editor in Chief, page 311-312