Horace was the son of Robert Smith of Westbourne Terrace, Hyde Park, London.
He was educated at King’s College, London, and Trinity Hall, Cambridge (BA in honors, 1860). Called to the bar in 1862, he held several important posts, and became a Metropolitan Police Magistrate in 1888.