When James Anderson Haviland was born on May 6, 1821, in Claysville, Kentucky, his father, Robert, was 24 and his mother, Mary, was 22. He had two brothers and five sisters. He died on March 11, 1892, in Cynthiana, Kentucky, at the age of 70, and was buried in Harrison, Kentucky.