Son of David Worley and Catherine Baker. He was married to Mary Ann "Polly" Whisenand.

The children of Hiram George Worley and Mary Ann "Polly" Whisenand are:

- Catherine Worley (b. abt. 1824; d. bet. 1880-1900 (see Find A Grave Memorial# 123829731). Was married to Andrew John Jackson "Jackie" Howard. They had a son, Isaac Baker Howard, who was named after his great, great-grandfather, Isaac Baker, who's daughter Catherine Baker married David Worley. He also had an uncle named Isaac Baker Worley.
- Rebecca Worley Ledford (b. Dec 08, 1825; d. May 29, 1895 (see Find A Grave Memorial# 82357214). Was married to William Houston Ledford.
- Charlotte "Lottie" Worley Smith (b. 1827; d. Feb 04, 1896 (see Find A Grave Memorial# 54050323). Was married to John Adam Smith.
- Naomi Worley Boles (b. Nov 07, 1829; d. Jan 14, 1873 (see Find A Grave Memorial# 57946196). Was married to Robert F. "Bob" Boles.
- Isaac Baker Worley (b. abt. 1831; d. aft. 1880, burial location unknown). Was named after his great-grandfather, Isaac Baker, who's daughter Catherine Baker married David Worley. Isaac Baker Worley married Susan A. Beaty.
- Mary Worley (b. abt 1835, death and burial location unknown)
- Hiram George Worley, Jr. (b. Jun 03, 1839; d. May 17, 1915 (see Find A Grave Memorial# 9340350). Was married to Mary Rebecca Booher.
- John Nathan Worley (b. Oct 15, 1841; d. Aug 24, 1893 (see Find A Grave Memorial# 37734148). Was married to Sarah Elizabeth Reeser and Louverna Howard.
- James L. Worley (b. Abt. 1844; d. aft. 1870, burial location unknown). Was married to Nancy Parks.
- Martha Worley (b. abt. 1845, burial location unknown)

A number of Hiram George Worley's children were named after his siblings or grandparents.