1832: married to Rhoda Hedgepeth Wright (5/7/1817-10/23/1848) - had 9 children.

1850 Federal Census taken 11/14/1850, for Chester Co., SC:
Wm. Colvin, male, age 39, b. SC;
Jane Colvin, female, age 28, b. SC;
Jane Colvin, female, age 16, b. SC;
Jemima Colvin, female, age 13, b. SC;
Mary Colvin, female, age 12, b. SC;
Wm. H. Colvin, male, age 9, b. SC;
Thos. R. Colvin, male, age 8, b. SC;
Vincent B. Colvin, male, age 7, b. SC;
Susan Colvin, female, age 5, b. SC;
Spencer P. Colvin, male, age 4, b. SC.

1851: married to Jane Weir Esters (5/21/1814-8/6/1864) - had 4 children.

1860 Federal Census taken 9/19/1860, for Vienna P.O., Jackson Parish, LA:
William Colven, male, age 50, b. SC;
Jane Colven, female, age 43, b. SC;
Thomas B. Colven, male, age 19, b. SC;
V. D. Colven, male, age 16, b. SC;
Susan Colven, female, age 14, b. SC;
Samuel P. Colven, male, age 13, b. SC;
John P. Colven, male, age 8, b. SC;
William S. B. Colven, male, age 6, b. SC;
Mary E. Colven, female, age 5, b. SC;
Ansly H. Colven, male, age 3, b. LA.

1865: married Mary "Mollie" W. Aswell (1/12/1829-6/30/1882) - had 2 children.

1870 Federal Census taken 6/20/1870, for Jackson Parish, LA:
W. H. Colvin, male, age 59, b. SC;
M. W. Colvin, female, age 40, b. LA;
J. P. Colvin, male, age 18, b. SC;
S. W. B. Colvin, male, age 17, b. SC;
M. Colvin, female, age 15, b. SC;
A. Colvin, male, age 12, b. LA;
L. Colvin, female, age 3, b. LA;
W. H. Colvin, Jr., male, b. 3/1870 @ LA;
D. Braton, black female, servant, age 45, b. SC.

1880 Federal Census taken 6/23/1880, for Lincoln Parish, LA:
Wm. H. Calvin, head, age 70, b. SC;
Mary Calvin, wife, age 50, b. LA;
Loula Calvin, dau., age 13, b. LA;
William Calvin, son, age 10, b. LA;
Jasper M. Calvin, nephew, age 27, b. SC;
Nannie Aswell, sis-in-law, age 33, b. LA;
Munk Baker, hired hand, age 23, b. LA;
Jas. Horton, wagoneer, age 29, b. SC;
Wm. Dye, grandson, age 21, b. LA.

7/30/1883: married Josephine Teutsch