The son of Robert & Phebe (Beals) Sumner of Fairfax Co VA and late of Guilford Co NC, Caleb was born in Carver's Creek, Anson [then Bladen, now Cumberland] Co NC. His birth is recorded, along with siblings, at New Garden, Rowan Co NC:

"William Sumners [sic] Son of Robt Sumner and the above named Phebe Canaday his then wife was born ye 29 of ye 9 mo 1747 O:S: ye 13 of ye 11 mo N:S:
Bowater Sumner Son of ye same was born ye 8 of ye 8 mo 1749 O:S: ye 20 of ye 10 mo N:S:
Caleb Sumner Son of ye same was born ye 22 of ye 5 mo 1751 O:S: ye 3 of ye 7 mo. N:S:"

Caleb married Mary Elizabeth (Cook) Carson on 9 Oct 1782 at the Tom's Creek Quaker Friends Meeting House in Surry Co NC, the daughter of Thomas & Mary (Underwood) Cook, and widow of Uriah Carson.

Encyclopedia of American Quaker Genealogy
New Garden MM, Vol I, NC:
"1782, 10, 9. Caleb, Surry Co., s Robert, m Mary Carson."

Children with Mary:
1) Mary Sumner (1783-1860), m: William Beeson (1781-1826).
2) Phebe Sumner (c1786- ); m. Jonathan Hodgson.
3) Tabitha Sumner (1789-1834), m: Bowater Burris (1784-1841); my 3x paternal Gr-Grandparents..
4) Caleb Sumner Jr (1792-1850), m: Rebecca Harrold (1796-1864).
4) Amy Sumner (c1796-c1798).

Caleb may have been married secondly to a woman named Sarah, but this is not yet verified. He was 31 yrs old when he married the widowed Mary, who brought to the marriage six children, among them a son named John who later married Caleb's much younger sister, Abigail.

By the time Caleb married Mary, her oldest children by Uriah Carson, Sarah and John, were already married. Her younger children were ages 12, 10, 7 and 5 years.

On 25 Mar 1809, Caleb and his family received in OH from NC:
(Old) Fairfield MM, Leesburg, Highland Co OH -
"1809, 3, 25. Caleb & son, Caleb, received on certificate from Westfield MM, N.C., dtd 1808, 1, 12."

Encyclopedia of American Quaker Genealogy
Vol 5, Pg 215, OH:
"1809, 3, 25. Mary & daughters, Mary & Tabitha, received on certificate from Westfield MM, N.C., dtd 1808, 11, 12."

Wife Mary died 31 Mar 1809, a few days after being received into the Fairfield MM in Leesburg, Highland Co OH. She was laid to rest there and on 17 Feb 1827, Caleb was granted a certificate to move from OH to IN:
(Old) Fairfield MM, Leesburg, Highland Co OH -
"1827, 2, 17. Caleb granted certificate to Fairfield monthly meeting, Ind."

There are two Fairfield MM, one in Highland Co OH, the other, where Caleb moved to in 1827, is located in Friendswood, Hendricks Co IN.

In 1750, Anson Co was formed from Bladen Co, in NC. In 1753, Rowan Co was formed from the northern part of Anson Co. In 1754 the northern part of what was left of Bladen County became Cumberland County. In 1771, the northeastern part of Rowan Co then became Surry Co NC. These kinds of re-allocations are part of the confusion for the locations of many births, deaths, etc.

Additionally, in 1757, the northwestern two-thirds of Fairfax Co VA became known as Loudoun Co VA.