John Oliver Williams was the son of Dr. Henry Eugene Williams and Jenny Williams of Pine Bluff, Arkansas. He attended Pine Bluff public schools and the University of Arkansas until he received an appointment to the United States Military Academy at West Point, New York. He graduated from West Point in 1928 and served as an Army officer at Fort Crook, Nebraska, Brook Field, Texas, Fort Sam Houston, Texas, Fort Davis in the Panama Canal Zone, and at Fort Benning, Georgia. He was in Panama for almost five years before being assigned to the 3rd Infantry Division in December, 1941. In October of 1942, he sailed with the division for North Africa as the regimental executive officer with the 7th Infantry Regiment and participated in OPERATION TORCH, the invasion of North Africa. He fought with his regiment throughout the Tunisian campaign and continued with them into the invasion of Sicily. Lt. Col. Williams was killed in action while leading a patrol on 7/16/1943 in enemy territory at Agrigenton.

Lt. Col. Williams married Annina Bond, the daughter of John H. and Ray S. Bond, in Bexar County, Texas, in 1930. His son, John Oliver Williams, Jr., was born there on 4/24/1931. The couple would have two more children, daughters, Nancy Ray Williams and Judith Ann Williams. The family continued to live in San Antonio close to Annina's parents after Lt. Col. Williams' death.

Lieutenant Colonel John Oliver Williams earned the following verified decorations for his service and supreme sacrifice during World War II:
- Combat Infantryman's Badge
- Bronze Star Medal
- Purple Heart Medal (posthumously)
- American Defense Medal
- American Campaign Medal
- European Theater of Operations Campaign Medal with 3 battle stars
- World War II Victory Medal
- Presidential Unit Citation ribbon