Originally the United Presbyterian Cemetery, White Oak Cemetery was purchased by the City of Bloomington in 1914 and renamed White Oak in 1983.

For most of its history, the White Oak Cemetery was named the United Presbyterian Cemetery. The United Presbyterian Church (or its predecessor, the Associated Reformed Presbyterian Church), was established in 1833 and built at early log church building on this site, which was given to the church by John Blair. The first burial in the adjoining cemetery was probably in 1837 (as stated in the November 1, 1898 issue of the local newspaper, the Republican Progress). This cemetery is thus one of the oldest in the country, having been started only 19 years after Monroe County was organized. Many of the pioneer church members, several being important figures in early Monroe County history, were buried here. These include names such as Fee, Wylie, Bryan, Gourley, Woodburn, and Henderson, important names in Monroe County and United Presbyterian Church history.

An article in the December 22, 1883 Bloomington Telephone notes that a substantial stone fence was placed around the cemetery through the efforts of James Strong. But less than 15 years later an article in the November 1, 1898 issue of the Republican Progess that the trustees of the church had put the cemetery up for sale. The article indicated that the burials had been removed to Rose Hill Cemetery. Many monuments in this cemetery did not immediately sell, as records indicate that the City of Bloomington purchased the property from the church of 1914. The city made improvements to the cemetery in 1982 including re-grading, landscaping, and installation of a new lawn on the east end. They gave the renovated cemetery the name White Oak Cemetery in 1983. The west part of the cemetery is still being used for burials.

An important date in the history of the cemetery was November 3, 1989. On that date the Bloomington Township Trustee, James Dawson, and his advisory board with the support of Bloomington Mayor Tomilea Allison dedicated the Pioneer Memorial. The memorial commemorates early settlers who were buried in small cemeteries that are now lost or destroyed, mostly in the name of "progress". The marker lists names of 132 early settlers buried in small cemeteries in Bloomington township from 1815 to 1947. Dawson also prepared a booklet with the names of people buried in those cemeteries.