The Cornerstone Missionary Baptist Church had its beginnings as Hickory Hill Baptist Church (Hickory Hill Colored Baptist Church as reflected in the 1903 deed). The name Hickory Hill was chosen because of the large hickory tree that stood near the church. Hickory Hill was first located on Greene Street, near what was once the site of the old 5th Street Fire Station. The church was in an area considered downtown Greenville. Rev. Ruffin Carrol was the first pastor, and worship services were held the third Sunday of each month.

​

In 1903, under the pastorate of Rev. G.W. Bucklum, the church moved to Clark Street, near the northwest corner of 14th Street, in the "New Town" area of Greenville. At that time, Charles Henryham, Edward Carr, and Ted Jenkins were appointed as Deacons; and Violet Henryham, Harriet Jackson, and Sarah Dudley were appointed as Deaconnesses.