Silver Hill United Methodist Church is the oldest African American congregation in Spartanburg. Silver Hill was founded by Reverend James R. Roseman who also founded several other Methodist churches in the upstate of South Carolina. Silver Hill is said to get its name because church members put silver dollars under each corner of the church.