I started my inquiry by trying to research the best ways to contact churches. I didn't find much. From Family Tree Magazine, I found a list of Church Record Resources, including the American Baptist Historical Society (though FTM has the wrong link, I was able to find their site via google). From their website, I found that they, "have found that Baptist church records are generally not helpful for genealogical research." This is mainly due to adult baptism that is not recorded, the fact that marriage is not regarded as a sacrament and records are not often kept, and because there is no regulated administrative policy. They do, however, keep records of those who served the church as pastors or missionaries.
Well, regardless of this, I'm still going to attempt to contact the church to see if they have information. I read in someone else's research that my ancestor, Reubin Boatright, was a deacon of the church. Also, many of his family members are buried there, so the church might have some burial or death information.
Here's the letter I'm sending via the contact form on their website:
I'm not sure how good this letter is, but I guess I'll find out when (if?) I receive a response.