The First Baptist Church was founded by William Rodgers of the Rodgers & Burchfield Steel Company. On Jan. 26, 1868 the first service was held in the borough’s school house. They met there for five years until moving to a church near the old canal on Railroad Avenue in 1873. The land & building was donated by the Rodgers & Burchfield Steel Company. One of the walls of that building collapsed and a new building was erected in 1896 with a tower and Town Clock. After the flood of 1936, there was extensive damage, but the congregation revamped & rededicated the building in 1937. In 1974 the congregation bought the Shrine of Sts. Cosmos & Damien on Owens View and sold the building on Railroad Avenue to the Bible Presbyterian Church of Apollo. The Bible Presbyterian Church of Apollo first met in the Spring Church Grange Hall on July 9, 1972. The congregation moved to the former First Baptist Church of Apollo later in 1972. The first pastor was Rev. Burton Toms, 1974 until 1988. The clock tower, built in 1896, became one of the most recognizable landmarks of Apollo. Unfortunately the tower suffered extensive water damage and was torn down in 1984.

During the summer of 2026, the church congregation began transitioning to become Trinity Bible Chapel, a reformed Baptist church. The new pastor is Pastor Clarence Walker.