The Covert Baptist Church was constituted February 16, 1803, being known as the Baptist Church of Ovid and Hector. Minor Thomas was chosen as this church’s first pastor on April 21, 1804, with his compensation "to depend upon the liberality of the church and congregation." On March 9, 1805, the name of the church was changed to the Second Baptist Church of Ovid. In 1809, meetings were held one-half of the time at the home church in Thomas’ settlement; one-fourth of the time at the Samuel Hanley’s in Hector; and one-fourth of the time at Peach Orchard, or other stations.10 Thomas’ settlement was about three miles north of Trumansburg. Probably the first actual church building in Seneca County was built there at Thomas’ settlement, probably around 1809 or 1810. The Church Building God's word has been preached in Covert for over 208 years. The original building was described as a rare model of architecture for [it’s] time, and was used from it’s construction in the early 1800s until 1850. In 1850 the present church edifice was erected, dedicated and consecrated by the conversion of souls. Between 1867 and 1871 it was repaired and in part re-furnished. July 4th, 1876 was a notable day in the history of the Covert Church. Nearly one thousand people assembled to hear the notes of the centennial bell rung for the first time upon that national holiday. That same bell still rings each Sunday morning inviting one and all to come to the church. The Chapel was added to the Church building in the early 1900's. Church and Chapel were painted in the early 1950s, in 1976 as part of Bi-Centennial project, during the 1990s and most recently in 2008 by volunteers from the church. As part of the Bi-Centennial project the Covert Historical District was created and added to the National Register of Historical Places. In the last few years major interior work has been done with new drop ceiling, new carpeting, painting of the interior, and new baseboard heat so the main church can be used for services. New windows were added in 2007 and a new roof in 2008. Volunteers from the church spent many hours painting the outside of the building. The chapel was painted in the fall of 2007 and the main building was painted during the summer of 2008. The church has withstood the tests of time, man and the elements and remains a lighthouse shining the light of Jesus Christ to a lost and dying world.