Not if you are using it as a common noun - but if you are stating the name of a church then it should be capitalized
The church was just down the road from the park.
St Patrick's Church was just down the road from the park.
The church was just down the road from the park.
St Patrick's Church was just down the road from the park.