The Pilgrim Holiness Church, the “Baled Hay Church,” at the northwest corner of Cedar and Heath streets in Arthur, was planned by Congregationalists in 1927 and built in 1928 with load-bearing walls of baled rye straw two feet thick, stuccoed outside and plastered inside; it is called the oldest known straw-bale church in North America. Services ended in the mid-1960s, and it was restored in 1976. Listed on the National Register in 1979, it is owned by the Arthur County Historical Society and open as a museum by appointment.