The society started in 1846, and originally met in a house. The first chapel was opened in Old Silsoe Road (formerly Luton Road) in 1853. It has now been demolished. A second chapel in the High Street was sold in 1938.
A community archive hosted by Bedford Borough Council has more information and photos about these chapels.