This stone to Thee in faith we lay. J, Montgomery. [Laying Foundation-stone of a Church.] Written in 1822, for the laying of the Foundation-stone of Christ Church, Attercliffe, Sheffield, and sung at that ceremony on Oct. 30, 1822. It was printed in Montgomery's newspaper, the Sheffield Iris, Nov. 5, 1822, together with a full account of the whole ceremony. Subsequently it was published in Montgomery's Christian Psalmist, 1825, No. 474, his Poetical Works of various dates, and his Original Hymns, 1853, No. 300, in 6 stanzas of 4 lines. It is in extensive use in its full or in an abbreviated form, and also as:—
1. Here, in Thy Name, eternal God. This form is given in Hatfield's Church Hymn Book, N. Y., 1872, and others.
2. When in these courts we seek Thy face. In the American Sabbath Hymn Book , Andover, 1858, it begins with an altered form of stanza ii.
3. Within these walls let heavenly peace. In the American Church Praise Book, N. Y., 1882. Of this text in 3 stanzas, stanza i. is from J. Newton's "O Lord, our languid souls inspire," Olney Hymns, 1779, Bk. ii., No. 43, stanzas v., and stanzas ii. and iii. are from this hymn by Montgomery.
4. When here, 0 Lord, we seek Thy face. This form of the text, beginning with stanza ii., is in the Plymouth Collection, U.S.A., 1855.
--John Julian, Dictionary of Hymnology (1907)