Sweet the time, exceeding sweet. G. Burder. [Christian Fellowship.] Published in the Gospel Magazine, April, 1779, p. 220, in 5 stanzas of 4 lines, headed "An Hymn for Christian Company," and signed "A. R." In 1784 it was given, unaltered, in G. Burder's Collection of Hymns, as No. 66, and in the Index it is signed "G. Burder." In Cotterill's Selection 1810, No. 46, it is altered to "Great the joy, the union sweet." This form is in extensive use. In the 8th edition of his Selection Cotterill altered it again to "Great the joy when Christians meet." This, also, is well known. In one or two collections it is also altered to "Gladsome 'tis when Christians meet."
-- John Julian, Dictionary of Hymnology (1907)