Go Ad-Free
If you regularly use Hymnary.org, you might benefit from eliminating ads. Consider buying a Hymnary Pro subscription.
Insert the special character in something like a Microsoft Word document, then copy and paste the character into a Hymnary page. To insert a character into a Microsoft Word document, select "Insert" from the menu bar, select "Symbol", find the symbol you're interested in, then click "Insert".