God has said, Never will I leave you; never will I forsake you.@Hebrews 13:5
John Rippon (1751–1836)

From A Selection of Hymns from the Best Authors, by John Rippon, 1787; attributed variously to John Keene, Kirkham, or John Keith.

Protection, from A Compilation of Genuine Church Music, by Joseph Funk (Winchester, Virginia: J. W. Hollis, 1832) (🔊 pdf nwc).

This hymn was sung at the funerals of American presidents Theodore Roosevelt and Woodrow Wilson. In addition:

[It] was the favorite of Deborah Jackson [sic; her name was actually Rachel] President Andrew Jackson’s beloved wife [he was President-elect at the time], and on his death-bed the warrior and statesman called for it. It was the favorite of Gen. Robert E. Lee, and was sung at his funeral. The American love and familiar preference for the remarkable hymn was never more strikingly illustrated than when on Christmas Eve, 1898, a whole corps of the United States Army Northern and Southern, encamped on the Quemados hills, near Havana [Cuba], took up the sacred tune and words.

Brown, p. 206

How firm a foundation, ye saints of the Lord,
Is laid for your faith in His excellent Word!
What more can He say than to you He hath said,
You, who unto Jesus for refuge have fled?

In every condition, in sickness, in health;
In poverty’s vale, or abounding in wealth;
At home and abroad, on the land, on the sea,
As thy days may demand, shall thy strength ever be.

Fear not, I am with thee, O be not dismayed,
For I am thy God and will still give thee aid;
I’ll strengthen and help thee, and cause thee to stand
Upheld by My righteous, omnipotent hand.

When through the deep waters I call thee to go,
The rivers of woe shall not thee overflow;
For I will be with thee, thy troubles to bless,
And sanctify to thee thy deepest distress.

When through fiery trials thy pathways shall lie,
My grace, all sufficient, shall be thy supply;
The flame shall not hurt thee; I only design
Thy dross to consume, and thy gold to refine.

Even down to old age all My people shall prove
My sovereign, eternal, unchangeable love;
And when hoary hairs shall their temples adorn,
Like lambs they shall still in My bosom be borne.

The soul that on Jesus has leaned for repose,
I will not, I will not desert to its foes;
That soul, though all hell should endeavor to shake,
I’ll never, no never, no never forsake.