How Can I Keep From Singing?  
lyric adapted by Andrew Calhoun, recorded on Grapevine. 
Guitar tablature available below, newly arranged in key of D with melodic guitar break. 

My life flows on in endless song, 
Above earth's lamentation; 
I hear the sweet, though far-off hymn, 
That hails the new creation. 
Through all the tumult and the strife, 
I hear the music ringing; 
It finds an echo in my soul, 
How can I keep from singing? 

What though the tempest loudly roars, 
I hear the Word, it liveth; 
What though the darkness round me close, 
Songs in the night it giveth. 
No storm can shake my inmost calm, 
While to the rock I'm clinging; 
Since love's the rule of heaven and earth, 
How can I keep from singing? 

I lift my eyes, the cloud removes, 
I see the blue above it; 
And day by day this pathway smooths, 
Since first I learned to love it. 
Thy song of peace makes fresh my heart, 
A fountain ever springing; 
All things are mine since I am thine, 
How can I keep from singing?

The first known publication of the words was on August 27, 1868, in The New York Observer, and attributed to "Pauline T.," whose full identity is lost to history. 
The text reads: 

Always Rejoicing 

  My life flows on in endless song; 
   Above earth's lamentation, 
  I catch the sweet, tho' far-off hymn 
   That hails a new creation; 
  Thro' all the tumult and the strife 
   I hear the music ringing; 
  It finds an echo in my soul— 
   How can I keep from singing? 

  What tho' my joys and comforts die? 
   The Lord my Saviour liveth; 
  What tho' the darkness gather round? 
   Songs in the night he giveth. 
  No storm can shake my inmost calm 
   While to that refuge clinging; 
  Since Christ is Lord of heaven and earth, 
   How can I keep from singing? 

  I lift my eyes; the cloud grows thin; 
   I see the blue above it; 
  And day by day this pathway smooths, 
   Since first I learned to love it, 
  The peace of Christ makes fresh my heart, 
   A fountain ever springing; 
  All things are mine since I am his— 
   How can I keep from singing?

It was set to music by Robert Wadsworth Lowry in 1869.