Copyright records indicate Olmstead was living in Chicago, Illinois, in 1914. He served on the commission that produced the Free Methodist Hymnal (Winona Lake, Indiana: The Free Methodist Publishing House, 1910). His other works include:
- Autobiography of Rev Charles H. Sage (editor) (Chicago, Illinois: Free Methodist Publishing House, 1903)
- Light and Life Songs, with Thoro Harris & William Kirkpatrick (Chicago, Illinois: S. K. J. Chesbro, 1904)
- Handbook for Sunday-School Workers (Chicago, Illinois: W. B. Ross, 1907)