The Lineberger family moved to Columbia, South Carolina, from Marlowe, Georgia, in 1929. Fred was a Lutheran pastor and organized Mt. Olive, the first congregation of the Lutheran Church Missouri Synod in South Carolina at the then small town of Irmo. The musical family lived on a working farm without electricity from 1932 until 1937 surviving the great depression.