Allen married Mary Box, daughter of Seth Box and Margaret Dailey, on 9 Dec 1819 in Winchester, Franklin County, Tennessee. They had eight children: Henry Walton, Mary Ann, Averilla, Sarah Orlenie, Lucinda Francis, Margaret H., Leroy Franklin, and James Allen.