Ellsworth Milton Statler was the third of the children of Rev. William J. Statler and Mary A. McKinney. Govinda R., Charles O., Ellsworth M., Elizabeth, Alabama A., Lillian, Osceola A., and William J.E.M. married first Mary Idesta Manderbach (1866-28 October 1925) and together they raised four adopted children. Milton Howland Statler (16 September 1906 – 7 December 1933), Marian Francis Statler (3 July 1907 – 7 August 1927), Ellsworth Morgan Statler (d.1987), and Elva Idesta Statler (7 June 1912- 27 February 1935.) E.M. had only one grandchild, Milton's daughter Joan M. Statler (1931-2005).
E.M. married Alice M. Seidler (d. 1969) on 30 April 1927.