His sons are novelist Christopher Morley, Pulitzer Prize winner Felix Morley, and his son, also mathematician, Frank Vigor Morley.
Jego synowie to: powieściopisarz Christopher Morley, zwycięzca nagrody Pulitzera, Felix Morley oraz matematyk Frank Vigor Morley.