His father, an observant Jew whose first language was Yiddish, allowed his children a liberal education.
His father allowed his children a liberal education. His father was an observant Jew. An observant Jew's first was Yiddish.