Please edit the text to have better coherence.
The manager, an old Quaker, declined saying that. On principle Quaker never attended entertainments.
The manager, an old Quaker, declined saying that although on principle he never attended entertainments.