He had an affair with Louise de La Béraudière de l'Isle Rouhet, "la belle Rouet," with whom he had a son, Charles III de Bourbon (1554–1610) who became archbishop of Rouen.
Tivo un romance con Louise de la Béraudière, "la belle Rouet," con quen tivo un fillo, Carlos III de Borbón (1554–1610) que se convertería en arcebispo de Ruán.