Kelly was raised in a house with many women