"You have no cause to be sorry", he says softly. "It would be unforgivably selfish if I were to think myself the only one who suffers."
Other options:
no subject
"You have no cause to be sorry", he says softly. "It would be unforgivably selfish if I were to think myself the only one who suffers."