The times with her was full of pure love and kindness had vanished when his bastard father brought him in his family.  Yes, he is an illegitimate child.  Once he steps in his 'new' family, he knew it would never be the same.