All these of course was when the Queen was still around and her family was a large faction that had lots of power. She was still in charge of the harem then.
With the passing of the Queen, the whole country was mourning and Mo Qian Yuan fell terribly ill for three whole months and after his recovery, his temperament had undergone major changes.