Saying his true opinion, it was an insult without considering the church’s upper echelons. It seems he was assessed as baka who can’t read the situation.
He caused various other problems as well. He might be a baka but since he is a Duke it isn’t possible to simply criticize him publicly.
Of course he received harsh criticism behind the scenes.