The Duke describes the Duchess as "too soon made glad" (22) and "too easily impressed" (23). This is his main problem with her: too many things make her happy.
Another way of looking at it is that she’s not serious enough. She doesn’t save her "spot of joy" for him alone. She’s not the discriminating snob that he wants her to be.
She likes everything she sees, and she sees everything.