The difference to me is that I dream about something when I am asleep.
I dream of something when I daydream or get lost in my thoughts.
Other than that, I can't see a difference.
Then, of course, there is "dream up", which is a different thing entirely.