Because you're not as rich as he is.
Because you're too different from him, not only about money, financial status but also
life styles (on how to make and spend money).
Being rich is not his fault. There'd be women who share his ideas and life styles too.
It's you and him are too different.