Oxford dictionary on racism: Prejudice, discrimination, or antagonism
directed against someone of a different race based on the belief that
one’s own race is superior.
Not only are you wrong by definition. But you are also wrong in terms of public opinion.
So call it something else then.
Personally I believe that the only reason you are following this line of reasoning is that it is a way to drown out any opposite views to your particular brand of feminism. That way any male (or females) opinion you don't like can be branded sexist, whereas your opinions can merely be labelled prejudiced.
Edit: I found it, if you wish you can call it "institutional racism".