Giving women more power has benefitted men a lot too. Your premise is that women only vote in ways which has negative consequences for men. I live in Scandinavia which has pushed gender equality far and while that obviously has benefits to women, I also think it has profound benefits to men as well. Because the ideal is that men help equal at home, nobody complains that I leave work early to pick up kids at day care. It means I had several months of paternity leave when my children got born because taking care of small children is now also seen as the responsibility of men. Oh, the horror, I had to spend time with my own children getting to no them better! /s
No, women have pushed through many important changes that me and other men have benefitted enormously from.
Likewise many of the changes which will be pushed through to help minorities will be a benefit to the majority.
Of course it depends on specific policies. I don’t see the value in pushing whites to self-hatred is a benefit to anyone.
But giving minorities more opportunities is a benefit. Your example of elite universities is perhaps just a another argument why they should perhaps not exist in the first place. They seem like institutions designed to maintain class hierarchies to me.