Giving Up Power

In class we spoke a little bit about how it is wrong to expect a privileged group to give up some of their power. It was referred to as bringing them down to a lower level instead of the under privileged group striving to reach their level. I think that in many cases, privileged groups need to be willing to give up some of their power. As I feminist, I don't always desire the power that males have. For example, I do not want females to have the power to have a presence in society that is so threatening to men that they have to live in fear, the way women do. One big issue in feminism is sexual assault and male violence against women. But the goal of feminism is not to get women to be as powerful and threatening as males are so they can compete at their level. Men need to give up some of their power to achieve gender equality. This applies to many other issues, such as racial equality and economic equality. In his essay "What Motivates Socialists", Dr. Mark Cooray, argues that the problem with socialism is that there is a desire to bring privileged people down to the level of less privileged people. I agree with him, except I don't see anthing wrong with this.

Question: What's wrong with wanting a privileged group to give up some of their power?