Using the words fag, queer, and the N-word

I'll be honest.  I don't understand why homosexuals are allowed to use the words queers and fags while non-homosexuals are not allowed to use them.  And the same goes with black people and the N-word.  I heard the expression that the minorities are taking back the power of those words, but I have never agreed with that PC philosophy.  How are we going to have everyone being treated the same if we keep separating ourselves in such wild ways?

I say that if anyone is allowed to use them, then everyone is allowed to use them.  You thoughts please.  Thanks.