Weird. Sorry, this sounds like a bullshit situation. It doesn't sound like cultural appropriation at all, and if you wrote the lyrics, the title should be your choice IMO, unless you have another arrangement in place already. You've got to be on the same page as the people you're playing with. I could see a group turning down something truly objectionable, or maybe having a discussion about what titles and subject matter are the best fit, but this isn't that. Sounds more like ego. If you can live with a compromise and everything else about the band is great, then let it go; if it feels like an important enough issue that you would regret not standing up for yourself, then you should do that.