Yes and no. Labels are useful in science. Labels are handy for music. Labels can help to define.
Labels used negatively, like white fragility, yid, misogynist, are bad.
But it’s all to do with context. Without labels you could argue theres no order. Some would say that’s a good thing. But even subconsciously, lions stick with lions, humans mate with humans, birds flock together. Its nature to remain within your own perception of a label.