How can I bulk delete Labels from my references?

To remove a Label from references, go to Project > Project Settings. In the Project Labels window, your Labels will have a tiny "x" in the left corner, which when clicked will remove the Label from ALL references it is attached to in the Project.

However, at the moment DistillerSR does not support removing Labels from a specific set of references.