hate speech detection

**Hate speech detection** is the AI task of automatically identifying text that expresses **hatred, hostility, or discrimination** against individuals or groups based on characteristics such as race, ethnicity, gender, religion, sexual orientation, disability, or national origin. It is one of the most important and challenging applications of NLP. **What Constitutes Hate Speech** - **Direct Attacks**: Explicitly derogatory language targeting a group ("X people are inferior"). - **Dehumanization**: Comparing groups to animals, diseases, or other dehumanizing metaphors. - **Calls to Violence**: Inciting or encouraging violence against groups. - **Stereotyping**: Perpetuating harmful stereotypes about entire groups. - **Coded Language**: Using euphemisms, dog whistles, or coded terms that insiders recognize as hateful. **Detection Approaches** - **Fine-Tuned Classifiers**: BERT/RoBERTa models trained on labeled hate speech datasets. Most common production approach. - **Few-Shot LLM**: Prompt large language models with examples and definitions of hate speech for classification. Good for cold-start scenarios. - **Multi-Label**: Classify not just "hate speech or not" but also the **target group**, **type of hate**, and **severity level**. - **Multi-Lingual**: Models that detect hate speech across languages, crucial for global platforms. **Major Challenges** - **Context Dependence**: "My people are being exterminated" is a cry for help, not hate speech. Context is critical. - **Implicit Hate**: Statements that are hateful through **implication** rather than explicit language are much harder to detect. - **Sarcasm and Irony**: "Oh great, another one of *those* people" requires understanding tone. - **Inter-Annotator Disagreement**: Humans themselves often disagree on what constitutes hate speech, making training data noisy. - **Platform-Specific Norms**: What counts as hate speech varies across communities, platforms, and legal jurisdictions. **Regulatory Context** Hate speech detection is increasingly **legally mandated** — the EU's Digital Services Act requires platforms to have effective systems for identifying and removing illegal hate speech.