Hate Speech and Offensive Language Dataset
A Twitter (crowdsourced hate speech annotation) dataset of 24,783 tweets labeled as hate speech (1,430), offensive (19,190), or neither (4,163), collected by Davidson et al. via CrowdFlower crowdsourcing (2017). Each record contains tweet text, majority class label (0=hate/1=offensive/2=neither), per-label coder counts, total coder count. Davidson et al. 2017 is one of the most cited hate speech datasets, with 24,783 tweets annotated by multiple crowdworkers — distinguished by separating hate speech from merely offensive language. Suitable for hate speech detection, offensive language classification, content moderation, NLP benchmarking, crowdsourced annotation research.
Cite this dataset at
hate-offensive-2017.echo.directory
Analytics
Topic 0
Topic 1
Topic 2
Topic 3
Topic 4
Topic 5
Topic 6
Topic 7
Topic 8
Topic 9
Topic 10
Topic 11
Show all 22 topics
Topic 12
Topic 13
Topic 14
Topic 15
Topic 16
Topic 17
Topic 18
Topic 19
Topic 20
Topic 21
Computed over the full corpus.
Record
- Catalog key
hate-offensive-2017- Authors
- Davidson, Thomas; Warmsley, Dana; Macy, Michael; Weber, Ingmar
- Year
- 2017
- Source paper
- Automated Hate Speech Detection and the Problem of Offensive Language
- DOI / arXiv
- 10.1609/icwsm.v11i1.14955
- License
- MIT (MIT)
- Records
- 24,783
- Languages
- en
- Collected
- 2017 (2010s)
- Tasks
- Toxicity detection (multi-label;
is_offensive, offensive_agreement) inferred, Hate speech detection (multi-label;is_hate_speech, hate_agreement) inferred - Region
- Global (inferred: the platform is used worldwide)
Provenance
- Originally published at
- https://github.com/t-davidson/hate-speech-and-offensive-language link checked
- Hosted copy
- Mirrored on echo.directory on 2026-10-09, 2.4 MB across 1 files. Checksums in MANIFEST.json.
Citations
Automated Hate Speech Detection and the Problem of Offensive Language
Thomas Davidson, Dana Warmsley, M. Macy, Ingmar Weber
Journal Article · International Conference on Web and Social Media · 2017
Cited by
- "Humans welcome to observe": A First Look at the Agent Social Network Moltbook
Yu-Kun Jiang, Ya-Ge Zhang et al. · arXiv.org · 2026 · cited 34× - Noisy but Valid: Robust Statistical Evaluation of LLMs with Imperfect Judges
Chen Feng, Ming Shen et al. · arXiv.org · 2026 · cited 26× - ObliInjection: Order-Oblivious Prompt Injection Attack to LLM Agents with Multi-source Data
Reachal Wang, Yu-Qi Jia et al. · Network and Distributed System Security Symposium · 2025 · cited 23× - A comprehensive review of LLM-based content moderation: advancements, challenges, and future directions
Cong Chen, Wei Qu et al. · Knowledge-Based Systems · 2025 · cited 23× - Enhancing social media hate speech detection in low-resource languages using transformers and explainable AI
Endrit Fetahi, A. Susuri et al. · Social Network Analysis and Mining · 2025 · cited 22×
Show all 10
- PIShield: Detecting Prompt Injection Attacks via Intrinsic LLM Features
Wei Zou, Yupei Liu et al. · arXiv.org · 2025 · cited 19× - Cyberbullying-Related Automated Hate Speech Detection on Social Media Platforms Using Stack Ensemble Classification Method
Muhammad Mubeen, Aliza Muskan et al. · International Journal of Computational Intelligence Systems · 2025 · cited 18× - RubRIX: Rubric-Driven Risk Mitigation in Caregiver-AI Interactions
Drishti Goel, Jeongah Lee et al. · Annual Meeting of the Association for Computational Linguistics · 2026 · cited 14× - Attention is All You Need to Defend Against Indirect Prompt Injection Attacks in LLMs
Yinan Zhong, Qianhao Miao et al. · Network and Distributed System Security Symposium · 2025 · cited 14× - AI vs. Human Moderators: A Comparative Evaluation of Multimodal LLMs in Content Moderation for Brand Safety
Adi Levi, Or Levi et al. · 2025 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · 2025 · cited 13×
Citation data from Semantic Scholar, retrieved 2026-10-19.
How to cite
BibTeX
@misc{echo2026,
title = {ECHO: Exploratory Compendium of Humanity Online},
author = {Switzer, Braden and Zafarani, Reza},
year = {2026},
url = {https://echo.directory},
note = {Syracuse University}
}
@inproceedings{davidson2017automated,
title = {Automated Hate Speech Detection and the Problem of Offensive Language},
author = {Davidson, Thomas and Warmsley, Dana and Macy, Michael and Weber, Ingmar},
booktitle = {ICWSM},
year = {2017}
} APA
Switzer, B., & Zafarani, R. (2026). ECHO: Exploratory Compendium of Humanity Online [Data repository]. Syracuse University. https://echo.directory
Davidson, T., Warmsley, D., Macy, M., & Weber, I. (2017). Hate Speech and Offensive Language Dataset [Data set]. https://doi.org/10.1609/icwsm.v11i1.14955
MLA
Switzer, Braden, and Reza Zafarani. ECHO: Exploratory Compendium of Humanity Online. Syracuse University, 2026, echo.directory.
Davidson, Thomas, et al. Hate Speech and Offensive Language Dataset. 2017, doi.org/10.1609/icwsm.v11i1.14955.