Cited By
View all- Hodent CBlumberg FDeterding S(2024)Ethical Games: Toward Evidence-Based Guidance for Safeguarding Players and DevelopersGames: Research and Practice10.1145/36852072:2(1-11)Online publication date: 29-Jul-2024
Dataset | Snapshots | # of Matches | # of Chat Lines |
---|---|---|---|
For Honor | 1 | 456,130 | 2,052,588 |
2 | 363,049 | 1,670,204 | |
3 | 1,787,075 | 7,786,219 | |
2,606,254 | 11,509,011 | ||
Rainbow Six Siege | 1 | 442,562 | 10,585,273 |
2 | 196,497 | 7,455,248 | |
639,059 | 18,040,521 |
Category | Class | For Honor | Rainbow Six Siege |
---|---|---|---|
Severely Toxic | Hate and Harassment | 4,453 | 5,482 |
Threats | 421 | 618 | |
Harmful | Minor Endangerment | 109 | 625 |
Extremism | 173 | 392 | |
Scams and Ads | 53 | 456 | |
Toxic | Insults and Flaming | 11,329 | 8,824 |
Slightly Toxic | Spam | 2,210 | 11,127 |
Other Offensive | 2,077 | 3,117 | |
Not Toxic | Non-toxic | 78,292 | 64,937 |
Fleiss \(\kappa\) | 0.47 | 0.54 |
Pre-training | Fine-tuning | ||||
---|---|---|---|---|---|
Learning Rate | Loss | Epoch | Precision | Recall | F1-score |
1e-3 | 1.94 | 13 | 82.44 ± 0.45 | 82.52 ± 0.64 | 82.43 ± 0.54 |
1e-4 | 2.20 | 7 | 82.20 ± 0.00 | 82.87 ± 0.00 | 82.40 ± 0.00 |
1e-5 | 2.57 | 7 | 81.96 ± 0.00 | 81.96 ± 0.00 | 81.89 ± 0.00 |
1e-6 | 2.90 | 12 | 81.24 ± 0.34 | 81.70 ± 0.33 | 81.34 ± 0.35 |
For Honor | Rainbow Six Siege | |||||
---|---|---|---|---|---|---|
Precision | Recall | F1-score | Precision | Recall | F1-score | |
Cleanspeak | 66.62 | 29.10 | 40.48 | 65.91 | 38.92 | 48.93 |
Perspective API | 73.48 | 37.97 | 50.07 | 75.11 | 24.38 | 36.81 |
Our Model | 81.12 ± 0.46 | 81.51 ± 0.59 | 81.11 ± 0.57 | 82.95 ± 0.31 | 83.56 ± 0.27 | 83.56 ± 0.27 |
For Honor | Rainbow Six Siege | |
---|---|---|
No. of Matches (with Chat) | 27k | 92k |
No. of Players (who Chat) | 13k | 127k |
No. of Lines per Match | 4.31 | 15.39 |
No. of Players per Match | 1.35 | 4.12 |
Toxicity is pervasive in online multiplayer games, exposing players to disruptive and harmful behaviours. Players employ various approaches to cope with exposure to toxicity; however, game designers and researchers lack guidance on how to implement ...
Is it possible to detect toxicity in games just by observing in-game behavior? If so, what are the behavioral factors that will help machine learning to discover the unknown relationship between gameplay and toxic behavior? In this initial study, we ...
Video game toxicity, endemic to online play, represents a pervasive and complex problem. Antisocial behaviours in online play directly harm player wellbeing, enjoyment, and retention—but research has also revealed that some players normalize toxicity ...
Association for Computing Machinery
New York, NY, United States
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in