When the Echo Chamber Shatters: Examining the Use of Community-Specific Language Post-Subreddit Ban

Milo Trujillo, Sam Rosenblatt, Guillermo de Anda Jáuregui, Emily Moog, Briane Paul V. Samson, Laurent Hébert-Dufresne & Allison M. Roth

Workshop on Online Abuse and Harms (WOAH) Proceedings, 2021

Two scatter plots that show the activity of banned subreddit users before and after the ban.

Example plots comparing user behavior after a subreddit ban. Users from the top 100 and random samples are displayed in terms of their relative change in activity and change in in-group vocabulary usage. Distributions are displayed along each axis for convenience.

Abstract

Community-level bans are a common tool against groups that enable online harassment and harmful speech. Unfortunately, the efficacy of community bans has only been partially studied and with mixed results. Here, we provide a flexible unsupervised methodology to identify in-group language and track user activity on Reddit both before and after the ban of a community (subreddit). We use a simple word frequency divergence to identify uncommon words overrepresented in a given community, not as a proxy for harmful speech but as a linguistic signature of the community. We apply our method to 15 banned subreddits, and find that community response is heterogeneous between subreddits and between users of a subreddit. Top users were more likely to become less active overall, while random users often reduced use of in-group language without decreasing activity. Finally, we find some evidence that the effectiveness of bans aligns with the content of a community. Users of dark humor communities were largely unaffected by bans while users of communities organized around white supremacy and fascism were the most affected. Altogether, our results show that bans do not affect all groups or users equally, and pave the way to understanding the effect of bans across communities.

Materials

 Publisher's Copy PDF  DOI

Bibtex

@inproceedings{trujillo-etal-2021-echo,
title = {When the Echo Chamber Shatters: Examining the Use of Community-Specific Language Post-Subreddit Ban},
author = {Trujillo, Milo and Rosenblatt, Sam and de Anda Jáuregui, Guillermo and Moog, Emily and Samson, Briane Paul V. and Hébert-Dufresne, Laurent and Roth, Allison M.},
booktitle = {Proceedings of the 5th Workshop on Online Abuse and Harms (WOAH 2021)},
month = aug,
year = {2021},
address = {Online},
publisher = {Association for Computational Linguistics},
url = {https://aclanthology.org/2021.woah-1.18},
doi = {10.18653/v1/2021.woah-1.18},
pages = {164--178}
}

Citation

Trujillo, M., Rosenblatt, S., Jáuregui, G. de A., Moog, E., Samson, B. P. V., Hébert-Dufresne, L., & Roth, A. M. (2021). When the echo chamber shatters: Examining the use of community-specific language post-subreddit ban. 164–178. Association for Computational Linguistics, https://doi.org/10.18653/v1/2021.woah-1.18.