Incivility (Hate Speech/Incivility)

Abstract

The variable incivility is an indicator used to describe violations of communication norms. These norms can be social norms established within a society, a culture or parts of a society (e.g. a social class, milieu or group) or democratic norms established within a democratic society. In this sense incivility is associated with behaviors that threaten a collective face or a democratic society, deny people their personal freedoms, and stereotype individuals or social groups. Furthermore, some scholars include impoliteness into the concept of incivility and argue that the two concepts have no clear boundaries (e.g. Seely, 2017). They therefore describe incivility as aggressive, offensive or derogatory communication expressed directly or indirectly to other individuals or parties. In many studies a message is classified as uncivil if the message contains at least one instance of incivility (e.g. one violent threat). The direction of an uncivil statement is coded as ‘interpersonal’/‘personal’ or ‘other-oriented’/‘impersonal’ or sometimes also as ‘neutral’, meaning it is not directed at any group or individual.

Field of application/theoretical foundation:

One unifying element to communication that is labelled as incivility is that it has to be a violation of an existing norm. Which norms are seen as violated depends on the theoretical tradition. Incivility research is related to theories on social norms of communication and conversation: conversational-maxims (Grice, 1975), face-saving concepts (Brown & Levinson, 1987; Goffman, 1989) or conversational-contract theories (Fraser, 1990). Further, incivility research has ties to theories that view public communication as part of democratic opinion formation and decision-making processes, e.g. theories on deliberative democracy and deliberation (Dryzek, 2000; Gutmann & Thompson, 1996; Habermas, 1994).

References/combination with other methods of data collection:

Incivility is examined through content analysis and sometimes combined with comparative designs (e.g., Rowe, 2015) or experimental designs (Muddiman, 2017; Oz, Zheng, & Chen, 2017). In addition, content analyses can be accompanied by interviews or surveys, for example to validate the results of the content analysis (Erjavec & Kovačič, 2012).

Example studies:

Research question/research interest: Previous studies have been interested in the extent, levels and direction of incivility in online communication (e.g. in one specific online discussion, in discussions on a specific topic, in discussions on a specific platform or on different platforms comparatively).

Object of analysis: Previous studies have investigated incivility in user comments on political newsgroups, news websites, social media platforms (e.g. Twitter, Facebook), political blogs, science blogs or online consultation platforms.

Timeframe of analysis: Many studies investigate incivility in user comments focusing on periods between 2 months and 1 year. It is common to use constructed weeks.

Level of analysis: Most manual content analyses measure incivility on the level of a message, for example on the level of user comments. On a higher level of analysis, the level of incivility for a whole discussion thread or online platform can be measured or estimated. On a lower level of analysis incivility can be measured on the level of utterances, sentences or words which are the preferred levels of analysis in automated content analyses.

Table 1. Previous manual content analysis studies and measures of incivility

Example study	Construct	Dimensions/Variables	Explanation/ example	Reliability
Papacharissi (2004)	incivility (separate from impoliteness)	threat to democracy	e.g. propose to overthrow a democratic government by force	Ir = .89
		stereotype	e.g. association of a person with a group by using labels, whether those are mild – “liberal”, or more offensive – “faggot”)?	Ir = .91
		threat to other individuals’ rights	e.g. personal freedom, freedom to speak	Ir = .86
		incivility		Ir = .89
Coe, Kenski, and Rains (2014)	incivility (impoliteness is included)	name-calling	mean-spirited or disparaging words directed at a person or group of people	K-α = .67
		aspersion	mean-spirited or disparaging words directed at an idea, plan, policy, or behavior	K-α = .61
		reference to lying	stating or implying that an idea, plan, or policy was disingenuous	K-α = .73
		vulgarity	using profanity or language that would not be considered proper (e.g., “pissed”, “screw”) in professional discourse	K-α = .91
		pejorative for speech	disparaging remark about the way in which a person communicates	K-α = .74
		incivility / impoliteness		K-α = .73
Rowe (2015)	incivility (separate from impoliteness)	threat to democracy	proposes to overthrow the government (e.g. proposes a revolution) or advocates an armed struggle in opposition to the government (e.g. threatens the use of violence against the government)	κ = .66
		threat to individual rights	advocates restricting the rights or freedoms of certain members of society or certain individuals	κ = .86
		stereotype	asserts a widely held but fixed and oversimplified image or idea of a particular type of person	κ = .80
		incivility		κ = .77
Seely (2017)	incivility (impoliteness is included)	insulting language	name calling and other derogatory remarks often seen in pejorative speech and aspersions	K-α = .84
		vulgarity	e.g. “lazy f**kers”, “a**holes”	K-α = 1
		stereotyping of political party/ideology	e.g. “typical lying lefties”	K-α = .88
		stereotyping using “isms”/discriminatory language	e.g. “if we don’t get rid of idiotic Muslim theologies, we will have growing problems”	K-α = 1
		other stereotyping language	e.g. “GENERALS LIKE TO HAVE A MALE SOLDIER ON THEIR LAP AT ALL TIMES.”	K-α = .78
		sarcasm	e.g. “betrayed again by the Repub leadership . . . what a shock”	K-α = .79
		accusations of lying	e.g. “typical lying lefties”	K-α = .80
		shouting	excessive capitalization and/or exclamation points	K-α = .83
		incivility / impoliteness		K-α = .81

Note: Previous studies used different inter-coder reliability statistics; I_r = reliability index by Perreault and Leigh (1989); K-α = Krippendorff’s-α; κ = Cohen’s Kappa

Codebook used in the study Rowe (2015) is available under: https://www.tandfonline.com/doi/full/10.1080/1369118X.2014.940365

References

Brown, P., & Levinson, S. C. (1987). Politeness: Some universals in language usage. Cambridge: Cambridge University Press.

Coe, K., Kenski, K., & Rains, S. A. (2014). Online and Uncivil? Patterns and Determinants of Incivility in Newspaper Website Comments. Journal of Communication, 64(4), 658–679. https://doi.org/10.1111/jcom.12104

Dryzek, J. S. (2000). Deliberative democracy and beyond: Liberals, Critics, Contestations. Oxford political theory. Oxford, New York: Oxford University Press.

Erjavec, K., & Kovačič, M. P. (2012). “You Don't Understand, This is a New War! ” Analysis of Hate Speech in News Web Sites' Comments. Mass Communication and Society, 15(6), 899–920. https://doi.org/10.1080/15205436.2011.619679

Fraser, B. (1990). Perspectives on politeness. Journal of Pragmatics, 14(2), 219–236. https://doi.org/10.1016/0378-2166(90)90081-n

Goffman, E. (1989). Interaction ritual: Essays on face-to-face behavior. New York: Pantheon Books.

Grice, P. H. (1975). Logic and conversation. In P. Cole (Ed.), Syntax and Semantics: Speech acts (pp. 41–58). New York: Academic Press.

Gutmann, A., & Thompson, D. F. (1996). Democracy and disagreement. Cambridge, Massachusetts: Belknap Press of Harvard University Press.

Habermas, J. (1994). Three Normative Models of Democracy. Constellations, 1(1), 1–10.

Muddiman, A. (2017). : Personal and public levels of political incivility. International Journal of Communication, 11, 3182–3202.

Oz, M., Zheng, P., & Chen, G. M. (2017). Twitter versus Facebook: Comparing incivility, impoliteness, and deliberative attributes. New Media & Society, 20(9), 3400–3419. https://doi.org/10.1177/1461444817749516

Papacharissi, Z. (2004). Democracy online: Civility, politeness, and the democratic potential of online political discussion groups. New Media & Society, 6(2), 259–283. https://doi.org/10.1177/1461444804041444

Rowe, I. (2015). Civility 2.0: A comparative analysis of incivility in online political discussion. Information, Communication & Society, 18(2), 121–138. https://doi.org/10.1080/1369118X.2014.940365

Seely, N. (2017). Virtual Vitriol: A Comparative Analysis of Incivility Within Political News Discussion Forums. Electronic News, 12(1), 42–61. https://doi.org/10.1177/1931243117739060