TY - JOUR AU - Esau, Katharina PY - 2021/03/26 Y2 - 2024/03/28 TI - Incivility (Hate Speech/Incivility) JF - DOCA - Database of Variables for Content Analysis JA - DOCA VL - 1 IS - 5 SE - User-Generated Media Content DO - 10.34778/5c UR - https://www.hope.uzh.ch/doca/article/view/5c SP - AB - <p>The variable <strong>incivility</strong> is an indicator used to describe violations of communication norms. These norms can be social norms established within a society, a culture or parts of a society (e.g. a social class, milieu or group) or democratic norms established within a democratic society. In this sense <strong>incivility</strong> is associated with behaviors that threaten a collective face or a democratic society, deny people their personal freedoms, and stereotype individuals or social groups. Furthermore, some scholars include <strong>impoliteness</strong> into the concept of <strong>incivility </strong>and argue that the two concepts have no clear boundaries (e.g. Seely, 2017). They therefore describe incivility as aggressive, offensive or derogatory communication expressed directly or indirectly to other individuals or parties. In many studies a message is classified as uncivil if the message contains at least one instance of <strong>incivility</strong> (e.g. one violent threat). The direction of an uncivil statement is coded as ‘interpersonal’/‘personal’ or ‘other-oriented’/‘impersonal’ or sometimes also as ‘neutral’, meaning it is not directed at any group or individual.</p><p><em><strong>Field of application/theoretical foundation:</strong></em></p><p>One unifying element to communication that is labelled as <strong>incivility</strong> is that it has to be a violation of an existing norm. Which norms are seen as violated depends on the theoretical tradition. <strong>Incivility</strong> research is related to theories on social norms of communication and conversation: conversational-maxims (Grice, 1975), face-saving concepts (Brown &amp; Levinson, 1987; Goffman, 1989) or conversational-contract theories (Fraser, 1990). Further, <strong>incivility</strong> research has ties to theories that view public communication as part of democratic opinion formation and decision-making processes, e.g. theories on <strong>deliberative democracy</strong> and <strong>deliberation</strong> (Dryzek, 2000; Gutmann &amp; Thompson, 1996; Habermas, 1994).</p><p><em><strong>References/combination with other methods of data collection:</strong></em></p><p><strong>Incivility</strong> is examined through content analysis and sometimes combined with comparative designs (e.g., Rowe, 2015) or experimental designs (Muddiman, 2017; Oz, Zheng, &amp; Chen, 2017). In addition, content analyses can be accompanied by interviews or surveys, for example to validate the results of the content analysis (Erjavec &amp; Kovačič, 2012).</p><p><em><strong>Example studies:</strong></em></p><p><strong>Research question/research interest: </strong>Previous studies have been interested in the extent, levels and direction of <strong>incivility</strong> in online communication (e.g. in one specific online discussion, in discussions on a specific topic, in discussions on a specific platform or on different platforms comparatively).</p><p><strong>Object of analysis: </strong>Previous studies have investigated <strong>incivility</strong> in user comments on political newsgroups, news websites, social media platforms (e.g. Twitter, Facebook), political blogs, science blogs or online consultation platforms.</p><p><strong>Timeframe of analysis: </strong>Many studies investigate <strong>incivility</strong> in user comments focusing on periods between 2 months and 1 year. It is common to use constructed weeks.</p><p><strong>Level of analysis: </strong>Most manual content analyses measure <strong>incivility</strong> on the level of a message, for example on the level of user comments. On a higher level of analysis, the level of <strong>incivility</strong> for a whole discussion thread or online platform can be measured or estimated. On a lower level of analysis <strong>incivility</strong> can be measured on the level of utterances, sentences or words which are the preferred levels of analysis in automated content analyses.</p><p>Table 1. Previous manual content analysis studies and measures of incivility</p><div style="overflow-x: auto;"><table><tbody><tr><td class="t"><p><strong>Example study</strong></p></td><td class="t"><p><strong>Construct</strong></p></td><td class="t"><p><strong>Dimensions/Variables</strong></p></td><td class="t"><p><strong>Explanation/<br />example</strong></p></td><td class="t"><p><strong>Reliability</strong></p></td></tr><tr><td class="t" rowspan="4"><p>Papacharissi (2004)</p></td><td class="t" rowspan="4"><p><strong>incivility</strong> (<em>separate</em> from <strong>impoliteness</strong>)</p></td><td class="t"><p>threat to democracy</p></td><td class="t"><p>e.g. propose to overthrow a democratic government by force</p></td><td class="t"><p><em>I<sub>r</sub> </em>= .89</p></td></tr><tr><td class="t"><p>stereotype</p></td><td class="t"><p>e.g. association of a person with</p><p>a group by using labels, whether those are mild – “liberal”, or</p><p>more offensive – “faggot”)?</p></td><td class="t"><p><em>I<sub>r</sub> </em>= .91</p></td></tr><tr><td class="t"><p>threat to other individuals’ rights</p></td><td class="t"><p>e.g. personal freedom, freedom to speak</p></td><td class="t"><p><em>I<sub>r</sub> </em>= .86</p></td></tr><tr><td class="t" colspan="2"><p><strong>incivility</strong></p></td><td class="t"><p><em>I<sub>r</sub> </em>= .89</p></td></tr><tr><td class="t" rowspan="6"><p>Coe, Kenski, and Rains (2014)</p></td><td class="t" rowspan="6"><p><strong>incivility </strong>(<strong>impoliteness </strong>is <em>included</em>)</p></td><td class="t"><p>name-calling</p></td><td class="t"><p>mean-spirited or disparaging</p><p>words directed at a person or</p><p>group of people</p></td><td class="t"><p><em>K</em>-α = .67</p></td></tr><tr><td class="t"><p>aspersion</p></td><td class="t"><p>mean-spirited or disparaging</p><p>words directed at an idea,</p><p>plan, policy, or behavior</p></td><td class="t"><p><em>K</em>-α = .61</p></td></tr><tr><td class="t"><p>reference to lying</p></td><td class="t"><p>stating or implying that an</p><p>idea, plan, or policy was disingenuous</p></td><td class="t"><p><em>K</em>-α = .73</p></td></tr><tr><td class="t"><p>vulgarity</p></td><td class="t"><p>using profanity or language that would not be considered proper (e.g., “pissed”, “screw”) in professional discourse</p></td><td class="t"><p><em>K</em>-α = .91</p></td></tr><tr><td class="t"><p>pejorative for speech</p></td><td class="t"><p>disparaging remark about the way in which a person communicates</p></td><td class="t"><p><em>K</em>-α = .74</p></td></tr><tr><td class="t" colspan="2"><p><strong>incivility / impoliteness</strong></p></td><td class="t"><p><em>K</em>-α = .73</p></td></tr><tr><td class="t" rowspan="4"><p>Rowe (2015)</p></td><td class="t" rowspan="4"><p><strong>incivility</strong> (<em>separate</em> from <strong>impoliteness</strong>)</p></td><td class="t"><p>threat to democracy</p></td><td class="t"><p>proposes to overthrow the government (e.g. proposes a revolution) or advocates an armed struggle in opposition to the government (e.g. threatens the use of violence against the government)</p></td><td class="t"><p>κ = .66</p></td></tr><tr><td class="t"><p>threat to individual rights</p></td><td class="t"><p>advocates restricting the rights or freedoms of certain members of society or certain individuals</p></td><td class="t"><p>κ = .86</p></td></tr><tr><td class="t"><p>stereotype</p></td><td class="t"><p>asserts a widely held but fixed and oversimplified image or idea of a particular type of person</p></td><td class="t"><p>κ = .80</p></td></tr><tr><td class="t" colspan="2"><p><strong>incivility</strong></p></td><td class="t"><p>κ = .77</p></td></tr><tr><td class="t b" rowspan="9"><p>Seely (2017)</p></td><td class="t b" rowspan="9"><p><strong>incivility</strong><br />(<strong>impoliteness </strong>is <em>included</em>)</p></td><td class="t"><p>insulting language</p></td><td class="t"><p>name calling and other derogatory remarks often seen in pejorative speech and aspersions</p></td><td class="t"><p><em>K</em>-α = .84</p></td></tr><tr><td class="t"><p>vulgarity</p></td><td class="t"><p>e.g. “lazy f**kers”, “a**holes”</p></td><td class="t"><p><em>K</em>-α = 1</p></td></tr><tr><td class="t"><p>stereotyping of political party/ideology</p></td><td class="t"><p>e.g. “typical lying lefties”</p></td><td class="t"><p><em>K</em>-α = .88</p></td></tr><tr><td class="t"><p>stereotyping using “isms”/discriminatory language</p></td><td class="t"><p>e.g. “if we don’t get rid of idiotic Muslim theologies, we will have growing problems”</p></td><td class="t"><p><em>K</em>-α = 1</p></td></tr><tr><td class="t"><p>other stereotyping language</p></td><td class="t"><p>e.g. “GENERALS LIKE TO HAVE A MALE SOLDIER ON THEIR LAP AT ALL TIMES.”</p></td><td class="t"><p><em>K</em>-α = .78</p></td></tr><tr><td class="t"><p>sarcasm</p></td><td class="t"><p>e.g. “betrayed again by the Repub leadership . . . what a shock”</p></td><td class="t"><p><em>K</em>-α = .79</p></td></tr><tr><td class="t"><p>accusations of lying</p></td><td class="t"><p>e.g. “typical lying lefties”</p></td><td class="t"><p><em>K</em>-α = .80</p></td></tr><tr><td class="t"><p>shouting</p></td><td class="t"><p>excessive capitalization</p><p>and/or exclamation points</p></td><td class="t"><p><em>K</em>-α = .83</p></td></tr><tr><td class="t b" colspan="2"><p><strong>incivility / impoliteness</strong></p></td><td class="t b"><p><em>K</em>-α = .81</p></td></tr></tbody></table></div><p><em>Note</em>: Previous studies used different inter-coder reliability statistics; I<sub>r</sub> = reliability index by Perreault and Leigh (1989); <em>K</em>-α = Krippendorff’s-α; κ = Cohen’s Kappa</p><p> </p><p>Codebook used in the study Rowe (2015) is available under: <a href="https://www.tandfonline.com/doi/full/10.1080/1369118X.2014.940365">https://www.tandfonline.com/doi/full/10.1080/1369118X.2014.940365</a></p><p> </p><p><strong>References</strong></p><p>Brown, P., &amp; Levinson, S. C. (1987). <em>Politeness: Some universals in language usage</em>. Cambridge: Cambridge University Press.</p><p>Coe, K., Kenski, K., &amp; Rains, S. A. (2014). Online and Uncivil? Patterns and Determinants of Incivility in Newspaper Website Comments. <em>Journal of Communication</em>, <em>64</em>(4), 658–679. https://doi.org/10.1111/jcom.12104</p><p>Dryzek, J. S. (2000). <em>Deliberative democracy and beyond: Liberals, Critics, Contestations</em>. <em>Oxford political theory</em>. Oxford, New York: Oxford University Press.</p><p>Erjavec, K., &amp; Kovačič, M. P. (2012). “You Don't Understand, This is a New War! ” Analysis of Hate Speech in News Web Sites' Comments. <em>Mass Communication and Society</em>, <em>15</em>(6), 899–920. https://doi.org/10.1080/15205436.2011.619679</p><p>Fraser, B. (1990). Perspectives on politeness. <em>Journal of Pragmatics</em>, <em>14</em>(2), 219–236. https://doi.org/10.1016/0378-2166(90)90081-n</p><p>Goffman, E. (1989). <em>Interaction ritual: Essays on face-to-face behavior</em>. New York: Pantheon Books.</p><p>Grice, P. H. (1975). Logic and conversation. In P. Cole (Ed.), <em>Syntax and Semantics: Speech acts </em>(pp. 41–58). New York: Academic Press.</p><p>Gutmann, A., &amp; Thompson, D. F. (1996). <em>Democracy and disagreement</em>. Cambridge, Massachusetts: Belknap Press of Harvard University Press.</p><p>Habermas, J. (1994). Three Normative Models of Democracy. <em>Constellations</em>, <em>1</em>(1), 1–10.</p><p>Muddiman, A. (2017). : Personal and public levels of political incivility. <em>International Journal of Communication</em>, <em>11</em>, 3182–3202.</p><p>Oz, M., Zheng, P., &amp; Chen, G. M. (2017). Twitter versus Facebook: Comparing incivility, impoliteness, and deliberative attributes. <em>New Media &amp; Society</em>, <em>20</em>(9), 3400–3419. https://doi.org/10.1177/1461444817749516</p><p>Papacharissi, Z. (2004). Democracy online: Civility, politeness, and the democratic potential of online political discussion groups. <em>New Media &amp; Society</em>, <em>6</em>(2), 259–283. https://doi.org/10.1177/1461444804041444</p><p>Rowe, I. (2015). Civility 2.0: A comparative analysis of incivility in online political discussion. <em>Information, Communication &amp; Society</em>, <em>18</em>(2), 121–138. https://doi.org/10.1080/1369118X.2014.940365</p><p>Seely, N. (2017). Virtual Vitriol: A Comparative Analysis of Incivility Within Political News Discussion Forums. <em>Electronic News</em>, <em>12</em>(1), 42–61. https://doi.org/10.1177/1931243117739060</p> ER -