https://www.hope.uzh.ch/doca/issue/feed DOCA - Database of Variables for Content Analysis 2023-01-01T00:00:00+01:00 Franziska Oehmer-Pedrazzi mfg@ikmz.uzh.ch Open Journal Systems <p>DOCA is a database that presents and discusses content analytical constructs and their operationalizations.</p> https://www.hope.uzh.ch/doca/article/view/4008 Inclusivity (Online Discussions/Discussion Quality) 2022-11-29T20:45:46+01:00 Dominique Heinbach dominique.heinbach@hhu.de <p>Inclusivity is a key dimension to assess the deliberative quality of online discussions. In quantitative content analyses, this dimension measures the openness and accessibility of and the equality and diversity within a discussion.</p> <p><strong>Field of application/Theoretical foundation</strong></p> <p>Most studies on online discussions draw on deliberative norms to measure the quality of their discourse (e.g., Esau et al., 2017; Friess et al., 2021; Rowe, 2015; Ziegele et al., 2020; Zimmermann, 2017). Deliberation is an important concept for the study of (political) online discussions (Ziegele et al., 2020). It focuses on a free and equal exchange of arguments to bridge social differences and legitimize political decisions (Dryzek et al., 2019; Fishkin, 1991, Habermas, 2015). Inclusivity or open participation is one of the central criteria of Habermas’ discourse ethics. Deliberative discussions should be open to everyone and all participants should be able to express their attitudes, desires, and needs (Habermas, 2015; Steenbergen et al., 2003). Inclusivity occurs on two levels: On the one hand, it is a matter of open and free access for all citizens, which precedes the actual discussion process (input, Friess &amp; Eilders, 2015). This precondition is often referred to as universalism or openness (Engelke, 2019; Kersting, 2008). In the discussion process itself (troughput, Friess &amp; Eilders, 2015), all voices should have an equal opportunity to be heard and responded to, regardless of factors such as gender, race, or social background. Inclusivity usually implies opinion diversity, since one-sided discussions carry the risk of marginalizing other positions (Habermas, 2006; Manin, 1987; Zimmermann, 2017).</p> <p> </p> <p><strong>References/Combination with other methods</strong></p> <p>Besides quantitative content analyses, the (deliberative) quality of online discussions is examined with qualitative content analyses and discourse analyses (e.g., Graham &amp; Witschge, 2003; Price &amp; Capella, 2002). Furthermore, participants’ perceptions of the quality of online discussions are investigated with qualitative interviews (e.g., Engelke, 2019; Ziegele, 2016) or a combina­tion of qualitative interviews and content analy­sis (Díaz Noci et al., 2012).</p> <p> </p> <p><em>Cross-references</em></p> <p>Inclusivity is one of five dimensions of deliberative quality in this database written by the same author. Accordingly, there are overlaps with the entries on <a href="https://doi.org/10.34778/5t">rationality</a>, <a href="https://doi.org/10.34778/5u">interactivity</a>, <a href="https://doi.org/10.34778/5v">explicit civility</a>, and <a href="https://doi.org/10.34778/5w">storytelling</a> regarding the theoretical background, references/combinations with other methods, and some example studies.</p> <p> </p> <p><strong>Information on Stromer-Galley (2007)</strong></p> <p><strong>Author: </strong>Jennifer Stromer-Galley</p> <p><strong>Research question: </strong>The aim of the paper was developing a coding scheme for academics and practitioners of deliberation to systematically measure what happens during group deliberations (p. 1; p. 7).</p> <p><strong>Object of analysis: </strong>The author conducted a secondary analysis of online group discussions (23 groups with 5-12 participants) in an experiment called “The Virtual Agora Project” at Carnegie Mellon Unversitiy in Pittsburgh, Pennsylvania. Participants attended the discussions from dormitory rooms that were equipped with a computer, headphones, and microphone. The group discussions were recorded and transcribed for analysis (pp. 7-8). Although strictly speaking the study does not analyze media content, the coding scheme has provided the basis for numerous other studies on the deliberative quality of online discussions (e.g., Rowe, 2015; Stroud et al., 2015; Ziegele et al., 2020).</p> <p><strong>Time frame of analysis: </strong>Three weeks in July 2004 (p. 7).</p> <p><strong><em>Info about variables</em></strong></p> <p><strong>Level of analysis: </strong>Equality was measured on the <em>level of the group discussion</em> as well as on the <em>level of the thought</em>. Coders segmented each speaking contribution into thought units as first stage of the coding process. “A thought is defined as an utterance (from a single sentence to multiple sentences) that expresses an idea on a topic. A change in topic signaled a change in thought. A second indicator of a change in thought was a change in the type of talk. The distinct types of talk that this coding captured were the following: talk about the problem of public schools, talk about the process of the talk, talk about the process of the deliberation, and social talk” (p. 9).</p> <p><strong>Variables and values: </strong>For measuring the variable equality, the <em>number of speakers within a group</em> was counted. Furthermore, the thoughts were counted for the <em>number of words per thought</em>. Additionally, the total <em>number of thoughts spoken in a given</em> group was counted (p. 15).</p> <p><strong>Reliability: </strong>“Two coders spent nearly two months developing and training with the coding scheme. The intercoder agreement measures […] were established from coding 3 of the 23 groups, which were randomly selected. […] The coders of the unitizing process achieved a statistically significant correlation of .86 (p &lt; .001)” (p. 14).</p> <p><strong>Codebook</strong>: in the appendix (pp. 22-33)</p> <p><strong>Information on Zimmermann (2017)</strong></p> <p><strong>Author: </strong>Tobias Zimmermann</p> <p><strong>Research question: </strong>Which role do online reader comments play for a deliberative-democratic understanding of a digital public sphere? (p. 11)</p> <p><strong>Object of analysis: </strong>To compare discursive participation online and offline, the author conducted a full-sample content analysis of online reader comments (N = 1.176) and letters to the editor (N = 381) from German local newspapers on three similar conflicts in local politics concerning the renaming of streets and squares. Because the coding scheme was based on the discourse quality index (DQI), only contributions that contained a demand were included in the analysis, that is, “a proposal on what decision should or should not be made” Steenbergen et al., 2003, p. 27). Only then, a speech act is considered relevant from a discourse ethics perspective.</p> <p><strong>Time frame of analysis: </strong>June 2012 to May 2013</p> <p><strong><em>Info about variables</em></strong></p> <p><strong>Level of analysis:</strong> see Table 1</p> <p><strong>Variables:</strong> Following Stromer-Galley (2007) and Bächtiger et al. (2010), the author operationalizes <em>participation (egalitarian openness)</em> based on frequency and volume of the comments. Furthermore, the study assigns the comments to a pro or contra side in regard to their content. This allows conclusions regarding the equality of different positions (pp. 161-163). Additionally, based on the DQI (Steenbergen et al., 2003), he included the variable <em>common good reference</em>, because reasoning oriented to common interests represents the most inclusive form of reasoning (pp. 190-191).</p> <p><strong>Reliability: </strong>Intracoder reliability was tested on a subset of 100 comments. The variable “common good reference” reached a Krippendorff’s Alpha of .71 (p. 201).</p> <p><strong>Codebook: </strong>pp. 159-185 (in German)</p> <p><em>Table 1: Variables, values and level of analysis (Zimmermann, 2017, p. 163; p. 191)</em></p> <div style="overflow-x: auto;"> <table> <tbody> <tr> <td class="t b"> <p>Indicator</p> </td> <td class="t b"> <p>Category</p> </td> <td class="t b"> <p>Definition</p> </td> <td class="t b"> <p>Level of analysis</p> </td> </tr> <tr> <td width="111"> <p>Egalitarian openness</p> </td> <td class="t b"> <p>Egalitarian openness (a)</p> </td> <td class="t b"> <p>Length of a comment (or letter to the editor)</p> </td> <td class="t b"> <p>Individual contribution</p> </td> </tr> <tr> <td width="111"> <p><strong> </strong></p> </td> <td class="t b"> <p>Egalitarian openness (b)</p> </td> <td class="t b"> <p>Number of contributions per participant</p> </td> <td class="t b"> <p>Discussion</p> </td> </tr> <tr> <td class="b"> <p><strong> </strong></p> </td> <td class="t b"> <p>Egalitarian openness (c)</p> </td> <td class="t b"> <p>Number of contributions per thematic position</p> </td> <td class="t b"> <p>Discussion</p> </td> </tr> <tr> <td width="111"> <p>Common good reference</p> </td> <td class="t b"> <p>No common good reference</p> </td> <td class="t b"> <p>No reference to the common good is explicitly made</p> </td> <td class="t b"> <p>Individual contribution</p> </td> </tr> <tr> <td class="b"> <p><strong> </strong></p> </td> <td class="t b"> <p>Explicit common good reference</p> </td> <td class="t b"> <p>The contribution includes at least one explicit reference to the common good (utilitarian or disadvantaged-oriented)</p> </td> <td class="t b"> <p>Individual contribution</p> </td> </tr> </tbody> </table> </div> <p><strong> </strong></p> <p><strong>Example studies</strong></p> <p>Ruiz, C., Domingo, D., Micó, J. L., Díaz-Noci, J., Meso, C. &amp; Masip, P. (2011). Public Sphere 2.0? The Democratic Qualities of Citizen Debates in Online Newspapers. <em>The International Journal of Press/Politics</em>, <em>16</em>, 463–487.</p> <p>Stromer Galley, J. (2007). Measuring Deliberation's Content: A Coding Scheme. <em>Journal of Public Deliberation</em>, <em>3</em>(1), Article 12.</p> <p>Ziegele, M., Quiring, O., Esau, K. &amp; Friess, D. (2020). Linking News Value Theory With Online Deliberation: How News Factors and Illustration Factors in News Articles Affect the Deliberative Quality of User Discussions in SNS’ Comment Sections. <em>Communication Research</em>, <em>47</em>(6), 860-890. <a href="https://doi.org/10.1177/0093650218797884">https://doi.org/10.1177/0093650218797884</a></p> <p>Zimmermann, T. (2017). <em>Digitale Diskussionen: Über politische Partizipation mittels Online-Leserkommentaren [Digital discussions: On political participation trough online reader comments]</em>. <em>Edition Politik: Bd. 44</em>. transcript Verlag. <a href="http://www.content-select.com/index.php?id=bib_view&amp;ean=9783839438886">http://www.content-select.com/index.php?id=bib_view&amp;ean=9783839438886</a></p> <p><strong><em>Further references</em></strong></p> <p>Bächtiger, A., Shikano, S., Pedrini, S. &amp; Ryser, M. (2010). <em>Measuring Deliberation 2.0: Standards, Discourse Types, and Sequentialization. </em>University of Konstanz and University of Bern. <a href="https://ash.harvard.edu/files/ash/files/baechtiger_0.pdf">https://ash.harvard.edu/files/ash/files/baechtiger_0.pdf</a></p> <p>Díaz Noci, J., Domingo, D., Masip, P., Micó, J. L. &amp; Ruiz, C. (2012). Comments in news, democracy booster or journalistic night­mare: Assessing the quality and dynamics of citizen debates in Catalan online new­spapers. #ISOJ, 2(1), 46–64. <a href="https://isoj.org/%20wp-content/uploads/2016/10/ISOJ_Jour­nal_V2_N1_2012_Spring.pdf#page=46">https://isoj.org/ wp-content/uploads/2016/10/ISOJ_Jour­nal_V2_N1_2012_Spring.pdf#page=46</a></p> <p>Dryzek, J. S., Bächtiger, A., Chambers, S., Cohen, J., Druckman, J. N., Felicetti, A., Fishkin, J. S., Farrell, D. M., Fung, A., Gutmann, A., Landemore, H., Mansbridge, J., Marien, S., Neblo, M. A., Niemeyer, S., Setälä, M., Slothuus, R., Suiter, J., Thompson, D. &amp; Warren, M. E. (2019). The crisis of democracy and the science of deliberation. <em>Science (New York, N.Y.)</em>, <em>363</em>(6432), 1144–1146. <a href="https://doi.org/10.1126/science.aaw2694">https://doi.org/10.1126/science.aaw2694</a></p> <p>Engelke, K. M. (2019). Enriching the Conversation: Audience Perspectives on the Deliberative Nature and Potential of User Comments for News Media. <em>Digital Journalism</em>, <em>8</em>(4), 1–20. <a href="https://doi.org/10.1080/21670811.2019.1680567">https://doi.org/10.1080/21670811.2019.1680567</a></p> <p>Esau, K., Friess, D. &amp; Eilders, C. (2017). Design Matters! An Empirical Analysis of Online Deliberation on Different News Platforms. <em>Policy &amp; Internet</em>, <em>9</em>(3), 321–342. <a href="https://doi.org/10.1002/poi3.154">https://doi.org/10.1002/poi3.154</a></p> <p>Fishkin, J. S. (1991). <em>Democracy and deliberation: New directions for democratic reform</em>. Yale University Press. <a href="http://www.jstor.org/stable/10.2307/j.ctt1dt006v%20https://doi.org/10.2307/j.ctt1dt006v">http://www.jstor.org/stable/10.2307/j.ctt1dt006v https://doi.org/10.2307/j.ctt1dt006v</a></p> <p>Friess, D. &amp; Eilders, C. (2015). A systematic review of online deliberation research. <em>Policy &amp; Internet</em>, <em>7</em>(3), 319–339. <a href="https://doi.org/10.1002/poi3.95">https://doi.org/10.1002/poi3.95</a></p> <p>Friess, D., Ziegele, M. &amp; Heinbach, D. (2021). Collective Civic Moderation for Deliberation? Exploring the Links between Citizens’ Organized Engagement in Comment Sections and the Deliberative Quality of Online Discussions. <em>Political Communication</em>, <em>38</em>(5), 624–646. <a href="https://doi.org/10.1080/10584609.2020.1830322">https://doi.org/10.1080/10584609.2020.1830322</a></p> <p>Graham, T. &amp; Witschge, T. (2003). In Search of Online Deliberation: Towards a New Method for Examining the Quality of Online Discussions. <em>Communications</em>, <em>28</em>(2). <a href="https://doi.org/10.1515/comm.2003.012">https://doi.org/10.1515/comm.2003.012</a></p> <p>Habermas, J. (2006). Political communication in media society: Does democracy still enjoy an epistemic dimension? The impact of normative theory on empirical research. <em>Communication Theory</em>, <em>16</em>(4), 411–426.</p> <p>Habermas, J. (2015). <em>Between facts and norms: Contributions to a discourse theory of law and democracy</em> (Reprinted.). Polity Press.</p> <p>Kersting, N. (2008). Innovative Partizipation: Legitimation, Machtkontrolle und Transformation. Eine Einführung [Innovative participation. Legitimation, control of power, and transformation. An introduction]. In N. Kersting (Hrsg.), <em>Politische Beteiligung: Einführung in dialogorientierte Instrumente politischer und gesellschaftlicher Partizipation </em>(S. 11–39). VS Verlag für Sozialwissenschaften.</p> <p>Manin, B. (1987). On Legitimacy and Political Deliberation. <em>Political Theory</em>, <em>15</em>(3), 338–368. <a href="https://doi.org/10.1177/0090591787015003005">https://doi.org/10.1177/0090591787015003005</a></p> <p>Price, V. &amp; Cappella, J. N. (2002). Online deliberation and its influence: The Electronic Dialogue Project in Campaign 2000. <em>IT&amp;Society</em>, <em>1</em>(1), 303–329. <a href="https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.9.5945&amp;rep=rep1&amp;type=pdf">https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.9.5945&amp;rep=rep1&amp;type=pdf</a></p> <p>Rowe, I. (2015). Deliberation 2.0: Comparing the Deliberative Quality of Online News User Comments Across Platforms. <em>Journal of Broadcasting &amp; Electronic Media</em>, <em>59</em>(4), 539–555. <a href="https://doi.org/10.1080/08838151.2015.1093482">https://doi.org/10.1080/08838151.2015.1093482</a></p> <p>Steenbergen, M. R., Bächtiger, A., Spörndli, M. &amp; Steiner, J. (2003). Measuring Political Deliberation: A Discourse Quality Index. <em>Comparative European Politics</em>, <em>1</em>(1), 21–48. <a href="https://doi.org/10.1057/palgrave.cep.6110002">https://doi.org/10.1057/palgrave.cep.6110002</a></p> <p>Stroud, N. J., Scacco, J. M., Muddiman, A., &amp; Curry, A. L. (2015). Changing Deliberative Norms on News Organizations' Facebook Sites. <em>Journal of Computer-Mediated Communication, 20</em>(2), 188–203. <a href="https://doi.org/10.1111/jcc4.12104">https://doi.org/10.1111/jcc4.12104</a></p> <p>Ziegele, M. (2016). <em>Nutzerkommentare als Anschlusskommunikation: Theorie und qualitative Analyse des Diskussionswerts von Online-Nachrichten</em><em> [T</em><em>he Discussion Value of Online News. An Analysis of User Comments on News Platforms]</em>. Springer VS.</p> 2022-11-29T00:00:00+01:00 Copyright (c) 2022 DOCA - Database of Variables for Content Analysis https://www.hope.uzh.ch/doca/article/view/4007 Storytelling (Online Discussions/Discussion Quality) 2022-11-29T20:36:41+01:00 Dominique Heinbach dominique.heinbach@hhu.de <p>Storytelling is a variable to assess the quality of online discussions beyond traditional deliberation criteria, such as rationality, interactivity, and inclusiveness. It belongs to the so-called type II deliberation (Bächtiger et al., 2010) and includes personal experiences and narratives from participants’ own lives and environments.</p> <p><strong>Field of application/Theoretical foundation</strong></p> <p>In addition to traditional criteria such as rationality, more inclusive forms are increasingly playing a role in deliberation research, for example, the so-called "type II deliberation" (Bächtiger et al., 2010) or "democratic deliberation" (Mansbridge, 2007). Following these approaches, the use of expressive forms of communication such as participants’ personal experiences and stories, emotions, and humor are also legitimate in deliberative discourse (Esau et al., 2019; Esau et al., 2021). Of these inclusive quality criteria, the most important is probably storytelling, where participants contribute personal stories, narratives, and experiences to the discussion (Bächtiger et al., 2010; Polletta &amp; Lee, 2006). By now, storytelling is widely accepted as an indicator of quality in deliberation research (Bächtiger et al., 2010; Zimmermann, 2017). It is considered the most significant alternative to rational argumentation, which has been so crucial in traditional deliberation literature, since positions can also be justified with personal stories and experiences (Bächtiger et al., 2010; Polletta &amp; Lee, 2006; Steiner, 2012).</p> <p><strong>References/Combination with other methods</strong></p> <p>Besides quantitative content analyses, storytelling is examined by means of qualitative content analyses and discourse analyses (Graham &amp; Witschge, 2003; Steiner et al., 2017) or a combination of qualitative and quantitative analyses (Polletta &amp; Lee, 2006).</p> <p><strong><em> </em></strong></p> <p><em>Cross-references</em></p> <p>Storytelling is one of five dimensions of deliberative quality in this database written by the same author. Accordingly, there are overlaps with the entries on <a href="https://doi.org/10.34778/5u">interactivity</a>, <a href="https://doi.org/10.34778/5x">inclusivity</a>, <a href="https://doi.org/10.34778/5t">rationality</a>, and <a href="https://doi.org/10.34778/5v">explicit civility</a> regarding theoretical background, references/combinations with other methods, and some example studies.</p> <p><strong><em> </em></strong></p> <p><strong>Information on Esau et al. </strong><strong>(2021)</strong></p> <p><strong>Authors: </strong>Katharina Esau, Dannica Fleuß, &amp; Sarah-Michelle Nienhaus</p> <p><strong>Research question: “</strong>RQ1: How does the deliberative quality of online participatory practices vary between different deliberative arenas? RQ2: Does deliberative quality, according to a classic concept of deliberation, vary between different arenas? RQ 1.2: Does the proportion of alternative forms of communication (expressions of emotion and storytelling) vary between arenas?” (p. 88)</p> <p><strong>Object of analysis: </strong>The authors conducted comparative content analyses of three different deliberative arenas: A government-run online consultation platform (all user comments, N = 603), the comment sections of mass media platforms (stratified random sample, N = 794), and a civil society Facebook community page (all user comments, N = 767). This resulted in a final sample of 2,164 user comments across all three platforms (pp. 101-102).</p> <p><strong>Time frame of analysis: </strong>2015</p> <p><strong><em>Info about variables</em></strong></p> <p><strong>Level of analysis: </strong>User comment (p. 101)</p> <p><strong>Variables:</strong> see Table 1</p> <p><strong>Values: </strong>Dichotomous measure (yes,no)</p> <p><strong>Reliability: “</strong>The comments were analyzed by a team of five trained coders. […] All variables had a Krippendorff’s α &gt; 0.70“ (p. 102).</p> <p><em>Table 1: Variables (Esau et al., 2021, p. 102).</em></p> <div style="overflow-x: auto;"> <table> <tbody> <tr> <td class="t b"> <p>Dimension</p> </td> <td class="t b"> <p>Measure</p> </td> <td class="t b"> <p>Definition</p> </td> </tr> <tr> <td class="t b"> <p>Storytelling</p> </td> <td class="t b"> <p>Personal storytelling</p> </td> <td class="t b"> <p>This measure captured whether a comment reported a personal experience (or an experience of known others), expressed in a narrative form.</p> </td> </tr> </tbody> </table> </div> <p><strong><em> </em></strong></p> <p><strong>Information on Heinbach &amp; Wilms (2022)</strong></p> <p><strong>Authors: </strong>Dominique Heinbach &amp; Lena K. Wilms (Codebook by Dominique Heinbach, Marc Ziegele, &amp; Lena K. Wilms)</p> <p><strong>Research question: </strong>Which attributes differentiate moderated from unmoderated comments?</p> <p><strong>Object of analysis: </strong>The quantitative content analysis was based on a stratified random sample of moderated and not moderated comments (N = 1.682) from the German online participation platform “#meinfernsehen202” [#myTV2021], a citizen participation platform to discuss the future of public broadcasting in Germany.</p> <p><strong>Time frame of analysis: </strong>November 24, 2020 to March 3, 2021</p> <p><strong><em>Info about variables</em></strong></p> <p><strong>Level of analysis: </strong>User comment</p> <p><strong>Variables and reliability:</strong> see Table 2</p> <p><strong>Values: </strong>All variables were coded on a four-point scale (1 = clearly not present; 2 = rather not present; 3 = rather present; 4 = clearly present). Detailed explanations and examples for each value are provided in the Codebook (in German).</p> <p><strong>Codebook:</strong> in the appendix of this entry (in German)</p> <p><em>Table 2: Variables and reliability (Heinbach &amp; Wilms, 2022)</em></p> <div style="overflow-x: auto;"> <table> <tbody> <tr> <td class="t b"> <p>Dimension</p> </td> <td class="t b"> <p>Measure</p> </td> <td class="t b"> <p>Definition</p> </td> <td class="t b"> <p>Krippendorff’s α</p> </td> </tr> <tr> <td width="113"> <p>Storytelling</p> </td> <td class="t b"> <p>Storytelling</p> </td> <td class="t b"> <p>Does the comment contain personal stories and experiences?</p> </td> <td class="t b"> <p>.85</p> </td> </tr> <tr> <td width="113"> <p><strong> </strong></p> </td> <td class="t b"> <p>Narrative reasoning</p> </td> <td class="t b"> <p>Does the comment contain personal stories or experiences to support an argument or position?</p> </td> <td class="t b"> <p>.75</p> </td> </tr> <tr> <td class="t b"> <p> </p> </td> <td class="t b"> <p><strong> </strong></p> </td> <td class="t b"> <p> </p> </td> <td class="t b"> <p>n = 159, 3 coders</p> </td> </tr> </tbody> </table> </div> <p><strong><em> </em></strong></p> <p><strong>Information on Zimmermann (2017)</strong></p> <p><strong>Author: </strong>Tobias Zimmermann</p> <p><strong>Research question: </strong>Which role do online reader comments play for a deliberative-democratic understanding of a digital public sphere? (p. 11)</p> <p><strong>Object of analysis: </strong>To compare discursive participation online and offline, the author conducted a full-sample content analysis of online reader comments (N = 1.176) and letters to the editor (N = 381) from German local newspapers on three similar conflicts in local politics concerning the renaming of streets and squares. Because the coding scheme was based on the discourse quality index (DQI), only contributions that contained a demand were included in the analysis, that is, “a proposal on what decision should or should not be made” Steenbergen et al., 2003, p. 27). Only then, a speech act is considered relevant from a discourse ethics perspective.</p> <p><strong>Time frame of analysis: </strong>June 2012 to May 2013</p> <p><strong><em>Info about variables</em></strong></p> <p><strong>Variables: </strong>Following Bächtiger et al. (2011, p. 17), the variable storytelling measures “whether participants use personal narratives or experiences”. However, the author interprets storytelling in a narrow sense, that is, if users clarify the narration as their personal story of experience. Consequently, only own experiences are considered (p. 173). Following Steiner (2012), the study operationalizes storytelling on an ordinal scale in order to measure its deliberative quality (p. 174).</p> <p><strong>Level of analysis:</strong> Individual contribution</p> <p><strong>Variables and values:</strong> see Table 3</p> <p><strong>Reliability: </strong>Intracoder reliability for storytelling was tested on a subset of 100 comments and exceeded a Krippendorff’s Alpha (ordinal) above .73 (p. 201).</p> <p><strong>Codebook: </strong>pp. 159-185 (in German)</p> <p><em>Table 3: Variables and values (Zimmermann, 2017, p. 174)</em></p> <div style="overflow-x: auto;"> <table> <tbody> <tr> <td class="t b"> <p>Variable</p> </td> <td class="t b"> <p>Value</p> </td> <td class="t b"> <p>Definition</p> </td> </tr> <tr> <td width="123"> <p>Storytelling</p> </td> <td class="t b"> <p>No storytelling</p> </td> <td class="t b"> <p>The comment does not contain any personal story of experience of the author.</p> </td> </tr> <tr> <td width="123"> <p><strong> </strong></p> </td> <td class="t b"> <p>Unfocused storytelling</p> </td> <td class="t b"> <p>The comment does contain at least one personal story of experience of the author.</p> </td> </tr> <tr> <td width="123"> <p><strong> </strong></p> </td> <td class="t b"> <p>Justifying storytelling</p> </td> <td class="t b"> <p>The comment does contain at least one personal story of experience of the author, which serves as sole justification for the demand.</p> </td> </tr> <tr> <td class="b"> <p><strong> </strong></p> </td> <td class="t b"> <p>Complementary storytelling</p> </td> <td class="t b"> <p>The comment does contain at least one personal story of experience of the author that supports the justification.</p> </td> </tr> </tbody> </table> </div> <p><strong>Example studies</strong></p> <p>Esau, K., Fleuß, D. &amp; Nienhaus, S.‑M. (2021). Different Arenas, Different Deliberative Quality? Using a Systemic Framework to Evaluate Online Deliberation on Immigration Policy in Germany. <em>Policy &amp; Internet</em>, <em>13</em>(1), 86–112. <a href="https://doi.org/10.1002/poi3.232">https://doi.org/10.1002/poi3.232</a></p> <p>Heinbach, D. &amp; Wilms, L. K. (2022): Der Einsatz von Moderation bei #meinfernsehen2021 [The deployment of moderation at #meinfernsehen2021]. In: F. Gerlach, C. Eilders &amp; K. Schmitz (Eds.): <em>#meinfernsehen2021. Partizipationsverfahren zur </em>Zukunft des öffentlich-rechtlichen Fernsehens. Baden-Baden: Nomos.</p> <p>Rowe, I. (2015). Deliberation 2.0: Comparing the Deliberative Quality of Online News User Comments Across Platforms. <em>Journal of Broadcasting &amp; Electronic Media</em>, <em>59</em>(4), 539–555. <a href="https://doi.org/10.1080/08838151.2015.1093482">https://doi.org/10.1080/08838151.2015.1093482</a></p> <p>Stromer Galley, J. (2007). Measuring Deliberation's Content: A Coding Scheme. <em>Journal of Public Deliberation</em>, <em>3</em>(1), Article 12.</p> <p>Zimmermann, T. (2017). <em>Digitale Diskussionen: Über politische Partizipation mittels Online-Leserkommentaren [Digital discussions: On political participation trough online reader comments]</em>. <em>Edition Politik: Bd. 44</em>. transcript Verlag. <a href="http://www.content-select.com/index.php?id=bib_view&amp;ean=9783839438886">http://www.content-select.com/index.php?id=bib_view&amp;ean=9783839438886</a></p> <p><strong><em>Further references</em></strong></p> <p>Bächtiger, A., Gerber, M., &amp; Shikano, S. (2011, August). Deliberative Abilities of Ordinary Citizens. In <em>6th ECPR General Conference, Reykjavik</em>.</p> <p>Bächtiger, A., Shikano, S., Pedrini, S. &amp; Ryser, M. (2010). <em>Measuring Deliberation 2.0: Standards, Discourse Types, and Sequentialization. </em>University of Konstanz and University of Bern. <a href="https://ash.harvard.edu/files/ash/files/baechtiger_0.pdf">https://ash.harvard.edu/files/ash/files/baechtiger_0.pdf</a></p> <p>Graham, T. &amp; Witschge, T. (2003). In Search of Online Deliberation: Towards a New Method for Examining the Quality of Online Discussions. <em>Communications</em>, <em>28</em>(2). <a href="https://doi.org/10.1515/comm.2003.012">https://doi.org/10.1515/comm.2003.012</a></p> <p>Mansbrige, J. (2007). “Deliberative Democracy” or “Democratic Deliberation”? In S. W. Rosenberg (Hrsg.), <em>Deliberation, Participation and Democracy </em>(S. 251–271). Palgrave Macmillan, London. <a href="https://doi.org/10.1057/9780230591080_12">https://doi.org/10.1057/9780230591080_12</a></p> <p>Polletta, F. &amp; Lee, J. (2006). Is Telling Stories Good for Democracy? Rhetoric in Public Deliberation after 9/11. <em>American Sociological Review</em>, <em>71</em>(5), 699–721. <a href="https://doi.org/10.1177/000312240607100501">https://doi.org/10.1177/000312240607100501</a></p> <p>Steenbergen, M. R., Bächtiger, A., Spörndli, M., &amp; Steiner, J. (2003). Measuring Political Deliberation: A Discourse Quality Index. <em>Comparative European Politics</em>, <em>1</em>(1), 21–48. <a href="https://doi.org/10.1057/palgrave.cep.6110002">https://doi.org/10.1057/palgrave.cep.6110002</a></p> <p>Steiner, J. (2012). <em>The Foundations of Deliberative Democracy.</em> Cambridge University Press.</p> <p>Steiner, J., Jaramillo, M. C., Maia, R. C. M. &amp; Mameli, S. (2017). <em>Deliberation Across Deeply Divided Societies</em>. Cambridge University Press. <a href="https://doi.org/10.1017/9781316941591">https://doi.org/10.1017/9781316941591</a></p> 2022-11-29T00:00:00+01:00 Copyright (c) 2022 DOCA - Database of Variables for Content Analysis https://www.hope.uzh.ch/doca/article/view/4006 Explicit civility (Online Discussions/Discussion Quality) 2022-11-29T20:28:23+01:00 Dominique Heinbach dominique.heinbach@hhu.de <p>Explicit civility or respect is a key dimension to assess the (deliberative) quality of online discussions. In contrast to operationalizations that address civility through the mere absence of incivility or offensive language, this construct measures explicit indicators for respect, such as acknowledgements, endorsement, and explicit valuation.</p> <p><strong>Field of application/Theoretical foundation</strong></p> <p>Most studies on online discussions draw on deliberative norms to measure the quality of their discourse (e.g., Esau et al., 2017; Friess et al., 2021; Rowe, 2015; Ziegele et al., 2020; Zimmermann, 2017). Deliberation is an important concept for the study of (political) online discussions and consists of a fair and respectful exchange of arguments between participants who are deemed as equals (Graham &amp; Witschge, 2003; Ziegele et al., 2020). Mutual respect and appreciation of one another are considered fundamental assets of a democratic society (Papacharissi, 2004). A minimum level of respect ensures the mutual acknowledgement of participants as free and equal members of society and hence is a requirement for deliberation (Habermas, 2007; Steiner, 2012; Ziegele et al., 2020).</p> <p>&nbsp;</p> <p><strong>References/Combination with other methods</strong></p> <p>Besides quantitative content analyses, the (deliberative) quality of online discussions is examined with qualitative content analyses and discourse analyses (Graham &amp; Witschge, 2003; Price &amp; Capella, 2002). Furthermore, perceptions of civility and incivility are investigated with qualitative interviews and focus groups (Bormann, 2022; Engelke, 2019; Ziegele, 2016), surveys (Kenski et al., 2020; Stryker et al., 2016) and experimental designs (Muddiman, 2017; Ziegele et al., 2019).</p> <p><em>Cross-references</em></p> <p>Explicit civility is one of five dimensions of deliberative quality in this database written by the same author. Accordingly, there are overlaps with the entries on <a href="https://doi.org/10.34778/5u">interactivity</a>, <a href="https://doi.org/10.34778/5x">inclusivity</a>, <a href="https://doi.org/10.34778/5t">rationality</a>, and <a href="https://doi.org/10.34778/5w">storytelling</a> regarding theoretical background, references/combinations with other methods, and some example studies.</p> <p>&nbsp;</p> <p><strong>Information on Heinbach &amp; Wilms (2022)</strong></p> <p><strong>Authors: </strong>Dominique Heinbach &amp; Lena K. Wilms (Codebook by Dominique Heinbach, Marc Ziegele, &amp; Lena K. Wilms)</p> <p><strong>Research question: </strong>Which attributes differentiate moderated from unmoderated comments?</p> <p><strong>Object of analysis: </strong>The quantitative content analysis was based on a stratified random sample of moderated and not moderated comments (N = 1.682) from the German online participation platform “#meinfernsehen2021” [#myTV2021], a citizen participation platform to discuss the future of public broadcasting in Germany.</p> <p><strong>Time frame of analysis: </strong>November 24, 2020 to March 3, 2021</p> <p><strong><em>Info about variables</em></strong></p> <p><strong>Level of analysis: User comment</strong></p> <p><strong>Variables and reliability:</strong> see Table 1</p> <p><strong>Values: </strong>All variables were coded on a four-point scale (1 = clearly not present; 2 = rather not present; 3 = rather present; 4 = clearly present). Detailed explanations and examples for each value are provided in the Codebook (in German).</p> <p><strong>Codebook: in the appendix of this entry (in German)</strong></p> <p><em>Table 1: Variables and reliability (Heinbach &amp; Wilms, 2022)</em></p> <div style="overflow-x: auto;"> <table> <tbody> <tr> <td class="t b"> <p>Dimension</p> </td> <td class="t b"> <p>Measure</p> </td> <td class="t b"> <p>Definition</p> </td> <td class="t b"> <p>Krippendorff’s α</p> <p>(n = 159, 3 coders)</p> </td> </tr> <tr> <td width="113"> <p>Explicit</p> <p>respect</p> </td> <td class="t b"> <p>Polite salutation</p> </td> <td class="t b"> <p>Does the comment contain formulations of polite salutations, greetings or farewell phrases, e.g., “Dear …”, “Have a good weekend”?</p> </td> <td class="t b"> <p>.80</p> </td> </tr> <tr> <td class="b"> <p><strong>&nbsp;</strong></p> </td> <td class="t b"> <p>Expression of respect</p> </td> <td class="t b"> <p>Does the comment contain appreciation, approval, praise, or acknowledgements, e.g, “Kudos!”, “You are doing a great job, “Thank you”, “I respect your opinion“?</p> </td> <td class="t b"> <p>.71</p> </td> </tr> </tbody> </table> </div> <p><strong>&nbsp;</strong></p> <p><strong>Information on Stromer-Galley (2007)</strong></p> <p><strong>Author: </strong>Jennifer Stromer-Galley</p> <p><strong>Research question: </strong>The aim of the paper was developing a coding scheme for academics and practitioners of deliberation to systematically measure what happens during group deliberations (p. 1; p. 7).</p> <p><strong>Object of analysis:</strong> The author conducted a secondary analysis of online group discussions (23 groups with 5-12 participants) in an experiment called “The Virtual Agora Project” at Carnegie Mellon Unversitiy in Pittsburgh, Pennsylvania. Participants attended the discussions from dormitory rooms that were equipped with a computer, headphones, and microphone. The group discussions were recorded and transcribed for analysis (pp. 7-8). Although strictly speaking the study does not analyze media content, the coding scheme has provided the basis for numerous other studies on the deliberative quality of online discussions (e.g., Rowe, 2015; Stroud et al., 2015; Ziegele et al., 2020).</p> <p><strong>Time frame of analysis: </strong>Three weeks in July 2004 (p. 7).</p> <p><strong><em>Info about variables</em></strong></p> <p><strong>Level of analysis:</strong> Social talk was measured on the <em>level of the thought</em>. Coders segmented each speaking contribution into thought units before coding the categories. “A thought is defined as an utterance (from a single sentence to multiple sentences) that expresses an idea on a topic. A change in topic signaled a change in thought. A second indicator of a change in thought was a change in the type of talk. The distinct types of talk that this coding captured were the following: talk about the problem of public schools, talk about the process of the talk, talk about the process of the deliberation, and social talk” (p. 9).</p> <p><strong>Variables and values:</strong> see Table 2</p> <p><strong>Reliability: </strong>Reliability scores for social talk are not provided.</p> <p><strong>Codebook</strong>: in the appendix (pp. 22-33)</p> <p><em>Table 2: Variables and values (Stromer-Galley, 2007, p. 9; pp. 26-27).</em></p> <div style="overflow-x: auto;"> <table> <tbody> <tr> <td class="t b"> <p>Variable</p> </td> <td class="t b"> <p>Description</p> </td> <td class="t b"> <p>Value</p> </td> <td class="t b"> <p>Definition</p> </td> </tr> <tr> <td width="86"> <p>Social talk</p> </td> <td width="169"> <p>Social talk is talk that brings the strangers together by building social bonds, including salutations, praise, and apologies.</p> </td> <td class="t b"> <p>Salutations</p> </td> <td class="t b"> <p>Statements of welcome, greeting, hello, and good bye, see you later, and the like.</p> </td> </tr> <tr> <td width="86"> <p><strong>&nbsp;</strong></p> </td> <td width="169"> <p>&nbsp;</p> </td> <td class="t b"> <p>Apologies</p> </td> <td class="t b"> <p>Statements of apology: I’m sorry, and ‘I hope’ statements, such as “I hope I haven’t been too obnoxious.” Includes statements of reflection of how the participant performed in the group (likely comes at the end of the group’s discussion): “I hope my few ideas did get across.”</p> </td> </tr> <tr> <td width="86"> <p><strong>&nbsp;</strong></p> </td> <td width="169"> <p>&nbsp;</p> </td> <td class="t b"> <p>Praise</p> </td> <td class="t b"> <p>Includes thank you, you’re welcome, as well as praise for other individuals or the group (“you’ve been a good group.” I’ve really enjoyed myself,” “this has been fun”) Praise in the service of an argument about the problem is coded as a problem thought (“I want to commend Sally for volunteering at her school. We need more people to be volunteers”).</p> </td> </tr> <tr> <td class="b"> <p><strong>&nbsp;</strong></p> </td> <td class="b"> <p>&nbsp;</p> </td> <td class="t b"> <p>ChitChat</p> </td> <td class="t b"> <p>Thought statements that are not on topic relative to the deliberation. These could be jokes or puns (but not as they relate to the problem of schools), social chit chat about the weather, and the like.</p> </td> </tr> </tbody> </table> </div> <p><strong>&nbsp;</strong></p> <p><strong>Information on Zimmermann (2017)</strong></p> <p><strong>Author: </strong>Tobias Zimmermann</p> <p><strong>Research question: </strong>Which role do online reader comments play for a deliberative-democratic understanding of a digital public sphere? (p. 11)</p> <p><strong>Object of analysis: </strong>To compare discursive participation online and offline, the author conducted a full-sample content analysis of online reader comments (N = 1.176) and letters to the editor (N = 381) from German local newspapers on three similar conflicts in local politics concerning the renaming of streets and squares. Because the coding scheme was based on the discourse quality index (DQI), only contributions that contained a demand were included in the analysis, that is, “a proposal on what decision should or should not be made” Steenbergen et al., 2003, p. 27). Only then, a speech act is considered relevant from a discourse ethics perspective.</p> <p><strong>Time frame of analysis: </strong>June 2012 to May 2013</p> <p><strong><em>Info about variables</em></strong></p> <p><strong>Variables:</strong> For the variable respect towards groups, the author extends the respect variable of the Discourse Quality Index (DQI, Steenbergen et al., 2003) by adding anti-democratic behavior following Papacharissi (2004). Besides the ordinal variable “respect”, the author measured the dichotomous variable “democratic respect”.</p> <p><strong>Level of analysis:</strong> Individual contribution</p> <p><strong>Variables and values:</strong> see Table 3</p> <p><strong>Reliability: </strong>Intracoder reliability was tested on a subset of 100 comments. The ordinal respect variable exceeded a Krippendorff’s Alpha above .73 (p. 201). The dichotomous variable “democratic respect” that measured if a comment contained anti-democratic behavior or not reached a Krippendorff’s Alpha of .89 (p. 200-201).</p> <p><strong>Codebook: </strong>pp. 159-185 (in German)</p> <p><em>Table 3: Variables and values (Zimmermann, 2017, p. 171; p. 189)</em></p> <div style="overflow-x: auto;"> <table> <tbody> <tr> <td class="t b"> <p>Variable</p> </td> <td class="t b"> <p>Value</p> </td> <td class="t b"> <p>Definition</p> </td> </tr> <tr> <td width="159"> <p>Respect</p> </td> <td class="t b"> <p>Anti-democratic behavior</p> </td> <td class="t b"> <p>Only or predominantly statements are made that either contain at least one threat against the democratic system as a whole, use negative stereotypes, or question other individuals’ individual liberty rights.</p> </td> </tr> <tr> <td width="159"> <p><strong>&nbsp;</strong></p> </td> <td class="t b"> <p>No respect</p> </td> <td class="t b"> <p>This category applies when exclusively or predominantly negative statements about others, but not anti-democratic statements are made.</p> </td> </tr> <tr> <td width="159"> <p><strong>&nbsp;</strong></p> </td> <td class="t b"> <p>Implicit respect</p> </td> <td class="t b"> <p>There are no explicitly positive or negative statements to others, that is, a comment is neither explicitly respectful nor disrespectful.</p> </td> </tr> <tr> <td width="159"> <p><strong>&nbsp;</strong></p> </td> <td class="t b"> <p>Balanced respect</p> </td> <td class="t b"> <p>Both positive and negative statements in relation to others are expressed in the same degree.</p> </td> </tr> <tr> <td class="b"> <p><strong>&nbsp;</strong></p> </td> <td class="t b"> <p>Explicit respect</p> </td> <td class="t b"> <p>This category is applied when there is at least one explicitly positive statement regarding others and no negative statements, or if the positive statement clearly dominates the negative.</p> </td> </tr> <tr> <td width="159"> <p>Democratic respect</p> </td> <td class="t b"> <p>Anti-democratic behavior</p> </td> <td class="t b"> <p>Only or predominantly statements are made that either contain at least one threat against the democratic system as a whole, use negative stereotypes, or question other individuals’ individual liberty rights.</p> </td> </tr> <tr> <td class="b"> <p><strong>&nbsp;</strong></p> </td> <td class="t b"> <p>Democratic respect</p> </td> <td class="t b"> <p>Anti-democratic behavior does not occur.</p> </td> </tr> </tbody> </table> </div> <p><strong>&nbsp;</strong></p> <p><strong>Example studies</strong></p> <p>Heinbach, D. &amp; Wilms, L. K. (2022): Der Einsatz von Moderation bei #meinfernsehen2021 [The deployment of moderation at #meinfernsehen2021]. In: F. Gerlach, C. Eilders &amp; K. Schmitz (Eds.): <em>#meinfernsehen2021. Partizipationsverfahren zur </em>Zukunft des öffentlich-rechtlichen Fernsehens. Baden-Baden: Nomos.</p> <p>Stromer Galley,&nbsp;J. (2007). Measuring Deliberation's Content: A Coding Scheme. <em>Journal of Public Deliberation</em>, <em>3</em>(1), Article 12.</p> <p>Zimmermann,&nbsp;T. (2017). <em>Digitale Diskussionen: Über politische Partizipation mittels Online-Leserkommentaren [Digital discussions: On political participation trough online reader comments]</em>. <em>Edition Politik: Bd. 44</em>. transcript Verlag. <a href="http://www.content-select.com/index.php?id=bib_view&amp;ean=9783839438886">http://www.content-select.com/index.php?id=bib_view&amp;ean=9783839438886</a></p> <p><strong><em>Further references</em></strong></p> <p>Bormann,&nbsp;M. (2022). Perceptions and Evaluations of Incivility in Public Online Discussions—Insights From Focus Groups With Different Online Actors. <em>Frontiers in Political Science</em>, <em>4</em>, Article 812145. <a href="https://doi.org/10.3389/fpos.2022.812145">https://doi.org/10.3389/fpos.2022.812145</a></p> <p>Engelke,&nbsp;K.&nbsp;M. (2019). Enriching the Conversation: Audience Perspectives on the Deliberative Nature and Potential of User Comments for News Media. <em>Digital Journalism</em>, <em>8</em>(4), 1–20. <a href="https://doi.org/10.1080/21670811.2019.1680567">https://doi.org/10.1080/21670811.2019.1680567</a></p> <p>Esau,&nbsp;K., Friess,&nbsp;D. &amp; Eilders,&nbsp;C. (2017). Design Matters! An Empirical Analysis of Online Deliberation on Different News Platforms. <em>Policy &amp; Internet</em>, <em>9</em>(3), 321–342. <a href="https://doi.org/10.1002/poi3.154">https://doi.org/10.1002/poi3.154</a></p> <p>Friess,&nbsp;D., Ziegele,&nbsp;M. &amp; Heinbach,&nbsp;D. (2021). Collective Civic Moderation for Deliberation? Exploring the Links between Citizens’ Organized Engagement in Comment Sections and the Deliberative Quality of Online Discussions. <em>Political Communication</em>, <em>38</em>(5), 624–646. <a href="https://doi.org/10.1080/10584609.2020.1830322">https://doi.org/10.1080/10584609.2020.1830322</a></p> <p>Graham,&nbsp;T. &amp; Witschge,&nbsp;T. (2003). In Search of Online Deliberation: Towards a New Method for Examining the Quality of Online Discussions. <em>Communications</em>, <em>28</em>(2). <a href="https://doi.org/10.1515/comm.2003.012">https://doi.org/10.1515/comm.2003.012</a></p> <p>Habermas,&nbsp;J. (2007). <em>Moral consciousness and communicative action</em> (Repr). Polity.</p> <p>Kenski,&nbsp;K., Coe,&nbsp;K. &amp; Rains,&nbsp;S.&nbsp;A. (2020). Perceptions of Uncivil Discourse Online: An Examination of Types and Predictors: An examination of types and predictors. <em>Communication Research</em>, <em>47</em>(6), 795–814. <a href="https://doi.org/10.1177/0093650217699933">https://doi.org/10.1177/0093650217699933</a></p> <p>Muddiman,&nbsp;A. (2017). Personal and Public Levels of Political Incivility. <em>International Journal of Communication</em>, <em>11</em>, 3182–3202.</p> <p>Papacharissi,&nbsp;Z. (2004). Democracy online: civility, politeness, and the democratic potential of online political discussion groups. <em>new media &amp; society</em>, <em>6</em>(2), 259–283. <a href="https://doi.org/10.1177/1461444804041444">https://doi.org/10.1177/1461444804041444</a></p> <p>Price,&nbsp;V. &amp; Cappella,&nbsp;J.&nbsp;N. (2002). Online deliberation and its influence: The Electronic Dialogue Project in Campaign 2000. <em>IT&amp;Society</em>, <em>1</em>(1), 303–329. <a href="https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.9.5945&amp;rep=rep1&amp;type=pdf">https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.9.5945&amp;rep=rep1&amp;type=pdf</a></p> <p>Rowe,&nbsp;I. (2015). Deliberation 2.0: Comparing the Deliberative Quality of Online News User Comments Across Platforms. <em>Journal of Broadcasting &amp; Electronic Media</em>, <em>59</em>(4), 539–555. <a href="https://doi.org/10.1080/08838151.2015.1093482">https://doi.org/10.1080/08838151.2015.1093482</a></p> <p>Steenbergen,&nbsp;M.&nbsp;R., Bächtiger,&nbsp;A., Spörndli,&nbsp;M., &amp; Steiner,&nbsp;J. (2003). Measuring Political Deliberation: A Discourse Quality Index. <em>Comparative European Politics</em>, <em>1</em>(1), 21–48. <a href="https://doi.org/10.1057/palgrave.cep.6110002">https://doi.org/10.1057/palgrave.cep.6110002</a></p> <p>Steiner,&nbsp;J. (2012). <em>The Foundations of Deliberative Democracy</em>. Cambridge University Press. <a href="https://doi.org/10.1017/CBO9781139057486">https://doi.org/10.1017/CBO9781139057486</a></p> <p>Stroud,&nbsp;N.&nbsp;J., Scacco,&nbsp;J.&nbsp;M., Muddiman,&nbsp;A., &amp; Curry,&nbsp;A.&nbsp;L. (2015). Changing Deliberative Norms on News Organizations' Facebook Sites. <em>Journal of Computer-Mediated Communication, 20</em>(2), 188–203. <a href="https://doi.org/10.1111/jcc4.12104">https://doi.org/10.1111/jcc4.12104</a></p> <p>Stryker,&nbsp;R., Conway,&nbsp;B.&nbsp;A. &amp; Danielson,&nbsp;J.&nbsp;T. (2016). What is political incivility? <em>Communication Monographs</em>, <em>83</em>(4), 535–556. <a href="https://doi.org/10.1080/03637751.2016.1201207">https://doi.org/10.1080/03637751.2016.1201207</a></p> <p>Ziegele,&nbsp;M. (2016). <em>Nutzerkommentare als Anschlusskommunikation: Theorie und qualitative Analyse des Diskussionswerts von Online-Nachrichten</em><em> [T</em><em>he Discussion Value of Online News. </em><em>An Analysis of User Comments on News Platforms]</em>. Springer VS.</p> <p>Ziegele,&nbsp;M., Naab,&nbsp;T.&nbsp;K. &amp; Jost,&nbsp;P. (2020). Lonely together? Identifying the determinants of collective corrective action against uncivil comments. <em>New Media &amp; Society</em>, <em>22</em>(5), 731-751. <a href="https://doi.org/10.1177/1461444819870130">https://doi.org/10.1177/1461444819870130</a></p> <p>Ziegele,&nbsp;M., Quiring,&nbsp;O., Esau,&nbsp;K. &amp; Friess,&nbsp;D. (2020). Linking News Value Theory With Online Deliberation: How News Factors and Illustration Factors in News Articles Affect the Deliberative Quality of User Discussions in SNS’ Comment Sections. <em>Communication Research</em>, <em>47</em>(6), 860-890. <a href="https://doi.org/10.1177/0093650218797884">https://doi.org/10.1177/0093650218797884</a></p> 2022-11-29T00:00:00+01:00 Copyright (c) 2022 DOCA - Database of Variables for Content Analysis https://www.hope.uzh.ch/doca/article/view/4005 Interactivity/Reciprocity (Online Discussions/Discussion Quality) 2022-11-29T20:08:23+01:00 Dominique Heinbach dominique.heinbach@hhu.de <p>Interactivity (or reciprocity) is a key dimension to assess the deliberative quality of online discussions. In quantitative content analyses, this dimension measures if participants engage in dialog with each other and refer to each other.</p> <p><strong>Field of application/Theoretical foundation</strong></p> <p>Most studies on online discussions draw on deliberative norms to measure the quality of their discourse (e.g., Esau et al., 2017; Friess et al., 2021; Rowe, 2015; Ziegele et al., 2020; Zimmermann, 2017). Deliberation is an important concept for the study of (political) online discussions (Ziegele et al., 2020). It focuses on a free and equal exchange of arguments to bridge social differences and legitimize political decisions (Dryzek et al., 2019; Fishkin, 1991, Habermas, 2015). Interactivity is a key dimension of deliberative quality, since deliberation is always a reciprocal and dialogical process (Goodin, 2000; Zimmermann, 2017). Participants engage in a dialogic exchange with each other, reflecting on other views and perspectives, and referring to each other (Friess et al., 2021; Ziegele et al., 2020). This reciprocal process includes both responding and listening (Barber, 1984; Graham, 2009). Interactivity is considered essential for desirable effects of deliberation such as learning, tolerance building and opinion change (Estlund &amp; Landmore, 2018; Friess et al., 2021).</p> <p> </p> <p><strong>References/Combination with other methods</strong></p> <p>Besides quantitative content analyses, the (deliberative) quality of online discussions is examined with qualitative content analyses and discourse analyses (e.g., Graham &amp; Witschge, 2003; Price &amp; Capella, 2002). Furthermore, participants’ perceptions of the quality of online discussions are investigated with qualitative interviews (e.g., Engelke, 2019; Ziegele, 2016) or a combination of qualitative interviews and content analy­sis (Díaz Noci et al., 2012).</p> <p><em>Cross-references</em></p> <p>Interactivity is one of five dimensions of deliberative quality in this database written by the same author. Accordingly, there are overlaps with the entries on <a href="https://doi.org/10.34778/5x">inclusivity</a>, <a href="https://doi.org/10.34778/5t">rationality</a>, <a href="https://doi.org/10.34778/5v">explicit civility</a>, and <a href="https://doi.org/10.34778/5w">storytelling</a> regarding theoretical background, references/combinations with other methods, and some example studies.</p> <p> </p> <p><strong>Information on Esau et al. (2017)</strong></p> <p><strong>Authors: </strong>Katharina Esau, Dennis Friess, &amp; Christiane Eilders</p> <p><strong>Research question: “</strong>How does platform design affect the level of deliberative quality?” (p. 323)</p> <p><strong>Object of analysis: “</strong>We conducted a quantitative content analysis of user comments left in a news forum, on news websites, and on Facebook news pages concerning the same journalistic content on two topics […] A sample of news articles […] with related user comments, was drawn from the online platforms of four German news media […] The first step of the sampling process consisted of 18 news articles from which 3,341 comments were collected […] In the second step for each article, up to 100 sequential comments were randomly selected for content analysis, leading to a total sample of 1,801 comments (979 on Facebook, 591 on news websites, and 231 in the news forum)” (p. 331).</p> <p><strong>Time frame of analysis: </strong>December 2015</p> <p><strong><em>Info about variables</em></strong></p> <p><strong>Level of analysis: </strong>individual comment</p> <p><strong>Variables and reliability:</strong> see Table 1</p> <p><em>Table 1: Variables and Reliability (Esau et al., 2017, pp. 332-333):</em></p> <div style="overflow-x: auto;"> <table> <tbody> <tr> <td class="t b"> <p>Dimension</p> </td> <td class="t b"> <p>Measure</p> </td> <td class="t b"> <p>Definition</p> </td> <td class="t b"> <p>RCA</p> </td> <td class="t b"> <p>Cohen’s Kappa</p> </td> </tr> <tr> <td width="99"> <p>Reciprocity</p> </td> <td class="t b"> <p>General engagement</p> </td> <td class="t b"> <p>This measure captures whether a comment addresses another comment.</p> </td> <td class="t b"> <p>.92</p> </td> <td class="t b"> <p>-</p> </td> </tr> <tr> <td width="99"> <p><strong> </strong></p> </td> <td class="t b"> <p>Argumentative engagement</p> </td> <td class="t b"> <p>This measure captures whether a comment addresses a specific argument made in another comment.</p> </td> <td class="t b"> <p>.77</p> </td> <td class="t b"> <p>.542</p> </td> </tr> <tr> <td class="b"> <p><strong> </strong></p> </td> <td class="t b"> <p>Critical engagement</p> </td> <td class="t b"> <p>This measure captures whether a comment is critical of another comment.</p> </td> <td class="t b"> <p>.89</p> </td> <td class="t b"> <p>-</p> </td> </tr> <tr> <td class="t b"> <p> </p> </td> <td class="t b"> <p> </p> </td> <td class="t b"> <p> </p> </td> <td class="t b"> </td> <td>n = 40; 12 coders</td> </tr> </tbody> </table> </div> <p><strong>Values</strong>: Dichotomous measures (yes, no) </p> <p> </p> <p><strong>Information on Heinbach &amp; Wilms (2022)</strong></p> <p><strong>Authors: </strong>Dominique Heinbach &amp; Lena K. Wilms (Codebook by Dominique Heinbach, Marc Ziegele, &amp; Lena K. Wilms)</p> <p><strong>Research question: </strong>Which attributes differentiate moderated from unmoderated comments?</p> <p><strong>Object of analysis: </strong>The quantitative content analysis was based on a stratified random sample of moderated and not moderated comments (N = 1.682) from the German online participation platform “#meinfernsehen202” [#myTV2021], a citizen participation platform to discuss the future of public broadcasting in Germany.</p> <p><strong>Time frame of analysis: </strong>November 24, 2020 to March 3, 2021</p> <p><strong><em>Info about variables</em></strong></p> <p><strong>Level of analysis: </strong>User comment</p> <p><strong>Variables and reliability:</strong> see Table 2</p> <p><em>Table 2: Variables and reliability (Heinbach &amp; Wilms, 2022)</em></p> <div style="overflow-x: auto;"> <table> <tbody> <tr> <td class="t b"> <p>Dimension</p> </td> <td class="t b"> <p>Measure</p> </td> <td class="t b"> <p>Definition</p> </td> <td class="t b"> <p>Krippendorff’s α</p> </td> </tr> <tr> <td width="104"> <p>Reciprocity</p> </td> <td class="t b"> <p>Reference to other users or to the community</p> </td> <td class="t b"> <p>Does the comment refer to at least one other user, a group of users, or all users in the community?</p> </td> <td class="t b"> <p>.78</p> </td> </tr> <tr> <td width="104"> <p><strong> </strong></p> </td> <td class="t b"> <p>Reference to the content of other comments</p> </td> <td width="255"> <p>Does the comment refer to content, arguments or positions in other comments?</p> </td> <td class="t b"> <p>.78</p> </td> </tr> <tr> <td width="104"> <p><strong> </strong></p> </td> <td width="132"> <p>Critical reference</p> </td> <td class="t b"> <p>Does the comment refer to other comments in a critical manner?</p> </td> <td class="t b"> <p>.86</p> </td> </tr> <tr> <td class="t b"> <p> </p> </td> <td class="t b"> <p><strong> </strong></p> </td> <td class="t b"> <p> </p> </td> <td class="t b"> <p>n = 159, 3 coders</p> </td> </tr> </tbody> </table> </div> <p><strong> </strong></p> <p><strong>Values: </strong>All variables were coded on a four-point scale (1 = clearly not present; 2 = rather not present; 3 = rather present; 4 = clearly present). Detailed explanations and examples for each value are provided in the Codebook (in German).</p> <p><strong>Codebook:</strong> in the appendix of this entry (in German)</p> <p> </p> <p><strong>Information on Stromer-Galley (2007)</strong></p> <p><strong>Author: </strong>Jennifer Stromer-Galley</p> <p><strong>Research question: </strong>The aim of the paper was developing a coding scheme for academics and practitioners of deliberation to systematically measure what happens during group deliberations (p. 1; p. 7).</p> <p><strong>Object of analysis: </strong>The author conducted a secondary analysis of online group discussions (23 groups with 5-12 participants) in an experiment called “The Virtual Agora Project” at Carnegie Mellon Unversitiy in Pittsburgh, Pennsylvania. Participants attended the discussions from dormitory rooms that were equipped with a computer, headphones, and microphone. The group discussions were recorded and transcribed for analysis (pp. 7-8). Although strictly speaking the study does not analyze media content, the coding scheme has provided the basis for numerous other studies on the deliberative quality of online discussions (e.g., Rowe, 2015; Stroud et al., 2015; Ziegele et al., 2020).</p> <p><strong>Time frame of analysis: </strong>Three weeks in July 2004 (p. 7).</p> <p><strong><em>Info about variables</em></strong></p> <p><strong>Level of analysis: </strong><em>Level of the turn</em>: Speaking contribution of a participant. Participants had to get “in line” to speak. When a speaker had finished their turn, the software activated the next speaker (max. 3 minutes per turn) (p. 8). <em>Level of the thought</em>: Coders segmented each turn into thought units before coding the categories. “A thought is defined as an utterance (from a single sentence to multiple sentences) that expresses an idea on a topic. A change in topic signaled a change in thought. A second indicator of a change in thought was a change in the type of talk. The distinct types of talk that this coding captured were the following: talk about the problem of public schools, talk about the process of the talk, talk about the process of the deliberation, and social talk” (p. 9).</p> <p><strong>Variables an values:</strong> see Table 3</p> <p><strong>Reliability: </strong>“Two coders spent nearly two months developing and training with the coding scheme. The intercoder agreement measures […] were established from coding 3 of the 23 groups, which were randomly selected. […] Cohen’s Kappas of the coding elements described above are as follows: thought statements on the problem of public schools, .95; […] turn type (new topic, continuing self, responding to others) .97; meta-talk, 1.0 […]” (p. 13-14).</p> <p><strong>Codebook</strong>: in the appendix (pp. 22-33)</p> <p><em>Table 3: Variables and values of the dimension “engagement” (Stromer-Galley, 2007, p.12; pp. 24-26). </em></p> <div style="overflow-x: auto;"> <table> <tbody> <tr> <td class="t b"> <p>Category</p> </td> <td class="t b"> <p>Level</p> </td> <td class="t b"> <p>Description</p> </td> <td class="t b"> <p>Value</p> </td> <td class="t b"> <p>Definition</p> </td> </tr> <tr> <td width="77"> <p>Turn-type</p> </td> <td width="74"> <p>Turn</p> </td> <td width="151"> <p>Identify whether and to whom this turn is referring.</p> </td> <td class="t b"> <p>Starting a new topic</p> </td> <td class="t b"> <p>A new topic (not prompted by the moderator).</p> </td> </tr> <tr> <td width="77"> <p><strong> </strong></p> </td> <td width="74"> <p> </p> </td> <td width="151"> <p> </p> </td> <td class="t b"> <p>Respond on topic</p> </td> <td class="t b"> <p>A turn that is in response to a prior speaker or is on a topic that has been discussed. Includes responding to multiple speakers.</p> </td> </tr> <tr> <td width="77"> <p><strong> </strong></p> </td> <td width="74"> <p> </p> </td> <td width="151"> <p> </p> </td> <td class="t b"> <p>Respond to moderator</p> </td> <td class="t b"> <p>A turn that is a response to a prompt or question from the moderator.</p> </td> </tr> <tr> <td width="77"> <p><strong> </strong></p> </td> <td width="74"> <p> </p> </td> <td width="151"> <p> </p> </td> <td class="t b"> <p>Continue self</p> </td> <td class="t b"> <p>A turn that seems not to respond to anything a prior speaker said but to continue the current speaker’s ideas from one of his or her prior turns.</p> </td> </tr> <tr> <td class="t b"> <p>Problem</p> </td> <td class="t b"> <p>Thought</p> </td> <td class="t b"> <p>Talk about the problem is talk that focuses on the issue under consideration.</p> </td> <td class="t b"> <p>Question</p> </td> <td class="t b"> <p>A genuine question directed to another speaker that is trying to seek information or an opinion from others.</p> </td> </tr> <tr> <td width="77"> <p>Metatalk</p> <p><strong> </strong></p> </td> <td width="74"> <p>Thought</p> </td> <td width="151"> <p>Metatalk is talk about the talk. It attempts to step back and assess what has transpired or is transpiring in the interaction.</p> </td> <td width="102"> <p>Consensus</p> </td> <td width="209"> <p>Consensus metatalk is talk about the speaker’s sense of consensus of the group (“I think we all agree that . . . .”), including an explanation for the collective’s opinions or the collective’s behavior (We’re asking you these questions because . .).</p> </td> </tr> <tr> <td width="77"> <p><strong> </strong></p> </td> <td width="74"> <p> </p> </td> <td width="151"> <p> </p> </td> <td class="t b"> <p>Conflict</p> </td> <td class="t b"> <p>Highlighting some disagreement or conflict in the group (“I sense some disagreement around . . . .”).</p> </td> </tr> <tr> <td width="77"> <p><strong> </strong></p> </td> <td width="74"> <p> </p> </td> <td width="151"> <p> </p> </td> <td class="t b"> <p>Clarify own</p> </td> <td class="t b"> <p>Clarify the speaker’s own opinion or fact statement (“what I’m trying to say is”). It’s an attempt to clarify what the speaker means. This will arise ONLY after they’ve provided an opinion, NOT a question, and are now trying to clarify their original opinion on the problem, likely because they believe someone has misunderstood them.</p> </td> </tr> <tr> <td class="b"> <p><strong> </strong></p> </td> <td class="b"> <p> </p> </td> <td class="b"> <p> </p> </td> <td class="t b"> <p>Clarify other</p> </td> <td class="t b"> <p>Clarify someone else’s argument/opinion or fact statement (“Sally, so, what you’re saying is . . . “). It is an attempt to clarify what someone else <em>means</em>. Pay attention to the use of another participants’ name. That can be a sign of metatalk of another’s position.</p> </td> </tr> </tbody> </table> </div> <p><strong> </strong></p> <p><strong>Example studies</strong></p> <p>Esau, K., Fleuß, D. &amp; Nienhaus, S.‑M. (2021). Different Arenas, Different Deliberative Quality? Using a Systemic Framework to Evaluate Online Deliberation on Immigration Policy in Germany. <em>Policy &amp; Internet</em>, <em>13</em>(1), 86–112. <a href="https://doi.org/10.1002/poi3.232">https://doi.org/10.1002/poi3.232</a></p> <p>Esau, K., Friess, D. &amp; Eilders, C. (2017). Design Matters! An Empirical Analysis of Online Deliberation on Different News Platforms. <em>Policy &amp; Internet</em>, <em>9</em>(3), 321–342. <a href="https://doi.org/10.1002/poi3.154">https://doi.org/10.1002/poi3.154</a></p> <p>Esau, K., Frieß, D. &amp; Eilders, C. (2019). Online-Partizipation jenseits klassischer Deliberation: Eine Analyse zum Verhältnis unterschiedlicher Deliberationskonzepte in Nutzerkommentaren auf Facebook-Nachrichtenseiten und Beteiligungsplattformen. In I. Engelmann, M. Legrand &amp; H. Marzinkowski (Hrsg.), <em>Digital Communication Research: Bd. 6. Politische Partizipation im Medienwandel </em>(S. 221–245).</p> <p>Friess, D., Ziegele, M. &amp; Heinbach, D. (2021). Collective Civic Moderation for Deliberation? Exploring the Links between Citizens’ Organized Engagement in Comment Sections and the Deliberative Quality of Online Discussions. <em>Political Communication</em>, <em>38</em>(5), 624–646. <a href="https://doi.org/10.1080/10584609.2020.1830322">https://doi.org/10.1080/10584609.2020.1830322</a></p> <p>Heinbach, D. &amp; Wilms, L. K. (2022): Der Einsatz von Moderation bei #meinfernsehen2021 [The deployment of moderation at #meinfernsehen2021]. In: F. Gerlach, C. Eilders &amp; K. Schmitz (Eds.): <em>#meinfernsehen2021. Partizipationsverfahren zur </em>Zukunft des öffentlich-rechtlichen Fernsehens. Baden-Baden: Nomos.</p> <p>Rowe, I. (2015). Deliberation 2.0: Comparing the Deliberative Quality of Online News User Comments Across Platforms. <em>Journal of Broadcasting &amp; Electronic Media</em>, <em>59</em>(4), 539–555. <a href="https://doi.org/10.1080/08838151.2015.1093482">https://doi.org/10.1080/08838151.2015.1093482</a></p> <p>Stromer Galley, J. (2007). Measuring Deliberation's Content: A Coding Scheme. <em>Journal of Public Deliberation</em>, <em>3</em>(1), Article 12.</p> <p>Ziegele, M., Quiring, O., Esau, K. &amp; Friess, D. (2020). Linking News Value Theory With Online Deliberation: How News Factors and Illustration Factors in News Articles Affect the Deliberative Quality of User Discussions in SNS’ Comment Sections. <em>Communication Research</em>, <em>47</em>(6), 860-890. <a href="https://doi.org/10.1177/0093650218797884">https://doi.org/10.1177/0093650218797884</a></p> <p>Zimmermann, T. (2017). <em>Digitale Diskussionen: Über politische Partizipation mittels Online-Leserkommentaren</em>. <em>Edition Politik: Bd. 44</em>. transcript Verlag. <a href="http://www.content-select.com/index.php?id=bib_view&amp;ean=9783839438886">http://www.content-select.com/index.php?id=bib_view&amp;ean=9783839438886</a></p> <p><strong><em>Further references</em></strong></p> <p>Barber, B. R. (1984). <em>Strong democracy: Participatory politics for a new age</em>. University of California Press.</p> <p>Díaz Noci, J., Domingo, D., Masip, P., Micó, J. L. &amp; Ruiz, C. (2012). Comments in news, democracy booster or journalistic night­mare: Assessing the quality and dynamics of citizen debates in Catalan online new­spapers. #ISOJ, 2(1), 46–64. <a href="https://isoj.org/%20wp-content/uploads/2016/10/ISOJ_Jour­nal_V2_N1_2012_Spring.pdf#page=46">https://isoj.org/ wp-content/uploads/2016/10/ISOJ_Jour­nal_V2_N1_2012_Spring.pdf#page=46</a></p> <p>Dryzek, J. S., Bächtiger, A., Chambers, S., Cohen, J., Druckman, J. N., Felicetti, A., Fishkin, J. S., Farrell, D. M., Fung, A., Gutmann, A., Landemore, H., Mansbridge, J., Marien, S., Neblo, M. A., Niemeyer, S., Setälä, M., Slothuus, R., Suiter, J., Thompson, D. &amp; Warren, M. E. (2019). The crisis of democracy and the science of deliberation. <em>Science (New York, N.Y.)</em>, <em>363</em>(6432), 1144–1146. <a href="https://doi.org/10.1126/science.aaw2694">https://doi.org/10.1126/science.aaw2694</a></p> <p>Engelke, K. M. (2019). Enriching the Conversation: Audience Perspectives on the Deliberative Nature and Potential of User Comments for News Media. <em>Digital Journalism</em>, <em>8</em>(4), 1–20. <a href="https://doi.org/10.1080/21670811.2019.1680567">https://doi.org/10.1080/21670811.2019.1680567</a></p> <p>Estlund, D. &amp; Landemore, H. (2018). The epistemic value of democratic deliberation. In A. Bächtiger, J. S. Dryzek, J. J. Mansbridge &amp; M. E. Warren (Hrsg.), <em>Oxford handbooks online. The Oxford handbook of deliberative democracy: An introduction </em>(S. 113–131). Oxford University Press.</p> <p>Fishkin, J. S. (1991). <em>Democracy and deliberation: New directions for democratic reform</em>. Yale University Press. <a href="http://www.jstor.org/stable/10.2307/j.ctt1dt006v%20https://doi.org/10.2307/j.ctt1dt006v">http://www.jstor.org/stable/10.2307/j.ctt1dt006v https://doi.org/10.2307/j.ctt1dt006v</a></p> <p>Goodin, R. E. (2000). Democratic Deliberation Within. <em>Philosophy &amp; Public Affairs</em>, <em>29</em>(1), 81–109. <a href="https://doi.org/10.1111/j.1088-4963.2000.00081.x">https://doi.org/10.1111/j.1088-4963.2000.00081.x</a></p> <p>Graham, T. (2009). <em>What's Wife Swap got to do with it? Talking politics in the net-based public sphere</em> Amsterdam: University of Amsterdam DOI: 10.13140/RG.2.1.3413.0088</p> <p>Graham, T. &amp; Witschge, T. (2003). In Search of Online Deliberation: Towards a New Method for Examining the Quality of Online Discussions. <em>Communications</em>, <em>28</em>(2). <a href="https://doi.org/10.1515/comm.2003.012">https://doi.org/10.1515/comm.2003.012</a></p> <p>Habermas, J. (2015). <em>Between facts and norms: Contributions to a discourse theory of law and democracy</em> (Reprinted.). Polity Press.</p> <p>Price, V. &amp; Cappella, J. N. (2002). Online deliberation and its influence: The Electronic Dialogue Project in Campaign 2000. <em>IT&amp;Society</em>, <em>1</em>(1), 303–329. <a href="https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.9.5945&amp;rep=rep1&amp;type=pdf">https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.9.5945&amp;rep=rep1&amp;type=pdf</a></p> <p>Stroud, N. J., Scacco, J. M., Muddiman, A., &amp; Curry, A. L. (2015). Changing Deliberative Norms on News Organizations' Facebook Sites. <em>Journal of Computer-Mediated Communication, 20</em>(2), 188–203. <a href="https://doi.org/10.1111/jcc4.12104">https://doi.org/10.1111/jcc4.12104</a></p> <p>Ziegele, M. (2016). <em>Nutzerkommentare als Anschlusskommunikation: Theorie und qualitative Analyse des Diskussionswerts von Online-Nachrichten</em><em> [T</em><em>he Discussion Value of Online News. </em><em>An Analysis of User Comments on News Platforms]</em>. Springer VS.</p> 2022-11-29T00:00:00+01:00 Copyright (c) 2022 DOCA - Database of Variables for Content Analysis https://www.hope.uzh.ch/doca/article/view/4004 Rationality (Online Discussions/Discussion Quality) 2022-11-29T18:03:59+01:00 Dominique Heinbach dominique.heinbach@hhu.de <p>Rationality is considered the most important dimension to assess the deliberative quality of online discussions. In quantitative content analyses, it is usually measured with a set of variables, including (among others) reasoning, justification, fact claims, evidence, additional knowledge, and topic relevance.</p> <p> </p> <p><strong>Field of application/Theoretical foundation</strong></p> <p>Most studies on online discussions draw on deliberative theories to measure the quality of their discourse (e.g., Esau et al., 2017; Friess et al., 2021; Rowe, 2015; Ziegele et al., 2020; Zimmermann, 2017). Deliberation is an important concept for the study of (political) online discussions (Ziegele et al., 2020). It focuses on a free and equal exchange of arguments to bridge social differences and legitimize political decisions (Dryzek et al., 2019; Fishkin, 1991, Habermas, 2015). Rationality is considered the most important dimension of deliberative quality, which is inherent in most conceptualizations (Frieß &amp; Eilders, 2015). Rationality is primarily about reasoning, justifications, and facts (Engelke, 2019). Discussion participants should provide justifications and evidence to support their positions (Friess et al., 2021). These reasons and arguments must be both criticizable and verifiable or falsifiable (Esterling, 2011; Habermas, 1995). Counterarguments and different perspectives should also be included (Engelke, 2019; Ziegele et al., 2020). This allows the elaboration of the best arguments in the deliberation process and an informed opinion formation based on these arguments (“the unforced force of the better argument”, Habermas, 2015). A rational discourse and a constructive discussion atmosphere are also considered necessary for reaching a rationally motivated consensus, a central aim of formal deliberation (Cohen, 1989; Friess &amp; Eilders, 2015; Stromer-Galley, 2007).</p> <p> </p> <p><strong>References/Combination with other methods</strong></p> <p>Besides quantitative content analyses, the (deliberative) quality of online discussions is examined with qualitative content analyses and discourse analyses (e.g., Graham &amp; Witschge, 2003; Price &amp; Capella, 2002). Furthermore, participants’ perceptions of the quality of online discussions are investigated with qualitative interviews (e.g., Engelke, 2019; Ziegele, 2016) or a combination of qualitative interviews and content analysis (Díaz Noci et al., 2012).</p> <p> </p> <p><em>Cross-references</em></p> <p>Rationality is one of five dimensions of deliberative quality in this database written by the same author. Accordingly, there are overlaps with the entries on <a href="https://doi.org/10.34778/5u">interactivity</a>, <a href="https://doi.org/10.34778/5x">inclusivity</a>, <a href="https://doi.org/10.34778/5v">explicit civility</a>, and <a href="https://doi.org/10.34778/5w">storytelling</a> regarding theoretical background, references/combinations with other methods, and some example studies.</p> <p> </p> <p><strong>Information on Heinbach &amp; Wilms (2022)</strong></p> <p><strong>Authors: </strong>Dominique Heinbach &amp; Lena K. Wilms (Codebook by Dominique Heinbach, Marc Ziegele, &amp; Lena K. Wilms)</p> <p><strong>Research question: </strong>Which attributes differentiate moderated from unmoderated comments?</p> <p><strong>Object of analysis: </strong>The quantitative content analysis was based on a stratified random sample of moderated and unmoderated comments (N = 1.682) from the German online participation platform “#meinfernsehen202” [#myTV2021], a citizen participation platform to discuss the future of public broadcasting in Germany.</p> <p><strong>Time frame of analysis: </strong>November 24, 2020 to March 3, 2021</p> <p><strong><em>Info about variables</em></strong></p> <p><strong>Level of analysis: </strong>User comment</p> <p><strong>Variables and reliability:</strong> see Table 1</p> <p><em>Table 1: Variables and reliability (Heinbach &amp; Wilms, 2022)</em></p> <div style="overflow-x: auto;"> <table> <tbody> <tr> <td class="t b"> <p>Dimension</p> </td> <td class="t b"> <p>Measure</p> </td> <td class="t b"> <p>Definition</p> </td> <td class="t b"> <p>Krippendorff’s α (ordinal)</p> </td> </tr> <tr> <td class="t"> <p>Rationality</p> </td> <td class="t b"> <p>Topic relevance</p> </td> <td class="t b"> <p>Does the comment refer to the topic of the post?</p> </td> <td class="t b"> <p>.70</p> </td> </tr> <tr> <td width="104"> <p><strong> </strong></p> </td> <td class="t b"> <p>Fact claims</p> </td> <td class="t b"> <p>Does the comment contain at least one objectively falsifiable statement with a claim to truth?</p> </td> <td class="t b"> <p>.78</p> </td> </tr> <tr> <td width="104"> <p><strong> </strong></p> </td> <td class="t b"> <p>Reasoning</p> <p> </p> </td> <td class="t b"> <p>Does the comment contain at least one justification to support a statement (e.g., an assertion, opinion, or claim)?</p> </td> <td class="t b"> <p>.73</p> </td> </tr> <tr> <td width="104"> <p><strong> </strong></p> </td> <td class="t b"> <p>Solution proposal</p> </td> <td class="t b"> <p>Does the comment contain at least one suggestion on how to resolve problems or issues?</p> </td> <td class="t b"> <p>.75</p> </td> </tr> <tr> <td width="104"> <p><strong> </strong></p> </td> <td class="t b"> <p>Additional knowledge</p> </td> <td class="t b"> <p>Does the comment contain additional information that is of a knowledge nature of and adds content-related value?</p> </td> <td class="t b"> <p>.72</p> </td> </tr> <tr> <td class="b"> <p><strong> </strong></p> </td> <td class="t b"> <p>Genuine questions</p> </td> <td class="t b"> <p>Does the comment contain at least one question with a genuine need for</p> <p>information, e.g. questions of knowledge, understanding, justification or opinion?</p> </td> <td class="t b"> <p>.75</p> </td> </tr> <tr> <td class="t b"> <p> </p> </td> <td class="t b"> <p><strong> </strong></p> </td> <td class="t b"> <p> </p> </td> <td class="t b"> <p>n = 159, 3 coders</p> </td> </tr> </tbody> </table> </div> <p><strong>Values: </strong>All variables were coded on a four-point scale (1 = clearly not present; 2 = rather not present; 3 = rather present; 4 = clearly present). Detailed explanations and examples for each value are provided in the Codebook (in German).</p> <p><strong>Codebook:</strong> in the appendix of this entry (in German)</p> <p> </p> <p><strong>Information on Zimmermann (2017)</strong></p> <p><strong>Author: </strong>Tobias Zimmermann</p> <p><strong>Research question: </strong>Which role do online reader comments play for a deliberative-democratic understanding of a digital public sphere? (p. 11)</p> <p><strong>Object of analysis: </strong>To compare discursive participation online and offline, the author conducted a full-sample content analysis of online reader comments (N = 1.176) and letters to the editor (N = 381) from German local newspapers on three similar conflicts in local politics concerning the renaming of streets and squares. Because the coding scheme was based on the discourse quality index (DQI), only contributions that contained a demand were included in the analysis, that is, “a proposal on what decision should or should not be made” Steenbergen et al., 2003, p. 27). Only then, a speech act is considered relevant from a discourse ethics perspective.</p> <p><strong>Time frame of analysis: </strong>June 2012 to May 2013</p> <p><strong><em>Info about variables</em></strong></p> <p><strong>Variables: </strong>Based on the DQI (Steenbergen et al., 2003) the author operationalizes the <em>level of justification</em> as an indicator for rationality. This variable distinguishes four levels of justification (p. 164). Besides the ordinal variable “Level of justification”, the author also uses a dichotomous measurement to distinguish between substantiated and unsubstantiated claims.</p> <p><strong>Level of analysis:</strong> Individual contribution</p> <p><strong>Values:</strong> see Table 2</p> <p><em>Table 2: Variables and Values (pp. 163-166; p. 188)</em></p> <table> <tbody> <tr> <td class="t b"> <p>Variable</p> </td> <td class="t b"> <p>Value</p> </td> <td class="t b"> <p>Definition</p> </td> </tr> <tr> <td rowspan="4" width="113"> <p>Level of Justification</p> </td> <td class="t b"> <p>No justification</p> </td> <td class="t b"> <p>The author makes a demand without justifying it argumentatively. The demand stands for itself.</p> </td> </tr> <tr> <td class="t b"> <p>Indirect justification</p> </td> <td class="t b"> <p>The author introduces an argument but its connection to the demand is incomplete, or its justification is not falsifiable.</p> </td> </tr> <tr> <td class="t b"> <p>Qualified justification</p> </td> <td class="t b"> <p>An argument substantiates a demand. A (falsifiable) link is made as to why one should expect that X contributes to or detracts from Y.</p> </td> </tr> <tr> <td class="t b"> <p>Detailed justification</p> </td> <td class="t b"> <p>At least two complete justifications are given, either two complete justifications for the same demand or complete justifications for two different demands (broad justification). Or one justification explains the represented position in depth from several points of view (deep justification).</p> </td> </tr> <tr> <td class="b" rowspan="2" width="113"> <p>Justification</p> </td> <td class="t b"> <p>No justification</p> </td> <td class="t b"> <p>A user makes a demand that X should (not) be done or happen without giving a justification.</p> </td> </tr> <tr> <td class="t b"> <p>Justification</p> </td> <td class="t b"> <p>A user substantiates a demand why X should (not) be done or happen.</p> </td> </tr> </tbody> </table> <p><strong>Reliability: </strong>Intracoder reliability was tested on a subset of 100 comments. The ordinal variable “level of justification” exceeded a Krippendorff’s Alpha above .73. The dichotomous variable “justification” reached a Krippendorff’s Alpha of .75 (p. 200-201).</p> <p><strong>Codebook: </strong>pp. 159-185 (in German)</p> <p> </p> <p><strong>Information on Ziegele et al. </strong><strong>(2020)</strong></p> <p><strong>Authors: </strong>Marc Ziegele, Oliver Quiring, Katharina Esau, &amp; Dennis Friess</p> <p><strong>Research questions:</strong> RQ1: “Which news factors predict the <em>civility</em> and <em>rationality</em> of reactive user comments?” (p. 869) RQ3: “Which illustration factors predict <em>civil</em> and <em>rational</em> reactive user comments?” (p. 871)</p> <p><strong>Object of analysis: </strong>The quantitative content analysis was based on a sample of top-level comments (i.e., comments responding to the article) from the Facebook pages of nine established German news media outlets (N = 11.218). Three artificial weeks were constructed for the sampling of news articles and user comments. On each access day, three or four news articles and the corresponding user comments were randomly selected from each news page. Then, for each article, the oldest five top-level comments, the most recent five top-level comments, five random top-level comments from the middle of the discussion, and the five most popular comments were selected (20 comments per article) (pp. 872-873).</p> <p><strong>Time frame of analysis: </strong>May 2015 to August 2015</p> <p><strong><em>Info about variables</em></strong></p> <p><strong>Level of analysis: </strong>User comment</p> <p><strong>Variables and reliability:</strong> see Table 3</p> <p><em>Table 3: Variables and reliability (p. 874)</em></p> <div style="overflow-x: auto;"> <table> <tbody> <tr> <td class="t b"> <p>Dimension</p> </td> <td class="t b"> <p>Measure</p> </td> <td class="t b"> <p>Definition</p> </td> <td class="t b"> <p>Krippendorff’s α</p> </td> </tr> <tr> <td width="104"> <p>Rationality</p> </td> <td class="t b"> <p>Topic relevance</p> </td> <td class="t b"> <p>Is the comment on-topic?</p> </td> <td class="t b"> <p>.67</p> </td> </tr> <tr> <td width="104"> <p><strong> </strong></p> </td> <td class="t b"> <p>Balance</p> </td> <td class="t b"> <p>Does the comment include a balanced view on the commented issue?</p> </td> <td class="t b"> <p>.74</p> </td> </tr> <tr> <td width="104"> <p><strong> </strong></p> </td> <td class="t b"> <p>Additional knowledge</p> </td> <td class="t b"> <p>Does the comment contain additional knowledge?</p> </td> <td class="t b"> <p>.79</p> </td> </tr> <tr> <td width="104"> <p><strong> </strong></p> </td> <td class="t b"> <p>Elaboration</p> </td> <td class="t b"> <p>Does the comment appear elaborate to the coders?</p> </td> <td class="t b"> <p>.81</p> </td> </tr> <tr> <td width="104"> <p><strong> </strong></p> </td> <td class="t b"> <p>Arguments</p> </td> <td class="t b"> <p>Does the comment provide reasons for its claims?</p> </td> <td class="t b"> <p>.74</p> </td> </tr> <tr> <td width="104"> <p><strong> </strong></p> </td> <td class="t b"> <p>Analytical</p> </td> <td class="t b"> <p>Does the comment analyze the background of the issue at hand?</p> </td> <td class="t b"> <p>.70</p> </td> </tr> <tr> <td width="104"> <p><strong> </strong></p> </td> <td class="t b"> <p>Factual claims</p> </td> <td class="t b"> <p>Does the comment provide facts and factual claims?</p> </td> <td class="t b"> <p>.72</p> </td> </tr> <tr> <td class="b"> <p><strong> </strong></p> </td> <td class="t b"> <p>Questions</p> </td> <td class="t b"> <p>Does the comment include genuine questions?</p> </td> <td class="t b"> <p>.80</p> </td> </tr> <tr> <td class="t b"> <p> </p> </td> <td class="t b"> <p><strong> </strong></p> </td> <td class="t b"> <p> </p> </td> <td class="t b"> <p>n = 100, 9 coders</p> </td> </tr> </tbody> </table> </div> <p><strong>Values:</strong> “Each factor was coded on 3-point scales (0 = <em>absent</em>, 1 = <em>sporadically</em> <em>present</em>, 2 = <em>highly present</em>)” (p. 874).</p> <p> </p> <p><strong>Example studies</strong></p> <p>Esau, K., Fleuß, D. &amp; Nienhaus, S.‑M. (2021). Different Arenas, Different Deliberative Quality? Using a Systemic Framework to Evaluate Online Deliberation on Immigration Policy in Germany. <em>Policy &amp; Internet</em>, <em>13</em>(1), 86–112. <a href="https://doi.org/10.1002/poi3.232">https://doi.org/10.1002/poi3.232</a></p> <p>Esau, K., Friess, D. &amp; Eilders, C. (2017). Design Matters! An Empirical Analysis of Online Deliberation on Different News Platforms. <em>Policy &amp; Internet</em>, <em>9</em>(3), 321–342. <a href="https://doi.org/10.1002/poi3.154">https://doi.org/10.1002/poi3.154</a></p> <p>Friess, D., Ziegele, M. &amp; Heinbach, D. (2021). Collective Civic Moderation for Deliberation? Exploring the Links between Citizens’ Organized Engagement in Comment Sections and the Deliberative Quality of Online Discussions. <em>Political Communication</em>, <em>38</em>(5), 624–646. <a href="https://doi.org/10.1080/10584609.2020.1830322">https://doi.org/10.1080/10584609.2020.1830322</a></p> <p>Heinbach, D. &amp; Wilms, L. K. (2022): Der Einsatz von Moderation bei #meinfernsehen2021 [The deployment of moderation at #meinfernsehen2021]. In: F. Gerlach, C. Eilders &amp; K. Schmitz (Eds.): <em>#meinfernsehen2021. Partizipationsverfahren zur </em>Zukunft des öffentlich-rechtlichen Fernsehens. Baden-Baden: Nomos.</p> <p>Monnoyer-Smith, L. &amp; Wojcik, S. (2012). Technology and the quality of public deliberation: a comparison between on and offline participation. <em>International Journal of Electronic Governance</em>, <em>5</em>(1), Artikel 47443, 24. <a href="https://doi.org/10.1504/IJEG.2012.047443">https://doi.org/10.1504/IJEG.2012.047443</a></p> <p>Rowe, I. (2015). Deliberation 2.0: Comparing the Deliberative Quality of Online News User Comments Across Platforms. <em>Journal of Broadcasting &amp; Electronic Media</em>, <em>59</em>(4), 539–555. <a href="https://doi.org/10.1080/08838151.2015.1093482">https://doi.org/10.1080/08838151.2015.1093482</a></p> <p>Stromer Galley, J. (2007). Measuring Deliberation's Content: A Coding Scheme. <em>Journal of Public Deliberation</em>, <em>3</em>(1), Article 12.</p> <p>Stroud, N. J., Scacco, J. M., Muddiman, A. &amp; Curry, A. L. (2015). Changing Deliberative Norms on News Organizations' Facebook Sites. <em>Journal of Computer-Mediated Communication</em>, <em>20</em>(2), 188–203. <a href="https://doi.org/10.1111/jcc4.12104">https://doi.org/10.1111/jcc4.12104</a></p> <p>Ziegele, M., Quiring, O., Esau, K. &amp; Friess, D. (2020). Linking News Value Theory With Online Deliberation: How News Factors and Illustration Factors in News Articles Affect the Deliberative Quality of User Discussions in SNS’ Comment Sections. <em>Communication Research</em>, <em>47</em>(6), 860-890. <a href="https://doi.org/10.1177/0093650218797884">https://doi.org/10.1177/0093650218797884</a></p> <p>Zimmermann, T. (2017). <em>Digitale Diskussionen: Über politische Partizipation mittels Online-Leserkommentaren</em>. <em>Edition Politik: Bd. 44</em>. transcript Verlag. <a href="http://www.content-select.com/index.php?id=bib_view&amp;ean=9783839438886">http://www.content-select.com/index.php?id=bib_view&amp;ean=9783839438886</a></p> <p><strong><em>Further references</em></strong></p> <p>Cohen, J. (1989). Deliberation and democratic legitimacy. In A. P. Hamlin &amp; P. Pettit (Hrsg.), <em>The good polity: Normative analysis of the state </em>(S. 67–92). Blackwell.</p> <p>Díaz Noci, J., Domingo, D., Masip, P., Micó, J. L. &amp; Ruiz, C. (2012). Comments in news, democracy booster or journalistic nightmare: Assessing the quality and dynamics of citizen debates in Catalan online newspapers. <em>#ISOJ</em>, <em>2</em>(1), 46–64. <a href="https://isoj.org/wp-content/uploads/2016/10/ISOJ_Journal_V2_N1_2012_Spring.pdf#page=46">https://isoj.org/wp-content/uploads/2016/10/ISOJ_Journal_V2_N1_2012_Spring.pdf#page=46</a></p> <p>Dryzek, J. S., Bächtiger, A., Chambers, S., Cohen, J., Druckman, J. N., Felicetti, A., Fishkin, J. S., Farrell, D. M., Fung, A., Gutmann, A., Landemore, H., Mansbridge, J., Marien, S., Neblo, M. A., Niemeyer, S., Setälä, M., Slothuus, R., Suiter, J., Thompson, D. &amp; Warren, M. E. (2019). The crisis of democracy and the science of deliberation. <em>Science (New York, N.Y.)</em>, <em>363</em>(6432), 1144–1146. <a href="https://doi.org/10.1126/science.aaw2694">https://doi.org/10.1126/science.aaw2694</a></p> <p>Engelke, K. M. (2019). Enriching the Conversation: Audience Perspectives on the Deliberative Nature and Potential of User Comments for News Media. <em>Digital Journalism</em>, <em>8</em>(4), 1–20. <a href="https://doi.org/10.1080/21670811.2019.1680567">https://doi.org/10.1080/21670811.2019.1680567</a></p> <p>Esterling, K. M. (2011). “Deliberative Disagreement” in U.S. Health Policy Committee Hearings. <em>Legislative Studies Quarterly</em>, <em>36</em>(2), 169–198. <a href="https://doi.org/10.1111/j.1939-9162.2011.00010.x">https://doi.org/10.1111/j.1939-9162.2011.00010.x</a></p> <p>Fishkin, J. S. (1991). <em>Democracy and deliberation: New directions for democratic reform</em>. Yale University Press. <a href="http://www.jstor.org/stable/10.2307/j.ctt1dt006v%20https://doi.org/10.2307/j.ctt1dt006v">http://www.jstor.org/stable/10.2307/j.ctt1dt006v https://doi.org/10.2307/j.ctt1dt006v</a></p> <p>Friess, D. &amp; Eilders, C. (2015). A systematic review of online deliberation research. <em>Policy &amp; Internet</em>, <em>7</em>(3), 319–339. <a href="https://doi.org/10.1002/poi3.95">https://doi.org/10.1002/poi3.95</a></p> <p>Graham, T. &amp; Witschge, T. (2003). In Search of Online Deliberation: Towards a New Method for Examining the Quality of Online Discussions. <em>Communications</em>, <em>28</em>(2). <a href="https://doi.org/10.1515/comm.2003.012">https://doi.org/10.1515/comm.2003.012</a></p> <p>Habermas, J. (2015). <em>Between facts and norms: Contributions to a discourse theory of law and democracy</em> (Reprinted.). Polity Press.</p> <p>Price, V. &amp; Cappella, J. N. (2002). Online deliberation and its influence: The Electronic Dialogue Project in Campaign 2000. <em>IT&amp;Society</em>, <em>1</em>(1), 303–329. <a href="https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.9.5945&amp;rep=rep1&amp;type=pdf">https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.9.5945&amp;rep=rep1&amp;type=pdf</a></p> <p>Steenbergen, M. R., Bächtiger, A., Spörndli, M. &amp; Steiner, J. (2003). Measuring Political Deliberation: A Discourse Quality Index. <em>Comparative European Politics</em>, <em>1</em>(1), 21–48. <a href="https://doi.org/10.1057/palgrave.cep.6110002">https://doi.org/10.1057/palgrave.cep.6110002</a></p> <p>Ziegele, M. (2016). <em>Nutzerkommentare als Anschlusskommunikation: Theorie und qualitative Analyse des Diskussionswerts von Online-Nachrichten</em><em> [T</em><em>he Discussion Value of Online News. </em><em>An Analysis of User Comments on News Platforms]</em>. Springer VS.</p> 2022-11-29T00:00:00+01:00 Copyright (c) 2022 DOCA - Database of Variables for Content Analysis https://www.hope.uzh.ch/doca/article/view/3877 Consent Communication (Portrayals of Sexuality in Pornography) 2022-10-22T21:19:47+02:00 Nicola Döring nicola.doering@tu-ilmenau.de Dan J. Miller daniel.miller1@jcu.edu.au <p>Pornography is a <em>fictional media genre</em> that depicts <em>sexual</em> <em>fantasies</em> and explicitly presents naked bodies and sexual activities for the purpose of sexual arousal (Williams, 1989; McKee et al., 2020). Regarding media ethics and media effects, pornography has traditionally been viewed as highly problematic. Pornographic material has been accused of portraying sexuality in unhealthy, morally questionable and often sexist ways, thereby harming performers, audiences, and society at large. In the age of the Internet, pornography has become more diverse, accessible, and widespread than ever (Döring, 2009; Miller et al., 2020). Consequently, the depiction of sexuality in pornography is the focus of a growing number of content analyses of both mass media (e.g., erotic and pornographic novels and movies) and social media (e.g., erotic and pornographic stories, photos and videos shared via online platforms). Typically, <em>pornography’s portrayals of sexuality</em> are examined by measuring the prevalence and frequency of sexual practices or relational dynamics and related gender roles via quantitative content analysis (for research reviews see Carrotte et al., 2020; Miller &amp; McBain, 2022). This entry focuses on the representation of <em>consent communication</em> as one of eight important dimensions of the portrayals of sexuality in pornography.</p> <p> </p> <p><strong><em>Field of application/theoretical foundation:</em></strong></p> <p>In the field of pornographic media content research, different theories are used, mainly 1) general media effects theories, 2) sexual media effects theories, 3) gender role, feminist and queer theories, 4) sexual fantasy and desire theories, and different 5) mold theories versus mirror theories. The DOCA entry “<a href="https://doi.org/10.34778/5k">Conceptual Overview (Portrayals of Sexuality in Pornography)</a>” introduces all these theories and explains their application to pornography. The respective theories are applicable to the analysis of the depiction of consent communication as one dimension of the portrayals of sexuality in pornography.</p> <p> </p> <p><strong><em>References/combination with other methods of data collection:</em></strong></p> <p>Manual quantitative content analyses of pornographic material can be combined with qualitative (e.g., Keft-Kennedy, 2008) as well as computational (e.g., Seehuus et al., 2019) content analyses. Furthermore, content analyses can be complemented with qualitative interviews and quantitative surveys to investigate perceptions and evaluations of the portrayals of sexuality in pornography among pornography’s creators and performers (e.g., West, 2019) and audiences (e.g., Cowan &amp; Dunn, 1994; Hardy et al., 2022; Paasoonen, 2021; Shor, 2022). Additionally, experimental studies are helpful to measure directly how different dimensions of pornographic portrayals of sexuality are perceived and evaluated by recipients, and if and how these portrayals can affect audiences’ sexuality-related thoughts, feelings, and behaviors (e.g., Kohut &amp; Fisher, 2013; Miller et al., 2019).</p> <p> </p> <p><strong><em>Example studies for manual quantitative content analyses:</em></strong></p> <p>A common research hypothesis states that pornography depicts sex mostly without consent communication, especially explicit verbal communication. To test this hypothesis and code pornographic material accordingly, it is necessary to clarify the concept of “consent communication” and use valid and reliable measures for different types of consent communication.</p> <p>Here it is important to conceptually differentiate between consent communication <em>between characters</em> in the fictional world of the porn scene and consent communication <em>between performers</em> on set (or consent <em>of</em> performers to have their image be recorded and disseminated as pornography). This distinction becomes murky with regard to amateur pornography, which ostensibly is meant to depict “authentic” sex (although this sex may still be performative), and also professional pornography in which a performer is playing “themselves” as opposed to a character. Some production studios (especially those specializing in BDSM content) embed interviews with performers into their videos, in which performers indicate that they consented to the activities presented.</p> <p> </p> <div style="overflow-x: auto;"> <table width="879"> <tbody> <tr> <td class="t b"> <p><strong>Coding Material</strong></p> </td> <td class="t b"> <p><strong>Measure</strong></p> </td> <td class="t b"> <p><strong>Operationalization (excerpt)</strong></p> </td> <td class="t b"> <p><strong>Reliability</strong></p> </td> <td class="t b"> <p><strong>Source</strong></p> </td> </tr> <tr> <td colspan="5" width="879"> <p><strong><em>Consent Communication: </em></strong>Whenever in the sequence of sexual activities depicted in pornography a new activity is started, the question arises if all participants have consented to the new behavior. Sexual consent between characters can be communicated verbally and nonverbally (Willis et al., 2020). Further, verbal or nonverbal communication may be explicit or implicit (Willis et al., 2020). Apart from issues of performer health protection, explicit consent communication on camera is also regarded as relevant in terms of modelling behaviors for audiences.</p> </td> </tr> <tr> <td class="t"> <p>N=50 segments (length 20 min. each) from a random sample of 50 bestselling pornographic films (1 segment per film) depicting a total of 1,109 sexual behaviors</p> </td> <td class="t b"> <p>Explicit verbal sexual consent</p> </td> <td class="t b"> <p>“Straightforward statements, questions, or responses expressing agreement to engage in sexual behavior stated using words for actual sexual behavior or a very close synonym”. Binary coding (1: present; 2: not present).</p> </td> <td class="t b"> <p>Cohen’s Kappa: .72</p> </td> <td class="t"> <p>Willis et al. (2020)</p> </td> </tr> <tr> <td width="170"> <p> </p> </td> <td class="t b"> <p>Implicit verbal sexual consent</p> </td> <td class="t b"> <p>“Verbally initiating sexual behavior or communicating agreement to engage in sexual behavior without explicitly using the word sex or other close synonyms. The content of the words may not be sexual in nature, but the connotation or tone of voice used by the characters implies sex or is sexual in nature”. Binary coding (1: present; 2: not present).</p> </td> <td class="t b"> <p>Cohen’s Kappa: .63</p> </td> <td width="87"> <p> </p> </td> </tr> <tr> <td width="170"> <p> </p> </td> <td class="t b"> <p>Explicit nonverbal sexual consent</p> </td> <td class="t b"> <p>“Behaviors or actions that are sexually explicit including bodily touching in a sexual way”. Binary coding (1: present; 2: not present).</p> </td> <td class="t b"> <p>Cohen’s Kappa: .76</p> </td> <td width="87"> <p> </p> </td> </tr> <tr> <td width="170"> <p> </p> </td> <td class="t b"> <p>Implicit nonverbal sexual consent</p> </td> <td class="t b"> <p>“Behaviors or actions that imply interest in engagement in sexual behavior”. Binary coding (1: present; 2: not present).</p> </td> <td class="t b"> <p>Cohen’s Kappa: .65</p> </td> <td width="87"> <p> </p> </td> </tr> <tr> <td width="170"> <p> </p> </td> <td class="t b"> <p>No response</p> </td> <td class="t b"> <p>“Characters do not say anything, do not resist, or let the sexual activity happen without much action. The person is a passive participant in sexual behavior, but not uncomfortable, distressed, or showing signs of disinterest”. Binary coding (1: present; 2: not present).</p> </td> <td class="t b"> <p>Cohen’s Kappa: .72</p> </td> <td width="87"> <p> </p> </td> </tr> <tr> <td class="b"> <p> </p> </td> <td class="t b"> <p>No sexual consent shown</p> </td> <td class="t b"> <p>“Scene begins or video cuts away and comes back with characters engaging in sexual behavior without any preceding actions to assess consent”. Binary coding (1: present; 2: not present).</p> </td> <td class="t b"> <p>Cohen’s Kappa: .95</p> </td> <td class="b"> <p> </p> </td> </tr> </tbody> </table> </div> <p> </p> <p>For more nuanced analyses of consent communication, the sex/gender of the persons involved in consent communication can be coded (see DOCA entry “<a href="https://doi.org/10.34778/5o">Performer Demographics (Portrayals of Sexuality in Pornography)</a>”) and the respective sex acts that are to be consented to (see DOCA entry “<a href="https://doi.org/10.34778/5n">Sex Acts (Portrayals of Sexuality in Pornography)</a>”). Furthermore, relationship status between characters might play an important role for consent communication (Willis et al., 2020): Characters in established relationships might be more likely to communicate sexual consent nonverbally than those in casual encounters (see DOCA entry "<a href="https://doi.org/10.34778/5r">Relational Context of Sex (Portrayals of Sexuality in Pornography</a>").</p> <p> </p> <p><strong>References</strong></p> <p>Carrotte, E. R., Davis, A. C., &amp; Lim, M. S. (2020). Sexual behaviors and violence in pornography: Systematic review and narrative synthesis of video content analyses. <em>Journal of Medical Internet Research</em>, <em>22</em>(5), Article e16702. <a href="https://doi.org/10.2196/16702">https://doi.org/10.2196/16702</a></p> <p>Cowan, G., &amp; Dunn, K. F. (1994). What themes in pornography lead to perceptions of the degradation of women? <em>Journal of Sex Research</em>, <em>31</em>(1), 11–21. <a href="https://doi.org/10.1080/00224499409551726">https://doi.org/10.1080/00224499409551726</a></p> <p>Döring, N. (2009). The Internet’s impact on sexuality: A critical review of 15 years of research. <em>Computers in Human Behavior</em>, <em>25</em>(5), 1089–1101. <a href="https://doi.org/10.1016/j.chb.2009.04.003">https://doi.org/10.1016/j.chb.2009.04.003</a></p> <p>Hardy, J., Kukkonen, T., &amp; Milhausen, R. (2022). Examining sexually explicit material use in adults over the age of 65 years. <em>The Canadian Journal of Human Sexuality</em>, <em>31</em>(1), 117–129. <a href="https://doi.org/10.3138/cjhs.2021-0047">https://doi.org/10.3138/cjhs.2021-0047</a></p> <p>Keft-Kennedy, V. (2008). Fantasising masculinity in Buffyverse slash fiction: Sexuality, violence, and the vampire. <em>Nordic Journal of English Studies</em>, <em>7</em>(1), 49–80.</p> <p>Kohut, T., &amp; Fisher, W. A. (2013). The impact of brief exposure to sexually explicit video clips on partnered female clitoral self-stimulation, orgasm and sexual satisfaction. <em>The Canadian Journal of Human Sexuality</em>, <em>22</em>(1), 40–50. <a href="https://doi.org/10.3138/cjhs.935">https://doi.org/10.3138/cjhs.935</a></p> <p>McKee, A., Byron, P., Litsou, K., &amp; Ingham, R. (2020). An interdisciplinary definition of pornography: Results from a global Delphi panel. <em>Archives of Sexual Behavior</em>, <em>49</em>(3), 1085–1091. <a href="https://doi.org/10.1007/s10508-019-01554-4">https://doi.org/10.1007/s10508-019-01554-4</a></p> <p>Miller, D. J., &amp; McBain, K. A. (2022). The content of contemporary, mainstream pornography: A literature review of content analytic studies. <em>American Journal of Sexuality Education</em>, <em>17</em>(2), 219–256. <a href="https://doi.org/10.1080/15546128.2021.2019648">https://doi.org/10.1080/15546128.2021.2019648</a></p> <p>Miller, D. J., McBain, K. A., &amp; Raggatt, P. T. F. (2019). An experimental investigation into pornography’s effect on men’s perceptions of the likelihood of women engaging in porn-like sex. <em>Psychology of Popular Media Culture</em>, <em>8</em>(4), 365–375. <a href="https://doi.org/10.1037/ppm0000202">https://doi.org/10.1037/ppm0000202</a></p> <p>Miller, D. J., Raggatt, P. T. F., &amp; McBain, K. (2020). A literature review of studies into the prevalence and frequency of men’s pornography use. <em>American Journal of Sexuality Education</em>, <em>15</em>(4), 502–529. <a href="https://doi.org/10.1080/15546128.2020.1831676">https://doi.org/10.1080/15546128.2020.1831676</a></p> <p>Paasonen, S. (2021). “We watch porn for the fucking, not for romantic tiptoeing”: Extremity, fantasy and women’s porn use. <em>Porn Studies</em>, 1–14. <a href="https://doi.org/10.1080/23268743.2021.1956366">https://doi.org/10.1080/23268743.2021.1956366</a></p> <p>Seehuus, M., Stanton, A. M., &amp; Handy, A. B. (2019). On the content of "real-world" sexual fantasy: Results from an analysis of 250,000+ anonymous text-based erotic fantasies. <em>Archives of Sexual Behavior</em>, <em>48</em>(3), 725–737. <a href="https://doi.org/10.1007/s10508-018-1334-0">https://doi.org/10.1007/s10508-018-1334-0</a></p> <p>Shor, E. (2022). Who seeks aggression in pornography? Findings from interviews with viewers. <em>Archives of Sexual Behavior</em>, <em>51</em>(2), 1237–1255. <a href="https://doi.org/10.1007/s10508-021-02053-1">https://doi.org/10.1007/s10508-021-02053-1</a></p> <p>West, C. (2019). Pornography and ethics: An interview with porn performer Blath. <em>Porn Studies</em>, <em>6</em>(2), 264–267. <a href="https://doi.org/10.1080/23268743.2018.1505540">https://doi.org/10.1080/23268743.2018.1505540</a></p> <p>Williams, L. (1989). <em>Hard Core: Power, pleasure, and the frenzy of the visible</em>. University of California Press.</p> <p>Willis, M., Canan, S. N., Jozkowski, K. N., &amp; Bridges, A. J. (2020). Sexual consent communication in best-selling pornography films: A content analysis. <em>Journal of Sex Research</em>, <em>57</em>(1), 52–63. <a href="https://doi.org/10.1080/00224499.2019.1655522">https://doi.org/10.1080/00224499.2019.1655522</a></p> 2022-10-24T00:00:00+02:00 Copyright (c) 2022 DOCA - Database of Variables for Content Analysis https://www.hope.uzh.ch/doca/article/view/3876 Relational Context of Sex (Portrayals of Sexuality in Pornography) 2022-10-22T21:11:48+02:00 Nicola Döring nicola.doering@tu-ilmenau.de Dan J. Miller daniel.miller1@jcu.edu.au <p>Pornography is a <em>fictional media genre</em> that depicts <em>sexual</em> <em>fantasies</em> and explicitly presents naked bodies and sexual activities for the purpose of sexual arousal (Williams, 1989; McKee et al., 2020). Regarding media ethics and media effects, pornography has traditionally been viewed as highly problematic. Pornographic material has been accused of portraying sexuality in unhealthy, morally questionable and often sexist ways, thereby harming performers, audiences, and society at large. In the age of the Internet, pornography has become more diverse, accessible, and widespread than ever (Döring, 2009; Miller et al., 2020). Consequently, the depiction of sexuality in pornography is the focus of a growing number of content analyses of both mass media (e.g., erotic and pornographic novels and movies) and social media (e.g., erotic and pornographic stories, photos and videos shared via online platforms). Typically, <em>pornography’s portrayals of sexuality</em> are examined by measuring the prevalence and frequency of sexual practices or relational dynamics and related gender roles via quantitative content analysis (for research reviews see Carrotte et al., 2020; Miller &amp; McBain, 2022). This entry focuses on the representation of <em>relational context of sex</em> as one of eight important dimensions of the portrayals of sexuality in pornography.</p> <p> </p> <p><strong><em>Field of application/theoretical foundation:</em></strong></p> <p>In the field of pornographic media content research, different theories are used, mainly 1) general media effects theories, 2) sexual media effects theories, 3) gender role, feminist and queer theories, 4) sexual fantasy and desire theories, and different 5) mold theories versus mirror theories. The DOCA entry “<a href="https://doi.org/10.34778/5k">Conceptual Overview (Portrayals of Sexuality in Pornography)</a>” introduces all these theories and explains their application to pornography. The respective theories are applicable to the analysis of the depiction of relational context of sex as one dimension of the portrayals of sexuality in pornography.</p> <p> </p> <p><strong><em>References/combination with other methods of data collection:</em></strong></p> <p>Manual quantitative content analyses of pornographic material can be combined with qualitative (e.g., Keft-Kennedy, 2008) as well as computational (e.g., Seehuus et al., 2019) content analyses. Furthermore, content analyses can be complemented with qualitative interviews and quantitative surveys to investigate perceptions and evaluations of the portrayals of sexuality in pornography among pornography’s creators and performers (e.g., West, 2019) and audiences (e.g., Cowan &amp; Dunn, 1994; Hardy et al., 2022; Paasoonen, 2021; Shor, 2022). Additionally, experimental studies are helpful to measure directly how different dimensions of pornographic portrayals of sexuality are perceived and evaluated by recipients, and if and how these portrayals can affect audiences’ sexuality-related thoughts, feelings, and behaviors (e.g., Kohut &amp; Fisher, 2013; Miller et al., 2019).</p> <p> </p> <p><strong><em>Example studies for manual quantitative content analyses:</em></strong></p> <p>Common research hypotheses state that sex in pornography is mostly depicted as casual and/or extrarelational, even though real life sex predominantly occurs in committed relationships. To test such hypotheses and code pornographic material accordingly, it is necessary to clarify the concept of “relational context of sex” and use valid and reliable measures for different types of relational contexts. In addition, it is necessary to code the sex/gender of the persons involved.</p> <p>It is important to note that the relational context of sex may be determined based on the interactions and dialogue between performers or based on video titles and descriptions. For example, a video might depict sex with little or no dialogue indicative of the nature of the relationship between performers, but include a title or description that contextualizes this relationship (e.g., “Cheating wife has sex with stranger” or “woman surprises her fiancé”).</p> <p> </p> <div style="overflow-x: auto;"> <table> <tbody> <tr> <td class="t b"> <p><strong>Coding Material</strong></p> </td> <td class="t b"> <p><strong>Measure</strong></p> </td> <td class="t b"> <p><strong>Operationalization (excerpt)</strong></p> </td> <td class="t b"> <p><strong>Reliability</strong></p> </td> <td class="t b"> <p><strong>Source</strong></p> </td> </tr> <tr> <td style="width: 873px;" colspan="5"> <p><strong><em>Relational Context of Sex</em></strong><strong>: </strong>Two people engaging in sex (a dyad) can have different types of romantic or non-romantic relationships with each other and with further people outside this dyad. If a person is having sex with a person they just met, this is defined as casual sex; and if a person is in a monogamous relationship and engages in sex with another person outside this relationship, this is considered extrarelational sex or infidelity (Rasmussen et al., 2019).</p> </td> </tr> <tr> <td class="t"> <p>N=190 scenes (average length 14 min.) taken from the highest rated section of PornHub (86 scenes) and Xvideos (104 scenes)</p> </td> <td class="t b"> <p>Casual sex and further relationship contexts with sex partners</p> </td> <td class="t b"> <p>Relationship between dyad members for each dyad engaging in sex during the scene. Polytomous coding (0: no relational information; 1: just met / casual sex; 2: acquaintances/friends; 3: dating; 4: married; 5: not enough information).</p> </td> <td class="t"> <p>Krippendorff’s Alpha average of .74 for all variables in codebook</p> </td> <td class="t"> <p>Rasmussen et al. (2019)</p> <p> </p> </td> </tr> <tr> <td style="width: 166px;"> <p> </p> </td> <td class="t b"> <p>Extrarelational sex</p> </td> <td class="t b"> <p>Sexual scene with at least one of the sexual participants being in a romantic relationship with someone not present in the sexual encounter. Binary coding (1: yes; 2: no).</p> </td> <td style="width: 137px;"> <p> </p> </td> <td style="width: 87px;"> <p> </p> </td> </tr> <tr> <td style="width: 87px;"> <p><strong> </strong></p> </td> <td class="t b"> <p>- Extrarelational participant dating (type of extrarelational sex)</p> </td> <td class="t b"> <p>Sexual scene with at least one participant dating someone not present in the sexual encounter. Binary coding (1: yes; 2: no).</p> </td> <td style="width: 137px;"> <p> </p> </td> <td style="width: 137px;"> <p> </p> </td> </tr> <tr> <td class="b"> <p><strong> </strong></p> </td> <td class="t b"> <p>- Extrarelational participant married (type of extrarelational sex)</p> </td> <td class="t b"> <p>Sexual scene with at least one participant being married to someone not present in the sexual encounter. Binary coding (1: yes; 2: no).</p> </td> <td class="b"> <p> </p> </td> <td class="b"> <p> </p> </td> </tr> </tbody> </table> </div> <p><strong> </strong></p> <p>If sex is determined to be extrarelational it is possible to further code whether this extrarelational sex is happening with the knowledge, encouragement, or participation of the individual’s partner (e.g., as part of a cuckold fantasy). Rasmussen et al. (2019) refer to this as <em>consensual non-monogamy</em>.</p> <p><strong> </strong></p> <p><strong>References</strong></p> <p>Carrotte, E. R., Davis, A. C., &amp; Lim, M. S. (2020). Sexual behaviors and violence in pornography: Systematic review and narrative synthesis of video content analyses. <em>Journal of Medical Internet Research</em>, <em>22</em>(5), Article e16702. <a href="https://doi.org/10.2196/16702">https://doi.org/10.2196/16702</a></p> <p>Cowan, G., &amp; Dunn, K. F. (1994). What themes in pornography lead to perceptions of the degradation of women? <em>Journal of Sex Research</em>, <em>31</em>(1), 11–21. <a href="https://doi.org/10.1080/00224499409551726">https://doi.org/10.1080/00224499409551726</a></p> <p>Döring, N. (2009). The Internet’s impact on sexuality: A critical review of 15 years of research. <em>Computers in Human Behavior</em>, <em>25</em>(5), 1089–1101. <a href="https://doi.org/10.1016/j.chb.2009.04.003">https://doi.org/10.1016/j.chb.2009.04.003</a></p> <p>Hardy, J., Kukkonen, T., &amp; Milhausen, R. (2022). Examining sexually explicit material use in adults over the age of 65 years. <em>The Canadian Journal of Human Sexuality</em>, <em>31</em>(1), 117–129. <a href="https://doi.org/10.3138/cjhs.2021-0047">https://doi.org/10.3138/cjhs.2021-0047</a></p> <p>Keft-Kennedy, V. (2008). Fantasising masculinity in Buffyverse slash fiction: Sexuality, violence, and the vampire. <em>Nordic Journal of English Studies</em>, <em>7</em>(1), 49–80.</p> <p>Kohut, T., &amp; Fisher, W. A. (2013). The impact of brief exposure to sexually explicit video clips on partnered female clitoral self-stimulation, orgasm and sexual satisfaction. <em>The Canadian Journal of Human Sexuality</em>, <em>22</em>(1), 40–50. <a href="https://doi.org/10.3138/cjhs.935">https://doi.org/10.3138/cjhs.935</a></p> <p>McKee, A., Byron, P., Litsou, K., &amp; Ingham, R. (2020). An interdisciplinary definition of pornography: Results from a global Delphi panel. <em>Archives of Sexual Behavior</em>, <em>49</em>(3), 1085–1091. <a href="https://doi.org/10.1007/s10508-019-01554-4">https://doi.org/10.1007/s10508-019-01554-4</a></p> <p>Miller, D. J., &amp; McBain, K. A. (2022). The content of contemporary, mainstream pornography: A literature review of content analytic studies. <em>American Journal of Sexuality Education</em>, <em>17</em>(2), 219–256. <a href="https://doi.org/10.1080/15546128.2021.2019648">https://doi.org/10.1080/15546128.2021.2019648</a></p> <p>Miller, D. J., McBain, K. A., &amp; Raggatt, P. T. F. (2019). An experimental investigation into pornography’s effect on men’s perceptions of the likelihood of women engaging in porn-like sex. <em>Psychology of Popular Media Culture</em>, <em>8</em>(4), 365–375. <a href="https://doi.org/10.1037/ppm0000202">https://doi.org/10.1037/ppm0000202</a></p> <p>Miller, D. J., Raggatt, P. T. F., &amp; McBain, K. (2020). A literature review of studies into the prevalence and frequency of men’s pornography use. <em>American Journal of Sexuality Education</em>, <em>15</em>(4), 502–529. <a href="https://doi.org/10.1080/15546128.2020.1831676">https://doi.org/10.1080/15546128.2020.1831676</a></p> <p>Paasonen, S. (2021). “We watch porn for the fucking, not for romantic tiptoeing”: Extremity, fantasy and women’s porn use. <em>Porn Studies</em>, 1–14. <a href="https://doi.org/10.1080/23268743.2021.1956366">https://doi.org/10.1080/23268743.2021.1956366</a></p> <p>Rasmussen, K. R., Millar, D., &amp; Trenchuk, J. (2019). Relationships and infidelity in pornography: An analysis of pornography streaming websites. <em>Sexuality &amp; Culture</em>, <em>23</em>(2), 571–584. <a href="https://doi.org/10.1007/s12119-018-9574-7">https://doi.org/10.1007/s12119-018-9574-7</a></p> <p>Seehuus, M., Stanton, A. M., &amp; Handy, A. B. (2019). On the content of "real-world" sexual fantasy: Results from an analysis of 250,000+ anonymous text-based erotic fantasies. <em>Archives of Sexual Behavior</em>, <em>48</em>(3), 725–737. <a href="https://doi.org/10.1007/s10508-018-1334-0">https://doi.org/10.1007/s10508-018-1334-0</a></p> <p>Shor, E. (2022). Who seeks aggression in pornography? Findings from interviews with viewers. <em>Archives of Sexual Behavior</em>, <em>51</em>(2), 1237–1255. <a href="https://doi.org/10.1007/s10508-021-02053-1">https://doi.org/10.1007/s10508-021-02053-1</a></p> <p>West, C. (2019). Pornography and ethics: An interview with porn performer Blath. <em>Porn Studies</em>, <em>6</em>(2), 264–267. <a href="https://doi.org/10.1080/23268743.2018.1505540">https://doi.org/10.1080/23268743.2018.1505540</a></p> <p>Williams, L. (1989). <em>Hard Core: Power, pleasure, and the frenzy of the visible</em>. University of California Press.</p> 2022-10-24T00:00:00+02:00 Copyright (c) 2022 DOCA - Database of Variables for Content Analysis https://www.hope.uzh.ch/doca/article/view/3875 Safer Sex Practices (Portrayals of Sexuality in Pornography) 2022-10-22T21:05:02+02:00 Nicola Döring nicola.doering@tu-ilmenau.de Dan J. Miller daniel.miller1@jcu.edu.au <p>Pornography is a <em>fictional media genre</em> that depicts <em>sexual</em> <em>fantasies</em> and explicitly presents naked bodies and sexual activities for the purpose of sexual arousal (Williams, 1989; McKee et al., 2020). Regarding media ethics and media effects, pornography has traditionally been viewed as highly problematic. Pornographic material has been accused of portraying sexuality in unhealthy, morally questionable and often sexist ways, thereby harming performers, audiences, and society at large. In the age of the Internet, pornography has become more diverse, accessible, and widespread than ever (Döring, 2009; Miller et al., 2020). Consequently, the depiction of sexuality in pornography is the focus of a growing number of content analyses of both mass media (e.g., erotic and pornographic novels and movies) and social media (e.g., erotic and pornographic stories, photos and videos shared via online platforms). Typically, <em>pornography’s portrayals of sexuality</em> are examined by measuring the prevalence and frequency of sexual practices or relational dynamics and related gender roles via quantitative content analysis (for research reviews see Carrotte et al., 2020; Miller &amp; McBain, 2022). This entry focuses on the representation of <em>safer sex practices</em> as one of eight important dimensions of the portrayals of sexuality in pornography.</p> <p> </p> <p><strong><em>Field of application/theoretical foundation:</em></strong></p> <p>In the field of pornographic media content research, different theories are used, mainly 1) general media effects theories, 2) sexual media effects theories, 3) gender role, feminist and queer theories, 4) sexual fantasy and desire theories, and different 5) mold theories versus mirror theories. The DOCA entry “<a href="https://doi.org/10.34778/5k">Conceptual Overview (Portrayals of Sexuality in Pornography)</a>” introduces all these theories and explains their application to pornography. The respective theories are applicable to the analysis of the depiction of safer sex practices as one dimension of the portrayals of sexuality in pornography.</p> <p> </p> <p><strong><em>References/combination with other methods of data collection:</em></strong></p> <p>Manual quantitative content analyses of pornographic material can be combined with qualitative (e.g., Keft-Kennedy, 2008) as well as computational (e.g., Seehuus et al., 2019) content analyses. Furthermore, content analyses can be complemented with qualitative interviews and quantitative surveys to investigate perceptions and evaluations of the portrayals of sexuality in pornography among pornography’s creators and performers (e.g., West, 2019) and audiences (e.g., Cowan &amp; Dunn, 1994; Hardy et al., 2022; Paasoonen, 2021; Shor, 2022). Additionally, experimental studies are helpful to measure directly how different dimensions of pornographic portrayals of sexuality are perceived and evaluated by recipients, and if and how these portrayals can affect audiences’ sexuality-related thoughts, feelings, and behaviors (e.g., Kohut &amp; Fisher, 2013; Miller et al., 2019).</p> <p> </p> <p><strong><em>Example studies for manual quantitative content analyses:</em></strong></p> <p>A common research hypothesis states that pornography displays sexuality – and even high-risk sex acts, such as penetrative sex – predominately without condoms. To test such hypotheses and code pornographic material accordingly, it is necessary to clarify the concept of “safer sex” and use valid and reliable measures for different types of safer sex practices.</p> <p>It is important to note that safer sex practices could be assessed at the sexual encounter level (e.g., Is a condom used during the sexual encounter?) or at the level of specific sexual acts (e.g., Is a condom used during anal sex?). It is also possible that a scene depicts a condom being used, but only for the purpose of it being removed (e.g., to highlight the unrestricted nature of the sex being shown or as part of an impregnation roleplay). Given that such scenarios would depict condom use while simultaneously presenting sex with a condom as being less pleasurable, researchers may need to consider these contextual factors when developing their coding schemes. In gay male pornography “barebacking” (deliberately forgoing condom use during anal sex) is its own sub-genre (Tollini, 2019), thus there is a possibility for indirect coding based on meta-information about whether material sits within this sub-genre.</p> <div style="overflow-x: auto;"> </div> <table style="height: 918px;" width="879"> <tbody> <tr style="height: 42px;"> <td class="t b"> <p><strong>Coding Material</strong></p> </td> <td class="t b"> <p><strong>Measure</strong></p> </td> <td class="t b"> <p><strong>Operationalization (excerpt)</strong><strong> </strong></p> </td> <td class="t b"> <p><strong>Reliability</strong></p> </td> <td class="t b"> <p><strong>Source</strong></p> </td> </tr> <tr style="height: 282px;"> <td style="height: 282px; width: 873px;" colspan="5"> <p><strong><em>Safer Sex Practices: </em></strong>Condom use during penetrative sex with a penis provides a high degree of protection against pregnancies and several types of STIs (Sexually Transmitted Infections) including HIV (Human Immunodeficiency Virus). While condom use is recommended for private sexual encounters (and demanded by some legislatures for porn performers), condoms can increase pain, risk of injury and risk of STI/HIV transmission among performers (particularly those engaging in receptive penetrative practices) because professional performances are typically much longer and more demanding than the average private sexual encounters. For this reason, some porn performers have challenged the idea that legal obligations for condom use on set effectively protect them (Shachner, 2015). Alternative protection measures are often preferred by professional performers (e.g., long acting contraception methods, regular STI/HIV testing, HIV-Pre-Exposure Prophylaxis). The availability of HIV-Pre-Exposure Prophylaxis has resulted in a trend toward condomless anal sex (“barebacking”) in gay male pornography (Tollini, 2019). Apart from issues of performer health protection, safer sex practices in pornography are also regarded as relevant in terms of modelling behaviors for audiences.</p> </td> </tr> <tr style="height: 42px;"> <td class="t b"> <p> </p> </td> <td class="t b"> <p><em>Condom use</em></p> </td> <td class="t b"> <p><em> </em></p> </td> <td class="t b"> <p> </p> </td> <td class="t b"> <p> </p> </td> </tr> <tr style="height: 186px;"> <td class="t"> <p>N=50 scenes from 50 best-selling heterosexual adult films (1 scene per film) and N=50 scenes from 50 bestselling male homosexual films (1 scene per film)</p> </td> <td class="t b" style="height: 186px; width: 134px;"> <p>- Condom use during penile-oral contact (type of condom use)</p> </td> <td class="t b" style="height: 186px; width: 336px;"> <p>Penile-oral contact is shown and a condom is used at least some of the time during this act. Binary coding (1: yes; 2: no).</p> </td> <td class="t" style="height: 186px; width: 138px;"> <p>Cohen’s Kappa across all four variables: .78</p> </td> <td class="t" style="height: 186px; width: 87px;"> <p>Grudzen et al. (2009)</p> </td> </tr> <tr style="height: 138px;"> <td style="height: 138px; width: 170px;"> <p> </p> </td> <td class="t b" style="height: 138px; width: 134px;"> <p>- Condom use during penile-vaginal contact (type of condom use)</p> </td> <td class="t b" style="height: 138px; width: 336px;"> <p>Penile-vaginal contact is shown and a condom is used at least some of the time during this act. Binary coding (1: yes; 2: no).</p> </td> <td style="height: 138px; width: 138px;"> <p> </p> </td> <td style="height: 138px; width: 87px;"> <p> </p> </td> </tr> <tr style="height: 114px;"> <td style="height: 114px; width: 170px;"> <p> </p> </td> <td class="t b" style="height: 114px; width: 134px;"> <p>- Condom use during penile-anal contact (type of condom use)</p> </td> <td class="t b" style="height: 114px; width: 336px;"> <p>Penile-anal contact is shown and a condom is used at least some of the time during this act. Binary coding (1: yes; 2: no).</p> </td> <td style="height: 114px; width: 138px;"> <p> </p> </td> <td style="height: 114px; width: 87px;"> <p> </p> </td> </tr> <tr style="height: 114px;"> <td class="b" style="height: 114px; width: 170px;"> <p> </p> </td> <td class="t b" style="height: 114px; width: 134px;"> <p>- Condom use during anal-to-oral penile insertion</p> </td> <td class="t b" style="height: 114px; width: 336px;"> <p>Anal-to-oral penile insertion (penile-oral insertion immediately following penile-anal insertion) is shown and a condom is used at least some of the time during this act. Binary coding (1: yes; 2: no).</p> </td> <td class="b" style="height: 114px; width: 138px;"> <p> </p> </td> <td class="b" style="height: 114px; width: 87px;"> <p> </p> </td> </tr> </tbody> </table> <p> </p> <p>Apart from condom use, further safer sex practices can be measured (e.g., visible use of lube to prevent pain or injuries during penetrative sex; observable communication between characters about sexual health status, STI testing, or use of contraception).</p> <p> </p> <p><strong>References</strong></p> <p>Carrotte, E. R., Davis, A. C., &amp; Lim, M. S. (2020). Sexual behaviors and violence in pornography: Systematic review and narrative synthesis of video content analyses. <em>Journal of Medical Internet Research</em>, <em>22</em>(5), Article e16702. <a href="https://doi.org/10.2196/16702">https://doi.org/10.2196/16702</a></p> <p>Cowan, G., &amp; Dunn, K. F. (1994). What themes in pornography lead to perceptions of the degradation of women? <em>Journal of Sex Research</em>, <em>31</em>(1), 11–21. <a href="https://doi.org/10.1080/00224499409551726">https://doi.org/10.1080/00224499409551726</a></p> <p>Döring, N. (2009). The Internet’s impact on sexuality: A critical review of 15 years of research. <em>Computers in Human Behavior</em>, <em>25</em>(5), 1089–1101. <a href="https://doi.org/10.1016/j.chb.2009.04.003">https://doi.org/10.1016/j.chb.2009.04.003</a></p> <p>Grudzen, C. R., Elliott, M. N., Kerndt, P. R., Schuster, M. A., Brook, R. H., &amp; Gelberg, L. (2009). Condom use and high-risk sexual acts in adult films: A comparison of heterosexual and homosexual films. <em>American Journal of Public Health</em>, <em>99</em>(S1), S152-156. <a href="https://doi.org/10.2105/AJPH.2007.127035">https://doi.org/10.2105/AJPH.2007.127035</a></p> <p>Hardy, J., Kukkonen, T., &amp; Milhausen, R. (2022). Examining sexually explicit material use in adults over the age of 65 years. <em>The Canadian Journal of Human Sexuality</em>, <em>31</em>(1), 117–129. <a href="https://doi.org/10.3138/cjhs.2021-0047">https://doi.org/10.3138/cjhs.2021-0047</a></p> <p>Keft-Kennedy, V. (2008). Fantasising masculinity in Buffyverse slash fiction: Sexuality, violence, and the vampire. <em>Nordic Journal of English Studies</em>, <em>7</em>(1), 49–80.</p> <p>Kohut, T., &amp; Fisher, W. A. (2013). The impact of brief exposure to sexually explicit video clips on partnered female clitoral self-stimulation, orgasm and sexual satisfaction. <em>The Canadian Journal of Human Sexuality</em>, <em>22</em>(1), 40–50. <a href="https://doi.org/10.3138/cjhs.935">https://doi.org/10.3138/cjhs.935</a></p> <p>McKee, A., Byron, P., Litsou, K., &amp; Ingham, R. (2020). An interdisciplinary definition of pornography: Results from a global Delphi panel. <em>Archives of Sexual Behavior</em>, <em>49</em>(3), 1085–1091. <a href="https://doi.org/10.1007/s10508-019-01554-4">https://doi.org/10.1007/s10508-019-01554-4</a></p> <p>Miller, D. J., &amp; McBain, K. A. (2022). The content of contemporary, mainstream pornography: A literature review of content analytic studies. <em>American Journal of Sexuality Education</em>, <em>17</em>(2), 219–256. <a href="https://doi.org/10.1080/15546128.2021.2019648">https://doi.org/10.1080/15546128.2021.2019648</a></p> <p>Miller, D. J., McBain, K. A., &amp; Raggatt, P. T. F. (2019). An experimental investigation into pornography’s effect on men’s perceptions of the likelihood of women engaging in porn-like sex. <em>Psychology of Popular Media Culture</em>, <em>8</em>(4), 365–375. <a href="https://doi.org/10.1037/ppm0000202">https://doi.org/10.1037/ppm0000202</a></p> <p>Miller, D. J., Raggatt, P. T. F., &amp; McBain, K. (2020). A literature review of studies into the prevalence and frequency of men’s pornography use. <em>American Journal of Sexuality Education</em>, <em>15</em>(4), 502–529. <a href="https://doi.org/10.1080/15546128.2020.1831676">https://doi.org/10.1080/15546128.2020.1831676</a></p> <p>Paasonen, S. (2021). “We watch porn for the fucking, not for romantic tiptoeing”: Extremity, fantasy and women’s porn use. <em>Porn Studies</em>, 1–14. <a href="https://doi.org/10.1080/23268743.2021.1956366">https://doi.org/10.1080/23268743.2021.1956366</a></p> <p>Shachner, J. (2015). Unwrapped: How the Los Angeles County Safer Sex in the Adult Film Industry Act's condom mandate hurts performers &amp; violates the First Amendment. <em>Health Matrix: The Journal of Law Medicine</em>, <em>24</em>(1), 345–375.</p> <p>Seehuus, M., Stanton, A. M., &amp; Handy, A. B. (2019). On the content of "real-world" sexual fantasy: Results from an analysis of 250,000+ anonymous text-based erotic fantasies. <em>Archives of Sexual Behavior</em>, <em>48</em>(3), 725–737. <a href="https://doi.org/10.1007/s10508-018-1334-0">https://doi.org/10.1007/s10508-018-1334-0</a></p> <p>Shor, E. (2022). Who seeks aggression in pornography? Findings from interviews with viewers. <em>Archives of Sexual Behavior</em>, <em>51</em>(2), 1237–1255. <a href="https://doi.org/10.1007/s10508-021-02053-1">https://doi.org/10.1007/s10508-021-02053-1</a></p> <p>Tollini, C. (2019). How two holdouts went bareback: CockyBoys and Men. com's initial transition to producing videos without condoms. <em>Porn Studies</em>, <em>6</em>(3), 282-300. <a href="https://doi.org/10.1080/23268743.2019.1602958">https://doi.org/10.1080/23268743.2019.1602958</a></p> <p>West, C. (2019). Pornography and ethics: An interview with porn performer Blath. <em>Porn Studies</em>, <em>6</em>(2), 264–267. <a href="https://doi.org/10.1080/23268743.2018.1505540">https://doi.org/10.1080/23268743.2018.1505540</a></p> <p>Williams, L. (1989). <em>Hard Core: Power, pleasure, and the frenzy of the visible</em>. University of California Press.</p> 2022-10-24T00:00:00+02:00 Copyright (c) 2022 DOCA - Database of Variables for Content Analysis https://www.hope.uzh.ch/doca/article/view/3874 Performer Bodily Appearance (Portrayals of Sexuality in Pornography) 2022-10-22T20:57:37+02:00 Nicola Döring nicola.doering@tu-ilmenau.de Dan J. Miller daniel.miller1@jcu.edu.au <p>Pornography is a <em>fictional media genre</em> that depicts <em>sexual</em> <em>fantasies</em> and explicitly presents naked bodies and sexual activities for the purpose of sexual arousal (Williams, 1989; McKee et al., 2020). Regarding media ethics and media effects, pornography has traditionally been viewed as highly problematic. Pornographic material has been accused of portraying sexuality in unhealthy, morally questionable and often sexist ways, thereby harming performers, audiences, and society at large. In the age of the Internet, pornography has become more diverse, accessible, and widespread than ever (Döring, 2009; Miller et al., 2020). Consequently, the depiction of sexuality in pornography is the focus of a growing number of content analyses of both mass media (e.g., erotic and pornographic novels and movies) and social media (e.g., erotic and pornographic stories, photos and videos shared via online platforms). Typically, <em>pornography’s portrayals of sexuality</em> are examined by measuring the prevalence and frequency of sexual practices or relational dynamics and related gender roles via quantitative content analysis (for research reviews see Carrotte et al., 2020; Miller &amp; McBain, 2022). This entry focuses on the representation of <em>performer bodily appearance</em> as one of eight important dimensions of the portrayals of sexuality in pornography.</p> <p> </p> <p><strong><em>Field of application/theoretical foundation:</em></strong></p> <p>In the field of pornographic media content research, different theories are used, mainly 1) general media effects theories, 2) sexual media effects theories, 3) gender role, feminist and queer theories, 4) sexual fantasy and desire theories, and different 5) mold theories versus mirror theories. The DOCA entry “<a href="https://doi.org/10.34778/5k">Conceptual Overview (Portrayals of Sexuality in Pornography)</a>” introduces all these theories and explains their application to pornography. The respective theories are applicable to the analysis of the depiction of performer bodily appearance as one dimension of the portrayals of sexuality in pornography.</p> <p> </p> <p><strong><em>References/combination with other methods of data collection:</em></strong></p> <p>Manual quantitative content analyses of pornographic material can be combined with qualitative (e.g., Keft-Kennedy, 2008) as well as computational (e.g., Seehuus et al., 2019) content analyses. Furthermore, content analyses can be complemented with qualitative interviews and quantitative surveys to investigate perceptions and evaluations of the portrayals of sexuality in pornography among pornography’s creators and performers (e.g., West, 2019) and audiences (e.g., Cowan &amp; Dunn, 1994; Hardy et al., 2022; Paasoonen, 2021; Shor, 2022). Additionally, experimental studies are helpful to measure directly how different dimensions of pornographic portrayals of sexuality are perceived and evaluated by recipients, and if and how these portrayals can affect audiences’ sexuality-related thoughts, feelings, and behaviors (e.g., Kohut &amp; Fisher, 2013; Miller et al., 2019).</p> <p> </p> <p><strong><em>Example studies for manual quantitative content analyses:</em></strong></p> <p>Common research hypotheses state that performers in pornography are mainly selected and presented to conform to gendered norms of sexual attractiveness but also potentially unhealthy beauty standards or current beauty trends. To test such hypotheses and code pornographic material accordingly, it is necessary to clarify the concept of “performer bodily appearance” and use valid and reliable measures for different aspects of appearance. In addition, it is necessary to code the sex/gender of the persons depicted.</p> <p>Two different approaches to coding are available: Direct coding based on the performer’s appearance (e.g., breast size) versus indirect coding based on meta-information about the material, such as the sub-genre pornography category the material belongs to (e.g., the “big tits”, “BBW” [big beautiful women], “tattoed women” categories on PornHub) or statistics provided as part of performer profiles published on online platforms (e.g., height, weight, bra or penis size).</p> <p> </p> <div style="overflow-x: auto;"> <table width="879"> <tbody> <tr> <td class="t b"> <p><strong>Coding Material</strong></p> </td> <td class="t b"> <p><strong>Measure</strong></p> </td> <td class="t b"> <p><strong>Operationalization (excerpt)</strong></p> </td> <td class="t b"> <p><strong>Reliability</strong></p> </td> <td class="t b"> <p><strong>Source</strong></p> </td> </tr> <tr> <td colspan="5" width="879"> <p><strong><em>Performer Bodily Appearance: </em></strong>Among the many aspects of performer appearance, those conventionally related to sexual attractiveness are measured most often in the context of pornography research. Researchers may also measure variables related to general beauty trends in society (e.g., shaving of pubic and body hair) or assess aspects of performer appearance which could be consider to promote unhealthy/unrealistic beauty standards (e.g., performers being unhealthily underweight or extremely muscular). Apart from issues of performer health protection, unhealthy standards of beauty and sexual attractiveness are also regarded as relevant in terms of modelling behaviors for audiences.</p> </td> </tr> <tr> <td class="t"> <p>N=50 best-selling pornographic videos and DVDs in Australia in 2003 with 838 sexual scenes</p> </td> <td class="t b"> <p>Performer body type</p> </td> <td class="t b"> <p>Performer body type. Polytomous coding (1: unhealthy underweight; 2: slim / undertoned; 3: average (untoned); 4: average (toned); 5: bulked up / very muscular; 6: overweight).</p> </td> <td class="t"> <p>Not available</p> </td> <td class="t"> <p>McKee et al. (2008)</p> </td> </tr> <tr> <td width="170"> <p><strong> </strong></p> </td> <td class="t b"> <p>Performer breast size</p> </td> <td class="t b"> <p>Performer breast size. Polytomous coding (1: smaller than average breasts; 2: average-sized breasts; 3: larger than average breasts).</p> </td> <td width="138"> <p> </p> </td> <td width="87"> <p> </p> </td> </tr> <tr> <td width="170"> <p><strong> </strong></p> </td> <td class="t b"> <p>Performer breast surgery</p> </td> <td class="t b"> <p>Performer breast surgery is obvious. Polytomous coding (1: yes; 2: no; 3: unsure).</p> </td> <td width="138"> <p> </p> </td> <td width="87"> <p> </p> </td> </tr> <tr> <td class="b"> <p><strong> </strong></p> </td> <td class="t b"> <p>Performer penis size</p> </td> <td class="t b"> <p>Performer penis size. Polytomous coding (1: smaller than average penis; 2: average-sized penis; 3: larger than average penis).</p> </td> <td class="b"> <p> </p> </td> <td class="b"> <p> </p> </td> </tr> <tr> <td class="t b"> <p>N &gt; 6,900 performer profiles from 10 gay male adult websites</p> </td> <td class="t b"> <p>Performer penis size</p> </td> <td class="t b"> <p>Performer penis size (as listed in performer profile). Polytomous coding (1: 5–6.5 inches; 2: 7–8 inches, 3: 8.5–10 inches, 4: 10.5–13 inches)</p> </td> <td class="t b"> <p>Not available</p> </td> <td class="t b"> <p>Brennan (2018)</p> </td> </tr> <tr> <td class="t b"> <p>N=50 MILF [“Mother I’d like to fuck” sub-genre category] and 50 “Teen” pornographic videos randomly selected from 10 different adult websites (10 videos per website)</p> <p><strong> </strong></p> </td> <td class="t b"> <p>Performer pubic hair</p> </td> <td class="t b"> <p>Performer pubic hair. Polytomous coding (1: none; 2. groomed; 3: natural).</p> </td> <td class="t b"> <p>Percentage agreement across all variables in codebook: 90.3%</p> </td> <td class="t b"> <p>Vannier et al. (2014)</p> </td> </tr> </tbody> </table> </div> <p> </p> <p><strong>References</strong></p> <p>Brennan, J. (2018). Size matters: Penis size and sexual position in gay porn profiles. <em>Journal of Homosexuality</em>, <em>65</em>(7), 912-933. <a href="https://doi.org/10.1080/00918369.2017.1364568">https://doi.org/10.1080/00918369.2017.1364568</a></p> <p>Carrotte, E. R., Davis, A. C., &amp; Lim, M. S. (2020). Sexual behaviors and violence in pornography: Systematic review and narrative synthesis of video content analyses. <em>Journal of Medical Internet Research</em>, <em>22</em>(5), Article e16702. <a href="https://doi.org/10.2196/16702">https://doi.org/10.2196/16702</a></p> <p>Cowan, G., &amp; Dunn, K. F. (1994). What themes in pornography lead to perceptions of the degradation of women? <em>Journal of Sex Research</em>, <em>31</em>(1), 11–21. https://doi.org/10.1080/00224499409551726</p> <p>Döring, N. (2009). The Internet’s impact on sexuality: A critical review of 15 years of research. <em>Computers in Human Behavior</em>, <em>25</em>(5), 1089–1101. <a href="https://doi.org/10.1016/j.chb.2009.04.003">https://doi.org/10.1016/j.chb.2009.04.003</a></p> <p>Hardy, J., Kukkonen, T., &amp; Milhausen, R. (2022). Examining sexually explicit material use in adults over the age of 65 years. <em>The Canadian Journal of Human Sexuality</em>, <em>31</em>(1), 117–129. <a href="https://doi.org/10.3138/cjhs.2021-0047">https://doi.org/10.3138/cjhs.2021-0047</a></p> <p>Keft-Kennedy, V. (2008). Fantasising masculinity in Buffyverse slash fiction: Sexuality, violence, and the vampire. <em>Nordic Journal of English Studies</em>, <em>7</em>(1), 49–80.</p> <p>Kohut, T., &amp; Fisher, W. A. (2013). The impact of brief exposure to sexually explicit video clips on partnered female clitoral self-stimulation, orgasm and sexual satisfaction. <em>The Canadian Journal of Human Sexuality</em>, <em>22</em>(1), 40–50. <a href="https://doi.org/10.3138/cjhs.935">https://doi.org/10.3138/cjhs.935</a></p> <p>McKee, A., Albury, K., &amp; Lumby, C. (2008). <em>The porn report</em>. Melbourne University Press.</p> <p>McKee, A., Byron, P., Litsou, K., &amp; Ingham, R. (2020). An interdisciplinary definition of pornography: Results from a global Delphi panel. <em>Archives of Sexual Behavior</em>, <em>49</em>(3), 1085–1091. <a href="https://doi.org/10.1007/s10508-019-01554-4">https://doi.org/10.1007/s10508-019-01554-4</a></p> <p>Miller, D. J., &amp; McBain, K. A. (2022). The content of contemporary, mainstream pornography: A literature review of content analytic studies. <em>American Journal of Sexuality Education</em>, <em>17</em>(2), 219–256. <a href="https://doi.org/10.1080/15546128.2021.2019648">https://doi.org/10.1080/15546128.2021.2019648</a></p> <p>Miller, D. J., McBain, K. A., &amp; Raggatt, P. T. F. (2019). An experimental investigation into pornography’s effect on men’s perceptions of the likelihood of women engaging in porn-like sex. <em>Psychology of Popular Media Culture</em>, <em>8</em>(4), 365–375. <a href="https://doi.org/10.1037/ppm0000202">https://doi.org/10.1037/ppm0000202</a></p> <p>Miller, D. J., Raggatt, P. T. F., &amp; McBain, K. (2020). A literature review of studies into the prevalence and frequency of men’s pornography use. <em>American Journal of Sexuality Education</em>, <em>15</em>(4), 502–529. <a href="https://doi.org/10.1080/15546128.2020.1831676">https://doi.org/10.1080/15546128.2020.1831676</a></p> <p>Paasonen, S. (2021). “We watch porn for the fucking, not for romantic tiptoeing”: Extremity, fantasy and women’s porn use. <em>Porn Studies</em>, 1–14. <a href="https://doi.org/10.1080/23268743.2021.1956366">https://doi.org/10.1080/23268743.2021.1956366</a></p> <p>Seehuus, M., Stanton, A. M., &amp; Handy, A. B. (2019). On the content of "real-world" sexual fantasy: Results from an analysis of 250,000+ anonymous text-based erotic fantasies. <em>Archives of Sexual Behavior</em>, <em>48</em>(3), 725–737. <a href="https://doi.org/10.1007/s10508-018-1334-0">https://doi.org/10.1007/s10508-018-1334-0</a></p> <p>Shor, E. (2022). Who seeks aggression in pornography? Findings from interviews with viewers. <em>Archives of Sexual Behavior</em>, <em>51</em>(2), 1237–1255. <a href="https://doi.org/10.1007/s10508-021-02053-1">https://doi.org/10.1007/s10508-021-02053-1</a></p> <p>Vannier, S. A., Currie, A. B., &amp; O'Sullivan, L. F. (2014). Schoolgirls and soccer moms: A content analysis of free “teen” and “MILF” online pornography. <em> Journal of Sex Research</em>, <em>51</em>(3), 253-264. <a href="https://doi.org/10.1080/00224499.2013.829795">https://doi.org/10.1080/00224499.2013.829795</a></p> <p>West, C. (2019). Pornography and ethics: An interview with porn performer Blath. <em>Porn Studies</em>, <em>6</em>(2), 264–267. <a href="https://doi.org/10.1080/23268743.2018.1505540">https://doi.org/10.1080/23268743.2018.1505540</a></p> <p>Williams, L. (1989). <em>Hard Core: Power, pleasure, and the frenzy of the visible</em>. University of California Press.</p> 2022-10-24T00:00:00+02:00 Copyright (c) 2022 DOCA - Database of Variables for Content Analysis https://www.hope.uzh.ch/doca/article/view/3873 Performer Demographics (Portrayals of Sexuality in Pornography) 2022-10-22T15:10:51+02:00 Nicola Döring nicola.doering@tu-ilmenau.de Dan J. Miller daniel.miller1@jcu.edu.au <p>Pornography is a <em>fictional media genre</em> that depicts <em>sexual</em> <em>fantasies</em> and explicitly presents naked bodies and sexual activities for the purpose of sexual arousal (Williams, 1989; McKee et al., 2020). Regarding media ethics and media effects, pornography has traditionally been viewed as highly problematic. Pornographic material has been accused of portraying sexuality in unhealthy, morally questionable and often sexist ways, thereby harming performers, audiences, and society at large. In the age of the Internet, pornography has become more diverse, accessible, and widespread than ever (Döring, 2009; Miller et al., 2020). Consequently, the depiction of sexuality in pornography is the focus of a growing number of content analyses of both mass media (e.g., erotic and pornographic novels and movies) and social media (e.g., erotic and pornographic stories, photos and videos shared via online platforms). Typically, <em>pornography’s portrayals of sexuality</em> are examined by measuring the prevalence and frequency of sexual practices or relational dynamics and related gender roles via quantitative content analysis (for research reviews see Carrotte et al., 2020; Miller &amp; McBain, 2022). This entry focuses on the representation of <em>performer demographics</em> (such as sex/gender, age, and race/ethnicity) as one of eight important dimensions of the portrayals of sexuality in pornography.</p> <p> </p> <p><strong><em>Field of application/theoretical foundation:</em></strong></p> <p>In the field of pornographic media content research, different theories are used, mainly 1) general media effects theories, 2) sexual media effects theories, 3) gender role, feminist and queer theories, 4) sexual fantasy and desire theories, and different 5) mold theories versus mirror theories. The DOCA entry “<a href="https://doi.org/10.34778/5k">Conceptual Overview (Portrayals of Sexuality in Pornography)</a>” introduces all these theories and explains their application to pornography. The respective theories are applicable to the analysis of the depiction of performer demographics as one dimension of portrayals of sexuality in pornography.</p> <p> </p> <p><strong><em>References/combination with other methods of data collection:</em></strong></p> <p>Manual quantitative content analyses of pornographic material can be combined with qualitative (e.g., Keft-Kennedy, 2008) as well as computational (e.g., Seehuus et al., 2019) content analyses. Furthermore, content analyses can be complemented with qualitative interviews and quantitative surveys to investigate perceptions and evaluations of the portrayals of sexuality in pornography among pornography’s creators and performers (e.g., West, 2019) and audiences (e.g., Cowan &amp; Dunn, 1994; Hardy et al., 2022; Paasoonen, 2021; Shor, 2022). Additionally, experimental studies are helpful to measure directly how different dimensions of pornographic portrayals of sexuality are perceived and evaluated by recipients, and if and how these portrayals can affect audiences’ sexuality-related thoughts, feelings, and behaviors (e.g., Kohut &amp; Fisher, 2013; Miller et al., 2019).</p> <p> </p> <p><strong><em>Example studies for manual quantitative content analyses:</em></strong></p> <p>Common research hypotheses in relation to performer demographics state that pornography portrays sexuality in a <em>sexist</em> manner entailing violence towards and degradation of women, usually perpetrated by men. In addition, it is hypothesized that pornographic portrayals of sexuality are <em>asymmetric</em> in terms of showing men in superior and dominating, and women in subordinate and submissive, positions. This sex/gender asymmetry can be reflected in demographic variables such as social status (difference) or age (difference). Furthermore, mainstream pornography is critized for its <em>racist</em> portrayal of sexuality. This means that non-White performers are underrepresented and if they are represented are often depicted according to racial/ethnic stereotypes. To test such hypotheses and code pornographic material accordingly, it is necessary to clarify demographic concepts such as sex/gender, age, and race/ethnicity and use valid and reliable measures.</p> <p>It is important to note that in the context of pornographic content research, researchers conceptualize demographic characteristics differently and that two different approaches to coding are available: Direct coding based on the person’s appearance (e.g., apparent sex/gender, age or skin color) versus indirect coding based on meta-information about the material, such as the sub-genre category the material belongs to (e.g., pornography category “Asian” displaying Asian-looking performers or “Teen” displaying adult performers who look very young). If applying an intersectional theoretical framework (see DOCA entry “<a href="https://doi.org/10.34778/5k">Conceptual Overview (Portrayals of Sexuality in Pornography)</a>”) the researcher would need to code each performer in terms of multiple demographic variables.</p> <p> </p> <div style="overflow-x: auto;"> <table> <tbody> <tr> <td class="t b"> <p><strong>Coding Material</strong></p> </td> <td class="t b"> <p><strong>Measure</strong></p> </td> <td class="t b"> <p><strong>Operationalization (excerpt)</strong></p> </td> <td class="t b"> <p><strong>Reliability</strong></p> </td> <td class="t b"> <p><strong>Source</strong></p> </td> </tr> <tr> <td style="width: 656.898px;" colspan="5"> <p><strong><em>Sex/gender: </em></strong>Most analyses of the way sexuality is portrayed in pornography hypothesize (or, at least, acknowledge the possibility) that men and women are depicted differently (e.g., that men are more likely to be depicted as the perpetrators of violent behaviors and that women are more likely to be depicted as recipients of violent behaviors). Accordingly, coding the sex/gender of performers is often essential to addressing research questions in this area. The term <em>gender</em> is often preferred when referring to people as groups, as gender reflects a social categorization, whereas <em>sex</em> reflects a biological categorization (American Psychological Association, 2020). While many content analyses of pornography address sex/gender differences they do not present any standardized measures for the demographic variable of sex/gender. The measure presented below is one of the rare exceptions, but it remains vague in its coding instructions and the meanings of the value “other”.</p> </td> </tr> <tr> <td class="t b"> <p>N=50 segments (length 20 min. each) from a random sample of 50 bestselling pornographic films (1 segment per film) depicting a total of 1,109 sexual behaviors</p> </td> <td class="t b"> <p>Sex/gender (based on performer appearance)</p> </td> <td class="t b"> <p>“Coder’s perception of character’s sex based on primary and secondary sex characteristics.” Polytomous coding (1: male; 2: female; 3: other).</p> </td> <td class="t b"> <p>Cohen’s Kappa: 1.0</p> </td> <td class="t b"> <p>Willis et al. (2020)</p> </td> </tr> <tr> <td style="width: 656.898px;" colspan="5"> <p><strong><em>Age:</em></strong> Performer age may be a variable of interest in its own right (e.g., if investigating whether pornography has a bias toward depicting performers in their early 20s). Alternatively, performer age may be recorded to investigate differential depictions by age group (e.g., investigating whether younger female performers are more likely to be depicted as submissive than older female performers). It should be noted that a performer’s age may be different to their character’s age (as is often the case in the legal pornography category “Teen”, where young characters are played by adult performers; Willis et al, 2020). It should be noted that reliable coding of age (of the performer or of the performed character) is difficult as tools such as make-up, costume, lighting, filters can greatly bias impressions. This problem is reflected in the available measures that cannot ensure sufficient reliability.</p> </td> </tr> <tr> <td class="t b"> <p>N=50 best-selling pornographic videos and DVDs in Australia in 2003 with 838 sexual scenes</p> </td> <td class="t b"> <p>Age of performer (based on performer appearance)</p> </td> <td class="t b"> <p>Performer age. Polytomous coding (1: 18-30 years; 2: 31-40 years; 3: 41-50 years; 4: 51+ years).</p> </td> <td class="t b"> <p>Not available</p> </td> <td class="t b"> <p>McKee et al. (2008)</p> </td> </tr> <tr> <td class="t b"> <p>N=50 segments (length 20 min. each) from a random sample of 50 bestselling pornographic films (1 segment per film) depicting a total of 1,109 sexual behaviors</p> </td> <td class="t b"> <p>Age of character (based on character appearance)</p> </td> <td class="t b"> <p>“Coder’s perception of character’s age—not the actor’s—based on physical appearance.” Note: some characters were clearly intended to be under 18 years of age, but their actors were likely older. Polytomous coding (1: &lt;18; 2: 18-20; 3: 21-30; 4: 31-40; 5: 41-50; 6: &gt;50 years).</p> </td> <td class="t b"> <p>Cohen’s Kappa: .47</p> </td> <td class="t b"> <p>Willis et al. (2020)</p> </td> </tr> <tr> <td style="width: 656.898px;" colspan="5"> <p><strong><em>Race/Ethnicity: </em></strong>Critical analyses of racism in pornography address the mere visibility of different races/ethnicities as well as racial/ethnic stereotypes, such as Black men being depicted as sexually aggressive and well-endowed or Asian women being depicted as petite, submissive and docile (Miller &amp; McBain, 2022).</p> </td> </tr> <tr> <td class="t b"> <p>N=269 popular pornographic videos from different PornHub.com sub-genre categories</p> </td> <td class="t b"> <p>Race/ethnicity (based on pornographic sub-genre category)</p> </td> <td class="t b"> <p>Videos selected/coded according to race/ethnicity-related sub-genre categories on PornHub. Polytomous coding (1: “Asian/Japanese” PornHub categeory; 2: “Interracial” PornHub category; 3: “Ebony” PornHub category; 4: “Latina” PornHub category).</p> </td> <td class="t b"> <p>Not applicable</p> </td> <td class="t b"> <p>Shor &amp; Seida (2019)</p> </td> </tr> <tr> <td class="t b"> <p>N=45 pornographic videos from 15 different adult websites (3 videos per website)</p> </td> <td class="t b"> <p>Race/ethnicity (based on performer appearance)</p> </td> <td class="t b"> <p>Performers coded according to physical appearance. Binary coding (1: White; 2: non-White/other race).</p> </td> <td class="t b"> <p>Not available</p> </td> <td class="t b"> <p>Gorman et al. (2010)</p> </td> </tr> <tr> <td class="t b"> <p>N=50 segments (length 20 min. each) from a random sample of 50 bestselling pornographic films (1 segment per film) depicting a total of 1,109 sexual behaviors</p> </td> <td class="t b"> <p>Race/ethnicity (based on performer appearance)</p> </td> <td class="t b"> <p>“Coder’s perception of character’s race based on physical appearance.” Polytomous coding (1: White; 2: Black; 3: Asian; 4: Latina/o; 5: Native American; 6: other).</p> </td> <td class="t b"> <p>Cohen’s Kappa: .94</p> </td> <td class="t b"> <p>Willis et al. (2020)</p> </td> </tr> </tbody> </table> </div> <p><br /><strong>References</strong></p> <p>American Psychological Association. (2020). <em>P</em><em>ublication manual of the American Psychological Association</em> (7th ed.).</p> <p>Carrotte, E. R., Davis, A. C., &amp; Lim, M. S. (2020). Sexual behaviors and violence in pornography: Systematic review and narrative synthesis of video content analyses. <em>Journal of Medical Internet Research</em>, <em>22</em>(5), Article e16702. <a href="https://doi.org/10.2196/16702">https://doi.org/10.2196/16702</a></p> <p>Cowan, G., &amp; Dunn, K. F. (1994). What themes in pornography lead to perceptions of the degradation of women? <em>Journal of Sex Research</em>, <em>31</em>(1), 11–21. <a href="https://doi.org/10.1080/00224499409551726">https://doi.org/10.1080/00224499409551726</a></p> <p>Döring, N. (2009). The Internet’s impact on sexuality: A critical review of 15 years of research. <em>Computers in Human Behavior</em>, <em>25</em>(5), 1089–1101. <a href="https://doi.org/10.1016/j.chb.2009.04.003">https://doi.org/10.1016/j.chb.2009.04.003</a></p> <p>Gorman, S., Monk-Turner, E., &amp; Fish, J. N. (2010). Free adult internet web sites: How prevalent are degrading acts? <em>Gender Issues</em>, <em>27</em>(3-4), 131–145. <a href="https://doi.org/10.1007/s12147-010-9095-7">https://doi.org/10.1007/s12147-010-9095-7</a></p> <p>Hardy, J., Kukkonen, T., &amp; Milhausen, R. (2022). Examining sexually explicit material use in adults over the age of 65 years. <em>The Canadian Journal of Human Sexuality</em>, <em>31</em>(1), 117–129. <a href="https://doi.org/10.3138/cjhs.2021-0047">https://doi.org/10.3138/cjhs.2021-0047</a></p> <p>Keft-Kennedy, V. (2008). Fantasising masculinity in Buffyverse slash fiction: Sexuality, violence, and the vampire. <em>Nordic Journal of English Studies</em>, <em>7</em>(1), 49–80.</p> <p>Kohut, T., &amp; Fisher, W. A. (2013). The impact of brief exposure to sexually explicit video clips on partnered female clitoral self-stimulation, orgasm and sexual satisfaction. <em>The Canadian Journal of Human Sexuality</em>, <em>22</em>(1), 40–50. <a href="https://doi.org/10.3138/cjhs.935">https://doi.org/10.3138/cjhs.935</a></p> <p>McKee, A. (2015). Methodological issues in defining aggression for content analyses of sexually explicit material. <em>Archives of Sexual Behavior</em>, <em>44</em>(1), 81–87. <a href="https://doi.org/10.1007/s10508-013-0253-3">https://doi.org/10.1007/s10508-013-0253-3</a></p> <p>McKee, A., Byron, P., Litsou, K., &amp; Ingham, R. (2020). An interdisciplinary definition of pornography: Results from a global Delphi panel. <em>Archives of Sexual Behavior</em>, <em>49</em>(3), 1085–1091. <a href="https://doi.org/10.1007/s10508-019-01554-4">https://doi.org/10.1007/s10508-019-01554-4</a></p> <p>Miller, D. J., &amp; McBain, K. A. (2022). The content of contemporary, mainstream pornography: A literature review of content analytic studies. <em>American Journal of Sexuality Education</em>, <em>17</em>(2), 219–256. <a href="https://doi.org/10.1080/15546128.2021.2019648">https://doi.org/10.1080/15546128.2021.2019648</a></p> <p>Miller, D. J., McBain, K. A., &amp; Raggatt, P. T. F. (2019). An experimental investigation into pornography’s effect on men’s perceptions of the likelihood of women engaging in porn-like sex. <em>Psychology of Popular Media Culture</em>, <em>8</em>(4), 365–375. <a href="https://doi.org/10.1037/ppm0000202">https://doi.org/10.1037/ppm0000202</a></p> <p>Miller, D. J., Raggatt, P. T. F., &amp; McBain, K. (2020). A literature review of studies into the prevalence and frequency of men’s pornography use. <em>American Journal of Sexuality Education</em>, <em>15</em>(4), 502–529. <a href="https://doi.org/10.1080/15546128.2020.1831676">https://doi.org/10.1080/15546128.2020.1831676</a></p> <p>Paasonen, S. (2021). “We watch porn for the fucking, not for romantic tiptoeing”: Extremity, fantasy and women’s porn use. <em>Porn Studies</em>, 1–14. <a href="https://doi.org/10.1080/23268743.2021.1956366">https://doi.org/10.1080/23268743.2021.1956366</a></p> <p>Seehuus, M., Stanton, A. M., &amp; Handy, A. B. (2019). On the content of "real-world" sexual fantasy: Results from an analysis of 250,000+ anonymous text-based erotic fantasies. <em>Archives of Sexual Behavior</em>, <em>48</em>(3), 725–737. <a href="https://doi.org/10.1007/s10508-018-1334-0">https://doi.org/10.1007/s10508-018-1334-0</a></p> <p>Shor, E. (2022). Who seeks aggression in pornography? Findings from interviews with viewers. <em>Archives of Sexual Behavior</em>, <em>51</em>(2), 1237–1255. <a href="https://doi.org/10.1007/s10508-021-02053-1">https://doi.org/10.1007/s10508-021-02053-1</a></p> <p>Shor, E., &amp; Seida, K. (2019). "Harder and harder"? Is mainstream pornography becoming increasingly violent and do viewers prefer violent content? <em>Journal of Sex Research</em>, <em>56</em>(1), 16–28. <a href="https://doi.org/10.1080/00224499.2018.1451476">https://doi.org/10.1080/00224499.2018.1451476</a></p> <p>West, C. (2019). Pornography and ethics: An interview with porn performer Blath. <em>Porn Studies</em>, <em>6</em>(2), 264–267. <a href="https://doi.org/10.1080/23268743.2018.1505540">https://doi.org/10.1080/23268743.2018.1505540</a></p> <p>Williams, L. (1989). <em>Hard Core: Power, pleasure, and the frenzy of the visible</em>. University of California Press.Willis, M., Canan, S. N., Jozkowski, K. N., &amp; Bridges, A. J. (2020). Sexual consent communication in best-selling pornography films: A content analysis. Journal of Sex Research, 57(1), 52–63. <a href="https://doi.org/10.1080/00224499.2019.1655522">https://doi.org/10.1080/00224499.2019.1655522</a></p> 2022-10-24T00:00:00+02:00 Copyright (c) 2022 DOCA - Database of Variables for Content Analysis