Comments on: ReCal2: Reliability for 2 Coders http://dfreelon.org Deen Freelon, associate professor, American University School of Communication Tue, 25 Apr 2017 06:58:44 +0000 hourly 1 http://wordpress.org/?v=4.1.18 By: mona http://dfreelon.org/utils/recalfront/recal2/#comment-134830 Fri, 23 Dec 2016 16:26:08 +0000 http://dfreelon.org/?page_id=17#comment-134830 what if some of the questions are ordinal, some nominal and some ratio? what do I do?

]]>
By: Eileen http://dfreelon.org/utils/recalfront/recal2/#comment-134486 Wed, 11 Nov 2015 14:01:41 +0000 http://dfreelon.org/?page_id=17#comment-134486 This is absolutely perfect! Thanks to much for creating this and making it available!

]]>
By: student http://dfreelon.org/utils/recalfront/recal2/#comment-134475 Sat, 25 Apr 2015 22:36:09 +0000 http://dfreelon.org/?page_id=17#comment-134475 I was wondering if you can help me,
I have:
13 variables
224 participants
2 coders

However, coders can code `1` (i.e., present) across all 13 variables.

This means that Assumption 1 of Cohen`s Kappa is violated.

What do I do…I would appreciate any help. Thank you.

Assumption #1: The response (e.g., judgement) that is made by your two raters is measured on a nominal scale (i.e., either an ordinalor nominal variable) and the categories need to be mutually exclusive. For example, the two raters could be assessing whether a patient’s mole was “normal” or “suspicious” (i.e., two categories); whether the quality of service provided by a customer service agent was “above average”, “average” or “below average” (i.e., three categories); or whether a person’s activity level should be considered “sedentary”, “low”, “medium” or “high” (i.e., four categories). In addition, the categories being assessed by the two raters should be “mutually exclusive”, which means that no categories overlap (e.g., a rater could only consider a patient’s mole to be normal OR suspicious; the mole cannot be normal and suspicious at the same time).

https://statistics.laerd.com/spss-tutorials/cohens-kappa-in-spss-statistics.php

]]>
By: Sytske http://dfreelon.org/utils/recalfront/recal2/#comment-123808 Fri, 03 Oct 2014 23:44:33 +0000 http://dfreelon.org/?page_id=17#comment-123808 Hi Deen,
Thanks for making this calculator! I have the same question as Maria, because my variable is nominal, but has more than two options (Nominal does not necessarily mean binary/dichotomous). Does ReCal2 work with nominal variables that can have more than 2 options?

Thanks in advance for your response, Sytske

]]>
By: Surhita http://dfreelon.org/utils/recalfront/recal2/#comment-123790 Wed, 27 Aug 2014 09:04:43 +0000 http://dfreelon.org/?page_id=17#comment-123790 I have more around 15 different attributes for one variable. It’s an explorative news content analysis!

Was wondering whether there is any limitation on the number of attributes. I do not have 0 value and it is only 1-15.

Also, I hope I can enter 1-7 attributes for first pair of columns and 1-15 attributes for next pair of columns for the two different variables?

Thanks a lot. This is a great device!

]]>
By: Esmeralda http://dfreelon.org/utils/recalfront/recal2/#comment-27992 Fri, 20 Sep 2013 11:01:55 +0000 http://dfreelon.org/?page_id=17#comment-27992 Wow, this is so much easier than getting Krippendorff’s macro working in SPSS (Hayes, A. F., & Krippendorff, K. (2007). Answering the Call for a Standard Reliability Measure for Coding Data. Communication Methods and Measures, 1(1), 77-89.)

Wish I had come a across your tool before. Thanks for building and sharing it!

]]>
By: Tammy Smith http://dfreelon.org/utils/recalfront/recal2/#comment-16978 Sat, 13 Apr 2013 10:29:07 +0000 http://dfreelon.org/?page_id=17#comment-16978 Can you tell me what the confidence interval is for ReCal2?

]]>
By: Jenna http://dfreelon.org/utils/recalfront/recal2/#comment-13545 Fri, 08 Mar 2013 09:44:59 +0000 http://dfreelon.org/?page_id=17#comment-13545 Hello. Thank you for very much for this useful tool.
I am a little bit confused though, and would really appreciate it if someone can confirm that I used this correctly.
Two coders categorized 90 items into 5 categories: 1, 2, 3, 4, or 5.
So, column 1 has all the categorizations of coder 1. And column 2 has all the categorizations of coder 2.
Am I doing it right?

]]>
By: Eric http://dfreelon.org/utils/recalfront/recal2/#comment-4672 Sun, 20 May 2012 15:24:10 +0000 http://dfreelon.org/?page_id=17#comment-4672 very good maybe

]]>
By: Maria http://dfreelon.org/utils/recalfront/recal2/#comment-2578 Sun, 22 Jan 2012 14:36:28 +0000 http://dfreelon.org/?page_id=17#comment-2578 i am testing intercoder reliability on 15 variables

most of the variables will be coded as 0 or 1

however 2 of the variables have 3 possible answers coded as 1 or 2 or 3

can these latter 2 variables be tested in the same way?

thanks!

]]>