Comments on: ReCal for Ordinal, Interval, and Ratio Data (OIR) http://dfreelon.org Assistant professor, American University School of Communication Sat, 05 May 2012 05:00:23 +0000 hourly 1 http://wordpress.org/?v=3.1.1 By: Ajay Sharma http://dfreelon.org/utils/recalfront/recal-oir/#comment-1943 Ajay Sharma Thu, 13 Oct 2011 09:26:21 +0000 http://dfreelon.org/?page_id=60#comment-1943 Thanx Mr dfreen for providing online help for calculating reliability for content analysis. It’s really wonderful…… for calculating Krippendorff's Alpha. Thanx Mr dfreen for providing online help for calculating reliability for content analysis. It’s really wonderful…… for calculating Krippendorff’s Alpha.

]]> By: Chris Celaya http://dfreelon.org/utils/recalfront/recal-oir/#comment-1839 Chris Celaya Sun, 11 Sep 2011 08:22:14 +0000 http://dfreelon.org/?page_id=60#comment-1839 I'm having trouble understanding the value of the alpha. From what I am able to gather, an alpha closest to 1 means the most reliable, but from what I am able to tell, the number closest to 0 is the one closest to complete reliability in your program. I provided an excel file saved as a CSV and it seemed to run perfectly in the program, and I got a result of -.069. Thinking that negative was inherently bad, I wanted to make sure, so I put in a false set of coding for my 777 fields with only one aberrant answer (776 out of 777 answers were "1", and one of them was "0"), which yielded an alpha of "0", which is why I believe that 0 is your mark for reliability. Please let me know if my understanding is correct. Thank you, Chris- I’m having trouble understanding the value of the alpha. From what I am able to gather, an alpha closest to 1 means the most reliable, but from what I am able to tell, the number closest to 0 is the one closest to complete reliability in your program. I provided an excel file saved as a CSV and it seemed to run perfectly in the program, and I got a result of -.069. Thinking that negative was inherently bad, I wanted to make sure, so I put in a false set of coding for my 777 fields with only one aberrant answer (776 out of 777 answers were “1″, and one of them was “0″), which yielded an alpha of “0″, which is why I believe that 0 is your mark for reliability. Please let me know if my understanding is correct. Thank you, Chris-

]]> By: Tom http://dfreelon.org/utils/recalfront/recal-oir/#comment-1288 Tom Wed, 16 Mar 2011 09:42:09 +0000 http://dfreelon.org/?page_id=60#comment-1288 thx a lot 4 ur calculator. Searched for online and/or offline scripts (SPSS, Matlab, ...), but urs was the fastest and easiest way of calculating Kripp's alpha preventing me from writing my own script.. So thx 4 saving my time and nerves ;) thx a lot 4 ur calculator. Searched for online and/or offline scripts (SPSS, Matlab, …), but urs was the fastest and easiest way of calculating Kripp’s alpha preventing me from writing my own script.. So thx 4 saving my time and nerves ;)

]]> By: Steve http://dfreelon.org/utils/recalfront/recal-oir/#comment-1087 Steve Mon, 14 Feb 2011 19:29:12 +0000 http://dfreelon.org/?page_id=60#comment-1087 Yes that helps, thank you so much! Steve Yes that helps, thank you so much!

Steve

]]> By: dfreelon http://dfreelon.org/utils/recalfront/recal-oir/#comment-1018 dfreelon Wed, 02 Feb 2011 01:23:57 +0000 http://dfreelon.org/?page_id=60#comment-1018 Steve, The math of Krippendorff’s alpha does not take account of variable values that do not actually appear in the data. In other words the fact that your variable had a possible value of 5 does not affect the final value at all; the results will be the same as if 5 was not a possible value. Hope this helps. Steve,

The math of Krippendorff’s alpha does not take account of variable values that do not actually appear in the data. In other words the fact that your variable had a possible value of 5 does not affect the final value at all; the results will be the same as if 5 was not a possible value. Hope this helps.

]]> By: Steve http://dfreelon.org/utils/recalfront/recal-oir/#comment-1016 Steve Wed, 02 Feb 2011 01:15:20 +0000 http://dfreelon.org/?page_id=60#comment-1016 I have collected ordinal data where the coding scheme ranges from 1-5. I want to compute the reliability between two coders for one variable. For example, one coder has the values: 3, 4, 1, 3. The second coder has the values: 3, 4, 1, 2. The highest code, 5, is not listed between either coder. Do all codes have to be represented to obtain an accurate alpha? Thanks! I have collected ordinal data where the coding scheme ranges from 1-5. I want to compute the reliability between two coders for one variable. For example, one coder has the values: 3, 4, 1, 3. The second coder has the values: 3, 4, 1, 2. The highest code, 5, is not listed between either coder. Do all codes have to be represented to obtain an accurate alpha? Thanks!

]]>