ReCal (“Reliability Calculator”) is an online utility that computes intercoder/interrater reliability coefficients for nominal, ordinal, interval, or ratio-level data. It is compatible with Excel, SPSS, STATA, OpenOffice, Google Docs, and any other database, spreadsheet, or statistical application that can export comma-separated (CSV), tab-separated (TSV), or semicolon-delimited data files.
ReCal consists of three independent modules each specialized for different types of data. The following table will help you select the module that best fits your data. (If you do not know whether your data are considered nominal, ordinal, interval, or ratio, please consult this Wikipedia article to find out more about these levels of measurement.)
|Level of measurement||N of coders||Missing data allowed?||Use|
|Nominal||2 coders only||No||ReCal2 (includes percent agreement, Scott’s pi, Cohen’s kappa, and nominal Krippendorff’s alpha)|
|Nominal||2 or more coders||No||ReCal3 (includes pairwise percent agreement, Fleiss’ kappa, pairwise Cohen’s kappa, and nominal Krippendorff’s alpha)|
|Nominal, ordinal, interval, or ratio||Any N of coders||Yes||ReCal OIR (includes nominal, ordinal, interval, and ratio Krippendorff’s alpha with support for missing data)|
Please visit the ReCal FAQ/troubleshooting page if you have questions or are experiencing difficulty getting ReCal to work with your data. If you still have questions please contact me directly rather than leaving a comment.
Want to support ReCal? The best way is with a citation to one or both of the following articles in your final manuscript. PDFs of both are linked below.
ReCal’s source code (which is open-source) was last updated on 05/22/2017. To date, ReCal (2, 3, and OIR combined) has been successfully executed a total of times by persons other than the developer.1
1This counter was reset to zero sometime in late 2014 under unknown circumstances. On 2/18/15 I manually reset it to the combined cumulative Google Analytics hit count for ReCal2, ReCal3, and ReCal OIR.