ReCal (”Reliability Calculator”) is an online utility that computes intercoder/interrater reliability coefficients for nominal, ordinal, interval, or ratio-level data. It is compatible with Excel, SPSS, STATA, OpenOffice, Google Docs, and any other database, spreadsheet, or statistical application that can export comma-separated (CSV), tab-separated (TSV), or semicolon-delimited data files.
ReCal consists of three independent modules each specialized for different types of data. The following table will help you select the module that best fits your data. (If you do not know whether your data are considered nominal, ordinal, interval, or ratio, please consult this Wikipedia article to find out more about these levels of measurement.)
|Level of measurement||N of coders||Use|
|Nominal||2 coders only||ReCal2 (includes percent agreement, Scott’s pi, Cohen’s kappa, and nominal Krippendorff’s alpha)|
|Nominal||3 or more coders||ReCal3 (includes pairwise percent agreement, Fleiss’ kappa, pairwise Cohen’s kappa, and nominal Krippendorff’s alpha)|
|Ordinal, interval, or ratio||Any N of coders||ReCal OIR (includes ordinal, interval, and ratio Krippendorff’s alpha)|
Please visit the ReCal FAQ/troubleshooting page if you have questions or are experiencing difficulty getting ReCal to work with your data. If you still have questions please contact me directly rather than leaving a comment.
Want to support ReCal? The best way is with a citation to one or both of the following articles in your final manuscript. PDFs of both are linked below.
ReCal’s source code was last updated on 01/15/2013. To date, ReCal (2, 3, and OIR combined) has been successfully executed a total of times by persons other than the developer.1
1This counter was reset to zero sometime in late 2014 under unknown circumstances. On 2/18/15 I manually reset it to the combined cumulative Google Analytics hit count for ReCal2, ReCal3, and ReCal OIR.