ReCal (”Reliability Calculator”) is an online utility that computes intercoder/interrater reliability coefficients for nominal, ordinal, interval, or ratio-level data. It is compatible with Excel, SPSS, STATA, OpenOffice, Google Docs, and any other database, spreadsheet, or statistical application that can export comma-separated (CSV), tab-separated (TSV), or semicolon-delimited data files.
ReCal consists of three autonomous modules each specialized for different types of data. The following table will help you select the module that best fits your data. (If you do not know whether your data are considered nominal, ordinal, interval, or ratio, please consult this Wikipedia article to find out more about these levels of measurement.)
|Level of measurement||N of coders||Use|
|Nominal||2 coders only||ReCal2 (includes percent agreement, Scott’s pi, Cohen’s kappa, and nominal Krippendorff’s alpha)|
|Nominal||3 or more coders||ReCal3 (includes pairwise percent agreement, Fleiss’ kappa, pairwise Cohen’s kappa, and nominal Krippendorff’s alpha)|
|Ordinal, interval, or ratio||Any N of coders||ReCal OIR (includes ordinal, interval, and ratio Krippendorff’s alpha)|
Please visit the ReCal FAQ/troubleshooting page if you have questions or are experiencing difficulty getting ReCal to work with your data. If you still have questions please contact me directly rather than leaving a comment.
Please cite one or both of the following articles as appropriate when including ReCal output in any published work. PDFs of both are linked to the references below.
ReCal’s source code was last updated on 01/15/2013. To date, ReCal (2, 3, and OIR combined) has been successfully executed a total of times by persons other than the developer.