org.dllearner.utilities.statistics
Class FleissKappa

java.lang.Object
  org.dllearner.utilities.statistics.FleissKappa

public class FleissKappa
extends Object

Computes the Fleiss' Kappa value as described in (Fleiss, 1971). Fleiss' Kappa is a statistical measure for assessing the reliability of agreement between a fixed number of raters when assigning categorical ratings to a number of items or classifying items.

Constructor Summary

FleissKappa()

Method Summary

static float	computeKappa(short[][] mat) Computes the Kappa value
static String	getInterpretation(float kappa) Landis and Koch (1977) gave the following table for interpreting κ values.
static void	main(String[] args) Example from Wikipedia article

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FleissKappa

public FleissKappa()

Method Detail

main

public static void main(String[] args)

Example from Wikipedia article

computeKappa

public static float computeKappa(short[][] mat)

Computes the Kappa value

Parameters:

n - Number of rating per subjects (number of human raters)

mat - Matrix[subjects][categories]

Returns:

The Kappa value

getInterpretation

public static String getInterpretation(float kappa)

Landis and Koch (1977) gave the following table for interpreting κ values. This table is however by no means universally accepted; They supplied no evidence to support it, basing it instead on personal opinion. It has been noted that these guidelines may be more harmful than helpful, as the number of categories and subjects will affect the magnitude of the value. The kappa will be higher when there are fewer categories. (Wikipedia)

Parameters:

kappa - The Kappa value