Is there a function in R that calculates kappa for more than two raters, more than two ratings, and varying...
I have a data set that has around 40 subjects, who are rated by either 2 or 3 people. Each rater evaluates several questions and can give a rating from 0-4 for each. I want to run a kappa for each question, but there are more than two rating possibilities and a varying number of raters on each subject.
I've found a way to run this in STATA (https://www.stata.com/help13.cgi?kappa last example) but I need a CI or standard error calculation. Is there a way to get this in (preferably) R or SAS/STATA?
r sas stata
edited Dec 27 at 17:07
Pearly Spencer
9,909173358
asked Dec 27 at 14:24
Mircea_cel_Batran
126
put on hold as off-topic by MichaelChirico, Nick Cox, Pearly Spencer, Roland, tink Dec 27 at 18:39
This question appears to be off-topic. The users who voted to close gave this specific reason:
- "Questions asking us to recommend or find a book, tool, software library, tutorial or other off-site resource are off-topic for Stack Overflow as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it." – MichaelChirico, Nick Cox, Pearly Spencer, tink
If this question can be reworded to fit the rules in the help center, please edit the question.
add a comment |
I have a data set that has around 40 subjects, who are rated by either 2 or 3 people. Each rater evaluates several questions and can give a rating from 0-4 for each. I want to run a kappa for each question, but there are more than two rating possibilities and a varying number of raters on each subject.
I've found a way to run this in STATA (https://www.stata.com/help13.cgi?kappa last example) but I need a CI or standard error calculation. Is there a way to get this in (preferably) R or SAS/STATA?
r sas stata
edited Dec 27 at 17:07
Pearly Spencer
9,909173358
asked Dec 27 at 14:24
Mircea_cel_Batran
126
put on hold as off-topic by MichaelChirico, Nick Cox, Pearly Spencer, Roland, tink Dec 27 at 18:39
This question appears to be off-topic. The users who voted to close gave this specific reason:
- "Questions asking us to recommend or find a book, tool, software library, tutorial or other off-site resource are off-topic for Stack Overflow as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it." – MichaelChirico, Nick Cox, Pearly Spencer, tink
If this question can be reworded to fit the rules in the help center, please edit the question.
Bootstrap the calculation.
– Nick Cox
Dec 27 at 14:49
add a comment |
I have a data set that has around 40 subjects, who are rated by either 2 or 3 people. Each rater evaluates several questions and can give a rating from 0-4 for each. I want to run a kappa for each question, but there are more than two rating possibilities and a varying number of raters on each subject.
I've found a way to run this in STATA (https://www.stata.com/help13.cgi?kappa last example) but I need a CI or standard error calculation. Is there a way to get this in (preferably) R or SAS/STATA?
r sas stata
edited Dec 27 at 17:07
Pearly Spencer
9,909173358
asked Dec 27 at 14:24
Mircea_cel_Batran
126
I have a data set that has around 40 subjects, who are rated by either 2 or 3 people. Each rater evaluates several questions and can give a rating from 0-4 for each. I want to run a kappa for each question, but there are more than two rating possibilities and a varying number of raters on each subject.
I've found a way to run this in STATA (https://www.stata.com/help13.cgi?kappa last example) but I need a CI or standard error calculation. Is there a way to get this in (preferably) R or SAS/STATA?
r sas stata
r sas stata
edited Dec 27 at 17:07
Pearly Spencer
9,909173358
asked Dec 27 at 14:24
Mircea_cel_Batran
126
edited Dec 27 at 17:07
Pearly Spencer
9,909173358
asked Dec 27 at 14:24
Mircea_cel_Batran
126
edited Dec 27 at 17:07
Pearly Spencer
9,909173358
edited Dec 27 at 17:07
Pearly Spencer
9,909173358
edited Dec 27 at 17:07
Pearly Spencer
9,909173358
9,909173358
asked Dec 27 at 14:24
Mircea_cel_Batran
126
asked Dec 27 at 14:24
Mircea_cel_Batran
126
asked Dec 27 at 14:24
Mircea_cel_Batran
126
126
put on hold as off-topic by MichaelChirico, Nick Cox, Pearly Spencer, Roland, tink Dec 27 at 18:39
This question appears to be off-topic. The users who voted to close gave this specific reason:
- "Questions asking us to recommend or find a book, tool, software library, tutorial or other off-site resource are off-topic for Stack Overflow as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it." – MichaelChirico, Nick Cox, Pearly Spencer, tink
If this question can be reworded to fit the rules in the help center, please edit the question.
put on hold as off-topic by MichaelChirico, Nick Cox, Pearly Spencer, Roland, tink Dec 27 at 18:39
This question appears to be off-topic. The users who voted to close gave this specific reason:
- "Questions asking us to recommend or find a book, tool, software library, tutorial or other off-site resource are off-topic for Stack Overflow as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it." – MichaelChirico, Nick Cox, Pearly Spencer, tink
If this question can be reworded to fit the rules in the help center, please edit the question.
Bootstrap the calculation.
– Nick Cox
Dec 27 at 14:49
add a comment |
Bootstrap the calculation.
– Nick Cox
Dec 27 at 14:49
Bootstrap the calculation.
– Nick Cox
Dec 27 at 14:49
Bootstrap the calculation.
– Nick Cox
Dec 27 at 14:49
add a comment |
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
Bootstrap the calculation.
– Nick Cox
Dec 27 at 14:49