Tag: reliability

43 Computing Cohen's Kappa variance (and standard errors) 2012-06-17T00:37:51.407

27 Computing repeatability of effects from an lmer model 2011-09-19T18:01:57.400

26 What distribution does my data follow? 2013-05-05T22:53:45.687

24 Inter-rater reliability for ordinal or interval data 2010-10-12T22:48:56.690

22 Is Joel Spolsky's "Hunting of the Snark" post valid statistical content analysis? 2012-08-02T17:21:56.747

14 Assessing reliability of a questionnaire: dimensionality, problematic items, and whether to use alpha, lambda6 or some other index? 2011-06-06T12:32:07.103

14 What are the case studies in public health policy research where unreliable/confounded/invalid studies or models were misused? 2013-08-12T05:31:01.343

13 Where do the descriptors for Cronbach's alpha values come from (e.g., poor, excellent)? 2013-09-17T16:34:41.360

12 Interrater reliability for events in a time series with uncertainty about event time 2010-12-22T15:41:17.387

12 Identification of useless questions from a questionnaire 2014-02-19T16:14:09.987

11 Reliability of a fitted curve? 2016-11-24T17:16:48.980

10 Can one validly reduce the numbers of items in a published Likert-scale? 2010-11-10T12:32:49.143

9 How to reduce number of items using factor analysis, internal consistency, and item response theory in conjunction? 2012-07-17T18:39:37.230

9 How to measure the reliability of a consensus ranking (problem from Kemeny-Snell book) 2014-03-01T00:22:34.967

9 How is the Spearman-Brown prophecy formula affected by questions of differing difficulties? 2014-05-09T17:23:58.933

9 Why is backward elimination justified when doing multiple regression? 2015-05-25T16:18:26.563

9 Accuracy vs. area under the ROC curve 2016-07-22T23:08:54.923

8 Intraclass correlation coefficient vs. F-test (one-way ANOVA)? 2011-04-30T19:02:45.603

8 How to perform inter-rater reliability with multiple raters, different raters per participant, and possible changes over time? 2012-06-25T15:51:42.873

8 How accurate is IQR for detecting outliers 2013-05-28T14:07:15.167

8 Good internal factor structure but poor Cronbach's $\alpha$? 2013-11-20T18:39:19.207

8 What is the relationship between scale reliability measures (Cronbach's alpha etc.) and component/factor loadings? 2014-06-17T15:58:27.003

8 What is Cronbach's Alpha intuitively? 2015-08-11T14:01:06.770

7 Reliability in Elicitation Exercise 2010-07-29T22:03:55.887

7 Reliability of mean of standard deviations 2011-01-20T15:40:31.200

7 Validating an existing questionnaire into another language 2011-02-11T15:52:57.197

7 Can one use Cohen's Kappa for two judgements only? 2011-02-14T17:16:52.580

7 What to do in case of low inter-rater reliability (ICC)? 2011-08-06T18:28:36.560

7 Inter-rater reliability with many non-overlapping raters 2011-08-24T22:23:37.280

7 Computing inter-rater reliability in R with variable number of ratings? 2011-11-16T19:45:30.850

7 Is it acceptable to use Cronbach's alpha to assess reliability of questionnaire composed of categorical and conditional items? 2012-06-18T14:41:39.873

7 What am I measuring when I apply a graded response model to the "Hunting of the Snark" dataset? 2012-08-03T22:07:57.417

7 Omega vs. alpha reliability 2012-10-11T09:07:37.523

7 Handling poor inter-rater reliability while minimizing the loss of data 2013-01-16T14:43:22.800

7 Cronbach's alpha in R 2014-12-16T00:07:46.793

7 How high is too high with Cronbach's alpha? 2015-02-10T06:40:48.727

6 Whether to use EFA or PCA to assess dimensionality of a set of Likert items 2011-06-08T12:57:46.427

6 What methods to use for statistical prediction/forecast of trading data? 2011-08-04T11:29:26.407

6 Cronbach's Alpha with missing data 2013-11-20T14:14:39.060

6 Item reliability or fit in IRT-based adaptive tests? 2014-04-14T21:41:35.613

5 Repeatability and measurement error from and between observers 2010-10-16T01:44:55.913

5 Comparing test-retest reliabilities 2010-10-21T15:48:52.837

5 Assessing rater bias where one rater has given one very high rating and the remainder very low ratings 2011-06-04T14:38:53.370

5 Frequency ratio test with correlation structures 2012-05-19T05:52:24.067

5 What am I supposed to do if Cronbach's alpha is negative? 2012-12-07T06:03:13.403

5 Computing Cronbach's Alpha and Intraclass Correlation coefficient from an lmer model 2013-02-21T18:58:47.610

5 What is the reasoning behind the formulae for the different standard errors of measurement? 2013-05-28T04:49:29.247

5 Cronbach's alpha negative result 2013-06-28T22:49:37.543

5 How can reliability and validity of content analysis be quantified when there is only one person coding the data? 2013-07-16T01:10:12.387

5 How to compare Cronbach's alpha when the grouping variable is continuous? 2014-04-09T23:23:14.930

5 which statistic should I use for inter-rater agreement on nominal data, multiple responses 2014-07-21T03:55:49.607

4 Should I reverse score items before running reliability analyses (item-total correlation) and factor analysis? 2010-09-19T22:35:50.730

4 Inter-rater reliability using Intra-class correlation with ratings for multiple objects on multiple properties 2010-10-27T02:29:31.147

4 How to "prove" that new measurement tool & process gives same result as old? 2010-11-03T13:17:39.483

4 Internal reliability for an ordinal scale 2010-11-18T20:40:16.053

4 General advice on forming an index of attitude to the environment from a set of Likert items 2011-05-06T01:11:14.787

4 How do I determine which set of measurements is better? 2011-06-25T15:58:31.873

4 Intra- and inter-rater reliability on the same data 2011-08-08T20:00:18.480

4 Standard error of measurement versus minimum detectable change 2011-10-26T00:57:59.640

4 Interrater reliability in SPSS 2012-06-06T00:48:56.717

4 Internal consistency reliability in item response theory models 2012-11-12T03:23:00.503

4 Modeling measurement error (reliability?) using repeated measurements 2012-12-08T18:48:33.263

4 Omega H asymptotic 2012-12-29T18:02:06.427

4 Which test to see if two set of continuous data are comparable 2013-07-24T15:23:12.720

4 What is the correct use of Cronbach's alpha? 2013-09-04T18:15:10.760

4 If a measure is valid (but not necesarily reliable), can it be consistently replicated? 2014-02-07T04:37:41.903

4 Can ICC values be negative? 2014-06-06T19:04:23.463

4 Reliability in IRT Style 2015-01-09T00:19:24.910

4 Cronbach's Alpha in Pilot Study: do I need to eliminate items if alpha is already > 0.7 2015-05-14T14:04:59.930

4 Quadratic weighted kappa 2016-11-29T13:30:45.810

3 The best measure of reliability for interval data between 0 and 1 2010-10-19T15:39:13.843

3 Interater reliability 2011-02-28T17:00:48.593

3 How to compute the standard error of measurement (SEM) from a reliability estimate? 2011-04-07T12:36:40.230

3 Implications of communalities close to 1.00 for reliability analysis and survey design 2011-05-22T02:36:46.997

3 Reliability and validity of a standard survey 2011-08-28T12:38:10.903

3 What is the Johnson family of distributions good for? What are their main features and applications? 2012-01-24T16:53:34.280

3 Is it plausible to get a Cronbach's alpha of .85 with only two Likert-type items? 2012-06-20T05:03:45.173

3 Can I use a measure when it has low reliability? 2012-06-27T07:01:28.100

3 Rule of thumb reliability of scales for using manifest variables in path analysis? 2012-09-14T07:54:42.600

3 Inconsistency of findings between Kappa and ICC for IRR study 2012-10-19T09:31:51.697

3 For intraclass correlation coefficients (ICC), interpret both "single" and "average" measured ICC values for reproducibility test? 2012-12-08T07:27:52.420

3 What is the proper test for inter-rater reliability with three raters and ordinal ratings? 2013-01-25T10:46:22.457

3 Validation of a scale for a different population (CFA) 2013-03-10T19:42:22.427

3 Why don't we square the reliability correlation when calculating reliable variance? 2013-05-27T23:50:44.453

3 How can there be a standard deviation of true scores? 2013-05-28T12:36:36.927

3 Reliability engineering: Measuring the proportion of defective products at several time points using the same test units 2013-07-24T14:58:22.287

3 Results of bootstrap reliable? 2013-08-10T16:36:20.353

3 How do I calculate reliability between an algorithm and multiple human experts? 2013-09-13T16:36:09.693

3 How does reliability and validity affect the results (descriptive statistics)? 2013-12-29T20:34:28.647

3 Why change items which don't change Cronbach Alpha? 2014-05-14T19:07:34.733

3 Sample selection algorithms to ensure that training & validation sets are representative 2014-10-11T14:54:32.973

3 Probability that node A is connected to another node 2014-10-28T20:38:19.787

3 Mysterious results from likelihood ratio confidence bounds on a Weibull reliability estimate 2016-02-17T14:18:51.140

3 Cronbach's alpha vs. Average Item-Sum correlation? 2016-04-18T13:42:10.567

3 Why do Split-Half reliability estimation and related methods use a correlation coefficient, rather than a coefficient of determination? 2016-11-07T21:08:06.867

3 Sample Size Determination for Inter- and Intra-rater Reliability 2016-12-14T14:07:48.703

3 Why do we need second rate of failure even though we have already hazard function? 2017-03-24T14:06:57.790

3 How to calculate Cronbach's alpha for instrument that presents every test item twice in an administration? 2017-06-13T15:54:20.430

2 Inter-rater reliability between similarity matrices 2010-10-20T19:57:52.263