Scoring System Improvements to Three Leadership Predictors
U.S. Army Research Institute for the Behavioral and Social Sciences, 1997 - Command of troops
"This project sought to examine and improve the reliability of the scoring systems for three instruments which have been used in previous Army leadership research. Review of existing literature and interviews with project staff participating in prior research provided initial information concerning the strengths and weaknesses of the scoring systems for the three instruments. This information was used to recommend modifications to the original scoring systems. Six individuals were trained to use the modified scoring systems. The modified scoring systems were evaluated by rescoring responses randomly selected from the sample which had been scored according to the scoring systems originally developed for the leadership research program. Reliability estimates for the three modified scoring systems were consistently strong and showed improvements over those obtained through the original scoring systems. Interrater agreement indices were significant for nearly all ratings. Validity estimates provided evidence that each modified instrument was moderately to highly correlated with conceptually similar scores generated through the original scoring scheme. The report recommends use of the revised rating systems in future research to improve the quality of measurement from the three predictors."--DTIC.
What people are saying - Write a review
We haven't found any reviews in the usual places.
analysis sample Archival data set Archival scores arms or hands Army Research Institute average originality average quality CAM1 CAM2 categorization scheme composite scores Consequences Scores considerations explicitly cited Creativity scale Dataset 3 Dataset Dataset 4 Mean Demonstration and Archival Demonstration data set Demonstration study Descriptive Statistics developed dimensions discussion Duplicate Response external variables grammatically correct Guilford and Guilford headline format Headline is grammatically Ideational Fluency scale impact interrater agreement Interrater reliability Irrelevant Response leader achievement leadership model leadership research Mean S.D. Mean Mean S.D. Rater Military Scenarios instrument modified scoring systems Mumford obvious and remote org-oriented original headline overall Presentation scale Problem Construction scale Raters 2 Raters ratings recommended remote response restatement or information rewritten headline S.D. Mean S.D. sample responses scenario description score distribution characteristics scorer training scoring scales standard deviation Table three instruments three scorers total number U.S. Army Research validity verbal reasoning Writing Skill score