[Rasch] Use of Rasch to a two-item scale
Bond, Trevor
trevor.bond at jcu.edu.au
Wed Mar 12 18:56:10 EST 2014
It might depend onwhich thresholds you used for the PCM analysis,
taus need can be disordered, but Thurstone style thresholds (from Masters' own work) MUST order.
Sent from 007's iPad
On 12 Mar 2014, at 3:21 am, "Kenji Yamazaki" <kyamazaki at acgme.org<mailto:kyamazaki at acgme.org>> wrote:
The fit indexes ranges from .94 to 1.01, which I believe is a good indication.
Table 7.4.1 Itm Measurement Report (arranged by 4MN).
+---------------------------------------------------------------------------------------------------------+
| Total Total Obsvd Fair-M| Model | Infit Outfit |Estim.| Corr. | |
| Score Count Average Avrage|Measure S.E. | MnSq ZStd MnSq ZStd|Discrm| PtBis | N Itm |
|-------------------------------+--------------+---------------------+------+-------+---------------------|
| 7099 1846 3.9 3.89| -.53 .05 | 1.01 .1 .99 -.3| .99 | .62 | 1 comp5_PR_Q1 |
| 6351 1846 3.5 3.39| .53 .04 | .95 -1.3 .94 -1.7| 1.02 | .62 | 2 comp5_PR_Q2 |
|-------------------------------+--------------+---------------------+------+-------+---------------------|
| 6725.0 1846.0 3.7 3.64| .00 .04 | .98 -.6 .96 -1.1| | .62 | Mean (Count: 2) |
| 374.0 .0 .2 .25| .53 .00 | .03 .7 .02 .7| | .00 | S.D. (Population) |
| 528.9 .0 .3 .36| .74 .00 | .04 1.0 .04 1.0| | .00 | S.D. (Sample) |
+---------------------------------------------------------------------------------------------------------+
Model, Populn: RMSE .04 Adj (True) S.D. .52 Separation 11.76 Strata 16.02 Reliability .99
Model, Sample: RMSE .04 Adj (True) S.D. .74 Separation 16.66 Strata 22.55 Reliability 1.00
Model, Fixed (all same) chi-square: 278.7 d.f.: 1 significance (probability): .00
-----------------------------------------------------------------------------------------------------------
From: rasch-bounces at acer.edu.au<mailto:rasch-bounces at acer.edu.au> [mailto:rasch-bounces at acer.edu.au] On Behalf Of Kenji Yamazaki
Sent: Tuesday, March 11, 2014 2:12 PM
To: rasch at acer.edu.au<mailto:rasch at acer.edu.au>
Subject: [Rasch] Use of Rasch to a two-item scale
Dear Rasch practitioners,
I have a question about applying the Rasch model to a two-item scale in the following scenario. I am working on a project where I examine psychometric properties of a measurement. I am investigating on one scale called professionalism that consists of only two items. Both two items have 10 rating categories ranging from performance levels 0 through 5. Each category has different behavioral descriptors in the order of difficulty in perform. The sample size is N=1846. This is actually the total number of the population because the compliance rate was 100%.
Here is how I did the analysis. First, I applied the principal complement analysis to this data. The result produced one factor. Then, I applied the Rasch model using person and item as facets with partial credit model. The results show that person reliability was .88 and its separation was 2.67. Also, item reliability was .99 and the separation was 11.76. In addition, no inversion of the category thresholds were not observed for the two items.
Given this situation, I was wondering if the way I did the analysis was legitimate. Also, I wonder if these results are sufficient to state that this two-item scale has so good psychometric properties that there is no need to modify the scale for improvement. My concerns is the number of items (although the sample size is large and the sample is actually the population.) Thank you very much in advance.
Sincerely,
Kenji Yamazaki
________________________________________
Rasch mailing list
email: Rasch at acer.edu.au<mailto:Rasch at acer.edu.au>
web: https://mailinglist.acer.edu.au/mailman/options/rasch/trevor.bond%40jcu.edu.au
-------------- next part --------------
An HTML attachment was scrubbed...
URL: https://mailinglist.acer.edu.au/pipermail/rasch/attachments/20140312/431e4629/attachment.html
More information about the Rasch
mailing list