[Rasch] PISA critique in TES

Adams, Ray Ray.Adams at acer.edu.au
Sat Sep 27 12:08:14 EST 2014


We have always shown things like range of possible ranks, standard errors and so on. We've also reported the effects of item selection and all data collected is publicly accessible for others to scrutinise.

Morrison dismisses all latent variable models kreiner says throw away everything that doesn't fit rasch perfectly and Goldstein says we throw away too much

Oh, and the comments about plausible values are just statistical naïveté, believe them and NAEP would have to be scrapped as would any statistical methods that use montecarlo estimation, the theory of which was regarded as sound last time I looked.

I love this criticism, it shows pisa is important. Putting energy into criticising it is good, I just wish genuine problems were uncovered and addressed. Goldstein does best on that front, I too would love longitudinal components and more finer grained analyses of subsets of items


Sent from my iPhone

On 27 Sep 2014, at 11:13 am, Mike Linacre <mike at winsteps.com<mailto:mike at winsteps.com>> wrote:

Thanks, T.

That article, and the comments following it, suggest to me that PISA results should be reported as box-and-whisker plots, not rankings. Then every country could choose to be at the top of its own whisker ....

Or perhaps PISA already do this??

Mike Linacre

On 9/27/2014 10:18 AM, Bond, Trevor wrote:


Rasch mailing list
email: Rasch at acer.edu.au<mailto:Rasch at acer.edu.au>
web: https://mailinglist.acer.edu.au/mailman/options/rasch/ray.adams%40acer.edu.au
-------------- next part --------------
An HTML attachment was scrubbed...
URL: https://mailinglist.acer.edu.au/pipermail/rasch/attachments/20140927/487f2ae2/attachment.html 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ATT00001.png
Type: image/png
Size: 3391 bytes
Desc: ATT00001.png
Url : https://mailinglist.acer.edu.au/pipermail/rasch/attachments/20140927/487f2ae2/attachment.png 

More information about the Rasch mailing list