[Rasch] What does this item represent?

[Fidelman, Carolyn]

Hi Edward,

Thanks very much for your response! One thing to note is that this is asked in the spring, anywhere from February to June. That is the reliability issue. Recollection 5-10 months after the fact. But also, I guess my reason for calling it also a validity question is about the construct it would measure. I realize it is intended to measure something to the effect of "child's disposition toward school attendance".  But we aren't asking the child directly or even doing a direct observation. It is the parent who is asked. When asked of the parent anywhere from 5-10 months after the fact, also doesn't it really become "parent's feeling about effort in obtaining child compliance with request to attend school"?

Also, someone off line mentions creating a Rasch scale. Oh if only! At this point it is only about score or variable use.  Thanks again for your thoughts on this!

Carolyn

From: Edward Li <edwardfli at hotmail.com>
Sent: Saturday, May 16, 2020 4:01 AM
To: Fidelman, Carolyn <Carolyn.Fidelman at ed.gov>; rasch at acer.edu.au
Subject: Re: What does this item represent?

Hi Carolyn,

I'm not sure if it's really a validity question as you've pointed out that it's about whether the indicator is "reliable enough or similar enough". I guess it's not as good as observing it during the course of two months but if it's too late to add this question to the survey and you think it's really important to know the answer to this question to assess the construct then including this question is better than nothing. The item stats for this question after data collection would give you some idea about how good or useful this item is.

Cheers,

Edward
________________________________
From: Rasch <rasch-bounces at acer.edu.au<mailto:rasch-bounces at acer.edu.au>> on behalf of Fidelman, Carolyn <Carolyn.Fidelman at ed.gov<mailto:Carolyn.Fidelman at ed.gov>>
Sent: Saturday, 16 May 2020 1:06 AM
To: rasch at acer.edu.au<mailto:rasch at acer.edu.au> <rasch at acer.edu.au<mailto:rasch at acer.edu.au>>
Subject: [Rasch] What does this item represent?


Hi All,



Rather than a technical question about Rasch modeling, I would like to ask more of a construct validity question or variable classification question (for a friend of course).  Would you say that the following item represents a latent construct (likely to be used in a scale) or is it observational in your opinion (and can be used as a variable on its own)?



On average, during the first two months of this school year did your child complain about school more than once a week, once a week or less, or not at all?

In other words, is a parent's retrospective report of a child behavior in a survey generally considered reliable enough or similar enough to a survey that asks a parent to observe their child over the course of two months and report back on the number of times they saw the behavior such that it qualifies as an observational variable on its own?





Carolyn



Carolyn G. Fidelman, Ph.D.
Study Director, Psychometrician
National Center for Education Statistics
Tel: 202 245 7046
carolyn.fidelman at ed.gov<mailto:carolyn.fidelman at ed.gov>

[cid:image001.png at 01D62CF7.87F4F410]

550 12th Street SW
Washington, DC 20202


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailinglist.acer.edu.au/pipermail/rasch/attachments/20200518/6d7309ad/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 2995 bytes
Desc: image001.png
URL: <https://mailinglist.acer.edu.au/pipermail/rasch/attachments/20200518/6d7309ad/attachment-0001.png>