[Rasch] Models of unidimensional constructs have theirlimitations: what is a "good thing"?
rodstaples at ozemail.com.au
Wed Nov 7 11:46:20 EST 2007
Thank you all for you most interesting and informative discussions over the
past few weeks. Please keep up the kinds of discussion, even if the initial
question seems dumb, because to relative newbies like me it is really
Now its time for me to add my three-penneth to the discussions!
In the physical sciences we have no problem talking about the three
dimensions of physical space, or about the four dimensions of space-time, or
the 11? Dimensions currently associated with string theory. I have no
problem imagining a circumstance in complex human behaviour that needs more
than a single dimension to describe. But in the physical sciences we use
measurements in the physical space, one dimension at a time, to create areas
It seems to me that Rasch modelling is working towards being able to use
this kind of multi-dimensional thinking, but isnt quite ready for it yet.
We have to be able to reliably build a precision, high-resolution measure
(ruler) in one dimension (length), and be able to independently confirm the
scale, and even perhaps the units, against a commonly agreed standard
(like the standard Metre) before we can start constructing multi-dimensional
construct spaces using orthogonal single dimensions. Do we have a standard
ability unit locked away in a vault somewhere, against which our measures
of ability can be compared?
Im happily working on trying to build a uni-dimensional construct around
ability in a context, and that is more than enough challenge for me at the
it is the reason why I find your recent discussion so relevant and
timely. But I can see a time, not so far into the future, when I will need
to consider more than one dimension.
For example, we can build a single construct around ability as a
technologist. But when a technologist also must perform as a manager, then
the construct defining the role as a manager will be quite different from
that describing the underlying technology latent trait (although there may
be some generalised abilities that are common
beyond my capacity to deal
with at this stage). Thus to define an engineering manager, we need to have
a two dimensional construct: an engineering dimension; and a management
dimension. In another case more closely related to education, we already
have multi-dimensional assessment when we have a theory component to
assessment (an exam), and a practical component (laboratory work, etc).
Thanks again for the discussion
Dr. Rodney Staples.
e-mail: rodstaples at ozemail.com.au
Telephone: +61 3 9770 2484
Mobile: +61 4 1935 9082
From: rasch-bounces at acer.edu.au [mailto:rasch-bounces at acer.edu.au]On Behalf
Of Lang, William Steve
Sent: Tuesday, 6 November 2007 11:42 PM
To: Rod O'Connor; Trevor Bond; rasch at acer.edu.au
Cc: jwilkers at fgcu.edu
Subject: RE: [Rasch] Models of unidimensional constructs have
theirlimitations: what is a "good thing"?
I believe this conversation is on track! Just as "reading comprehension"
was bogged down in a complex search for "variables" when Lou Bashaw and Jack
Stenner envisioned a usable measure that spurred a new wave of research,
Rasch "forces" the scale to understand and map the relevant construct at a
Judy Wilkerson and I also witnessed an endless and unresolvable debate about
the complexities of "teacher dispositions" based on morals, ethics, and
personality that resulted in useless attempts to measure the construct.
(See "Teacher Dispositions: Building a Teacher Education Framework of Moral
Standards", "Teacher Dispositions: Envisioning Their Role in Education", and
"Dispostions in Teacher Education" - all recent books.) Decades of debate
could not deconstruct the variables. The solution was to validate
job-related and predictive measures based on a defined and mapped construct
that doesn't attempt to sub-divide all the possible variables. (I hope that
Lou realizes that I was listening in that class!)
Now that the disposition scales are becoming available, appropriate research
and discussion make sense. Without the measures, you have an endless
"factor analysis nightmare" based on any individual's idea du jour. Until a
useful measure at some useful dimensional level starts the process, it is
unlikely that a synthesis of "stuff" will magically become useful. I think
this appears to happen in personality, theories of creativity, theories of
intelligence, and likely some of the health care measures. (Does anyone
remember the Functional Independence Measure discussion on thresholds in
When the "model", such as 3PL, allows the measures to "play around" with the
parameters so that there is a false fit, you are off on the invalidity
slippery slope. Rasch seems (to me) to force the measures to explain the
construct AT THE LEVEL OF INTEREST. Once it is working, there are plenty of
opportunities (FACETS, etc.) to break down and aggregate the real
More importantly to those of us who are looking at "complex human
variables", it is the DPF analysis that seems to inform the construct
interpretation in ways that simply are not envisioned in the original scale
development! If you look at "Item Response Theory" (Baker & Kim) or "Item
Response Theory for Psychologists" (Embretson & Reise), you hardly see any
mention of keyforms, kidmaps, or construct maps that are familiar to us
Rasch folks. I don't think you can EVER VALIDATE (or interpret) the
construct or sub-constructs of these complex variables without the person
profiles which are completely confounded in 2PL and 3PL models!
Judy and I will repeat, "Rasch puts the people in assessment". If you can't
develop the valid unidimensional constructs at some useful level (especially
complex human ones), then you'll likely never have the research tools that
encourage one to break out of the tail-chasing debates and identify the
"real variables" that actually exist in the data.
This is entirely applied and practical, regardless of the mathematical logic
of sufficiency, specific objectivity, and independence even though I'm glad
that others more talented than me have provided that logic.
University of South Florida St. Petersburg
From: rasch-bounces at acer.edu.au on behalf of Rod O'Connor
Sent: Tue 11/6/2007 12:25 AM
To: Trevor Bond; rasch at acer.edu.au
Subject: Re: [Rasch] Models of unidimensional constructs have their
Hello Trevor, very nice to hear from you (I recall your earlier
I have no doubt one could fit global HQoL data to a single Rasch scale
(any notion can be/is one construct, and multiple items can generally be
identified), however I fear that people might think this is
automatically a good thing and that having done so the healthcare
researcher has 'done their job'. Unfortunately in principle such a
scale might not be particularly helpful in 'improving healthcare',
potentially offering little more than a 'do you feel better' question
(except the scale would have more than one item). My view is that a
HQoL measure useful for healthcare improvement needs to not only provide
an indication of extent but also play a diagnostic role (allow
'formative' as well as 'summative' evaluation), identifying where and
how a change has occurred, and hence where treatment could usefully be
Of course it all depends on the criteria by which one would assess
success for the measure, which should always be set-up first.
Personally I think an overtly multi-dimensional assessment is likely to
be needed, with an accompanying complex scoring/combination rule to
predict values consistent with patient judgement.
_Trevor Bond said the following on 6/11/2007 3:34 PM:_
> mea culpa...denied not denied (sorry Dr Freud...it was a slip)
>> Dear Rod
>> HRQoL is one of the areas where Rasch is having a major impact, if I
>> can judge by the articles I am asked to review.
>> Are multidimensional states a composite of unidimensional states?
>> Why would we ever expect that any human condition could be DEFINED by
>> one dimension?
>> thanks for your prompt!
Rasch mailing list
Rasch at acer.edu.au
No virus found in this outgoing message.
Checked by AVG Free Edition.
Version: 7.5.503 / Virus Database: 269.15.22/1112 - Release Date: 5/11/2007
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the Rasch