[Rasch] Weighting items

Charles Partridge CPartridge at hec.ohio-state.edu
Sat Mar 11 02:59:43 EST 2006


I am using Facets 3.60.  I have multiple raters scoring grant applications with a series of Likert-style items that range from 1-6.  In calculating the "fair average," I need to weight some items more highly then others. Is there a simple way to do this in Facets?


Charles R. Partridge
Evaluation Specialist
Center for Learning Excellence
The John Glenn Institute for Public Service & Public Policy
807 Kinnear Road, Room 214
Columbus, Ohio 43212-1421
Phone: 614.292.2419
FAX: 614.247.6447
Email: cpartridge at hec.ohio-state.edu

CONFIDENTIALITY NOTICE: This message is intended only for the person or entity to which it is addressed and may contain information that is confidential or privileged.  If you are not the intended recipient, or the employee or person responsible for delivering it to the intended recipient, you are hereby notified that any dissemination, distribution, copying or use is strictly prohibited.  If you have received this communication in error, please notify the sender and destroy or delete this communication immediately.

"To be truly ignorant, be content with your own knowledge."
Chuang Tzu, circa 300 BC
-----Original Message-----
From: rasch-bounces at acer.edu.au [mailto:rasch-bounces at acer.edu.au] On Behalf Of rasch-request at acer.edu.au
Sent: Thursday, March 09, 2006 4:18 PM
To: rasch at acer.edu.au
Subject: Rasch Digest, Vol 8, Issue 4

Send Rasch mailing list submissions to
	rasch at acer.edu.au

To subscribe or unsubscribe via the World Wide Web, visit
or, via email, send a message with subject or body 'help' to
	rasch-request at acer.edu.au

You can reach the person managing the list at
	rasch-owner at acer.edu.au

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Rasch digest..."

Today's Topics:

   1. many facet Rasch model (Gracia, Susan)
   2. RE: many facet Rasch model (Barth Riley)
   3. RE: many facet Rasch model (rsmith.arm at att.net)


Message: 1
Date: Thu, 9 Mar 2006 15:20:57 -0500
From: "Gracia, Susan" <sgracia at ric.edu>
Subject: [Rasch] many facet Rasch model
To: <rasch at acer.edu.au>
	<A5BF98357A9C3846A86A18EFAECB2BC751C1C9 at mailsvr1.RICOL.EDU>
Content-Type: text/plain; charset="utf-8"


I am interested in using the many-facet Rasch model to study the ratings of judges of student exhibitions.  I am wondering how much overlap among raters is necessary.  In the setting I am interested in, I have 40 panels of 5 raters.  Each panel judges 5 students’ exhibitions.  Each panel stays “intact” (i.e., judges do not move around at all during judging, so there is no mixing of panels).  Is it possible to use the many facet Rasch model with this set up, or does there have to be overlapping of judges on more than one panel?


Any guidance you could give me would be much appreciated.


Thank you.


Susan Gracia, PhD

Associate Professor

Educational Leadership Program

Dept. of Counseling, Educational Leadership, and School Psychology

Adams 103

Rhode Island College

600 Mount Pleasant Avenue

Providence, RI 02908-1991 

tel.:  401-456-8577

email:  sgracia at ric.edu


-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailinglist.acer.edu.au/pipermail/rasch/attachments/20060309/9178f2ac/attachment-0001.html


Message: 2
Date: Thu, 9 Mar 2006 14:36:21 -0600
From: "Barth Riley" <barthr at uic.edu>
Subject: RE: [Rasch] many facet Rasch model
To: <rasch at acer.edu.au>
Message-ID: <004e01c643b9$208585b0$0d2cf880 at ad.uic.edu>
Content-Type: text/plain; charset="us-ascii"

Hi Susan


What will most likely happen is that Facets will be unable to link ratings
of exhibitions across panels. Therefore, it will not be possible to compare
an exhibit rated by panel #1 to an exhibit rated by panel #2, etc. If data
collection is still ongoing, I would strongly encourage moving raters to
multiple panels to ensure a linkage across panels. The alternative strategy
is to randomly assign raters to panels. Then we would assume that the panels
are "randomly equivalent" and then anchor each panel to a common logit
value, typically 0. 'This group anchoring method can sometimes, though not
always, allow disjointed subsets in the data to be connected by Facets.
Generally, the more overlap, the better.





Barth Riley, Ph.D.

Res. Asst. Professor & Associate Program Director

Dept. of Disability and Human Development M/C 626

University of Illinois-Chicago

1640 W. Roosevelt Rd.

Chicago, IL 60608

Voice (312) 355-4054

Fax:   (312) 355-4058

Email: barthr at uic.edu

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailinglist.acer.edu.au/pipermail/rasch/attachments/20060309/70f630e7/attachment-0001.html


Message: 3
Date: Thu, 09 Mar 2006 21:17:48 +0000
From: rsmith.arm at att.net
Subject: RE: [Rasch] many facet Rasch model
To: "Barth Riley" <barthr at uic.edu>,	rasch at acer.edu.au (Rasch
	<030920062117.23289.44109B7C0004BD6200005AF92160280651039D0ED2089B07039C9D at att.net>
Content-Type: text/plain; charset="us-ascii"

Skipped content of type multipart/alternative-------------- next part --------------
An embedded message was scrubbed...
From: "Barth Riley" <barthr at uic.edu>
Subject: RE: [Rasch] many facet Rasch model
Date: Thu, 9 Mar 2006 20:36:32 +0000
Size: 631
Url: http://mailinglist.acer.edu.au/pipermail/rasch/attachments/20060309/b6cf7996/attachment.mht


Rasch mailing list
Rasch at acer.edu.au

End of Rasch Digest, Vol 8, Issue 4

More information about the Rasch mailing list