<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">I mostly agree, but the first point seems incorrect. Facets was in fact designed for the case where raters grade only partly overlapping subsets of respondents. See RMT for examples of very minimal rater overlap …<div class=""><br class=""></div><div class="">Rense Lange<br class=""><div class=""><br class=""><div><div class="">On Feb 11, 2019, at 7:54 PM, Fabio La Porta <<a href="mailto:fabiolaporta@mail.com" class="">fabiolaporta@mail.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div class=""><div dir="auto" class="">Hi Ricardo,</div></div><div dir="auto" class="">In order to conduct a multifacet analysis the theoretical requirement is that all the raters examine all the subjects.  <<<<< NO</div><div dir="auto" class=""><br class=""></div><div dir="auto" class="">For sure, you cannot apply this design across countries. Here, you will want to test the requirement of invariance of the item difficulties trans culturally, i.e. the absence of DIF by Country.</div><div dir="auto" class=""><br class=""></div><div dir="auto" class="">Regarding the within-Country facet design, its feasibility depends on the amount of missing rater data.</div><div dir="auto" class=""><br class=""></div><div dir="auto" class="">I Hope this helps</div><div dir="auto" class="">Fabio </div><div class=""><br class=""><div class="gmail_quote"><div dir="ltr" class="gmail_attr">Il giorno lun 11 feb 2019 alle 12:27 Ricardo Primi <<a href="mailto:rprimi@mac.com" class="">rprimi@mac.com</a>> ha scritto:<br class=""></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word" class=""><p class="MsoNormal" style="margin-top:6.0pt;margin-right:0cm;margin-bottom:6.0pt;margin-left:0cm"><span lang="EN-US" class="">Dear list</span></p><p class="MsoNormal" style="margin-top:6.0pt;margin-right:0cm;margin-bottom:6.0pt;margin-left:0cm"><span lang="EN-US" class="">I have a
question about FACETS. I am working in a project where we have tasks translated
into various languages administered to students within several countries. Raters
are nested within countries, that is, a group A of raters of country A will
score tasks of country A students, a group B of raters of country B will score
tasks of students of country B students and so on. <u class=""></u><u class=""></u></span></p><p class="MsoNormal" style="margin-top:6.0pt;margin-right:0cm;margin-bottom:6.0pt;margin-left:0cm"><span lang="EN-US" class="">I have two
questions: 1) Do you know any similar study with these characteristics that
employed FACETS? Specifically any idea of a design that can be employed to
create connectedness and link measures, that is, create a metric that permits
to compare countries? 2) The main interest is to estimate country means as reliably
as possible. Do you know any study that address how person reliability (level 1
in a multilevel design) is related to group mean reliability (level 2)? A
specific question is how design features (number of tasks, number of raters per
task, rater agreement) affects this reliability of means at second level.<u class=""></u><u class=""></u></span></p><p class="MsoNormal" style="margin-top:6.0pt;margin-right:0cm;margin-bottom:6.0pt;margin-left:0cm"><span lang="EN-US" class="">Thanks a lot  in advance <u class=""></u><u class=""></u></span></p><p class="MsoNormal" style="margin-top:6.0pt;margin-right:0cm;margin-bottom:6.0pt;margin-left:0cm"><span lang="EN-US" class=""><br class=""></span></p><p class="MsoNormal" style="margin-top:6.0pt;margin-right:0cm;margin-bottom:6.0pt;margin-left:0cm"><span lang="EN-US" class="">Ricardo Primi</span></p><div class="">USF, Brazil</div><div style="margin: 6pt 0cm;" class=""><span lang="EN-US" class=""> </span><br class="webkit-block-placeholder"></div>

</div>________________________________________<br class="">
Rasch mailing list<br class="">
email: <a href="mailto:Rasch@acer.edu.au" target="_blank" class="">Rasch@acer.edu.au</a><br class="">
web: <a href="https://mailinglist.acer.edu.au/mailman/options/rasch/fabiolaporta%40mail.com" rel="noreferrer" target="_blank" class="">https://mailinglist.acer.edu.au/mailman/options/rasch/fabiolaporta%40mail.com</a></blockquote></div></div>-- <br class=""><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature">Fabio La Porta, MD PhD<br class=""></div>
________________________________________<br class="">Rasch mailing list<br class="">email: <a href="mailto:Rasch@acer.edu.au" class="">Rasch@acer.edu.au</a><br class="">web: <a href="https://mailinglist.acer.edu.au/mailman/options/rasch/rense.lange%40gmail.com" class="">https://mailinglist.acer.edu.au/mailman/options/rasch/rense.lange%40gmail.com</a></div></div><br class=""></div></div></body></html>