[en] Standardized tests are used widely in comparative studies of clinical populations, either as dependent or control variables. Yet, one cannot always be sure that the test items measure the same constructs in the groups under study. In the present work, 460 participants with intellectual disability of undifferentiated etiology and 488 typical children were tested using Raven’s Colored Progressive Matrices (RCPM). Data were analyzed using binomial logistic regression modeling designed to detect differential item functioning (DIF). Results showed that 12 items out of 36 function differentially between the two groups, but only 2 items exhibit at least moderate DIF. Thus, a very large majority of the items have identical discriminative power and difficulty levels across the two groups. It is concluded that RCPM can be used with confidence in studies comparing participants with and without intellectual disability. In addition, it is suggested that methods for investigating internal bias of tests used in cross-cultural, cross-linguistic or cross
gender comparisons should also be regularly employed in studies of clinical populations, particularly in the field of developmental disability, to show the absence of systematic measurement error (i.e. DIF) affecting item responses.
Disciplines :
Mathematics
Author, co-author :
Facon, Bruno
Magis, David ; Université de Liège - ULiège > Département de mathématique > Statistique mathématique
Nuchadee, Marie-Laure
De Boeck, Paul
Language :
English
Title :
Do Raven’s Colored Progressive Matrices function in the same way in typical and clinical populations? Insights from the intellectual disability field
Abad F.J., Colom R., Juan-Espinosa M., García L.F. Intelligence differentiation in adult samples. Intelligence 2003, 31:157-166.
Abad F.J., Colom R., Rebollo I., Escorial S. Sex differential item functioning in the Raven's Advanced Progressive Matrices: Evidence for bias. Personality and Individual Differences 2004, 36:1459-1470.
Abbeduto L., Chapman R.S. Language development in Down syndrome and Fragile X syndrome: Current research and implications for theory and practice. Trends in language acquisition research: Developmental theory and language disorders 2005, Vol. 4:44-72. John Benjamins Publishing Company, Amsterdam, NL.
Angoff W.H. Use of difficulty and discrimination indices for detecting item bias. Handbook of methods for detecting test bias 1982, 96-116. Johns Hopkins University Press, Baltimore, MD. R.A. Berk (Ed.).
Angoff W.H., Ford S.F. Item-race interaction on a test of scholastic aptitude. Journal of Educational Measurement 1973, 10:95-106.
Arden R., Plomin R. Scant evidence for Spearman's law of diminishing returns in middle childhood. Personality and Individual Differences 2007, 42:743-753.
Barnabas I., Kapur M., Rao S. Norm development and reliability of coloured progressive matrices test. Journal of Personality and Clinical Studies 1995, 11:17-22.
Bellugi U., Lichtenberger L., Jones W., Lai Z. I. The neurocognitive profile of Williams syndrome: A complex pattern of strengths and weaknesses. Journal of Cognitive Neuroscience 2000, 12:7-29.
Camilli G., Shepard L.A. Methods for identifying biased test items 1994, Sage Publications, Thousand Oaks, CA.
Candell G.L., Drasgow F. An iterative procedure for linking metrics and assessing item bias in item response theory. Applied Psychological Measurement 1988, 12:253-260.
Carlson J.S., Jensen C.M. The factorial structure of the Raven Coloured Progressive Matrices Test: A reanalysis. Educational and Psychological Measurement 1980, 40:1111-1116.
Carlstedt B. Differentiation of cognitive abilities as a function of level of general intelligence: A latent variable approach. Multivariate Behavioral Research 2001, 36:589-609.
Carroll J.B. Human cognitive abilities: A survey of factor analytic studies 1993, Cambridge University Press, New York.
Carroll J.B. The three-stratum theory of cognitive abilities. Contemporary intellectual assessment: Theories, tests and issues 1997, 122-130. The Guilford Press, New York. D.P. Flanagan, P.L. Harrison (Eds.).
Carroll J.B. The three-stratum theory of cognitive abilities. Contemporary intellectual assessment: Theories, tests and issues 2005, 69-76. The Guilford Press, New York. 2nd ed. D.P. Flanagan, P.L. Harrison (Eds.).
Cattell R.B. Abilities: Their structure, growth, and action 1971, Houghton Mifflin Company, Boston, MA.
Cattell R.B. Where is intelligence? Some answers from the triadic theory. Human cognitive abilities in theory and practice 1998, 29-38. Lawrence Erlbaum Associates, Mahwah, NJ. J.J. McArdle, R.W. Woodcock (Eds.).
Chapman R.S., Hesketh L.J. Behavioural phenotype of individuals with Down syndrome. Mental Retardation and Developmental Disability Research Reviews 2000, 6:84-95.
Cicchetti D., Ganiban J. The organization and coherence of developmental processes in infants and children with Down syndrome. Issues in the developmental approach to mental retardation 1990, 169-225. Cambridge University Press, New York. R.M. Hodapp, J. Burack, E. Zigler (Eds.).
Cicchetti D., Pogge-Hesse P. Possible contributions of the study of organically retarded persons to developmental theory. Mental retardation: The developmental-difference controversy 1982, 277-318. Lawrence Erlbaum Associates, Hillsdale, NJ. E. Zigler, D. Balla (Eds.).
Clauser B.E., Mazor K.M. Using statistical procedures to identify differential item functioning test items. Educational Measurement: Issues and Practice 1998, 17:31-44.
Clauser B.E., Mazor K.M., Hambleton R.K. The effects of purification of the matching criterion on the identification of DIF using the Mantel-Haenszel procedure. Applied Measurement in Education 1993, 6:269-279.
Costenbader V., Ngari S.M. A Kenya standardization of the Raven's coloured progressive matrices. School Psychology International 2001, 22:258-268.
Cotton S.M., Kiely P.M., Crewther D.P., Thomson B., Laycock R., Crewther S.G. A normative and reliability study for the Raven's coloured progressive matrices for primary school aged children from Victoria, Australia. Personality and Individual Differences 2005, 39:647-659.
Deary I.J., Egan V., Gibson G.J., Austin E.J., Brand C.R., Kellaghan T. Intelligence and the differentiation hypothesis. Intelligence 1996, 23:105-132.
Detterman D.K., Daniel M.H. Correlations of mental tests with each other and with cognitive variables are highest for low-IQ groups. Intelligence 1989, 13:349-359.
Devenny D.A. The contribution of memory to the behavioural phenotype of Down syndrome. Down syndrome: Neurobehavioural specificity 2006, 85-100. John Wiley & Sons, Chichester, UK. J.-A. Rondal, J. Perera (Eds.).
Dunn D.M., Dunn L.M. Peabody Picture Vocabulary Test-Fourth edition 2007, NCS Pearson, Inc, Minneapolis, MN.
Dykens E.M. The Williams syndrome behavioral phenotype: The "whole person" is missing. Current Opinion in Psychiatry 2003, 16:523-528.
Einarsdóttir S., Rounds J. Gender bias and construct validity in vocational interest measurement: Differential item functioning in the Strong Interest Inventory. Journal of Vocational Behavior 2009, 74:295-307.
Evans M.G. On the asymmetry of g. Psychological Reports 1999, 85:1059-1069.
Facon B. Intelligence générale, différenciation des aptitudes et retard mental. Revue Européenne de Psychologie Appliquée 2002, 52:3-12.
Facon B. L'organisation des aptitudes cognitives est-elle hiérarchique?. Revue Européenne de Psychologie Appliquée 2003, 53:189-198.
Facon B. Sur la loi des rendements décroissants. Efficience intellectuelle et facteur général. L'Année Psychologique 2003, 103:81-102.
Facon B. Are correlations between cognitive abilities highest in low-IQ groups during childhood?. Intelligence 2004, 32:391-401.
Facon B. Does age moderate the effect of IQ on the differentiation of cognitive abilities during childhood?. Intelligence 2006, 34:375-386.
Facon B. A cross-sectional test of the similar-trajectory hypothesis among adults with mental retardation. Research in Developmental Disabilities 2008, 29:29-44.
Facon B. How does the strength of the relationships between cognitive abilities evolve over the life-span for low-IQ vs high-IQ adults?. Intelligence 2008, 36:339-349.
Facon B., Bollengier T., Grubar J.-C. Overestimation of mentally retarded persons' IQs using the PPVT: A reanalysis and some implications for future research. Journal of Intellectual Disability Research 1993, 37:373-379.
Facon B., Facon-Bollengier T. Chronological age and crystallized intelligence of people with intellectual disability. Journal of Intellectual Disability Research 1999, 43:489-496.
Facon B., Facon-Bollengier T., Grubar J.-C. Chronological age, receptive vocabulary and syntax comprehension in children and adolescent with mental retardation. American Journal on Mental Retardation 2002, 107:91-98.
Facon B., Nuchadee M.-L. An item analysis of Raven's colored Progressive Matrices among participants with Down syndrome. Research in Developmental Disabilities 2010, 31:243-249.
Farran E.K. Perceptual grouping ability in Williams syndrome: Evidence for deviant patterns of performance. Neuropsychologia 2005, 43:815-822.
Farran E.K., Jarrold C. Exploring block construction and mental imagery: Evidence of atypical orientation discrimination in Williams syndrome. Visual Cognition 2004, 11:1019-1039.
Farran E.K., Jarrold C. Evidence for unusual spatial location coding in Williams syndrome: An explanation for the local bias in visuo-construction tasks?. Brain and Cognition 2005, 59:159-172.
Fogarty G.J., Stankov L. Challenging the "law of diminishing returns". Intelligence 1995, 21:157-174.
Green K.E., Kluever R.C. Structural properties of Raven's Coloured Progressive Matrices for a sample of gifted children. Perceptual and Motor Skills 1991, 72:59-64.
Hartmann P., Reuter M. Spearman's "Law of Diminishing Returns" tested with two methods. Intelligence 2006, 34:47-62.
Hartmann P., Teasdale T.W. A test of Spearman's "Law of Diminishing Returns" in two large samples of Danish military draftees. Intelligence 2004, 32:499-508.
Hartmann P., Teasdale T.W. Spearman's "Law of Diminishing Returns" and the role of test reliability investigated in a large sample of Danish military draftees. Personality and Individual Differences 2005, 39:1193-1203.
Hauger J.B., Sireci S.G. Detecting differential item functioning across examinees tested in their dominant language and examinees tested in a second language. International Journal of Testing 2008, 8:237-250.
Hodapp R.M., Burack J.A. Developmental approaches to children with mental retardation: A second generation?. Developmental psychopathology: Risk, disorder, and adaptation 2006, Vol. 3:235-267. John Wiley & Sons, Hoboken, NJ. 2nd ed. D.J. Cohen, D. Cicchetti (Eds.).
Hodapp R.M., Burack J.A., Zigler E. The developmental perspective in the field of mental retardation. Issues in the developmental approach to mental retardation 1990, 3-26. Cambridge University Press, New York. R.M. Hodapp, J.A. Burack, E. Zigler (Eds.).
Hodapp R.M., Burack J.A., Zigler E. Developmental approaches to mental retardation: A short introduction. Handbook of mental retardation and development 1998, 3-19. Cambridge University Press, New York. J.A. Burack, R.M. Hodapp, E. Zigler (Eds.).
Hodapp R.M., Dykens E.M. Behavioral effects of genetic mental retardation disorders. Handbook of intellectual and developmental disabilities 2007, 115-131. Springer Publishing Company, New York. J.W. Jacobson, J.A. Mulick, J. Rojahn (Eds.).
Hodapp R.M., Zigler E. New issues in the developmental approach to mental retardation. Ellis' Handbook of mental deficiency, psychological theory and research 1997, 115-136. Lawrence Erlbaum Associates, Mahwah, NJ. 3rd ed. W.E. MacLean (Ed.).
Horn J.L. Intellectual ability concepts. Advances in the psychology of human intelligence 1986, 35-77. Lawrence Erlbaum Associates, Hillsdale, NJ. R.J. Sternberg (Ed.).
Horn J.L. Theory of fluid and crystallized intelligence. Encyclopedia of human intelligence 1994, 443-451. Macmillan Publishing Company, New York. R.J. Sternberg (Ed.).
Horn J.L., Blankson N. Foundations for better understanding of cognitive abilities. Contemporary intellectual assessment: Theories, tests, and issues 2005, 41-68. The Guilford Press, New York. 2nd ed. D.P. Flanagan, P.L. Harrison (Eds.).
Horn J.L., Noll J. Human cognitive capabilities: Gf-Gc theory. Contemporary intellectual assessment. Theories, tests, and issues 1997, 53-91. The Guilford Press, New York. D.P. Flanagan, J.L. Genshaft, P.L. Harrison (Eds.).
Hunt E. The concept and utility of intelligence. Intelligence, genes and success. Scientists respond to the Bell Curve 1997, 157-176. Springer-Verlag, New York. B. Devlin, S.E. Fienberg, D.P. Resnick, K. Roeder (Eds.).
Jarrold C., Baddeley A.D., Phillips C.E. Verbal short-term memory in Down syndrome: A problem of memory, audition or speech?. Journal of Speech Language and Hearing Research 2002, 45:531-544.
Jarrold C., Thorn A.S.C., Stephens E. The relationships among verbal short-term memory, phonological awareness, and new word learning: Evidence from typical development and Down syndrome. Journal of Experimental Child Psychology 2009, 102:196-218.
Jensen A.R. Regularities in Spearman's law of diminishing returns. Intelligence 2003, 31:95-105.
Kane H.D., Oakland T.D., Brand C.R. Differentiation at higher levels of cognitive ability: Evidence from the United States. Journal of Genetic Psychology 2006, 167:327-341.
Karmiloff-Smith A., Brown J.H., Grice S., Paterson S. Dethroning the myth: Cognitive dissociations and innate modularity in Williams syndrome. Developmental Neuropsychology 2003, 23:229-244.
Kaufman A.S., Kaufman N.L. Kaufman Assessment Battery for Children-Second edition 2004, American Guidance Service, Circle Pines, MN.
Kazem A.M., Alzubiadi A.S., Yousif Y.H., Aljamali F.A., Al-Mashhdany S.I., Alkharusi H.A., et al. Psychometric properties of Raven's Colored Progressive Matrices for Omani children aged 5 through 11years. Social Behavior & Personality: An International Journal 2007, 35:1385-1397.
Kline P. The handbook of psychological testing 2000, Taylor & Francis/Routledge, London, UK. 2nd ed.
Knoetze J., Bass N., Steele G. The Raven's Coloured Progressive Matrices: Pilot norms for isiXhosa-speaking primary school learners in peri-urban Eastern Cape. South African Journal of Psychology 2005, 35:175-194.
Legree P.J., Pifer M.E., Grafton F.C. Correlations among cognitive abilities are lower for higher ability groups. Intelligence 1996, 23:45-57.
Leonard H., Wen X. The epidemiology of mental retardation: Challenges and opportunities in the new millennium. Mental Retardation and Developmental Disabilities Research Reviews 2002, 8:117-134.
Lynn R. Does Spearman's g decline at high IQ levels? Some evidence from Scotland. The Journal of Genetic Psychology 1990, 153:229-230.
Lynn R., Meisenberg G. National IQs calculated and validated for 108 nations. Intelligence 2010, 38:353-360.
Lynn R., Vanhanen T. IQ and the wealth of nations 2002, Praeger, Westport, CT.
Magis D., Béland S., Tuerlinckx F., De Boeck P. A general framework and an R package for the detection of dichotomous differential item functioning. Behavior Research Methods 2010, 42:847-862.
Malloy J. James Watson tells the inconvenient truth: Faces the consequences. Medical Hypotheses 2008, 70:1081-1091.
Mazor K.M., Hambleton R.K., Clauser B.E. Multidimensional DIF analyses: the effects of matching on unidimensional subtest scores. Applied Psychological Measurement 1998, 22:357-367.
McDermott S., Durkin M.S., Schupf N., Stein Z. Epidemiology and etiology of mental retardation. Handbook of intellectual and developmental disabilities 2007, 3-40. Springer Publishing Company, New York. J.W. Jacobson, J.A. Mulick, J. Rojahn (Eds.).
McGrew K.S. CHC theory and the human cognitive abilities project: Standing on the shoulders of the giants of psychometric intelligence research. Intelligence 2009, 37:1-10.
McIntire S.A., Miller L.A. Foundations of psychological testing: A practical approach 2007, Sage Publications, Thousand Oaks, CA. 2nd ed.
Meredith W., Millsap R.E. On the misuse of manifest variables in the detection of measurement bias. Psychometrika 1992, 57:289-311.
Mervis C.B., Becerra A.M. Language and communicative development in Williams syndrome. Mental Retardation and Developmental Disabilities Research Reviews 2007, 13:3-15.
Mervis C.B., Morris C.A. Williams syndrome. Neurogenetic developmental disorders: Variation of manifestation in childhood 2007, 199-262. The Massachusetts Institute of Technology Press, Cambridge, MA. J.L. Ross, M.M.M. Mazzocco (Eds.).
Meyer-Lindenberg A., Mervis C.B., Berman K.F. Neural mechanisms in Williams syndrome: A unique window to genetic influences on cognition and behaviour. Nature Reviews Neuroscience 2006, 7:380-393.
Molenaar D., Dolan C.V., Wicherts J.M., van der Maas H.L.J. Modeling differentiation of cognitive abilities within the higher-order factor model using moderated factor analysis. Intelligence 2010, 10.1016/j.intell.2010.09.002.
Murphy C.C., Boyle C., Schendel D., Decouflé P., Yeargin-Allsopp M. Epidemiology of mental retardation in children. Mental Retardation and Developmental Disabilities Research Reviews 1998, 4:6-13.
Nagelkerke N.J.D. A note on a general definition of the coefficient of determination. Biometrika 1991, 78:691-692.
Nesselroade J.R., Thompson W.W. Selection and related threats to group comparisons: An example comparing factorial structures of higher and lower ability groups of adult twins. Psychological Bulletin 1995, 117:271-284.
Numminen H., Lehto J.E., Ruoppila I. Tower of Hanoi and working memory in adult persons with intellectual disability. Research in Developmental Disabilities 2001, 22:373-387.
Numminen H., Service E., Ruoppila I. Working memory, intelligence and knowledge base in adult persons with intellectual disability. Research in Developmental Disabilities 2002, 23:105-118.
Osterlind S.J. Test item bias. Sage university paper series on quantitative applications in the social sciences, no 30 1983, Sage Publications, Newbury Park, CA.
Pagliari H.C. Individual and developmental differences in positive manifold: A historical and empirical investigation of the differentiation hypothesis 1998, Unpublished doctoral thesis, University of Edinburgh.
Pedraza O., Graff-Radford N.R., Smith G.E., Ivnik R.J., Willis F.B., Petersen R.C., et al. Differential item functioning of the Boston Naming Test in cognitively normal African American and Caucasian older adults. Journal of the International Neuropsychological Society 2009, 15:758-768.
Penfield R.D., Camilli G. Differential item functioning and item bias. Handbook of statistics: Psychometrics 2007, Vol. 26:125-167. Elsevier, Amsterdam, NL.
Ponsoda V., Abad F.J., Francis L.J., Hills P.R. Gender differences in the Coopersmith Self-Esteem Inventory: The incidence of differential item functioning. Journal of Individual Differences 2008, 29:217-222.
R Development Core Team R: A language and environment for statistical computing 2010, R Foundation for Statistical Computing, Vienna, Austria.
Raven J.C., Court J.H., Raven J. Progressive Matrices Couleur/Colored Progressive Matrices 1998, Les Editions du Centre de Psychologie Appliquée, Paris.
Reynolds M.R., Keith T.Z. Spearman's law of diminishing returns in hierarchical intelligence for children and adolescents. Intelligence 2007, 35:267-281.
Reynolds M.R., Keith T.Z., Beretvas N. Use of factor mixture modeling to capture Spearman's law of diminishing returns. Intelligence 2010, 38:231-241.
Riby D.M., Doherty-Sneddon G., Bruce V. Atypical unfamiliar face processing in Williams syndrome: What can it tell us about typical familiarity effects?. Cognitive Neuropsychiatry 2008, 13:47-58.
Richardson F.M., Thomas M.S.C. Language development in genetic disorders. The Cambridge handbook of child language 2009, 459-471. Cambridge University Press, Cambridge, UK. E. Bavin (Ed.).
Roberts J.E., Price J., Malkin C. Language and communication development in Down syndrome. Mental Retardation and Developmental Disabilities Research Reviews 2007, 13:26-35.
Rondal J.-A. Specific language profiles in Down syndrome and other genetic syndromes of mental retardation. Down syndrome: Neurobehavioural specificity 2006, 101-123. John Wiley & Sons, Chichester, UK. J.-A. Rondal, J. Perera (Eds.).
Rushton J.P. Jensen effects and African/Coloured/Indian/White differences on Raven's standard progressive matrices in South Africa. Personality and Individual Differences 2002, 33:1279-1284.
Rushton J.P., Bons T.A., Vernon P.A., Cvorovic J. Genetic and environmental contributions to population group differences on the Raven's progressive matrices estimated from twins reared together and apart. Proceedings of the Royal Society: B 2007, 274:1773-1777.
Rushton J.P., Skuy M. Performance on Raven's matrices by African and White university students in South Africa. Intelligence 2000, 28:251-265.
Rushton J.P., Skuy M., Fridjhon P. Performance on Raven's advanced progressive matrices by African, East Indian, and White engineering students in South Africa. Intelligence 2003, 31:123-137.
Saklofske D.H., Yang Z., Zhu J., Austin E.L. Spearman's law of diminishing returns in normative samples for the WISC-IV and WAIS-III. Journal of Individual Differences 2008, 29:57-69.
Scherbaum C.A., Goldstein H.W. Examining the relationship between race-based differential item functioning and item difficulty. Educational and Psychological Measurement 2008, 68:537-553.
Silverman W. Down syndrome: Cognitive phenotype. Mental Retardation and Developmental Disabilities Research Reviews 2007, 13:228-236.
Sireci S.G., Patsula L., Hambleton R.K. Statistical methods for identifying flawed items in the test adaptation process. Adapting educational and psychological tests for cross-cultural assessment 2005, 93-115. Lawrence Erlbaum Associates, Hillsdale, NJ. R.K. Hambleton, P.F. Merenda, C.D. Spielberger (Eds.).
Spearman C. The abilities of man. Their nature and measurement 1927, Macmillan and Co., Limited, London, UK.
Stojanovik V., van Ewijk L. Do children with Williams syndrome have unusual vocabularies?. Journal of Neurolinguistics 2008, 21:18-34.
Swaminathan H., Rogers H.J. Detecting differential item functioning using logistic regression procedures. Journal of Educational Measurement 1990, 27:361-370.
te Nijenhuis J., Hartmann P. Spearman's "Law of Diminishing Returns" in samples of Dutch and immigrant children and adults. Intelligence 2006, 34:437-447.
Tucker-Drob E.M. Differentiation of cognitive abilities across the life span. Developmental Psychology 2009, 45:1097-1118.
Uno A., Shinya N., Haruhara N., Kaneko M. Raven's Coloured Progressive Matrices in Japanese children as a screening intelligence test for children with learning disorder and acquired childhood aphasia. Japan Journal of Logopedics and Phoniatrics 2005, 46:185-189.
van der Ven A.H.G.S., Ellis J.L. A Rasch analysis of Raven's Standard Progressive Matrices. Personality and Individual Differences 2000, 29:45-64.
Vicari S., Carlesimo G.A. Short-term memory deficits are not uniform in Down and Williams syndromes. Neuropsychology Review 2006, 16:87-94.
Vicari S., Verucci L., Carlesimo G.A. Implicit memory is independent from IQ and age but not from etiology: evidence from Down and Williams syndromes. Journal of Intellectual Disability Research 2007, 51:932-941.
Wang P.P. A neuropsychological profile of Down syndrome: Cognitive skills and brain morphology. Mental Retardation and Developmental Disability Research Reviews 1996, 2:102-108.
Wechsler D. Wechsler Adult Intelligence Scale-Third edition 1997, Psychological Corporation, San Antonio, TX.
Wechsler D. Wechsler Intelligence Scale for Children-Fourth edition 2003, Psychological Corporation, San Antonio, TX.
Wicherts J.M., Borsboom D., Dolan C.V. Why national IQs do not support evolutionary theories of intelligence. Personality and Individual Differences 2010, 48:91-96.
Wicherts J.M., Dolan C.V., Carlson J.S., van der Maas H.L.J. Another failure to replicate Lynn's estimate of the average IQ of sub-Saharan Africans. Learning and Individual Differences 2010, 20:155-157.
Wicherts J.M., Dolan C.V., Carlson J.S., van der Maas H.L.J. Raven's test performance of sub-Saharan Africans: Average performance, psychometric properties, and the Flynn Effect. Learning and Individual Differences 2010, 20:135-151.
Wicherts J.M., Dolan C.V., van der Maas H.L.J. A systematic literature review of the average IQ of sub-Saharan Africans. Intelligence 2010, 38:1-20.
Wicherts J.M., Dolan C.V., van der Maas H.L.J. The dangers of unsystematic selection methods and the representativeness of 46 samples of African test-takers. Intelligence 2010, 38:30-37.
Wicherts J.M., Johnson W. Group differences in the heritability of items and test scores. Proceedings of the Royal Society: B. 2009, 276:2675-2683.
Yeargin-Allsopp M., Boyle C., Van Naarden Braun K., Trevathan E. The epidemiology of developmental disabilities. Capute & Accardo's neurodevelopmental disabilities in infancy and childhood 2008, 199-226. Paul H. Brookes Publishing Company, Baltimore, MD. P.J. Accardo (Ed.).
Zigler E. Familial mental retardation: A continuing dilemma. Science 1967, 155:292-298.
Zigler E. Developmental versus difference theories of mental retardation and the problem of motivation. American Journal of Mental Deficiency 1969, 73:536-556.
Zigler E. A developmental theory on mental retardation. Perspectives in special education: Personal orientations 1984, Vol. 1:173-209. Scott, Foresman and Company, Santa Monica, CA.
Zigler E., Hodapp R.M. Understanding mental retardation 1986, Cambridge University Press, New York.
Zumbo B.D. A Handbook on the theory and methods of differential item functioning (DIF): Logistic regression modeling as a unitary framework for binary and Likert-type (ordinal) item scores 1999, Directorate of Human Resources Research and Evaluation, Department of National Defense, Ottawa, ON.
Zumbo B.D. Three generations of DIF analyses: Considering where it has been, where it is now, and where it is going. Language Assessment Quarterly 2007, 4:223-233.
Zumbo B.D., Thomas D.R. A measure of effect size for a model-based approach for studying DIF 1997, University of Northern British Columbia, Edgeworth Laboratory for Quantitative Behavioral Science, Prince George, CAN.
