Predicting gender differences as latent variables

Summed scores, and individual item responses: A methods case study

Ricardo Pietrobon, Marcus Taylor, Ulrich Guller, Laurence D. Higgins, Danny O. Jacobs, Timothy Carey

Research output: Contribution to journalArticle

8 Citations (Scopus)

Abstract

Background: Modeling latent variables such as physical disability is challenging since its measurement is performed through proxies. This poses significant methodological challenges. The objective of this article is to present three different methods to predict latent variables based on classical summed scores, individual item responses, and latent variable models. Methods: This is a review of the literature and data analysis using "layers of information". Data was collected from the North Carolina Back Pain Project, using a modified version of the Roland Questionnaire. Results: The three models are compared in relation to their goals and underlying concepts, previous clinical applications, data requirements, statistical theory, and practical applications. Initial linear regression models demonstrated a difference in disability between genders of 1.32 points (95% CI 0.65, 2.00) on a scale from 0-23. Subsequent item analysis found contradictory results across items, with no clear pattern. Finally, IRT models demonstrated three items were demonstrated to present differential item functioning. After these items were removed, the difference between genders was reduced to 0.78 points (95% CI, -0.99, 1.23). These results were shown to be robust with re-sampling methods. Conclusions: Purported differences in the levels of a latent variable should be tested using different models to verify whether these differences are real or simply distorted by model assumptions.

Original languageEnglish (US)
JournalHealth and Quality of Life Outcomes
Volume2
DOIs
StatePublished - Oct 25 2004
Externally publishedYes

Fingerprint

Linear Models
Proxy
Back Pain
Surveys and Questionnaires

Keywords

  • Disability evaluation
  • Gender
  • Low-back pain
  • Outcome assessment
  • Psychometrics
  • Statistical models

ASJC Scopus subject areas

  • Public Health, Environmental and Occupational Health

Cite this

Predicting gender differences as latent variables : Summed scores, and individual item responses: A methods case study. / Pietrobon, Ricardo; Taylor, Marcus; Guller, Ulrich; Higgins, Laurence D.; Jacobs, Danny O.; Carey, Timothy.

In: Health and Quality of Life Outcomes, Vol. 2, 25.10.2004.

Research output: Contribution to journalArticle

Pietrobon, Ricardo ; Taylor, Marcus ; Guller, Ulrich ; Higgins, Laurence D. ; Jacobs, Danny O. ; Carey, Timothy. / Predicting gender differences as latent variables : Summed scores, and individual item responses: A methods case study. In: Health and Quality of Life Outcomes. 2004 ; Vol. 2.
@article{79b2e21f162e46a380472e50aa68f3f7,
title = "Predicting gender differences as latent variables: Summed scores, and individual item responses: A methods case study",
abstract = "Background: Modeling latent variables such as physical disability is challenging since its measurement is performed through proxies. This poses significant methodological challenges. The objective of this article is to present three different methods to predict latent variables based on classical summed scores, individual item responses, and latent variable models. Methods: This is a review of the literature and data analysis using {"}layers of information{"}. Data was collected from the North Carolina Back Pain Project, using a modified version of the Roland Questionnaire. Results: The three models are compared in relation to their goals and underlying concepts, previous clinical applications, data requirements, statistical theory, and practical applications. Initial linear regression models demonstrated a difference in disability between genders of 1.32 points (95{\%} CI 0.65, 2.00) on a scale from 0-23. Subsequent item analysis found contradictory results across items, with no clear pattern. Finally, IRT models demonstrated three items were demonstrated to present differential item functioning. After these items were removed, the difference between genders was reduced to 0.78 points (95{\%} CI, -0.99, 1.23). These results were shown to be robust with re-sampling methods. Conclusions: Purported differences in the levels of a latent variable should be tested using different models to verify whether these differences are real or simply distorted by model assumptions.",
keywords = "Disability evaluation, Gender, Low-back pain, Outcome assessment, Psychometrics, Statistical models",
author = "Ricardo Pietrobon and Marcus Taylor and Ulrich Guller and Higgins, {Laurence D.} and Jacobs, {Danny O.} and Timothy Carey",
year = "2004",
month = "10",
day = "25",
doi = "10.1186/1477-7525-2-59",
language = "English (US)",
volume = "2",
journal = "Health and Quality of Life Outcomes",
issn = "1477-7525",
publisher = "BioMed Central",

}

TY - JOUR

T1 - Predicting gender differences as latent variables

T2 - Summed scores, and individual item responses: A methods case study

AU - Pietrobon, Ricardo

AU - Taylor, Marcus

AU - Guller, Ulrich

AU - Higgins, Laurence D.

AU - Jacobs, Danny O.

AU - Carey, Timothy

PY - 2004/10/25

Y1 - 2004/10/25

N2 - Background: Modeling latent variables such as physical disability is challenging since its measurement is performed through proxies. This poses significant methodological challenges. The objective of this article is to present three different methods to predict latent variables based on classical summed scores, individual item responses, and latent variable models. Methods: This is a review of the literature and data analysis using "layers of information". Data was collected from the North Carolina Back Pain Project, using a modified version of the Roland Questionnaire. Results: The three models are compared in relation to their goals and underlying concepts, previous clinical applications, data requirements, statistical theory, and practical applications. Initial linear regression models demonstrated a difference in disability between genders of 1.32 points (95% CI 0.65, 2.00) on a scale from 0-23. Subsequent item analysis found contradictory results across items, with no clear pattern. Finally, IRT models demonstrated three items were demonstrated to present differential item functioning. After these items were removed, the difference between genders was reduced to 0.78 points (95% CI, -0.99, 1.23). These results were shown to be robust with re-sampling methods. Conclusions: Purported differences in the levels of a latent variable should be tested using different models to verify whether these differences are real or simply distorted by model assumptions.

AB - Background: Modeling latent variables such as physical disability is challenging since its measurement is performed through proxies. This poses significant methodological challenges. The objective of this article is to present three different methods to predict latent variables based on classical summed scores, individual item responses, and latent variable models. Methods: This is a review of the literature and data analysis using "layers of information". Data was collected from the North Carolina Back Pain Project, using a modified version of the Roland Questionnaire. Results: The three models are compared in relation to their goals and underlying concepts, previous clinical applications, data requirements, statistical theory, and practical applications. Initial linear regression models demonstrated a difference in disability between genders of 1.32 points (95% CI 0.65, 2.00) on a scale from 0-23. Subsequent item analysis found contradictory results across items, with no clear pattern. Finally, IRT models demonstrated three items were demonstrated to present differential item functioning. After these items were removed, the difference between genders was reduced to 0.78 points (95% CI, -0.99, 1.23). These results were shown to be robust with re-sampling methods. Conclusions: Purported differences in the levels of a latent variable should be tested using different models to verify whether these differences are real or simply distorted by model assumptions.

KW - Disability evaluation

KW - Gender

KW - Low-back pain

KW - Outcome assessment

KW - Psychometrics

KW - Statistical models

UR - http://www.scopus.com/inward/record.url?scp=16344366514&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=16344366514&partnerID=8YFLogxK

U2 - 10.1186/1477-7525-2-59

DO - 10.1186/1477-7525-2-59

M3 - Article

VL - 2

JO - Health and Quality of Life Outcomes

JF - Health and Quality of Life Outcomes

SN - 1477-7525

ER -