A virtual reality environment for evaluation of a daily living skill in brain injury rehabilitation: Reliability and validity

Ling Zhang, Beatriz C. Abreu, Gary S. Seale, Brent Masel, Charles H. Christiansen, Kenneth Ottenbacher

Research output: Contribution to journalArticle

104 Citations (Scopus)

Abstract

Objective: To establish the stability and validity of information collected in a virtual reality environment from persons with traumatic brain injury (TBI). Design: Prospective correlation design to examine 3-week test-retest results for equivalence reliability between computer-simulated and natural environments. Setting: A residential rehabilitation center for brain injury. Participants: Fifty-four consecutive patients with TBI who received comprehensive rehabilitation services and who were at different stages of recovery. Intervention: An immersive virtual kitchen was developed in which a meal preparation task involving multiple steps was performed. The subjects completed meal preparation both in a virtual reality kitchen and an actual kitchen twice over a 3-week period. Main Outcome Measures: Time and errors on task completion using virtual reality assessment, actual kitchen performance (analogous to the virtual reality environment), occupational therapy (OT) evaluation, and neuropsychologic tests. Results: The stability of performance using the simulated virtual environment was estimated with intraclass correlation coefficients (ICCs). The ICC value for total performance, based on all steps involved in the meal preparation task, was .76 (P<.01). The construct validity of the simulated environment was examined by correlating performance in the virtual environment with that in the actual kitchen (r=.63, P<.01), the OT evaluation (r=.30, P=.05 for meal preparation; r=.40, P=.01 for cognitive subskills), and neuropsychologic tests (r=.56, P<.01 for the full-scale intelligence quotient [IQ]; r=.40, P<.01 for the verbal IQ; r=.56, P<.01 for the performance IQ). Finally, a multiple regression analysis revealed that the virtual reality environment test was a good predictor for the actual assessment kitchen (β=.35, P=.01). Conclusion: The virtual reality system showed adequate reliability and validity as a method of assessment in persons with brain injury.

Original languageEnglish (US)
Pages (from-to)1118-1124
Number of pages7
JournalArchives of Physical Medicine and Rehabilitation
Volume84
Issue number8
DOIs
StatePublished - Aug 1 2003

Fingerprint

Reproducibility of Results
Brain Injuries
Rehabilitation
Meals
Intelligence
Neuropsychological Tests
Occupational Therapy
User-Computer Interface
Rehabilitation Centers
Regression Analysis
Outcome Assessment (Health Care)
Traumatic Brain Injury

Keywords

  • Brain injuries
  • Outcomes assessment (health care)
  • Rehabilitation
  • Virtual systems

ASJC Scopus subject areas

  • Rehabilitation

Cite this

A virtual reality environment for evaluation of a daily living skill in brain injury rehabilitation : Reliability and validity. / Zhang, Ling; Abreu, Beatriz C.; Seale, Gary S.; Masel, Brent; Christiansen, Charles H.; Ottenbacher, Kenneth.

In: Archives of Physical Medicine and Rehabilitation, Vol. 84, No. 8, 01.08.2003, p. 1118-1124.

Research output: Contribution to journalArticle

Zhang, Ling ; Abreu, Beatriz C. ; Seale, Gary S. ; Masel, Brent ; Christiansen, Charles H. ; Ottenbacher, Kenneth. / A virtual reality environment for evaluation of a daily living skill in brain injury rehabilitation : Reliability and validity. In: Archives of Physical Medicine and Rehabilitation. 2003 ; Vol. 84, No. 8. pp. 1118-1124.
@article{1e6cace0aba2454a9893ccaac0d672bd,
title = "A virtual reality environment for evaluation of a daily living skill in brain injury rehabilitation: Reliability and validity",
abstract = "Objective: To establish the stability and validity of information collected in a virtual reality environment from persons with traumatic brain injury (TBI). Design: Prospective correlation design to examine 3-week test-retest results for equivalence reliability between computer-simulated and natural environments. Setting: A residential rehabilitation center for brain injury. Participants: Fifty-four consecutive patients with TBI who received comprehensive rehabilitation services and who were at different stages of recovery. Intervention: An immersive virtual kitchen was developed in which a meal preparation task involving multiple steps was performed. The subjects completed meal preparation both in a virtual reality kitchen and an actual kitchen twice over a 3-week period. Main Outcome Measures: Time and errors on task completion using virtual reality assessment, actual kitchen performance (analogous to the virtual reality environment), occupational therapy (OT) evaluation, and neuropsychologic tests. Results: The stability of performance using the simulated virtual environment was estimated with intraclass correlation coefficients (ICCs). The ICC value for total performance, based on all steps involved in the meal preparation task, was .76 (P<.01). The construct validity of the simulated environment was examined by correlating performance in the virtual environment with that in the actual kitchen (r=.63, P<.01), the OT evaluation (r=.30, P=.05 for meal preparation; r=.40, P=.01 for cognitive subskills), and neuropsychologic tests (r=.56, P<.01 for the full-scale intelligence quotient [IQ]; r=.40, P<.01 for the verbal IQ; r=.56, P<.01 for the performance IQ). Finally, a multiple regression analysis revealed that the virtual reality environment test was a good predictor for the actual assessment kitchen (β=.35, P=.01). Conclusion: The virtual reality system showed adequate reliability and validity as a method of assessment in persons with brain injury.",
keywords = "Brain injuries, Outcomes assessment (health care), Rehabilitation, Virtual systems",
author = "Ling Zhang and Abreu, {Beatriz C.} and Seale, {Gary S.} and Brent Masel and Christiansen, {Charles H.} and Kenneth Ottenbacher",
year = "2003",
month = "8",
day = "1",
doi = "10.1016/S0003-9993(03)00203-X",
language = "English (US)",
volume = "84",
pages = "1118--1124",
journal = "Archives of Physical Medicine and Rehabilitation",
issn = "0003-9993",
publisher = "W.B. Saunders Ltd",
number = "8",

}

TY - JOUR

T1 - A virtual reality environment for evaluation of a daily living skill in brain injury rehabilitation

T2 - Reliability and validity

AU - Zhang, Ling

AU - Abreu, Beatriz C.

AU - Seale, Gary S.

AU - Masel, Brent

AU - Christiansen, Charles H.

AU - Ottenbacher, Kenneth

PY - 2003/8/1

Y1 - 2003/8/1

N2 - Objective: To establish the stability and validity of information collected in a virtual reality environment from persons with traumatic brain injury (TBI). Design: Prospective correlation design to examine 3-week test-retest results for equivalence reliability between computer-simulated and natural environments. Setting: A residential rehabilitation center for brain injury. Participants: Fifty-four consecutive patients with TBI who received comprehensive rehabilitation services and who were at different stages of recovery. Intervention: An immersive virtual kitchen was developed in which a meal preparation task involving multiple steps was performed. The subjects completed meal preparation both in a virtual reality kitchen and an actual kitchen twice over a 3-week period. Main Outcome Measures: Time and errors on task completion using virtual reality assessment, actual kitchen performance (analogous to the virtual reality environment), occupational therapy (OT) evaluation, and neuropsychologic tests. Results: The stability of performance using the simulated virtual environment was estimated with intraclass correlation coefficients (ICCs). The ICC value for total performance, based on all steps involved in the meal preparation task, was .76 (P<.01). The construct validity of the simulated environment was examined by correlating performance in the virtual environment with that in the actual kitchen (r=.63, P<.01), the OT evaluation (r=.30, P=.05 for meal preparation; r=.40, P=.01 for cognitive subskills), and neuropsychologic tests (r=.56, P<.01 for the full-scale intelligence quotient [IQ]; r=.40, P<.01 for the verbal IQ; r=.56, P<.01 for the performance IQ). Finally, a multiple regression analysis revealed that the virtual reality environment test was a good predictor for the actual assessment kitchen (β=.35, P=.01). Conclusion: The virtual reality system showed adequate reliability and validity as a method of assessment in persons with brain injury.

AB - Objective: To establish the stability and validity of information collected in a virtual reality environment from persons with traumatic brain injury (TBI). Design: Prospective correlation design to examine 3-week test-retest results for equivalence reliability between computer-simulated and natural environments. Setting: A residential rehabilitation center for brain injury. Participants: Fifty-four consecutive patients with TBI who received comprehensive rehabilitation services and who were at different stages of recovery. Intervention: An immersive virtual kitchen was developed in which a meal preparation task involving multiple steps was performed. The subjects completed meal preparation both in a virtual reality kitchen and an actual kitchen twice over a 3-week period. Main Outcome Measures: Time and errors on task completion using virtual reality assessment, actual kitchen performance (analogous to the virtual reality environment), occupational therapy (OT) evaluation, and neuropsychologic tests. Results: The stability of performance using the simulated virtual environment was estimated with intraclass correlation coefficients (ICCs). The ICC value for total performance, based on all steps involved in the meal preparation task, was .76 (P<.01). The construct validity of the simulated environment was examined by correlating performance in the virtual environment with that in the actual kitchen (r=.63, P<.01), the OT evaluation (r=.30, P=.05 for meal preparation; r=.40, P=.01 for cognitive subskills), and neuropsychologic tests (r=.56, P<.01 for the full-scale intelligence quotient [IQ]; r=.40, P<.01 for the verbal IQ; r=.56, P<.01 for the performance IQ). Finally, a multiple regression analysis revealed that the virtual reality environment test was a good predictor for the actual assessment kitchen (β=.35, P=.01). Conclusion: The virtual reality system showed adequate reliability and validity as a method of assessment in persons with brain injury.

KW - Brain injuries

KW - Outcomes assessment (health care)

KW - Rehabilitation

KW - Virtual systems

UR - http://www.scopus.com/inward/record.url?scp=0041560905&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0041560905&partnerID=8YFLogxK

U2 - 10.1016/S0003-9993(03)00203-X

DO - 10.1016/S0003-9993(03)00203-X

M3 - Article

C2 - 12917848

AN - SCOPUS:0041560905

VL - 84

SP - 1118

EP - 1124

JO - Archives of Physical Medicine and Rehabilitation

JF - Archives of Physical Medicine and Rehabilitation

SN - 0003-9993

IS - 8

ER -