Use of the American College of Surgeons NSQIP surgical risk calculator for laparoscopic colectomy

How good is it and how can we improve it?

Kyle G. Cologne, Deborah S. Keller, Loriel Liwanag, Bikash Devaraj, Anthony J. Senagore

Research output: Contribution to journalArticle

41 Citations (Scopus)

Abstract

Background The American College of Surgeons NSQIP risk calculator was developed from multi-institutional clinical data to estimate preoperative risk. The impact of outliers has the potential to greatly affect predictions. Although the effect of outliers is minimized in large series, their impact on the individual provider or institution could be profound. No previous study has assessed the risk calculator for a single institution or provider, including outliers. Our goal was to evaluate the accuracy of the predicted outcomes at a single institution. Study Design Laparoscopic colectomies performed by two colorectal surgeons at a tertiary referral center were prospectively evaluated using the risk calculator. Predicted outcomes were compared with actual outcomes for length of stay (LOS), complications, return to the operating room, and death. Main outcomes measures were differences in actual vs predicted outcomes. Results One hundred and sixteen patients were included. Actual LOS was higher than predicted (mean ± SD 4.22 ± 5.49 days vs predicted 4.11 ± 1.18 days; p = 0.0001). Four outliers with multiple complications had an LOS >3 SDs from the mean. After removing these, observed LOS was significantly shorter than predicted (adjusted LOS mean ± SD 3.31 ± 2.30 days vs predicted 4.05 ± 1.14 days; p = 0.002). Occurrence of any complication was significantly lower than predicted (17.3% vs 19.4%; p = 0.05). Rates of major complications (13.2% vs 19.4%; p = 0.009) and surgical site infections (9.8% vs 11.8%; p = 0.006) were also significantly lower than predicted. There were no significant differences in death, urinary tract infection, renal failure, and reoperation rates. Conclusions Although the risk calculator was effective for evaluating average surgical-risk patients, it does not accurately predict outcomes in a small percentage of patients when one or more serious complications occur. Addition of surgeon- and patient-specific data via the American College of Surgeons case-logging system could better adjust for these areas.

Original languageEnglish (US)
Pages (from-to)281-286
Number of pages6
JournalJournal of the American College of Surgeons
Volume220
Issue number3
DOIs
StatePublished - Mar 1 2015
Externally publishedYes

Fingerprint

Colectomy
Length of Stay
Surgical Wound Infection
Operating Rooms
Reoperation
Tertiary Care Centers
Urinary Tract Infections
Renal Insufficiency
Outcome Assessment (Health Care)

ASJC Scopus subject areas

  • Surgery
  • Medicine(all)

Cite this

Use of the American College of Surgeons NSQIP surgical risk calculator for laparoscopic colectomy : How good is it and how can we improve it? / Cologne, Kyle G.; Keller, Deborah S.; Liwanag, Loriel; Devaraj, Bikash; Senagore, Anthony J.

In: Journal of the American College of Surgeons, Vol. 220, No. 3, 01.03.2015, p. 281-286.

Research output: Contribution to journalArticle

Cologne, Kyle G. ; Keller, Deborah S. ; Liwanag, Loriel ; Devaraj, Bikash ; Senagore, Anthony J. / Use of the American College of Surgeons NSQIP surgical risk calculator for laparoscopic colectomy : How good is it and how can we improve it?. In: Journal of the American College of Surgeons. 2015 ; Vol. 220, No. 3. pp. 281-286.
@article{a924e5d5b3a746da9db7b2bf6d1f6865,
title = "Use of the American College of Surgeons NSQIP surgical risk calculator for laparoscopic colectomy: How good is it and how can we improve it?",
abstract = "Background The American College of Surgeons NSQIP risk calculator was developed from multi-institutional clinical data to estimate preoperative risk. The impact of outliers has the potential to greatly affect predictions. Although the effect of outliers is minimized in large series, their impact on the individual provider or institution could be profound. No previous study has assessed the risk calculator for a single institution or provider, including outliers. Our goal was to evaluate the accuracy of the predicted outcomes at a single institution. Study Design Laparoscopic colectomies performed by two colorectal surgeons at a tertiary referral center were prospectively evaluated using the risk calculator. Predicted outcomes were compared with actual outcomes for length of stay (LOS), complications, return to the operating room, and death. Main outcomes measures were differences in actual vs predicted outcomes. Results One hundred and sixteen patients were included. Actual LOS was higher than predicted (mean ± SD 4.22 ± 5.49 days vs predicted 4.11 ± 1.18 days; p = 0.0001). Four outliers with multiple complications had an LOS >3 SDs from the mean. After removing these, observed LOS was significantly shorter than predicted (adjusted LOS mean ± SD 3.31 ± 2.30 days vs predicted 4.05 ± 1.14 days; p = 0.002). Occurrence of any complication was significantly lower than predicted (17.3{\%} vs 19.4{\%}; p = 0.05). Rates of major complications (13.2{\%} vs 19.4{\%}; p = 0.009) and surgical site infections (9.8{\%} vs 11.8{\%}; p = 0.006) were also significantly lower than predicted. There were no significant differences in death, urinary tract infection, renal failure, and reoperation rates. Conclusions Although the risk calculator was effective for evaluating average surgical-risk patients, it does not accurately predict outcomes in a small percentage of patients when one or more serious complications occur. Addition of surgeon- and patient-specific data via the American College of Surgeons case-logging system could better adjust for these areas.",
author = "Cologne, {Kyle G.} and Keller, {Deborah S.} and Loriel Liwanag and Bikash Devaraj and Senagore, {Anthony J.}",
year = "2015",
month = "3",
day = "1",
doi = "10.1016/j.jamcollsurg.2014.12.007",
language = "English (US)",
volume = "220",
pages = "281--286",
journal = "Journal of the American College of Surgeons",
issn = "1072-7515",
publisher = "Elsevier Inc.",
number = "3",

}

TY - JOUR

T1 - Use of the American College of Surgeons NSQIP surgical risk calculator for laparoscopic colectomy

T2 - How good is it and how can we improve it?

AU - Cologne, Kyle G.

AU - Keller, Deborah S.

AU - Liwanag, Loriel

AU - Devaraj, Bikash

AU - Senagore, Anthony J.

PY - 2015/3/1

Y1 - 2015/3/1

N2 - Background The American College of Surgeons NSQIP risk calculator was developed from multi-institutional clinical data to estimate preoperative risk. The impact of outliers has the potential to greatly affect predictions. Although the effect of outliers is minimized in large series, their impact on the individual provider or institution could be profound. No previous study has assessed the risk calculator for a single institution or provider, including outliers. Our goal was to evaluate the accuracy of the predicted outcomes at a single institution. Study Design Laparoscopic colectomies performed by two colorectal surgeons at a tertiary referral center were prospectively evaluated using the risk calculator. Predicted outcomes were compared with actual outcomes for length of stay (LOS), complications, return to the operating room, and death. Main outcomes measures were differences in actual vs predicted outcomes. Results One hundred and sixteen patients were included. Actual LOS was higher than predicted (mean ± SD 4.22 ± 5.49 days vs predicted 4.11 ± 1.18 days; p = 0.0001). Four outliers with multiple complications had an LOS >3 SDs from the mean. After removing these, observed LOS was significantly shorter than predicted (adjusted LOS mean ± SD 3.31 ± 2.30 days vs predicted 4.05 ± 1.14 days; p = 0.002). Occurrence of any complication was significantly lower than predicted (17.3% vs 19.4%; p = 0.05). Rates of major complications (13.2% vs 19.4%; p = 0.009) and surgical site infections (9.8% vs 11.8%; p = 0.006) were also significantly lower than predicted. There were no significant differences in death, urinary tract infection, renal failure, and reoperation rates. Conclusions Although the risk calculator was effective for evaluating average surgical-risk patients, it does not accurately predict outcomes in a small percentage of patients when one or more serious complications occur. Addition of surgeon- and patient-specific data via the American College of Surgeons case-logging system could better adjust for these areas.

AB - Background The American College of Surgeons NSQIP risk calculator was developed from multi-institutional clinical data to estimate preoperative risk. The impact of outliers has the potential to greatly affect predictions. Although the effect of outliers is minimized in large series, their impact on the individual provider or institution could be profound. No previous study has assessed the risk calculator for a single institution or provider, including outliers. Our goal was to evaluate the accuracy of the predicted outcomes at a single institution. Study Design Laparoscopic colectomies performed by two colorectal surgeons at a tertiary referral center were prospectively evaluated using the risk calculator. Predicted outcomes were compared with actual outcomes for length of stay (LOS), complications, return to the operating room, and death. Main outcomes measures were differences in actual vs predicted outcomes. Results One hundred and sixteen patients were included. Actual LOS was higher than predicted (mean ± SD 4.22 ± 5.49 days vs predicted 4.11 ± 1.18 days; p = 0.0001). Four outliers with multiple complications had an LOS >3 SDs from the mean. After removing these, observed LOS was significantly shorter than predicted (adjusted LOS mean ± SD 3.31 ± 2.30 days vs predicted 4.05 ± 1.14 days; p = 0.002). Occurrence of any complication was significantly lower than predicted (17.3% vs 19.4%; p = 0.05). Rates of major complications (13.2% vs 19.4%; p = 0.009) and surgical site infections (9.8% vs 11.8%; p = 0.006) were also significantly lower than predicted. There were no significant differences in death, urinary tract infection, renal failure, and reoperation rates. Conclusions Although the risk calculator was effective for evaluating average surgical-risk patients, it does not accurately predict outcomes in a small percentage of patients when one or more serious complications occur. Addition of surgeon- and patient-specific data via the American College of Surgeons case-logging system could better adjust for these areas.

UR - http://www.scopus.com/inward/record.url?scp=84923254819&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84923254819&partnerID=8YFLogxK

U2 - 10.1016/j.jamcollsurg.2014.12.007

DO - 10.1016/j.jamcollsurg.2014.12.007

M3 - Article

VL - 220

SP - 281

EP - 286

JO - Journal of the American College of Surgeons

JF - Journal of the American College of Surgeons

SN - 1072-7515

IS - 3

ER -