Development and validation of an intraoperative bleeding severity scale for use in clinical studies of hemostatic agents

Kevin M. Lewis, Qing Li, Drew S. Jones, Jo Michelle D Corrales, Hongyan Du, Philippe E. Spiess, Emanuele Lo Menzo, Abelardo DeAnda

Research output: Contribution to journalArticle

11 Citations (Scopus)

Abstract

Background Clinical studies investigating topical hemostatic agents have not used standardized definitions for intraoperative bleeding. The Food and Drug Administration has recently sought use of a validated, clinician-reported scale to standardized bleeding sites in these clinical studies. The intent of a scale is to reduce patient risk, generate labeling claims, and allow comparisons among study results. We describe the development and validation of an intraoperative bleeding severity scale. Methods A concept phase defined the framework of the scale. A feasibility and validation phase investigated the usability, clarity, relevance, and reliability (ie, intra- and interobserver concordance) among surgeons and surgical specialties as required by the Food and Drug Administration for the validation of a clinician-reported scale. Data were collected using an online tool. A total of 144 surgeons participated in the 3 phases. Results The scale developed during the concept phase achieved an average intraobserver concordance of 0.97 and an interobserver concordance of 0.89 in the feasibility phase (N = 33); a concordance of 1.0 is perfect. The scale was refined and then achieved an average intraobserver concordance of 0.98 and an interobserver concordance of 0.91 in the validation phase with unanimous agreement by surgeons from multiple surgical specialties that the scale can be implemented into clinical studies (N = 102). Conclusion This study validated an intraoperative bleeding severity scale for use in clinical studies investigating hemostatic agents. The scale was usable, clear, and clinically relevant with excellent reliability. The scale fulfills requirements of the Food and Drug Administration for a clinician-reported scale and can be used to generate clinically meaningful labeling claims.

Original languageEnglish (US)
Pages (from-to)771-781
Number of pages11
JournalSurgery (United States)
Volume161
Issue number3
DOIs
StatePublished - Mar 1 2017

Fingerprint

Hemostatics
United States Food and Drug Administration
Surgical Specialties
Hemorrhage
Clinical Studies
Surgeons

ASJC Scopus subject areas

  • Surgery

Cite this

Development and validation of an intraoperative bleeding severity scale for use in clinical studies of hemostatic agents. / Lewis, Kevin M.; Li, Qing; Jones, Drew S.; Corrales, Jo Michelle D; Du, Hongyan; Spiess, Philippe E.; Lo Menzo, Emanuele; DeAnda, Abelardo.

In: Surgery (United States), Vol. 161, No. 3, 01.03.2017, p. 771-781.

Research output: Contribution to journalArticle

Lewis, Kevin M. ; Li, Qing ; Jones, Drew S. ; Corrales, Jo Michelle D ; Du, Hongyan ; Spiess, Philippe E. ; Lo Menzo, Emanuele ; DeAnda, Abelardo. / Development and validation of an intraoperative bleeding severity scale for use in clinical studies of hemostatic agents. In: Surgery (United States). 2017 ; Vol. 161, No. 3. pp. 771-781.
@article{7b1c9e4b2e1f490596e684507104ff82,
title = "Development and validation of an intraoperative bleeding severity scale for use in clinical studies of hemostatic agents",
abstract = "Background Clinical studies investigating topical hemostatic agents have not used standardized definitions for intraoperative bleeding. The Food and Drug Administration has recently sought use of a validated, clinician-reported scale to standardized bleeding sites in these clinical studies. The intent of a scale is to reduce patient risk, generate labeling claims, and allow comparisons among study results. We describe the development and validation of an intraoperative bleeding severity scale. Methods A concept phase defined the framework of the scale. A feasibility and validation phase investigated the usability, clarity, relevance, and reliability (ie, intra- and interobserver concordance) among surgeons and surgical specialties as required by the Food and Drug Administration for the validation of a clinician-reported scale. Data were collected using an online tool. A total of 144 surgeons participated in the 3 phases. Results The scale developed during the concept phase achieved an average intraobserver concordance of 0.97 and an interobserver concordance of 0.89 in the feasibility phase (N = 33); a concordance of 1.0 is perfect. The scale was refined and then achieved an average intraobserver concordance of 0.98 and an interobserver concordance of 0.91 in the validation phase with unanimous agreement by surgeons from multiple surgical specialties that the scale can be implemented into clinical studies (N = 102). Conclusion This study validated an intraoperative bleeding severity scale for use in clinical studies investigating hemostatic agents. The scale was usable, clear, and clinically relevant with excellent reliability. The scale fulfills requirements of the Food and Drug Administration for a clinician-reported scale and can be used to generate clinically meaningful labeling claims.",
author = "Lewis, {Kevin M.} and Qing Li and Jones, {Drew S.} and Corrales, {Jo Michelle D} and Hongyan Du and Spiess, {Philippe E.} and {Lo Menzo}, Emanuele and Abelardo DeAnda",
year = "2017",
month = "3",
day = "1",
doi = "10.1016/j.surg.2016.09.022",
language = "English (US)",
volume = "161",
pages = "771--781",
journal = "Surgery (United States)",
issn = "0039-6060",
publisher = "Mosby Inc.",
number = "3",

}

TY - JOUR

T1 - Development and validation of an intraoperative bleeding severity scale for use in clinical studies of hemostatic agents

AU - Lewis, Kevin M.

AU - Li, Qing

AU - Jones, Drew S.

AU - Corrales, Jo Michelle D

AU - Du, Hongyan

AU - Spiess, Philippe E.

AU - Lo Menzo, Emanuele

AU - DeAnda, Abelardo

PY - 2017/3/1

Y1 - 2017/3/1

N2 - Background Clinical studies investigating topical hemostatic agents have not used standardized definitions for intraoperative bleeding. The Food and Drug Administration has recently sought use of a validated, clinician-reported scale to standardized bleeding sites in these clinical studies. The intent of a scale is to reduce patient risk, generate labeling claims, and allow comparisons among study results. We describe the development and validation of an intraoperative bleeding severity scale. Methods A concept phase defined the framework of the scale. A feasibility and validation phase investigated the usability, clarity, relevance, and reliability (ie, intra- and interobserver concordance) among surgeons and surgical specialties as required by the Food and Drug Administration for the validation of a clinician-reported scale. Data were collected using an online tool. A total of 144 surgeons participated in the 3 phases. Results The scale developed during the concept phase achieved an average intraobserver concordance of 0.97 and an interobserver concordance of 0.89 in the feasibility phase (N = 33); a concordance of 1.0 is perfect. The scale was refined and then achieved an average intraobserver concordance of 0.98 and an interobserver concordance of 0.91 in the validation phase with unanimous agreement by surgeons from multiple surgical specialties that the scale can be implemented into clinical studies (N = 102). Conclusion This study validated an intraoperative bleeding severity scale for use in clinical studies investigating hemostatic agents. The scale was usable, clear, and clinically relevant with excellent reliability. The scale fulfills requirements of the Food and Drug Administration for a clinician-reported scale and can be used to generate clinically meaningful labeling claims.

AB - Background Clinical studies investigating topical hemostatic agents have not used standardized definitions for intraoperative bleeding. The Food and Drug Administration has recently sought use of a validated, clinician-reported scale to standardized bleeding sites in these clinical studies. The intent of a scale is to reduce patient risk, generate labeling claims, and allow comparisons among study results. We describe the development and validation of an intraoperative bleeding severity scale. Methods A concept phase defined the framework of the scale. A feasibility and validation phase investigated the usability, clarity, relevance, and reliability (ie, intra- and interobserver concordance) among surgeons and surgical specialties as required by the Food and Drug Administration for the validation of a clinician-reported scale. Data were collected using an online tool. A total of 144 surgeons participated in the 3 phases. Results The scale developed during the concept phase achieved an average intraobserver concordance of 0.97 and an interobserver concordance of 0.89 in the feasibility phase (N = 33); a concordance of 1.0 is perfect. The scale was refined and then achieved an average intraobserver concordance of 0.98 and an interobserver concordance of 0.91 in the validation phase with unanimous agreement by surgeons from multiple surgical specialties that the scale can be implemented into clinical studies (N = 102). Conclusion This study validated an intraoperative bleeding severity scale for use in clinical studies investigating hemostatic agents. The scale was usable, clear, and clinically relevant with excellent reliability. The scale fulfills requirements of the Food and Drug Administration for a clinician-reported scale and can be used to generate clinically meaningful labeling claims.

UR - http://www.scopus.com/inward/record.url?scp=85006285114&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85006285114&partnerID=8YFLogxK

U2 - 10.1016/j.surg.2016.09.022

DO - 10.1016/j.surg.2016.09.022

M3 - Article

C2 - 27839931

AN - SCOPUS:85006285114

VL - 161

SP - 771

EP - 781

JO - Surgery (United States)

JF - Surgery (United States)

SN - 0039-6060

IS - 3

ER -