The method of integral evaluation of the efficiency of the neurosurgical clinic based on the assessment of the degree of achievement of key performance indicators

Cover Page

Cite item

Full Text

Abstract

BACKGROUND: The efficiency of a modern clinic, including neurosurgery, is traditionally assessed through the prism over a set of indicators. However, a common approach to assessing the effectiveness of medical and preventive institutions and a corresponding set of universal private indicators that allow comparing them with each other are not available.

OBJECTIVE: To evaluate the efficacy of a neurosurgical clinic through a quality indicator perspective using the goal attainment scale.

MATERIALS AND METHODS: Eleven key indicators (target categories) were selected for the integral results assessment of the neurosurgical clinic. Calculated indicators were evaluated using a special scale — the goal achievement scale developed by Kiresyuk and Sherman.

RESULTS. Based on continuous analysis conducted on the key work parameters in the Neurosurgery Center from 2014 to 2021, the target indicators were “weighed” and indicators ("0") were formed, relative to which the degree of goal achievement was subsequently assessed (from "+2" to "–2"). The level required to achieve the targets was calculated in the web application. The results of the clinic's work in 2021 have significantly improved by some indicators (number of performed operations, postoperative mortality, respiratory and urinary system infections, surgical wound infections (meningitis) per 100 ICU patients with severe complications), while the indicators of surgical activity, bloodstream infections and the number of revisions have deteriorated.

CONCLUSION. Qualitative and quantitative indicators of a modern clinic can be systematically analyzed to assess the effectiveness of its work using a scale for goal achievement. This scale integration into a web application makes it possible to easily and quickly obtain information about the degree of goal achievement in a real-time mode and makes it possible to conduct external benchmarking.

About the authors

Dmitry Yu. Usachev

Burdenko National Medical Research Center for Neurosurgery

Email: DOusachev@nsi.ru
ORCID iD: 0000-0002-9811-9442
SPIN-code: 6618-0420

MD, Dr. Sci. (Med.), Academician of RAS, Neurosurgeon

Russian Federation, Moscow

Anton G. Nazarenko

Priorov National Medical Research Center for Traumatology and Orthopedics

Email: nazarenkoag@cito-priorov.ru
ORCID iD: 0000-0003-1314-2887
SPIN-code: 1402-5186

MD, Dr. Sci. (Med.), Professor of RAS, Traumatologist-Orthopedist

Russian Federation, Moscow

Nikolai A. Konovalov

Burdenko National Medical Research Center for Neurosurgery

Email: NAKonovalov@nsi.ru
ORCID iD: 0000-0003-0824-1848
SPIN-code: 9436-3719

MD, Dr. Sci. (Med.), Corresponding Member of RAS, Neurosurgeon

Russian Federation, Moscow

Alexander A. Dokukin

Federal Research Center «Computer Science and Control» of the Russian Academy of Sciences

Email: dalex@ccas.ru

Cand. Sci. (Phys.-Math.), Senior Researcher

Russian Federation, Moscow

Oleg I. Sharipov

Burdenko National Medical Research Center for Neurosurgery

Author for correspondence.
Email: osharipov@nsi.ru
ORCID iD: 0000-0003-3777-5662
SPIN-code: 3279-0844

MD, Cand. Sci. (Med.), Neurosurgeon

Russian Federation, Moscow

Pavel L. Kalinin

Burdenko National Medical Research Center for Neurosurgery

Email: PKalinin@nsi.ru
ORCID iD: 0000-0001-9333-9473
SPIN-code: 1775-7421

MD, Dr. Sci. (Med.)

Russian Federation, Moscow

Maria A. Shults

Burdenko National Medical Research Center for Neurosurgery

Email: MShults@nsi.ru
ORCID iD: 0000-0002-1727-5102
SPIN-code: 4250-6871

MD, Cand. Sci. (Med.), Neurosurgeon

Russian Federation, Moscow

Alexander A. Sychev

Burdenko National Medical Research Center for Neurosurgery

Email: ASichev@nsi.ru
ORCID iD: 0000-0002-0038-1005
SPIN-code: 1171-7690

MD, Dr. Sci. (Med.)

Russian Federation, Moscow

Anastasia I. Baranich

Burdenko National Medical Research Center for Neurosurgery

Email: abaranich@nsi.ru
ORCID iD: 0000-0002-1167-0742

MD, Cand. Sci. (Med.)

Russian Federation, Moscow

References

  1. Kiresuk TJ, Sherman RE. Goal attainment scaling: A general method for evaluating comprehensive community mental health programs. Community Ment Health J. 1968;4(6):443–453. doi: 10.1007/BF01530764
  2. Zidarov D, Poissant L, Sicotte C. Healthcare executives’ readiness for a performance measurement system: A rehabilitation hospital case study. Journal of Hospital Administration. 2014;3(4):157–172. doi: 10.5430/jha.v3n4p157
  3. Ahluwalia SC, Damberg CL, Silverman M, Motala A, Shekelle PG. What Defines a High-Performing Health Care Delivery System: A Systematic Review. The Joint Commission Journal on Quality and Patient Safety. 2017;43(9):450–459. doi: 10.1016/j.jcjq.2017.03.010
  4. Taraskina YuV. Indicators of business processes as a basis for evaluating the effectiveness of an organization. Bulletin of the Astrakhan State Technical University. Series: Economics. 2015;(4):15–22. (In Russ).
  5. Turenko TA. Methodological approaches to assessing the effectiveness and efficiency of healthcare based on official statistics. Izvestiya Irkutsk State Academy of Economics. 2013;(4):120–125. (In Russ).
  6. Cantor VJ, Poh KL. Integrated Analysis of Healthcare Efficiency: A Systematic Review. J Med Syst. 2018;42(1):1–23. doi: 10.1007/s10916-017-0848-7
  7. Hadji B, Meyer R, Melikeche S, Escalon S, Degoulet P. Assessing the relationships between hospital resources and activities: a systematic review. Journal of Medical Systems. 2014;38(10):127. doi: 10.1007/s10916-014-0127-9
  8. Nazarenko AG. The choice of optimal surgical tactics for degenerative diseases of the lumbosacral spine using an information and analytical system and computer modeling [dissertation]. Moscow; 2012. Available from: https://new-disser.ru/_avtoreferats/01005093867.pdf?ysclid=lkwl77r8dt931864027 (In Russ).
  9. Nazarenko AG, Ivanov IV, Shchesyul AG, Shimansky VN, Savin IA, Gadzhieva OA, Ershova ON, Matueva NM, Konovalov NA, Shultz MA, Danilov GV, Sosnin AD, Baranich AI, Sharipov OI. Monitoring of triggers of adverse events as a tool for quality management of medical care in a neurosurgical clinic. Invitation to a discussion. Questions of neurosurgery. 2019;83(6):35–43. (In Russ). doi: 10.17116/neiro20198306135/
  10. Nazarenko AG, Usachev DYu, Konovalov NA, Tanyashin SV, Sharipov OI, Shultz MA, Kalinin PL. Analysis of key indicators of the quality of the neurosurgical clinic. Quality management in medicine. 2021;(1):97–103. (In Russ).
  11. Lichiello P, Turnock BJ. Guidebook for Performance Measurement. 1999. Available from: https://www.phf.org/resourcestools/Documents/pmcguidebook.pdf
  12. Wolk A, Dholakia A, Kreitz K. Building a Performance Measurement System. Cambridge: Root Cause; 2009.
  13. Nazarenko GI. Goal-setting in clinical practice. N.N. Priorov Journal of Traumatology and Orthopedics. 2008;15(4):3–10. (In Russ).
  14. Petlenko VP, Baranovsky AYu. Methodological foundations of forecasting in medicine. Clinical medicine. 1992;70(1):3–8. (In Russ).
  15. Ryazanov VV. Logical patterns in recognition problems (parametric approach). Computational Mathematics and Mathematical Physics. 2007;47(10):173–1808. (In Russ). doi: 10.1134/S0965542507100120
  16. March JG, Sutton RI. Organizational performance as a dependent variable. Organization Science. 1997;8(6):697–706. doi: 10.1287/orsc.8.6.698

Supplementary files

Supplementary Files
Action
1. JATS XML
2. Fig. 1. Web application interface. Ranking («weighing») target indicators and entering the results of the assessment of key indicators.

Download (348KB)
3. Fig. 2. Web application interface. The result, reflecting the degree of achievement of the goals.

Download (359KB)

Copyright (c) 2023 Eco-Vector

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Согласие на обработку персональных данных

 

Используя сайт https://journals.rcsi.science, я (далее – «Пользователь» или «Субъект персональных данных») даю согласие на обработку персональных данных на этом сайте (текст Согласия) и на обработку персональных данных с помощью сервиса «Яндекс.Метрика» (текст Согласия).