نشریه علمی پژوهشی طب انتظامی Journal of Police Medicine
Volume 12, Issue 1 (2023)
J Police Med 2023, 12(1) |
Back to browse issues page
Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:
Moradimajd P, Taghizadeh S, Sedigh Maroufi S. Designing and Psychometry of the Evaluation Checklist for the Registration and Labeling Guidelines of Anesthetic Drugs in the Operating Room. J Police Med 2023; 12 (1) : e8
URL: http://jpmed.ir/article-1-1167-en.html
URL: http://jpmed.ir/article-1-1167-en.html
1- Department of Anesthesia, Faculty of Paramedicine, Iran University of Medical Sciences, Tehran, Iran , moradimajd.p@gmail.com
2- Department of Anesthesia, Faculty of Paramedicine, Iran University of Medical Sciences, Tehran, Iran
2- Department of Anesthesia, Faculty of Paramedicine, Iran University of Medical Sciences, Tehran, Iran
English Extended Abstract: (1308 Views)
Aims: The correct registration and labeling of anesthetic drugs in the operating room are the basic and important principles in order to maintain patient safety, reduce the wastage of drugs and their subsequent costs, and reduce environmental pollution. Therefore, the present study was conducted with the aim of designing and psychometry of evaluation checklist for the registration and labeling guidelines of anesthetic drugs in the operating room.
Materials and Methods: This descriptive-analytical research was conducted in 2022 in the Iran University of Medical Sciences. In order to design the checklist, the latest and most reliable scientific sources in the field of anesthesia were examined and the opinions of experts of the university's Department of Anesthesia were used. To determine the validity of the checklist, face and content validity (content validity index and content validity ratio) were calculated. In order to determine the reliability of the checklist, two methods of test-retest reliability and inter-rater reliability were used. The research results were analyzed using SPSS 22 software.
Findings: All the examined items in the checklist had good status in terms of face validity index and terms of the obtained importance score in comparison with the optimal level of effect (1.5 and more) (Table 1). Based on this, all items on the checklist obtained the necessary criteria for face validity and remained on the checklist. The evaluation results of the content validity index and value of the content validity index showed that most of the items had the desired statistical limits in the field of content validity, and their validity was confirmed in this respect; in other words, the measurement of the content validity ratio (CVR) showed that the score of 15 of the 19 initial items of the checklist was greater than the value of the Lawshe table (0.62) and these items remained in the checklist. This indicated that essential and important items were used in this checklist (Table 2). The score of the item of "the method of writing capital letters is used for drugs with similar names" was obtained as 0.60; due to the closeness of this number to the optimal level and due to the high content validity index of this item which was obtained as 1, and using the opinion of experts, this item was retained. Also, based on the research findings, the content validity index (CVI) in all items was more than 0.79; therefore, the mentioned items were recognized as suitable, and there was no change in the appearance of the items. Finally, using the results of CVR and CVI and considering the optimal level for these indicators, three items were removed from the checklist, and the final checklist with 16 items was designed and psychometrically evaluated (Table 2).
The results of the retest method using the intraclass correlation coefficient are presented in Table 3. In this method, ICC value was 0.992 (95% confidence interval). Also, Cronbach's alpha was 0.912 for the preliminary test and 0.992 for the second test (retest), which results showed that the checklist designed in terms of reliability over time (using the test-retest or test-retest validity method) has good reliability.
The results of the inter-rater agreement method using the intraclass correlation coefficient to check the reliability are presented in Table 4. In this method, the ICC rate was 0.987 (with a 95% confidence interval), which indicated that the checklist designed with the method of an inter-rater agreement had good reliability.
Conclusion: The research findings show the checklist's face and content validity and good reliability. Therefore, it can be used to evaluate the level of observance of the guidelines for registering and labeling anesthetic drugs.
Clinical & Practical Tips in POLICE MEDICINE: The current checklist is a practical tool to evaluate the process of registering and labeling intravenous anesthetics in operating rooms. Police hospitals can use this checklist as a quick and safe method to evaluate compliance with the instructions for registration and labeling of anesthetic drugs by the anesthesia experts working in the operating room.
Acknowledgments: Iran University of Medical Sciences and the medical staff of Shafa Yahyayan Hospital in Tehran are gratefully acknowledged.
Conflict of interest: The article's authors stated that the present study has no conflict of interest.
Authors' Contribution: Data collection and article writing by Shaghayegh Taghizadeh; Presenting the idea and design of the study by Parisa Moradi Majd; Data collection by Shahnam Sediq Maroufi; Data interpretation by Azam Saei; Statistical data analysis by Jamile Abolghasemi. All authors have approved the present article, and they accept responsibility for the accuracy and correctness of the content.
Financial Sources: The financial sponsor of the present study was the Research Vice-Chancellor of the Paramedical Faculty of Iran University of Medical Sciences.
Table 4) intraclass correlation coefficient (ICC) to check reliability (Inter-rater agreement)
Materials and Methods: This descriptive-analytical research was conducted in 2022 in the Iran University of Medical Sciences. In order to design the checklist, the latest and most reliable scientific sources in the field of anesthesia were examined and the opinions of experts of the university's Department of Anesthesia were used. To determine the validity of the checklist, face and content validity (content validity index and content validity ratio) were calculated. In order to determine the reliability of the checklist, two methods of test-retest reliability and inter-rater reliability were used. The research results were analyzed using SPSS 22 software.
Findings: All the examined items in the checklist had good status in terms of face validity index and terms of the obtained importance score in comparison with the optimal level of effect (1.5 and more) (Table 1). Based on this, all items on the checklist obtained the necessary criteria for face validity and remained on the checklist. The evaluation results of the content validity index and value of the content validity index showed that most of the items had the desired statistical limits in the field of content validity, and their validity was confirmed in this respect; in other words, the measurement of the content validity ratio (CVR) showed that the score of 15 of the 19 initial items of the checklist was greater than the value of the Lawshe table (0.62) and these items remained in the checklist. This indicated that essential and important items were used in this checklist (Table 2). The score of the item of "the method of writing capital letters is used for drugs with similar names" was obtained as 0.60; due to the closeness of this number to the optimal level and due to the high content validity index of this item which was obtained as 1, and using the opinion of experts, this item was retained. Also, based on the research findings, the content validity index (CVI) in all items was more than 0.79; therefore, the mentioned items were recognized as suitable, and there was no change in the appearance of the items. Finally, using the results of CVR and CVI and considering the optimal level for these indicators, three items were removed from the checklist, and the final checklist with 16 items was designed and psychometrically evaluated (Table 2).
The results of the retest method using the intraclass correlation coefficient are presented in Table 3. In this method, ICC value was 0.992 (95% confidence interval). Also, Cronbach's alpha was 0.912 for the preliminary test and 0.992 for the second test (retest), which results showed that the checklist designed in terms of reliability over time (using the test-retest or test-retest validity method) has good reliability.
The results of the inter-rater agreement method using the intraclass correlation coefficient to check the reliability are presented in Table 4. In this method, the ICC rate was 0.987 (with a 95% confidence interval), which indicated that the checklist designed with the method of an inter-rater agreement had good reliability.
Conclusion: The research findings show the checklist's face and content validity and good reliability. Therefore, it can be used to evaluate the level of observance of the guidelines for registering and labeling anesthetic drugs.
Clinical & Practical Tips in POLICE MEDICINE: The current checklist is a practical tool to evaluate the process of registering and labeling intravenous anesthetics in operating rooms. Police hospitals can use this checklist as a quick and safe method to evaluate compliance with the instructions for registration and labeling of anesthetic drugs by the anesthesia experts working in the operating room.
Acknowledgments: Iran University of Medical Sciences and the medical staff of Shafa Yahyayan Hospital in Tehran are gratefully acknowledged.
Conflict of interest: The article's authors stated that the present study has no conflict of interest.
Authors' Contribution: Data collection and article writing by Shaghayegh Taghizadeh; Presenting the idea and design of the study by Parisa Moradi Majd; Data collection by Shahnam Sediq Maroufi; Data interpretation by Azam Saei; Statistical data analysis by Jamile Abolghasemi. All authors have approved the present article, and they accept responsibility for the accuracy and correctness of the content.
Financial Sources: The financial sponsor of the present study was the Research Vice-Chancellor of the Paramedical Faculty of Iran University of Medical Sciences.
Table 1) face validity of checklist items for the evaluation of guidelines
for registration and labeling of anesthetic drugs in the operating room
for registration and labeling of anesthetic drugs in the operating room
| Row | Items | Optimal impact score | The resulting effect coefficient |
| 1 | All drug syringes are labeled as soon as they are prepared. | 1.5< | 5 |
| 2 | Labels with appropriate size and transparent background have been used. | 1.5< | 4.80 |
| 3 | Colored medicinal labels have been used. | 1.5< | 4.60 |
| 4 | Labels are inserted vertically or below the graduation lines on the syringe. | 1.5< | 4.60 |
| 5 | The full generic name of the drugs is written on the syringe label. | 1.5< | 4.90 |
| 6 | The concentration of drugs in units per milliliter is written on the syringe label. | 1.5< | 4.90 |
| 7 | The medicinal concentration units are fully written on the syringe label. If needed, the unit of micrograms is written in mcg and the unit of milligrams is written in mg on the syringe label.* | 1.5< | 4.80 |
| 8 | The time of drug preparation is written on the syringe label. | 1.5< | 4.50 |
| 9 | The date of drug preparation is written on the syringe label. | 1.5< | 4.50 |
| 10 | The name of the person preparing the medicine is written on the syringe label. | 1.5< | 3.70 |
| 11 | The name and volume of the drug dilution solution is written on the syringe label. | 1.5< | 4 |
| 12 | The expiration date of the drug after preparation is written on the syringe label. | 1.5< | 4 |
| 13 | Medication information is legibly written on the syringe label. | 1.5< | 4.90 |
| 14 | Capital letters have been used for drugs with similar names. | 1.5< | 4.60 |
| 15 | Drug information is not deleted after being recorded on the syringe label. | 1.5< | 4.60 |
| 16 | The drug information is written in the registration sheet immediately after the injection to the patient. | 1.5< | 4/40 |
| 17 | The name, dose, and time of administration of anesthesia-inducing drugs are written in the registration form. | 1.5< | 4.70 |
| 18 | The name, dose and time of administration of anesthesia maintenance drugs are written in the registration form** | 1.5< | 4.70 |
| 19 | The name, dose and time of administration of other drugs required during the procedure are written in the registration form*** | 1.5< | 4.70 |
*If there is a need to mention more information about the concentration of the drug
**Using capital letters in writing the names of drugs with similar names to emphasize the
difference in the names ***Infusion of drugs**** such as drugs that neutralize the effect
of neuromuscular relaxants, drugs To control pain, nausea and vomiting, inflammation, etc
Table 2) The content validity of checklist items for the evaluation of the guidelines
for registration and labeling of anesthetic drugs in the operating room
**Using capital letters in writing the names of drugs with similar names to emphasize the
difference in the names ***Infusion of drugs**** such as drugs that neutralize the effect
of neuromuscular relaxants, drugs To control pain, nausea and vomiting, inflammation, etc
Table 2) The content validity of checklist items for the evaluation of the guidelines
for registration and labeling of anesthetic drugs in the operating room
| Row | Items | CVR | CVI |
| 1 | All medication syringes are labeled as soon as they are prepared. | 1 | 1 |
| 2 | Labels with appropriate size and transparent background have been used. | 0.80 | 1 |
| 3 | Colored medicinal labels have been used. | 0.80 | 0.80 |
| 4 | Labels are inserted vertically or below the graduation lines on the syringe. | 0.80 | 1 |
| 5 | The full generic name of the drugs is written on the syringe label. | 1 | 1 |
| 6 | The concentration of drugs in units per milliliter is written on the syringe label. | 1 | 1 |
| 7 | The medicinal concentration units are fully written on the syringe label. If needed, the unit of micrograms is written in mcg and the unit of milligrams is written in mg on the syringe label.* | 1 | 1 |
| 8 | The time of drug preparation is written on the syringe label. | 0.80 | 1 |
| 9 | The date of drug preparation is written on the syringe label. | 0.80 | 1 |
| 10 | The name of the person preparing the medicine is written on the syringe label. | 0.20 | 0.80 |
| 11 | The name and volume of the drug dilution solution is written on the syringe label. | 0.40 | 0.80 |
| 12 | The expiration date of the drug after preparation is written on the syringe label. | 0.20 | 0.80 |
| 13 | Medication information is legibly written on the syringe label. | 1 | 0.90 |
| 14 | Capital letters have been used for drugs with similar names. | 0.60 | 1 |
| 15 | Drug information is not deleted after being recorded on the syringe label. | 0.80 | 1 |
| 16 | The drug information is written in the registration sheet immediately after the injection to the patient. | 0.80 | 0.80 |
| 17 | The name, dose, and time of administration of anesthesia-inducing drugs are written in the registration form. | 1 | 1 |
| 18 | The name, dose and time of administration of anesthesia maintenance drugs are written in the registration form** | 0.80 | 1 |
| 19 | The name, dose and time of administration of other drugs required during the procedure are written in the registration form*** | 1 | 1 |
* If it is necessary to mention more information about the concentration of the drug
** Using capital letters in writing the names of drugs with similar names to emphasize the
difference in the names *** Infusion of drugs **** such as drugs that neutralize the effect
of neuromuscular relaxants, drugs for Control of pain, nausea and vomiting, inflammation, etc
Table 3) intraclass correlation coefficient (ICC) to check reliability (retest reliability)
** Using capital letters in writing the names of drugs with similar names to emphasize the
difference in the names *** Infusion of drugs **** such as drugs that neutralize the effect
of neuromuscular relaxants, drugs for Control of pain, nausea and vomiting, inflammation, etc
Table 3) intraclass correlation coefficient (ICC) to check reliability (retest reliability)
| ICC | Number of items | lower limit ICC | upper limit ICC | Possibility |
| 0.992 | 16 | 0.980 | 0.997 | 0.001> |
Table 4) intraclass correlation coefficient (ICC) to check reliability (Inter-rater agreement)
| ICC | Number of items | lower limit ICC | upper limit ICC | Possibility |
| 0.987 | 16 | 0.968 | 0.995 | 0.001> |
Article number: e8
Keywords: Psychometrics [MeSH], Checklist [MeSH], Registration [MeSH], Labeling [MeSH], Anesthetic Drugs [MeSH]
Article Type: Original Research |
Subject:
Police Medicine Emergencies
Received: 2023/01/2 | Accepted: 2023/02/5 | Published: 2023/04/5
Received: 2023/01/2 | Accepted: 2023/02/5 | Published: 2023/04/5
References
1. Larmené-Beld KHM, Alting EK, Taxis K. A systematic literature review on strategies to avoid look-alike errors of labels. Eur J Clin Pharmacol. 2018;74(8):985-93. [DOI:10.1007/s00228-018-2471-z] [PMID] [PMCID]
2. Statement on Labeling of Pharmaceuticals Used in the Practice of Anesthesiology https://www.ashp.org/;2020
3. Küçükosman G, Aydın BG, Ayoğlu H. Attitudes and behaviors of anesthesia workers in Turkey towards drug labeling: A questionnaire study. Istanb Med J. 2019;20(4):299-305. https://cms.istanbulmedicaljournal.org/Uploads/Article_29837/IMJ-20-299-En.pdf [DOI:10.4274/imj.galenos.2019.68815]
4. Orser BA, Hyland S, U D, Sheppard I, Wilson CR. Review article: improving drug safety for patients undergoing anesthesia and surgery. Can J Anesth. 2013;60(2):127-35. [DOI:10.1007/s12630-012-9853-y] [PMID]
5. Dolan SA, Arias KM, Felizardo G, Barnes S, Kraska S, Patrick M, et al. APIC position paper: Safe injection, infusion, and medication vial practices in health care. Am J Infect Control. 2016;44(7):750-7. [DOI:10.1016/j.ajic.2016.02.033] [PMID]
6. Safety ACo, Care QiH. National standard for User-applied labelling of injectable medicines, fluids and lines. ACSQHC Sydney. 2015. https://www.safetyandquality.gov.au/publications-and-resources/resource-library/national-standard-user-applied-labelling-injectable-medicines-fluids-and-lines
7. Wilbanks BA, Geisz-Everson M, Boust RR. The role of documentation quality in anesthesia-related closed claims: A descriptive qualitative study. Comput Inform Nurs. 2016;34(9):406-12.
https://doi.org/10.1097/CIN.0000000000000270 [DOI:10.1097/cin.0000000000000270] [PMID]
8. Gebremedhn E, Nagaratnam V. Audit on anesthetic record completeness at a university teaching hospital operation theater of low-resource setting. J Anesth Crit Care. 2013;8(2):00298. [DOI:10.15406/jaccoa.2017.08.00298]
9. Yimer H, Yalew S. Audit on wastage of commonly used anaesthetic and analgesic agents in developing country: The case of Ethiopian University Teaching Hospital. J Anesth Clin Res. 2017;8(11):2-6. DOI: 10.4172/2155-6148.1000778 [DOI:10.4172/2155-6148.1000778]
10. Pourhossein M, Pourbabaki R, Roudi E, Moshiran VA, Khani HM, Khodaverdloo S. Labeling as a preventive approach for cognitive errors by medical staff in the use of look-alike-sound-alike (LASA) medications: A systematic review. J Health Saf Work. 2021;10(4):391-405. [Persian]. http://jhsw.tums.ac.ir/article-1-6414-en.html
11. Barbariol F, Deana C, Lucchese F, Cataldi G, Bassi F, Bove T, et al. Evaluation of drug wastage in the operating rooms and intensive care units of a regional health service. Anesth Analg. 2021;132(5):1450-6.
https://doi.org/10.1213/ANE.0000000000005457 [DOI:10.1213/ane.0000000000005457] [PMID]
12. Kaniyil S, Krishnadas A, Parathody AK, Ramadas KT. Financial implications of intravenous anesthetic drug wastage in operation room. Anesth Essays Res. 2017;11(2):304-8. [DOI:10.4103/0259-1162.186596] [PMID] [PMCID]
13. Shannon J, O'Riain S. Introduction of "international syringe labelling" in the Republic of Ireland. Ir J Med Sci. 2009;178(3):291-6. [DOI:10.1007/s11845-009-0342-4] [PMID]
14. Jaichenco AL, Lima LC. 50 - Infectious disease considerations for the operating room. A Practice of Anesthesia for Infants and Children (Sixth Edition). Philadelphia: Elsevier; 2019. 1146-60p. https://www.us.elsevierhealth.com/a-practice-of-anesthesia-for-infants-and-children-9780323429740.html [DOI:10.1016/B978-0-323-42974-0.00050-1] [PMCID]
15. Zorrilla-Vaca A, Escandón-Vargas K. The importance of infection control and prevention in anesthesiology. Colomb J Anesth. 2017;45:69-77. [DOI:10.1016/j.rcae.2017.10.001]
16. Eichhorn JH. APSF hosts medication safety conference. Consensus group defines challenges and opportunities for improved practice APSF Newsletter. 2010;25(1):1-8. https://www.apsf.org/article/apsf-hosts-medication-safety-conference/
17. Rebello E, Botney R. Drug labeling in the perioperative environment: issues that may contribute to medication errors. ASA Monitor. 2021;85(9):40-1. [DOI:10.1097/01.ASM.0000791648.86347.e9]
18. Levine WC. Bar code-assisted medication labeling: A novel system to improve efficiency and patient safety. Int J Anesth Pain Med. 2015;1(1):6. http://anaesthesia-painmedicine.imedpub.com/archive.php
19. Grissinger M. Reducing errors with injectable medications. Pharm Ther. 2010;35(8):428-51. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2935650/
20. Velayudhan S, Arumugam V. Syringe label: A potential source of dosage error. Indian J Anesth. 2014;58(4):506-7.
https://doi.org/10.4103/0019-5049.139036 [DOI:10.4103%2F0019-5049.139036] [PMID] [PMCID]
Send email to the article author
| Rights and permissions | |
 |
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License. |