Effectiveness of a portfolio model on the performance of the virtual osce
DOI:
https://doi.org/10.37467/revtechno.v13.4788Keywords:
COVID-19, Effectiveness, Medicine, Model, OSCEAbstract
We evaluated the effectiveness of the portfolio combined with the flipped classroom, team-based learning, and online videos on students' performance in a virtual OSCE and their perception of the attributes of the OSCE and videos.
The integration of the virtual OSCE in a medicine program manages the need to be on campus in the context of COVID-19, requires minimal technological resources, fulfills the main objective of creating a format of acceptable, low cost, and low administrative burden, and can be implemented in a short period.
References
Al-Mously, N., Nabil, N. M., & Salem, R. (2012). Student Feedback on OSPE: An Experience of a New Medical School in Saudi Arabia. Medical Science Educator, 22(1), 10–16. https://doi.org/10.1007/BF03341746
Allen, R., Heard, J., Savidge, M., Bittergle, J., Cantrell, M., & Huffmaster, T. (1998). Surveying Students’ Attitudes During the OSCE. Advances in Health Sciences Education, 3, 197–206.
Anderson, M., & Stickley, T. (2002). Finding reality: the use of objective structured clinical examination (OSCE) in the assessment of mental health nursing students interpersonal skills. Nurse Education in Practice, 2(3), 160–168. https://doi.org/10.1054/nepr.2002.0067
Azim Majumder, A., Kumar, A., Krishnamurthy, K., Ojeh, N., Adams, O. P., & Sa, B. (2019). An evaluative study of objective structured clinical examination (OSCE): students and examiners perspectives. Advances in Medical Education and Practice, Volume 10, 387–397. https://doi.org/10.2147/AMEP.S197275
Baig, M., Gazzaz, Z., & Farooq, M. (2020). Blended Learning: The impact of blackboard formative assessment on the final marks and students’ perception of its effectiveness. Pakistan Journal of Medical Sciences, 36. https://doi.org/10.12669/pjms.36.3.1925
Bedford, J., Enria, D., Giesecke, J., Heymann, D. L., Ihekweazu, C., Kobinger, G., Lane, H. C., Memish, Z., Oh, M., Sall, A. A., Schuchat, A., Ungchusak, K., & Wieler, L. H. (2020). COVID-19: towards controlling of a pandemic. The Lancet, 395(10229), 1015–1018. https://doi.org/10.1016/S0140-6736(20)30673-5
Bevan, J., Russell, B., & Marshall, B. (2019). A new approach to OSCE preparation - PrOSCEs. BMC Medical Education, 19. https://doi.org/10.1186/s12909-019-1571-5
Boursicot, K., Kemp, S., Ong, T., Wijaya, L., Goh, S., Freeman, K., & Curran, I. (2020). Conducting a high-stakes OSCE in a COVID-19 environment. MedEdPublish, 9. https://doi.org/10.15694/mep.2020.000054.1
Brand, H. S., & Schoonheim-Klein, M. (2009). Is the OSCE more stressful? Examination anxiety and its consequences in different assessment methods in dental education. European Journal of Dental Education, 13(3), 147–153. https://doi.org/10.1111/j.1600-0579.2008.00554.x
Díaz-Plasencia, J. A., Sánchez de Cáceda, E., Guzmán-Gavidia, C., Valencia-Mariñas, H., García-Cabrera, J., Yan-Quiroz, E., & Díaz-Villazón, M. (2016). Fiabilidad y validez de un portafolio reflexivo en la evaluación de la práctica clínica de los estudiantes del capítulo de Cirugía Oncológica del curso de Cirugía. Revista de La Fundación Educación Médica, 19(4), 175. https://doi.org/10.33588/fem.194.846
Diaz-Plasencia, J., Moreno-Castillo, P. A., Calmet, J., Yan, E., Díaz Villazón, M., Iglesias-Obando, A., Zegarra-Castillo, K., & Urquiaga-Ríos, K. (2016). Validez concurrente del examen clínico objetivo estructurado con el portafolio electrónico, examen teórico y promedio ponderado en estudiantes de cirugía de la Universidad Privada Antenor Orrego. Revista de La Fundación Educación Médica, 19, 237. https://doi.org/10.33588/fem.195.855
Dinscore, A., & Andres, A. (2010). Surgical Videos Online: A Survey of Prominent Sources and Future Trends. Medical Reference Services Quarterly, 29(1), 10–27. https://doi.org/10.1080/02763860903484996
Donkin, R., Askew, E., & Stevenson, H. (2019). Video feedback and e-Learning enhances laboratory skills and engagement in medical laboratory science students. BMC Medical Education, 19(1), 310. https://doi.org/10.1186/s12909-019-1745-1
Duvivier, R. J., van Geel, K., van Dalen, J., Scherpbier, A. J. J. A., & der Vleuten, C. P. M. Van. (2012). Learning physical examination skills outside timetabled training sessions: what happens and why? Advances in Health Sciences Education, 17, 339–355.
Elfaki, O., & Al-Humayed, S. (2016). Medical Students’ Perception of OSCE at the Department of Internal Medicine, College of Medicine, King Khalid University, Abha, KSA. Journal of the College of Physicians and Surgeons--Pakistan : JCPSP, 26 2, 158–159.
Ellaway, R., & Masters, K. (2008). AMEE Guide 32: E-Learning in medical education Part 1: Learning, teaching and assessment. Medical Teacher, 30(5). https://doi.org/10.1080/01421590802108331
Epstein, R. M. (2007). Assessment in Medical Education. New England Journal of Medicine, 356(4), 387–396. https://doi.org/10.1056/NEJMra054784
Faria, A. L., Perdigão, A. C. B., Marçal, E., Kubrusly, M., & Peixoto, Raquel Autran Coelho Junior, A. A. P. (2020). OSCE 3D: a virtual clinical skills assessment tool for coronavirus pandemic times. Research Square. https://doi.org/10.21203/rs.3.rs-25191/v1
Figueroa, C. (2004). Sistemas de evaluación académica. (Editorial Universitaria. (ed.); Primera).
Furlong, E., Fox, P., Lavin, M., & Collins, R. (2005). Oncology nursing students’ views of a modified OSCE. European Journal of Oncology Nursing, 9(4), 351–359. https://doi.org/10.1016/j.ejon.2005.03.001
García-Estañ, J. (2013). Prueba Nacional de Evaluación de Competencias Clínicas de la Conferencia Nacional de Decanos de Facultades de Medicina de ESP. FEM, 16, S59–S62.
García-Puig, J., Vara-Pinedo, F., & Vargas-Núñez, J. A. (2018). Implantación del Examen Clínico Objetivo y Estructurado en la Facultad de Medicina de la Universidad Autónoma de Madrid. Educación Médica, 19(3), 178–187. https://doi.org/10.1016/j.edumed.2017.01.003
Gormley, G. J., Collins, K., Boohan, M., Bickle, I. C., & Stevenson, M. (2009). Is there a place for e-learning in clinical skills? A survey of undergraduate medical students’ experiences and attitudes. Medical Teacher, 31(1), e6–e12. https://doi.org/10.1080/01421590802334317
Harden, R., Lilley, P., & Patricio, M. (2015). The Definitive Guide to the OSCE (1st editio). ELSEVIER.
Harden, R. M. (2015). Misconceptions and the OSCE. Medical Teacher, 37(7), 608–610. https://doi.org/10.3109/0142159X.2015.1042443
Hochlehnert, A., Schultz, J., Möltner, A., Tımbıl, S., Brass, K., & Jünger, J. (2015). Electronic acquisition of OSCE performance using tablets. GMS Zeitschrift Fü Medizinische Ausbildung, 32(4). https://doi.org/10.3205/zma000983
Hoppe, R. B., Farquhar, L. J., Henry, R. C., Stoffelmayr, B. E., & Helfer, M. (1988). A course component to teach interviewing skills in informing and motivating patients. Journal of Medical Education, 63 3, 176–181.
Jang, H. W., & Kim, K.-J. (2014). Use of online clinical videos for clinical skills training for medical students: benefits and challenges. BMC Medical Education, 14(1), 56. https://doi.org/10.1186/1472-6920-14-56
Jindal, P., & Khurana, G. (2016). The opinion of post graduate students on objective structured clinical examination in Anaesthesiology: A preliminary report. Indian Journal of Anaesthesia, 60(3), 168. https://doi.org/10.4103/0019-5049.177869
Jowett, N., Leblanc, V., Xeroulis, G., Macrae, H., & Dubrowski, A. (2007). Surgical skill acquisition with self-directed practice using computer-based video training. American Journal of Surgery, 193 2, 237–242.
Khan, A., Ayub, M., & Shah, Z. (2016). An Audit of the Medical Students’ Perceptions regarding Objective Structured Clinical Examination. Education Research International, 2016, 1–4. https://doi.org/10.1155/2016/4806398
Khan, H. (2017). OSCES are outdated: clinical skills assessment should be centred around workplace-based assessments (WPBAS) to put the ‘art’ back into medicine. MedEdPublish, 6(4). https://doi.org/10.15694/mep.2017.000189
Khogali, S. E. O., Davies, D. A., Donnan, P. T., Gray, A., Harden, R. M., Mcdonald, J., Pippard, M. J., Pringle, S. D., & Yu, N. (2011). Integration of e-learning resources into a medical school curriculum. Medical Teacher, 33(4), 311–318. https://doi.org/10.3109/0142159X.2011.540270
Kuhn, S., Frankenhauser, S., & Tolks, D. (2018). Digitale Lehr- und Lernangebote in der medizinischen Ausbildung. Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz, 61(2), 201–209. https://doi.org/10.1007/s00103-017-2673-z
Lara, S., Foster, C. W., Hawks, M., & Montgomery, M. (2020). Remote Assessment of Clinical Skills During COVID-19: A Virtual, High-Stakes, Summative Pediatric Objective Structured Clinical Examination. Academic Pediatrics, 20(6), 760—761. https://doi.org/10.1016/j.acap.2020.05.029
Lee, J., Boyd, R., & Stuart, P. (2007). Randomized controlled trial of an instructional DVD for clinical skills teaching. Emergency Medicine Australasia : EMA, 19, 241–245. https://doi.org/10.1111/j.1742-6723.2007.00976.x
Li, L., Xv, Q., & Yan, J. (2020). COVID-19: the need for continuous medical education and training. The Lancet Respiratory Medicine, 8(4), e23. https://doi.org/10.1016/S2213-2600(20)30125-9
Major, S., Sawan, L., Vognsen, J., & Jabre, M. (2020). COVID-19 pandemic prompts the development of a Web-OSCE using Zoom teleconferencing to resume medical students’ clinical skills training at Weill Cornell Medicine-Qatar. BMJ Simulation and Technology Enhanced Learning, bmjstel-2020. https://doi.org/10.1136/bmjstel-2020-000629
Marshall, G., & Jones, N. (2003). A pilot study into the anxiety induced by various assessment methods. Radiography, 9(3), 185–191. https://doi.org/10.1016/S1078-8174(03)00062-2
Matos, D. (2020). Los problemas más comunes en Zoom (y cómo solucionarlos). Digitaltrends. https://es.digitaltrends.com/computadoras/problemas-comunes-en-zoom/
Mavis, B. (2000). Does studying for an objective structured clinical examination make a difference? Medical Education, 34, 808–812.
Mavis, B. (2001). Self-Efficacy and OSCE Performance among Second Year Medical Students. Advances in Health Sciences Education : Theory and Practice, 6, 93–102. https://doi.org/10.1023/A:1011404132508
McLaughlin, M., & Brame, D. (2020). The Best Video Conferencing Software for 2020. PCmag. https://www.pcmag.com/picks/the-best-video-conferencing-software
McMahon, G. T., Ingelfinger, J. R., & Campion, E. W. (2006). Videos in Clinical Medicine — A New Journal Feature. New England Journal of Medicine, 354(15), 1635–1635. https://doi.org/10.1056/NEJMe068044
Merrick, H., Nowacek, G., Boyer, J., & Robertson, J. (2000). Comparison of the Objective Structured Clinical Examination with the performance of third-year medical students in surgery. American Journal of Surgery, 179, 286–288. https://doi.org/10.1016/S0002-9610(00)00340-8
Mian, A., & Khan, S. (2020). Medical education during pandemics: a UK perspective. BMC Medicine, 18(1), 100. https://doi.org/10.1186/s12916-020-01577-y
Michel, L. P., Goertz, L., Radomski, S., Fritsch, T., & Baschour, L. (2015). DIGITALES PRÜFEN UND BEWERTEN IM HOCHSCHULBEREICH. Geschäftsstelle Hochschulforum Digitalisierung. https://www.che.de/download/hfd_studie_digitalespruefen-pdf/?wpdmdl=10551&refresh=5f4be7dab55b31598810074
Minion, D., Donnelly, M., Quick, R., Pulito, A., & Schwartz, R. (2002). Are multiple objective measures of student performance necessary? American Journal of Surgery, 183 6, 663–665.
Musa, T. H., Ahmad, T., Khan, M., Haroon, H., & Wei, P. (2020). Global outbreak of 2019-nCoV, a new challenge? The Journal of Infection in Developing Countries, 14(03), 244–245. https://doi.org/10.3855/jidc.12530
Novack, D. H., Cohen, D., Peitzman, S. J., Beadenkopf, S., Gracely, E., & Morris, J. (2002). A pilot test of WebOSCE: a system for assessing trainees’ clinical skills via teleconference. Medical Teacher, 24(5), 483–487. https://doi.org/10.1080/0142159021000012504
Omu, A. E., Al-Azemi, M. K., Omu, F. E., Al-Harmi, J., & Diejomaoh, M. F. E. (2016). Attitudes of Academic Staff and Students towards the Objective Structured Clinical Examination (OSCE) in Obstetrics and Gynaecology. Creative Education, 07(06), 886–897. https://doi.org/10.4236/ce.2016.76093
Padilha, J. M., Machado, P. P., Ribeiro, A., Ramos, J., & Costa, P. (2019). Clinical Virtual Simulation in Nursing Education: Randomized Controlled Trial. Journal of Medical Internet Research, 21(3), e11529. https://doi.org/10.2196/11529
Patil, N. G., & Yan, Y. C. H. (2003). SARS and its effect on medical education in Hong Kong. Medical Education, 37(12), 1127–1128. https://doi.org/10.1046/j.1365-2923.2003.01723.x
Pierre, R., Wierenga, A., Barton, M., Branday, J., & Christie, C. (2004). Student evaluation of an OSCE in Paediatric at the University of the West Indies, Jamaica. BMC Medical Education, 4, 22. https://doi.org/10.1186/1472-6920-4-22
Prettyman, A. V., Knight, E. P., & Allison, T. E. (2018). Objective Structured Clinical Examination From Virtually Anywhere! The Journal for Nurse Practitioners, 14(8), e157–e163. https://doi.org/10.1016/j.nurpra.2018.05.007
Race, P., & Pickford, R. (2007). Making teaching work: ‘Teaching smarter’ in post-compulsory education. https://doi.org/10.4135/9781446214886
Raiman, L., Antbring, R., & Mahmood, A. (2017). WhatsApp messenger as a tool to supplement medical education for medical students on clinical attachment. BMC Medical Education, 17.
Robinson, P., Morton, L., Haran, H., & Manton, R. (2017). Mock OSCEs Improve Medical Students’ Confidence and Reduce Anxiety Related to Summative Examinations. Education in Medicine Journal, 9(2), 41–45. https://doi.org/10.21315/eimj2017.9.2.4
Round, J., Conradi, E., & Poulton, T. (2007, March 23). A Workable Model for Virtual Patient Design. E-Learning Unit, CMHCE, St George’s University of London. http://www.jround.co.uk/virtual_patients/papers/workable_vp.htm
Sarid, O., Anson, O., & Bentov, Y. (2005). Students’ Reactions to Three Typical Examinations in Health Sciences. Advances in Health Sciences Education, 10(4), 291–302. https://doi.org/10.1007/s10459-005-6706-2
Schapiro, R., Stickford-Becker, A., Foertsch, J., Remington, P., & Seibert, C. (2011). Integrative Cases for Preclinical Medical Students Connecting Clinical, Basic Science, and Public Health Approaches. American Journal of Preventive Medicine, 41, S187-92. https://doi.org/10.1016/j.amepre.2011.06.004
Schoonheim-Klein, M., Hoogstraten, J., Habets, L., Aartman, I., Van der Vleuten, C., Manogue, M., & Van der Velden, U. (2007). Language background and OSCE performance: a study of potential bias. European Journal of Dental Education, 11(4), 222–229. https://doi.org/10.1111/j.1600-0579.2007.00459.x
Shitu, B., & Girma, T. (2008). OBJECTIVE STRUCTURED CLINICAL EXAMINATION (OSCE): EXAMINEE´S PERCEPTION AT DEPARTMENT OF PEDIATRICS AND CHILD HEALTH, JIMMA UNIVERSITY. Ethiop J Health Sci., 18(2), 47–52.
Skrzypek, A., Szeliga, M., Stalmach-Przygoda, A., Górski, S., Kowalska, B., Kocurek, A., & Nowakowski, M. (2017). The Objective Structured Clinical Examination (OSCE) from the perspective of 3rd year’s medical students - a pilot study. Folia Medica Cracoviensia, 57, 67–75.
Stowe, C. D., & Gardner, S. F. (2005). Real-Time Standardized Participant Grading of an Objective Structured Clinical Examination. American Journal of Pharmaceutical Education, 69(3), 41. https://doi.org/10.5688/aj690341
Sutherland, S., & Jalali, A. (2017). Social media as an open-learning resource in medical education: current perspectives. Advances in Medical Education and Practice, Volume 8, 369–375. https://doi.org/10.2147/AMEP.S112594
Swicegood, J., & Haque, S. (2015). Lessons from Recruiting Second Life Users with Chronic Medical Conditions: Applications for Health Communications. Journal For Virtual Worlds Research, 8(1). https://doi.org/10.4101/jvwr.v8i1.7097
Taha, M., Abdalla, M. E., Wadi, M., & Khalafalla, H. (2020). Curriculum delivery in Medical Education during an emergency: A guide based on the responses to the COVID-19 pandemic. MedEdPublish, 9. https://doi.org/10.15694/mep.2020.000069.1
Thamburaj, A. J., Brass, K., Herrmann, M., & Jünger, J. (2015). 8 meeting of the medical assessment consortium UCAN: “Collaborative Perspectives for Competency-based and Quality-assured Medical Assessment.” GMS Zeitschrift Fü Medizinische Ausbildung, 32(4). https://doi.org/10.3205/zma000979
Troncon, L. E. de A. (2004). Clinical skills assessment: limitations to the introduction of an “OSCE” (Objective Structured Clinical Examination) in a traditional Brazilian medical school. Sao Paulo Medical Journal, 122(1), 12–17. https://doi.org/10.1590/S1516-31802004000100004
Waxman, K. T., & Telles, C. L. (2009). The Use of Benner’s Framework in High-fidelity Simulation Faculty Development. Clinical Simulation in Nursing, 5(6), e231–e235. https://doi.org/10.1016/j.ecns.2009.06.001
Xeroulis, G., Park, J., Moulton, C., Reznick, R., LeBlanc, V., & Dubrowski, A. (2007). Teaching suturing and knot-tying skills to medical students: A randomized controlled study comparing computer-based video instruction and (concurrent and summary) expert feedback. Surgery, 141, 442–449. https://doi.org/10.1016/j.surg.2006.09.012
Yang, W., Hebert, D., Kim, S., & Kang, B. (2019). MCRDR Knowledge-Based 3D Dialogue Simulation in Clinical Training and Assessment. Journal of Medical Systems, 43(7), 200. https://doi.org/10.1007/s10916-019-1262-0
Young, I., Montgomery, K., Kearns, P., Hayward, S., & Mellanby, E. (2014). The benefits of a peer-assisted mock OSCE. The Clinical Teacher, 11(3), 214–218. https://doi.org/10.1111/tct.12112
Yu, T.-C., Wilson, N., Singh, P. (Parry), Lemanu, D., Hawken, S., & Hill, A. (2011). Medical students-as-teachers: A systematic review of peer-assisted teaching during medical school. Advances in Medical Education and Practice, 2, 157–172. https://doi.org/10.2147/AMEP.S14383
Zartman, R. R., McWhorter, A., Seale, N., & Boone, W. (2002). Using OSCE-based evaluation: curricular impact over time. Journal of Dental Education, 66 12, 1323–1330.
