Article abstract

Journal of Educational Research and Reviews
Research Article | Published December 2022 | Volume 10, Issue 9, pp. 140-144.
doi: https://doi.org/10.33495/jerr_v10i9.22.142

 

Pretest and posttest reliability to measure the impact of online team-based learning workshops during the Covid-19 pandemic as a continuing faculty development activity among health professional educators

 

 

 

Shahid Hassan


Email Author


Department of Surgery School of Medicine/IMU Centre for Education, International Medical University, Malaysia.

 

 

……..…....….....…………............……………..........…..……….........................……………………...............……………………………….....………………...
Citation: Hassan S (2022). Pretest and posttest reliability to measure the impact of online team-based learning workshops during the Covid-19 pandemic as a continuing faculty development activity among health professional educators. J. Edu. Res. Rev. 10(9):140-144. doi: 10.33495/jerr_v10i9.22.142.
……..…....….....…………............……………..........…..……….........................……………………...............……………………………….....………………...

 

 

 Abstract 

 

Medical education has been facing unprecedented challenges due to the COVID-19 pandemic leaving aftermath, which needs continuing reparative work. Imperative to exploring solutions faced by Covid pandemic challenges, various immediate steps were taken by medical schools globally including the faculty development activities transformed into online strategies. Workshops are the most common methods of the FDA to enhance knowledge and skills in specific areas of teaching and learning and assessment. A retrospective analysis of three of the TBL online FDA workshops is presented to determine its immediate impact on teaching and learning as well as an assessment model using pretest and posttest designs of a 3-point Likert scale of participants attending a half-day online workshop during the Covid19 pandemic for faculty development in a teaching hospital in Malaysia. Data was collected and analysed using online links created in Microsoft Google form at the beginning and towards the end of each workshop on a 3-point Likert scale of agreed, disagreed and not sure. A 15 items questionnaire was administered with additional information of participants’ trends in studying the reading materials sent out a week prior to the actual workshop. An interventional strategy between the two tests were four plenaries and a break-out session with hands-on group work followed by presentations. A collated quantitative data was gathered from 82 participants attending the online TBL workshops. Data were analysed using the statistical test of paired t-test, one-way ANOVA and ANCOVA with effect size in SPSS version 24. The percentage correct pretest and posttest score difference was significant at p = .013. The mean difference between pretest and posttest scores was significant at t = 31.345, p < 0.01. A significant difference in mean scores between groups was found, F (2,79) = 4.923, P = .010 using one-way ANOVA. Post-hoc analysis revealed significantly high posttest mean scores compared to partially read and not read groups at p = .033 and .014, respectively. However, the difference between partially read and not read was insignificant. A difference in mean posttest scores among the three groups using one-way ANCOVA on removing the effect of pretest was found significant at F (2, 80) = 6.211, p = 0.003. The effect size using Cohen’s d and Partial Eta Squared have a large practical effect of 2.072 and a moderate effect of 11.1% and 13.70% shown in paired t-test, ANOVA and ANCOVA respectively. A significant difference in the mean pretest and posttest scores was found between the groups. A post-test score, controlling on pretest score, was also significant, with a large Cohen’s d and moderate practical effect size suggesting an effectively delivered TBL online workshop.

 

Keywords  Faculty development   online workshops   pretest   posttest design   quantitative evaluation  

 team-based learning 

 

Copyright © 2022 Author(s) retain the copyright of this article.

This article is published under the terms of the Creative Commons Attribution License 4.0



 References 


Arunava B, Sukanta S, Krishnangshu R (2019). Reliability assessment of pre – post test questionnaire on the impact of a daylong clinical pharmacology workshop among medical professionals. Asian J. Med. Sci. 10(6):93-97.

Barge GL (2007). Pre- and Post-Testing with More Impact. J. Ext. 45(6):103.

Cook CE, Kaplan M (2011). Advancing the culture of teaching on campus: How a teaching centre can make a difference. Stylus Pub.

Hartley J (1973). The effect of pre-testing on post-test performance. Instr. Sci. 2(2):193.

Jayachandran AL, Balaji J (2016). Introduction of pre and post lecture multiple choice question for second year undergraduate medical students in microbiology: a technique to assess knowledge acquired from the lecture. Int. J. Res. Med. Sci. 4:575-578.

Jehanzeb K, Bashir NA (2012). Training and development program and its benefits to employees and organizations: A conceptual study. Far East J. Psychol. Bus. 9(2):58-71.

Lancaster JW, Stein SM, Maclean LG, Amburgh JV, Persky AM (2014). Faculty Development Program models to advance teaching and learning within health science programs. Am. J. Pharm. Educ. 78(5):99. https://doi.org/10.5688/ajpe7 8599.

Steinert Y, Mann K, Anderson B, Barnett BM, Centeno A, Naismith L, Prideaux D, Spencer J, Tullo E, Viggiano T, Ward H, Dolmans D (2016). A systematic review of faculty development initiatives designed to enhance teaching effectiveness: A 10-year update: BEME Guide No. 40. Med. Teach. 38(8):769-786. https://doi.org/10.1080/0142159x.2016.1181851.

Shahid H (2020). Teaching and learning approaches in clinical education during Covid-19 pandemic: Time to take-on assessment as learning. Int. J. Sci. Res. (IJSR). 9 (11) November ISSN: 2319-706.

Shahid H, Ibrahim MS, Nabiha GH (2018). The Structural Framework, Implementation Strategies and Students‟ Perception of Team-Based Learning in UGME of a Medical School in Malaysia. Educ. Med. J. 10(1):53-66.

Shahid H, Imtiaz B, Nabiha GH (2018). Students‟ Perceptions about the Immediate Feedback Assessment Technique (IF-AT) in Team-Based Learning. Educ. Med. J. 10(1):23-32.

Shahid H, Sunil PV, Vishna DN (2021). Evaluation of immediate impact of Faculty Development Programme using a pretest-post‑test study design format. Innovation and Education. https://doi.org/10.1186/s42862-021-00009-9.

World Health Organization. (2013). Transforming and scaling up health professional education and training: Policy brief on faculty development. World Health Organization.