Effectiveness of the PBLMAR Model in Improving Student Learning Outcomes: An N-Gain Analysis in Air Conditioning Technology Course

Authors

DOI:

https://doi.org/10.56294/dm2025958

Keywords:

PBLMAR, N-Gain, Effectiveness, Learning Outcomes, Mobile Augmented Reality, Vocational Education

Abstract

Introduction: 
this study aims to evaluate the effectiveness of the Problem-Based Learning model assisted by Mobile Augmented Reality (PBLMAR) in improving student learning outcomes in the Air Conditioning Technology course. The integration of MAR technology is expected to support student-centered learning and enhance conceptual understanding in vocational education settings.
Methods:
a quasi-experimental method was applied using a one-group pretest-posttest design. Data collection involved pretest and posttest assessments administered to 30 vocational students. The normalized gain (N-Gain) was calculated using Microsoft Excel to measure the increase in students’ cognitive achievement after implementing the PBLMAR model. N-Gain results were interpreted using standard criteria (high, medium, low).
Results:
the analysis showed that the average N-Gain score was 0.7, which falls into the category, high category. This indicates a significant improvement in student learning outcomes. Additionally, student responses suggested positive engagement and interest in using MAR-based learning media.
Conclusions:
the PBLMAR model is effective in improving students’ conceptual understanding and engagement in the Air Conditioning Technology course. The use of N-Gain analysis provides clear evidence of the model's impact, supporting its further application in vocational education.

References

1. Kemendikbud. Panduan Implementasi Kurikulum Merdeka. Kementerian Pendidikan, Kebudayaan, Riset, dan Teknologi; 2022.

2. Sakir NAI, Kim JG. Enhancing students’ learning activity and outcomes via implementation of problem-based learning. Eurasia J Math Sci Technol Educ. 2020;16(12):em1925. Available from: https://doi.org/10.29333/ejmste/84440.

3. De Oliveira RA. Comparative analysis of automotive air conditioner with water-cooled and air-cooled condenser. Teknomekanik. 2020;7(2):99–106. Available from: https://doi.org/10.24036/teknomekanik.v7i2.31972.

4. Hasan AD. Perencanaan sistem pengkondisian udara (HVAC) pada ruang akomodasi kapal tanker menggunakan refrigeran R-407C [Undergraduate thesis]. Surabaya: Institut Teknologi Sepuluh Nopember; 2018.

5. Demirel M, Dağyar M. Effects of problem-based learning on attitude: a meta-analysis study. Eurasia J Math Sci Technol Educ. 2016;12(8):2115–37. Available from: https://doi.org/10.12973/eurasia.2016.1293.

6. Mardapi D. Pengukuran, Penilaian dan Evaluasi Pendidikan. Vol. 2, Parama Publishing. Elsevier B.V.; 2017. 244 p. Available from: http://dx.doi.org/10.1016/j.sbspro.2014.08.192.

7. Smith D, Smith K. The case for ‘passive’ learning – the ‘silent’ community of online learners. Eur J Open Distance E-Learn. 2014;17(2):85–98. Available from: https://doi.org/10.2478/eurodl-2014-0021.

8. Ni’mah I, Anistyasari Y. Studi literatur pengembangan simulator kamera untuk media pembelajaran. IT-Edu J Inf Technol Educ. 2021;6(1):713–23. Available from: https://ejournal.unesa.ac.id/index.php/it-edu/article/view/42044.

9. Astuti AAIY, Wibawa IMC, Suarjana IM. The effectiveness of problem based learning toward students’ science learning outcomes. J Ilm Sekolah Dasar. 2020;4(4):573–80. Available from: https://doi.org/10.23887/jisd.v4i4.25667.

10. Preeti B, Ashish A, Shriram G. Problem based learning (PBL) – an effective approach to improve learning outcomes in medical teaching. J Clin Diagn Res. 2013;7(12):2896–7. Available from: https://doi.org/10.7860/JCDR/2013/6470.3787.

11. Hmelo-Silver CE. Problem-based learning: What and how do students learn? Educ Psychol Rev. 2004;16(3):235–66. Available from: https://doi.org/10.1023/B:EDPR.0000034022.16470.f3.

12. Hidayati D, Novianti H, Khansa M, Slamet J, Suryati N. Effectiveness project-based learning in ESP class: Viewed from Indonesian students’ learning outcomes. Int J Inf Educ Technol. 2023;13(3):558–65. Available from: https://doi.org/10.18178/ijiet.2023.13.3.1839.

13. Kumar A, Mantri A, Singh G, Kaur DP. Impact of AR-based collaborative learning approach on knowledge gain of engineering students in embedded system course. Educ Inf Technol. 2022;27(6):8571–89. Available from: https://doi.org/10.1007/s10639-021-10858-9.

14. Carruth DW. Virtual reality for education and workforce training. In: Proceedings of the 2017 International Conference on Emerging eLearning Technologies and Applications (ICETA); 2017. p. 1–6.

15. Birt J, Stromberga Z, Cowling M, Moro C. Mobile mixed reality for experiential learning and simulation in medical and health sciences education. Information. 2018;9(2):31. Available from: https://doi.org/10.3390/info9020031​:contentReference[oaicite:8]{index=8}.

16. Akçayır M, Akçayır G. Advantages and challenges associated with augmented reality for education: A systematic review of the literature. Educ Res Rev. 2016. Available from: http://dx.doi.org/10.1016/j.edurev.2016.11.002.

17. Anti F, Lufri L, Ahda Y. Current trends in augmented reality to improve senior high school students’ skills in Education 4.0: A systematic literature review. Open Educ Stud. 2025;7(1):1–15. Available from: https://doi.org/10.1515/edu-2024-0053​:contentReference[oaicite:10]{index=10}.

18. Kitada M, Asano H, Kanbara M, Akaike S. Development of automotive air-conditioning system basic performance simulator: CFD technique development. JSAE Rev. 2000;21(1):91–6.

19. Nofirza N, Harpito H, Kusumanto I. Penerapan metode pembelajaran problem base learning pada bidang ilmu keteknikan (engineering). J Tek Ind. 2020;4(2):101–8. Available from: http://dx.doi.org/10.24014/jti.v4i2.6251.

20. Dochy F, Segers M, Van den Bossche P, Gijbels D. Effects of problem-based learning: A meta-analysis. Learn Instr. 2003;13(5):533–68.

21. Safitri R, Hadi S. The Effect of the Problem Based Learning Model on the Students Motivation and Learning Outcomes. 2023;9(9):7310–6.

22. Haetami A, Zulvita N, Marhadi MA, Santoso T. Investigation of Problem-Based Learning (PBL) on Physics Education Technology (PhET) Simulation in Improving Student Learning Outcomes in Acid-Base Material. 2023;9(11):9738–48.

23. Hake RR. Interactive-Engagement Versus Traditional Methods: A Six-Thousand-Student Survey of Mechanics Test Data for Introductory Physics Courses. 2014;(January 1998).

24. Kadir K. Meta-analysis of the effect of learning intervention toward mathematical thinking on research and publication of student. Tarbiya J Educ Muslim Soc. 2017;4(2):162–75.

25. Ibáñez MB, Delgado-Kloos C. Augmented reality for STEM learning: A systematic review. Comput Educ. 2018;123:109–23. doi:10.1016/j.compedu.2018.05.002.

26. Yano EM, Resnick A, Gluck M, Kwon H, Mistry KB. Accelerating learning healthcare system development through embedded research: Career trajectories, training needs, and strategies for managing and supporting embedded researchers. Healthcare. 2021;8(Suppl 1):100479. doi:10.1016/j.hjdsi.2020.100479.

27. Branch RM. Instructional design: The ADDIE approach. New York: Springer Science & Business Media; 2009.

28. Hung W. The 9-step problem design process for problem-based learning: Application of the 3C3R model. Educ Res Rev. 2009;4:118–41.

29. Tamblyn HB, Tamblyn R. Problem-based learning: An approach to medical education. New York: Springer US; 1980.

30. Billinghurst M, Kato H. Collaborative augmented reality. Commun ACM. 2002;45(7):64–70. doi:10.1145/514236.514265.

31. Tessmer M. An introduction to educational design research. London: Psychology Press; 1993.

32. Muslim M, Ambiyar A, Karudin A, Ruslan MSH, Kuo H-C, Hidayat N, et al. Augmented clutch reality mobile: Innovative educational media for modern engineering. J Phys Conf Ser. 2024;1023(23):8603–16.

33. Wu H-K, Lee SW-Y, Chang H-Y, Liang J-C. Current status, opportunities and challenges of augmented reality in education. Comput Educ. 2013;62:41–9. doi:10.1016/j.compedu.2012.10.024.

34. Simanungkalit I, Utanto Y, Rc AR. The effectiveness of PBL-based HOTS in English learning. J Educ Pract. 2019;8(2):67–73.

Downloads

Published

2025-04-25

Issue

Section

Original

How to Cite

1.
Hidayat N, Wakhinuddin W, Lapisa R, Giatman M, Dewi IP, Sardi J, et al. Effectiveness of the PBLMAR Model in Improving Student Learning Outcomes: An N-Gain Analysis in Air Conditioning Technology Course. Data and Metadata [Internet]. 2025 Apr. 25 [cited 2025 May 23];4:958. Available from: https://dm.ageditor.ar/index.php/dm/article/view/958