Analisis Butir Empiris terhadap Instrumen Penilaian Vokasi dalam Pelatihan Servis dan Konversi Kendaraan Listrik
DOI:
https://doi.org/10.52436/1.jpti.1910Keywords:
ANATES, analisis butir soal, asesmen vokasi, pelatihan kendaraan listrik, tes pilihan gandaAbstract
Penelitian ini bertujuan mengevaluasi kualitas empiris instrumen asesmen akhir berbentuk pilihan ganda pada pelatihan Servis dan Konversi Kendaraan Listrik. Penelitian menggunakan desain kuantitatif deskriptif dengan menganalisis respons 35 peserta terhadap 25 butir soal lima opsi. Data diolah menggunakan ANATES Versi 4.0.2 dan diverifikasi melalui analisis tingkat butir yang mencakup reliabilitas, tingkat kesukaran, daya pembeda, dan efektivitas pengecoh. Hasil menunjukkan rata-rata skor mentah peserta sebesar 18,94 dari 25 butir atau 75,77% jawaban benar. Koefisien reliabilitas internal instrumen sebesar 0,44, sehingga konsistensi skor masih tergolong rendah hingga sedang dan perlu ditafsirkan secara hati-hati. Analisis tingkat kesukaran menunjukkan 9 butir berkategori sedang, 13 butir mudah, dan 3 butir sangat mudah, tanpa butir sukar maupun sangat sukar. Analisis daya pembeda menunjukkan 11 butir sangat baik, 1 butir baik, 2 butir cukup, dan 11 butir buruk. Analisis pengecoh memperlihatkan beberapa opsi salah tidak berfungsi, terutama opsi E yang berulang kali tidak dipilih peserta. Butir 6, 7, 12, 13, 19, dan 25 memerlukan revisi besar atau penggantian, sedangkan butir 2, 4, 10, 16, dan 22 memerlukan revisi. Instrumen dapat memberikan informasi awal mengenai hasil belajar peserta, tetapi belum memadai sebagai alat ukur yang stabil. Revisi perlu difokuskan pada penyeimbangan tingkat kesukaran, penguatan daya pembeda, perbaikan pengecoh berbasis miskonsepsi, dan validasi isi oleh ahli.
Downloads
References
D. Iliescu, S. Greiff, and A. Ion, "Evidence based approaches for enhancing vocational education worldwide," npj Science of Learning, vol. 10, no. 1, Art. no. 20, 2025, doi: 10.1038/s41539-025-00317-2.
C. Osatis and C. Asavanirandorn, "An exploring human resource development in small and medium enterprises in response to electric vehicle industry development," World Electric Vehicle Journal, vol. 13, no. 6, Art. no. 98, 2022, doi: 10.3390/wevj13060098.
H.-C. Yu, T.-J. Hsueh, T.-Y. Wu, C. Liu, C.-W. Liao, and Y.-K. Fu, "A competency framework for electric vehicle maintenance technicians: Addressing the environmental, social, and governance (ESG) imperatives of the BEV industry," World Electric Vehicle Journal, vol. 16, no. 6, Art. no. 314, 2025, doi: 10.3390/wevj16060314.
R. A. P. Hardiyanta, Hermanto, A. Kurniawan, Purnawan, and I. E. Prakoso, "Development of the automotive technology vocational education curriculum based on current needs of the automotive industry," Jurnal Pendidikan Vokasi Otomotif, vol. 6, no. 2, 2024, doi: 10.21831/jpvo.v6i2.73156.
S. R. M. Yusop, M. S. Rasul, R. M. Yasin, and H. U. Hashim, "Identifying and validating vocational skills domains and indicators in classroom assessment practices in TVET," Sustainability, vol. 15, no. 6, Art. no. 5195, 2023, doi: 10.3390/su15065195.
S. R. M. Yusop, M. S. Rasul, R. M. Yasin, H. U. Hashim, and N. A. Jalaludin, "An assessment approaches and learning outcomes in technical and vocational education: A systematic review using PRISMA," Sustainability, vol. 14, no. 9, Art. no. 5225, 2022, doi: 10.3390/su14095225.
Z. Zhang, J. Tian, Z. Zhao, W. Zhou, F. Sun, Y. Que, and X. He, "Factors influencing vocational education and training teachers' professional competence based on a large-scale diagnostic method: A decade of data from China," Sustainability, vol. 14, no. 23, Art. no. 15871, 2022, doi: 10.3390/su142315871.
M. S. Mukhter, J. N. Yunus, and F. K. C. Yuet, "Evaluation of automotive technology diploma program at Malaysian vocational college: Validity and reliability," International Journal of Academic Research in Business and Social Sciences, vol. 13, no. 2, pp. 542-549, 2023, doi: 10.6007/IJARBSS/v13-i2/16371.
K. M. Salleh, N. L. Sulaiman, and G. W. Gloeckner, "Exploring test concept and measurement through validity and reliability process in TVET research: Guideline for the novice researcher," Journal of Technical Education and Training, vol. 15, no. 1, 2023, doi: 10.30880/jtet.2023.15.01.022.
M. R. Ridwan, E. Istiyono, and W. Widihastuti, "Test items analysis of mathematical problem solving ability using a classical test theory approach," Jurnal Pendidikan MIPA, vol. 22, no. 1, pp. 98-111, 2021, doi: 10.23960/jpmipa/v22i1.pp98-111.
S. Nurjanah, M. Iqbal, Zafrullah, M. N. Mahmud, D. S. F. Seran, I. K. Suardi, and L. Arriza, "Psychometric quality of multiple-choice tests under classical test theory (CTT): AnBuso, Iteman, and R," Jurnal Penelitian dan Evaluasi Pendidikan, vol. 28, no. 2, pp. 161-172, 2024, doi: 10.21831/pep.v28i2.71542.
A. A. Rezigalla et al., "Item analysis: The impact of distractor efficiency on the difficulty index and discrimination power of multiple-choice items," BMC Medical Education, vol. 24, no. 1, Art. no. 445, 2024, doi: 10.1186/s12909-024-05433-y.
P. K. Kissi, D. Baidoo-Anu, E. Anane, and R. K. Annan-Brew, "Teachers' test construction competencies in examination-oriented educational system: Exploring teachers' multiple-choice test construction competence," Frontiers in Education, vol. 8, Art. no. 1154592, 2023, doi: 10.3389/feduc.2023.1154592.
F. Dahalan, N. Alias, and M. S. N. Shaharom, "Gamification and game based learning for vocational education and training: A systematic literature review," Education and Information Technologies, vol. 29, pp. 1279-1317, 2024, doi: 10.1007/s10639-022-11548-w.
I. D. Azizan, M. Alias, and M. Z. Mustafa, "Effect of game-based learning in vehicle air-conditioning course on cognitive and affective skills of vocational students," Journal of Technical Education and Training, vol. 13, no. 3, pp. 146-154, 2021, doi: 10.30880/jtet.2021.13.03.014.
