Development and Content Validation of a Psychomotor Assessment Instrument for Conventional Distributor-Type Diesel Fuel System Maintenance
##plugins.themes.academic_pro.article.sidebar##
Published on-line since :
Jun 30, 2026
Download
Statistic
Downloads
Download data is not yet available.
##plugins.themes.academic_pro.article.main##
Abstract
Psychomotor assessment in vocational high schools often remains subjective and insufficiently standardized, particularly in practical automotive learning related to conventional distributor-type diesel fuel systems. This study developed a performance assessment instrument to evaluate students’ technical competence in vocational automotive education more objectively. A Research and Development design adapted from Sugiyono’s model was applied up to the expert validation stage. The instrument comprised three integrated components: a Job Sheet, Work Sheet, and Assessment Sheet, structured using hierarchical indicators of psychomotor assessment from Imitation (P1) to Naturalization (P5). Five experts, consisting of three content experts and two assessment-instrument experts, evaluated the instrument using a four-point Likert scale. The validation data were analyzed using Aiken’s V to examine content, construct, language, and usability validity. The results showed that all components obtained Aiken’s V values above 0.80, indicating valid expert judgment across the assessed aspects. The developed instrument provides an initial valid basis for more structured, transparent, and consistent assessment of diesel fuel system maintenance skills in vocational practice.
##plugins.themes.academic_pro.article.details##
This work is licensed under a Creative Commons Attribution 4.0 International License.
How to Cite
Riyadi, S., Permana, T., & Al Gifari, M. (2026). Development and Content Validation of a Psychomotor Assessment Instrument for Conventional Distributor-Type Diesel Fuel System Maintenance. AEEJ : Journal of Automotive Engineering and Vocational Education, 7(1), 1-16. https://doi.org/https://doi.org/10.24036/aeej.v7i1.315
References
[1] Badan Pusat Statistik, “Tingkat Pengangguran Terbuka (TPT) sebesar 4,76 persen. Rata-rata upah buruh sebesar 3,09 juta rupiah,” Berita Resmi Statistik, Jakarta, Indonesia, May 2025.
[2] D. Ginanto, A. T. Kesuma, Y. Anggraena, and D. Setiyowati, Panduan Pembelajaran dan Asesmen Pendidikan Anak Usia Dini, Pendidikan Dasar, dan Pendidikan Menengah, Edisi Revisi Tahun 2024. Jakarta, Indonesia: Badan Standar, Kurikulum, dan Asesmen Pendidikan, Kementerian Pendidikan, Kebudayaan, Riset, dan Teknologi, 2024.
[3] F. N. Fatinah, M. H. Hikmat, and K. Ratih, “Authentic assessment in vocational high school: Teachers’ perspectives, practice and challenges,” JLE: Journal of Literate of English Education Study Program, vol. 6, no. 1, pp. 61–70, 2025, doi: 10.47435/jle.v6i1.3881.
[4] Z. Sokhanvar, K. Salehi, and F. Sokhanvar, “Advantages of authentic assessment for improving the learning experience and employability skills of higher education students: A systematic literature review,” Studies in Educational Evaluation, vol. 70, Art. no. 101030, 2021, doi: 10.1016/j.stueduc.2021.101030.
[5] D. S. Wahyuni, “Developing competency-based assessment at Vocational High School (VHS) in Bali,” Jurnal Pendidikan Vokasi, vol. 11, no. 1, pp. 59–67, 2021, doi: 10.21831/jpv.v11i1.37383.
[6] T. Sugiarto, F. Rizal, W. Purwanto, H. Maksum, and M. Giatman, “Development of student psychomotor skill assessment based on performance in service and maintenance of motorcycles with electronic fuel injection: A case study in automotive engineering students,” Data and Metadata, vol. 4, Art. no. 910, 2025, doi: 10.56294/dm2025910.
[7] A. H. Ramadani, Ekohariadi, L. Anifah, Y. S. Nugroho, and R. Safitri, “Development of performance assessment instruments for measuring drawing skills in vocational students competence in mechanical engineering expertise,” IJORER: International Journal of Recent Educational Research, vol. 5, no. 2, pp. 268–279, 2024, doi: 10.46245/ijorer.v5i2.551.
[8] S. Islami, Ambiyar, Sukardi, M. A. Zaus, and A. A. Zaus, “Development of an online project-based learning assessment instrument for vocational education students,” Jurnal Kajian Ilmu Pendidikan (JKIP), vol. 4, no. 2, pp. 291–299, 2024, doi: 10.55583/jkip.v4i2.804.
[9] S. Purnomo, A. Listanto, Samidjo, M. Hakiki, and D. Susanto, “Development job sheet based performance assessment to improve skills overhaul Toyota transmission in vocational high schools,” VANOS Journal of Mechanical Engineering Education, vol. 9, no. 1, pp. 89–98, 2024, doi: 10.30870/vanos.v9i1.21312.
[10] N. Kania, Y. S. Kusumah, J. A. Dahlan, E. Nurlaelah, F. Gürbüz, and E. Bonyah, “Constructing and providing content validity evidence through the Aiken’s V index based on the experts’ judgments of the instrument to measure mathematical problem-solving skills,” REID: Research and Evaluation in Education, vol. 10, no. 1, pp. 64–79, 2024, doi: 10.21831/reid.v10i1.71032.
[11] L. R. Aiken, “Three coefficients for analyzing the reliability and validity of ratings,” Educational and Psychological Measurement, vol. 45, no. 1, pp. 131–142, 1985, doi: 10.1177/0013164485451012.
[12] Sugiyono, Metode Penelitian Kuantitatif, Kualitatif dan R&D. Bandung, Indonesia: Alfabeta, 2013.
[13] R. P. Saputri, F. Rijal, M. Giatman, Ambiyar, Krismadinata, and N. Syah, “Development and validation of an evaluation instrument for the Industrial Field Practice Program in Informatics Engineering at Universitas Putra Indonesia YPTK Padang,” Al-Ishlah: Jurnal Pendidikan, vol. 17, no. 4, pp. 7423–7432, 2025, doi: 10.35445/alishlah.v17i4.8022.
[14] R. R. Oroh, M. M. Attaufiq, M. Daud, and R. F. Roring, “Analysis of Vocational Student Performance Criteria on Work Skills Based on Industry Needs: An Analysis for Students’ Skill Test Instruments,” International Journal of Learning, Teaching and Educational Research, vol. 22, no. 10, pp. 174–189, 2023, doi: 10.26803/ijlter.22.10.10.
[15] F. A. Ghozali, F. Tentama, B. Sudarsono, and P. Listyaningrum, “Development of a Conveyor-Based Practice Performance Assessment Tool with Android Control to Improve Vocational High School Students’ Work Readiness,” Elinvo: Electronics, Informatics, and Vocational Education, vol. 8, no. 1, pp. 38–43, 2023, doi: 10.21831/elinvo.v8i1.57868.
[16] R. W. Daryono, M. A. Ramadhan, N. Kholifah, F. D. Isnantyo, and M. Nurtanto, “An empirical study to evaluate the student competency of vocational education,” International Journal of Evaluation and Research in Education, vol. 12, no. 2, pp. 1077–1084, 2023, doi: 10.11591/ijere.v12i2.22805.
[17] Abdurrahman, Parmin, and S. Muryanto, “Evaluation on the automotive skill competency test through ‘discontinuity’ model and the competency test management of vocational education school in Central Java, Indonesia,” Heliyon, vol. 8, no. 2, Art. no. e08872, 2022, doi: 10.1016/j.heliyon.2022.e08872.
[18] M. E. De Vos, L. K. J. Baartman, C. P. M. Van der Vleuten, and E. De Bruijn, “Unravelling workplace educators’ judgment processes when assessing students’ performance at the workplace,” Journal of Vocational Education & Training, vol. 76, no. 3, pp. 517–536, 2024, doi: 10.1080/13636820.2022.2042722.
[19] V. Villarroel, R. Melipillán, J. Santana, and D. Aguirre, “How authentic are assessments in vocational education? An analysis from Chilean teachers, students, and examinations,” Frontiers in Education, vol. 9, Art. no. 1308688, 2024, doi: 10.3389/feduc.2024.1308688.
[20] S. Suhartadi and W. Widiyanti, “Development of Competency Test Instruments for PPG Students in the Automotive Field: Analysis of Validity, Reliability, and Discrimination Power,” Letters in Information Technology Education, vol. 8, no. 2, pp. 67–74, 2025, doi: 10.17977/um010v8i22025p67-74.
[21] R. Doni, A. Algifari, and M. Irvan, “Implementation of Project Based Learning for Cognitive and Psychomotor Students in the Basic of Workshop Technology Course Welding Sub-competency in the Automotive Engineering Study Program,” INVOTEK: Jurnal Inovasi Vokasional dan Teknologi, vol. 22, no. 3, pp. 195–204, 2022, doi: 10.24036/invotek.v22i3.1073.
[22] L. Utami, Festiyed, D. P. Ilahi, A. Ratih, Lazulva, and E. Yenti, “Analisis Indeks Aiken untuk Mengetahui Validitas Isi Instrumen Scientific Habits of Mind,” Journal of Research and Education Chemistry, vol. 6, no. 1, pp. 59–67, 2024, doi: 10.25299/jrec.2024.vol6(1).17430.
[23] N. Hidayah and Muhtarom, “Validity and Reliability Test of Teaching Materials Using Aiken’s V Formula and SPSS 22,” Schola, vol. 1, no. 2, pp. 75–82, 2023, doi: 10.26877/schola.v1i2.342.
[24] L. Y. Y. Luk and C. K. Y. Chan, “Assessing student learning in work-integrated learning (WIL): A systematic review on assessment methods and purposes,” Studies in Educational Evaluation, vol. 81, Art. no. 101345, 2024, doi: 10.1016/j.stueduc.2024.101345.
[25] B. Sudarsono, F. Tentama, S. A. Mulasari, T. W. Sukesi, Sulistyawati, F. A. Ghozali, H. Yuliansyah, L. Nafiati, and H. Sofyan, “Development of Integrated Project-based (PjBL-T) model to improve work readiness of vocational high school students,” Jurnal Pendidikan Vokasi, vol. 12, no. 3, pp. 222–235, 2022, doi: 10.21831/jpv.v12i3.53158.
[26] T. R. Agraini, M. Adri, M. Giatman, and A. Huda, “Digital transformation in vocational education: Development and evaluation of a project-based e-jobsheet for LAN installation integrated with Google Workspace,” Al-Ishlah: Jurnal Pendidikan, vol. 18, no. 1, pp. 158–173, 2026, doi: 10.35445/alishlah.v18i1.8902.
[2] D. Ginanto, A. T. Kesuma, Y. Anggraena, and D. Setiyowati, Panduan Pembelajaran dan Asesmen Pendidikan Anak Usia Dini, Pendidikan Dasar, dan Pendidikan Menengah, Edisi Revisi Tahun 2024. Jakarta, Indonesia: Badan Standar, Kurikulum, dan Asesmen Pendidikan, Kementerian Pendidikan, Kebudayaan, Riset, dan Teknologi, 2024.
[3] F. N. Fatinah, M. H. Hikmat, and K. Ratih, “Authentic assessment in vocational high school: Teachers’ perspectives, practice and challenges,” JLE: Journal of Literate of English Education Study Program, vol. 6, no. 1, pp. 61–70, 2025, doi: 10.47435/jle.v6i1.3881.
[4] Z. Sokhanvar, K. Salehi, and F. Sokhanvar, “Advantages of authentic assessment for improving the learning experience and employability skills of higher education students: A systematic literature review,” Studies in Educational Evaluation, vol. 70, Art. no. 101030, 2021, doi: 10.1016/j.stueduc.2021.101030.
[5] D. S. Wahyuni, “Developing competency-based assessment at Vocational High School (VHS) in Bali,” Jurnal Pendidikan Vokasi, vol. 11, no. 1, pp. 59–67, 2021, doi: 10.21831/jpv.v11i1.37383.
[6] T. Sugiarto, F. Rizal, W. Purwanto, H. Maksum, and M. Giatman, “Development of student psychomotor skill assessment based on performance in service and maintenance of motorcycles with electronic fuel injection: A case study in automotive engineering students,” Data and Metadata, vol. 4, Art. no. 910, 2025, doi: 10.56294/dm2025910.
[7] A. H. Ramadani, Ekohariadi, L. Anifah, Y. S. Nugroho, and R. Safitri, “Development of performance assessment instruments for measuring drawing skills in vocational students competence in mechanical engineering expertise,” IJORER: International Journal of Recent Educational Research, vol. 5, no. 2, pp. 268–279, 2024, doi: 10.46245/ijorer.v5i2.551.
[8] S. Islami, Ambiyar, Sukardi, M. A. Zaus, and A. A. Zaus, “Development of an online project-based learning assessment instrument for vocational education students,” Jurnal Kajian Ilmu Pendidikan (JKIP), vol. 4, no. 2, pp. 291–299, 2024, doi: 10.55583/jkip.v4i2.804.
[9] S. Purnomo, A. Listanto, Samidjo, M. Hakiki, and D. Susanto, “Development job sheet based performance assessment to improve skills overhaul Toyota transmission in vocational high schools,” VANOS Journal of Mechanical Engineering Education, vol. 9, no. 1, pp. 89–98, 2024, doi: 10.30870/vanos.v9i1.21312.
[10] N. Kania, Y. S. Kusumah, J. A. Dahlan, E. Nurlaelah, F. Gürbüz, and E. Bonyah, “Constructing and providing content validity evidence through the Aiken’s V index based on the experts’ judgments of the instrument to measure mathematical problem-solving skills,” REID: Research and Evaluation in Education, vol. 10, no. 1, pp. 64–79, 2024, doi: 10.21831/reid.v10i1.71032.
[11] L. R. Aiken, “Three coefficients for analyzing the reliability and validity of ratings,” Educational and Psychological Measurement, vol. 45, no. 1, pp. 131–142, 1985, doi: 10.1177/0013164485451012.
[12] Sugiyono, Metode Penelitian Kuantitatif, Kualitatif dan R&D. Bandung, Indonesia: Alfabeta, 2013.
[13] R. P. Saputri, F. Rijal, M. Giatman, Ambiyar, Krismadinata, and N. Syah, “Development and validation of an evaluation instrument for the Industrial Field Practice Program in Informatics Engineering at Universitas Putra Indonesia YPTK Padang,” Al-Ishlah: Jurnal Pendidikan, vol. 17, no. 4, pp. 7423–7432, 2025, doi: 10.35445/alishlah.v17i4.8022.
[14] R. R. Oroh, M. M. Attaufiq, M. Daud, and R. F. Roring, “Analysis of Vocational Student Performance Criteria on Work Skills Based on Industry Needs: An Analysis for Students’ Skill Test Instruments,” International Journal of Learning, Teaching and Educational Research, vol. 22, no. 10, pp. 174–189, 2023, doi: 10.26803/ijlter.22.10.10.
[15] F. A. Ghozali, F. Tentama, B. Sudarsono, and P. Listyaningrum, “Development of a Conveyor-Based Practice Performance Assessment Tool with Android Control to Improve Vocational High School Students’ Work Readiness,” Elinvo: Electronics, Informatics, and Vocational Education, vol. 8, no. 1, pp. 38–43, 2023, doi: 10.21831/elinvo.v8i1.57868.
[16] R. W. Daryono, M. A. Ramadhan, N. Kholifah, F. D. Isnantyo, and M. Nurtanto, “An empirical study to evaluate the student competency of vocational education,” International Journal of Evaluation and Research in Education, vol. 12, no. 2, pp. 1077–1084, 2023, doi: 10.11591/ijere.v12i2.22805.
[17] Abdurrahman, Parmin, and S. Muryanto, “Evaluation on the automotive skill competency test through ‘discontinuity’ model and the competency test management of vocational education school in Central Java, Indonesia,” Heliyon, vol. 8, no. 2, Art. no. e08872, 2022, doi: 10.1016/j.heliyon.2022.e08872.
[18] M. E. De Vos, L. K. J. Baartman, C. P. M. Van der Vleuten, and E. De Bruijn, “Unravelling workplace educators’ judgment processes when assessing students’ performance at the workplace,” Journal of Vocational Education & Training, vol. 76, no. 3, pp. 517–536, 2024, doi: 10.1080/13636820.2022.2042722.
[19] V. Villarroel, R. Melipillán, J. Santana, and D. Aguirre, “How authentic are assessments in vocational education? An analysis from Chilean teachers, students, and examinations,” Frontiers in Education, vol. 9, Art. no. 1308688, 2024, doi: 10.3389/feduc.2024.1308688.
[20] S. Suhartadi and W. Widiyanti, “Development of Competency Test Instruments for PPG Students in the Automotive Field: Analysis of Validity, Reliability, and Discrimination Power,” Letters in Information Technology Education, vol. 8, no. 2, pp. 67–74, 2025, doi: 10.17977/um010v8i22025p67-74.
[21] R. Doni, A. Algifari, and M. Irvan, “Implementation of Project Based Learning for Cognitive and Psychomotor Students in the Basic of Workshop Technology Course Welding Sub-competency in the Automotive Engineering Study Program,” INVOTEK: Jurnal Inovasi Vokasional dan Teknologi, vol. 22, no. 3, pp. 195–204, 2022, doi: 10.24036/invotek.v22i3.1073.
[22] L. Utami, Festiyed, D. P. Ilahi, A. Ratih, Lazulva, and E. Yenti, “Analisis Indeks Aiken untuk Mengetahui Validitas Isi Instrumen Scientific Habits of Mind,” Journal of Research and Education Chemistry, vol. 6, no. 1, pp. 59–67, 2024, doi: 10.25299/jrec.2024.vol6(1).17430.
[23] N. Hidayah and Muhtarom, “Validity and Reliability Test of Teaching Materials Using Aiken’s V Formula and SPSS 22,” Schola, vol. 1, no. 2, pp. 75–82, 2023, doi: 10.26877/schola.v1i2.342.
[24] L. Y. Y. Luk and C. K. Y. Chan, “Assessing student learning in work-integrated learning (WIL): A systematic review on assessment methods and purposes,” Studies in Educational Evaluation, vol. 81, Art. no. 101345, 2024, doi: 10.1016/j.stueduc.2024.101345.
[25] B. Sudarsono, F. Tentama, S. A. Mulasari, T. W. Sukesi, Sulistyawati, F. A. Ghozali, H. Yuliansyah, L. Nafiati, and H. Sofyan, “Development of Integrated Project-based (PjBL-T) model to improve work readiness of vocational high school students,” Jurnal Pendidikan Vokasi, vol. 12, no. 3, pp. 222–235, 2022, doi: 10.21831/jpv.v12i3.53158.
[26] T. R. Agraini, M. Adri, M. Giatman, and A. Huda, “Digital transformation in vocational education: Development and evaluation of a project-based e-jobsheet for LAN installation integrated with Google Workspace,” Al-Ishlah: Jurnal Pendidikan, vol. 18, no. 1, pp. 158–173, 2026, doi: 10.35445/alishlah.v18i1.8902.