Evaluating Behavioral Transfer: A 360-Degree Kirkpatrick Level 3 Assessment of Learning Consultant Capacity Development

Efi Dyah Indrawati; Paula Magdalena Simanjuntak

doi:10.55681/armada.v4i9.3734

Authors

Efi Dyah Indrawati Badan Pendidikan dan Pelatihan Keuangan, Indonesia
Paula Magdalena Simanjuntak Badan Pendidikan dan Pelatihan Keuangan, Indonesia

DOI:

https://doi.org/10.55681/armada.v4i9.3734

Keywords:

Kirkpatrick Level 3, Behavioral Transfer, Distance Learning, Learning Consultant, Public Sector Training, 360-Degree Evaluation

Abstract

This study examines the effectiveness of a distance training program aimed at enhancing the role and capacity of learning consultants within a public sector training institution. Using Kirkpatrick’s Level 3 (behavior) framework, the study evaluates post-training behavioral changes through a 360-degree assessment involving alumni, supervisors, and peers. Data were collected from 33 respondents, with a response rate of 96.7%. Findings indicate a significant increase in behavioral performance scores (from 6.80 to 8.29), with 100% of valid participants demonstrating positive behavioral change. Additionally, 81.8% of participants engaged in knowledge-sharing activities, indicating early diffusion of learning within organizational contexts. However, challenges related to job relevance, uneven prior knowledge, and limited practical exposure were identified. The study contributes to the literature by proposing a contextualized model of behavioral transfer in distance learning environments, emphasizing the role of organizational alignment and experiential learning design.

Downloads

Download data is not yet available.

References

Carnell, S., Siqueira, A. G. D., Miles, A., & Lok, B. (2022). Informing and evaluating educational applications with the Kirkpatrick model in virtual environments: Using a virtual human scenario to measure communication skills behavior change. Frontiers in Virtual Reality, 3, Article 810797. https://doi.org/10.3389/frvir.2022.810797

Gallant, N. L., Paolucci, E. O., Russill, C. L., Jewett, R., Recsky, C., Ford, K., Idriss-Wheeler, D., Tseung, V., Ansari, H., Ladak, Z., Fernandes, A., & Marshall, D. A. (2026). Applications of the Kirkpatrick model in post-secondary health sciences education: A scoping review. International Journal of Health Policy and Management, 15(1), 1–14. https://doi.org/10.34172/ijhpm.8857

Gardner, J., Snyder, D., Guilkey, J., Abbott, V., & Barclay, M. (2021). What graduate school didn’t teach you about instructional design consulting. Performance Improvement. https://doi.org/10.1002/pfi.22012

Hesselgreaves, H., French, M., Hawkins, M., Lowe, T., Wheatman, A., Martin, M., & Wilson, R. (2021). New development: The emerging role of a learning partner relationship in supporting public service reform. Public Money & Management, 41(8), 672–675. https://doi.org/10.1080/09540962.2021.1909274

Moore, M. D. (2023). How external instructional design consultants do their work: A case study (Doctoral dissertation, University of North Texas). UNT Digital Library. https://doi.org/10.12794/metadc2137506

Nazli, N., & Khairudin, S. (2018). The factors that influence transfer of training and its effect on organizational citizenship behaviour: Evidence from Malaysia Civil Defence Force. Journal of Workplace Learning, 30(2), 121–146. https://doi.org/10.1108/JWL-09-2017-0080

Nsouli, E. D., Nelson, D., Nsouli, L., Curtis, F., Ahmed, S., McGonagle, I., Kane, R., & Ahmadi, K. (2023). The application of Kirkpatrick's evaluation model in the assessment of interprofessional simulation activities involving pharmacy students: A systematic review. American Journal of Pharmaceutical Education, 87(8), Article 100003. https://doi.org/10.1016/j.ajpe.2023.02.003

Pradhika, N. B. (2026). Evaluasi pelatihan non-teknis menggunakan model Kirkpatrick: Systematic literature review 2016–2025. JEMSI (Jurnal Ekonomi, Manajemen, dan Akuntansi). https://doi.org/10.35870/jemsi.v12i1.5978

Sugiyono. (2019). Metodologi penelitian kuantitatif, kualitatif, dan R&D. Alfabeta.

Bates, R., Holton, E. F., & Ruona, W. E. A. (2021). The role of organisational climate and support in learning transfer: Revisiting the transfer system framework. Human Resource Development Quarterly, 32(4), 451–472. https://doi.org/10.1002/hrdq.21434

Blume, B. D., Ford, J. K., Baldwin, T. T., & Huang, J. L. (2020). Transfer of training: A meta-analytic review. Journal of Management, 46(8), 1404–1433. https://doi.org/10.1177/0149206320929408

Branch, R. M. (2021). Instructional design: The ADDIE approach and emerging applications. Springer.

Gegenfurtner, A., & Vauras, M. (2022). Transfer of professional learning: The role of motivation, self-efficacy, and workplace support. Educational Research Review, 35, 100430. https://doi.org/10.1016/j.edurev.2022.100430

Gegenfurtner, A., Veermans, K., Festner, D., & Gruber, H. (2020). Integrative review: Transfer of training and workplace learning. Human Resource Development Review, 19(2), 101–124. https://doi.org/10.1177/1534484320916787

Grossman, R., & Salas, E. (2019). The transfer of training: What really matters. International Journal of Training and Development, 23(1), 1–17. https://doi.org/10.1111/ijtd.12152

Holton, E. F. (2005). Holton’s evaluation model: New evidence and construct elaborations. Advances in Developing Human Resources, 7(1), 37–54. https://doi.org/10.1177/1523422304272080

Hutchins, H. M., Nimon, K., Bates, R., & Holton, E. F. (2020). Can the LTSI predict transfer performance? Testing updated relationships between transfer climate and training outcomes. Human Resource Development Quarterly, 31(1), 55–78. https://doi.org/10.1002/hrdq.21377

Kim, W., & Park, J. (2020). Examining structural relationships among knowledge sharing, organisational learning, and organisational performance. Journal of Knowledge Management, 24(3), 547–565. https://doi.org/10.1108/JKM-06-2019-0345

Noe, R. A., Clarke, A. D. M., & Klein, H. J. (2023). Learning in the twenty-first-century workplace. Annual Review of Organizational Psychology and Organizational Behavior, 10, 245–268. https://doi.org/10.1146/annurev-orgpsych-090421-065451

Reigeluth, C. M., Beatty, B. J., & Myers, R. D. (2020). Instructional-design theories and models: The learner-centered paradigm of education. Routledge.

Saks, A. M., & Belcourt, M. (2021). An investigation of training activities and transfer of training in organisations. Human Resource Management Review, 31(2), 100745. https://doi.org/10.1016/j.hrmr.2020.100745

Sitzmann, T., & Weinhardt, J. M. (2022). Training engagement and transfer: A longitudinal investigation of workplace learning outcomes. Personnel Psychology, 75(3), 599–631. https://doi.org/10.1111/peps.12475

Wang, S., & Noe, R. A. (2021). Knowledge sharing: A review and directions for future research. Human Resource Management Review, 31(2), 100734. https://doi.org/10.1016/j.hrmr.2020.100734

Baldwin, T. T., Ford, J. K., & Blume, B. D. (2017). The state of transfer of training research: Moving toward more consumer-centric inquiry. Human Resource Development Quarterly, 28(1), 17–28. https://doi.org/10.1002/hrdq.21278