Journal Evaluation in Education (JEE)
Journal Evaluation in Education (JEE)

an Open Access Journal

SINTA

1.6519

Impact

GScholar

16

H-Index

Journal Evaluation in Education (JEE)

an Open Access Journal

Evaluating an International Class Initiative Program in EFL Higher Education: A CIPP Model Analysis

A. A. Gede Yudha Paramartha ORCID
Ganesha University of Education ROR
Indonesia
yudha.paramartha@undiksha.ac.id
Ni Nyoman Padmadewi
Ganesha University of Education ROR
Indonesia
I G A Lokita Purnamika Utami
Ganesha University of Education ROR
Indonesia
Putu Suarcaya
Ganesha University of Education ROR
Indonesia
Share

  • Purpose of the study: This study evaluated the implementation of the International Class Initiation (IKI) program within the English Language Education department at Universitas Pendidikan Ganesha (Undiksha) using Stufflebeam’s Context, Input, Process, and Product (CIPP) model.

    Methodology: This mixed-methods study operationalized CIPP framework. For Context evaluation document analysis was assessed to evaluate policy alignment. For Input Evaluation observation was done to assess the infrastructure and document analysis for assessing the curriculum. Process evaluation focused on instructional quality and EMI consistency collected through surveys. Product evaluation focused on measuring students GPAs as well as mapping students co-curricular achievements.

    Main Findings: Context and input evaluations revealed positive alignment with Indonesia’s Key Performance Indicators (IKU 8) and the university's vision, supported by strict selection criteria and improved classrooms. Process evaluation demonstrated high pedagogical clarity and consistent English instruction, though it highlighted an affective support gap by the lecturers. Product evaluation empirically proved: IKI students achieved significantly higher GPAs (p < 0.05), secured 38.9% of student awards despite a unequal class distribution ratio, and recorded 15 international mobility placements, including dual-degree programs.

    Novelty/Originality of this study: This study’s novelty lies in its multi-dimensional evaluation of an International Class Initiative. It uniquely integrates qualitative policy analysis and quantitative instructional surveys with empirical evidences of infrastructure, academic and non-academic achievements, and international mobility outcomes. This comprehensive approach offers a complete picture of how CIPP can be used to evaluate "Internationalization at Home" program.

  • How to cite

    [1]
    “Evaluating an International Class Initiative Program in EFL Higher Education: A CIPP Model Analysis”, Jor. Eva. Edu, vol. 7, no. 3, pp. 742–753, Jul. 2026, doi: 10.37251/jee.v7i3.3521.

    More Citation Formats

  • 25
    Abstract views
    12
    Downloads

    Metrics — Badges

    1. [1] M. Abelha, S. Fernandes, D. Mesquita, F. Seabra, and A. T. Ferreira-Oliveira, “Graduate employability and competence development in higher education—a systematic literature review using PRISMA,” Sustainability, vol. 12, no. 15, pp. 5900, 2020, doi: 10.3390/su12155900. DOI: https://doi.org/10.3390/su12155900
    2. [2] M. Healy, “Careers and employability learning: pedagogical principles for higher education,” Studies in Higher Education, vol. 48, no. 8, pp. 1303–1314, 2023, doi: 10.1080/03075079.2023.2196997. DOI: https://doi.org/10.1080/03075079.2023.2196997
    3. [3] J. Khalid, M. Chuanmin, M. Haroon Rasheed, and M. Umair Ashraf, “The employability edge: unleashing graduate potential through quality university experiences and psychological capital,” J. Furth. High. Educ., vol. 49, no. 7, pp. 874–898, 2025, doi: 10.1080/0309877X.2025.2507354. DOI: https://doi.org/10.1080/0309877X.2025.2507354
    4. [4] A. Bigwanto, N. Widayati, M. A. Wibowo, and E. M. Sari, “Key Performance Indicators (KPI) to Measure Effectiveness of Lean Construction in Indonesian Project,” Sustainability, vol. 16, no. 15, pp. 6461, 2024, doi: 10.3390/su16156461. DOI: https://doi.org/10.3390/su16156461
    5. [5] S. R. Asada and K. Kuroda, “The coming of age of East Asian cosmopolitan nation-state universities in the SDGs era: at the crossroads of internationalization, global governance, and nation-statehood,” Journal of Contemporary East Asia Studies, vol. 13, no. 1, pp. 1–9, 2024, doi: 10.1080/24761028.2025.2493380. DOI: https://doi.org/10.1080/24761028.2025.2493380
    6. [6] L. K. Noll et al., “Initiating a DBT consultation team: Conceptual and practical considerations for training clinics.,” Train. Educ. Prof. Psychol., vol. 14, no. 3, pp. 167–175, 2020, doi: 10.1037/tep0000252. DOI: https://doi.org/10.1037/tep0000252
    7. [7] E. Janebová and C. J. Johnstone, “Mapping the dimensions of inclusive internationalization,” Inequalities in study abroad and student mobility, pp. 115–128, 2020. DOI: https://doi.org/10.4324/9780367855130-12
    8. [8] L. Baldassar and L. McKenzie, “Beyond ‘Just Being There,’” Teach. Sociol., vol. 44, no. 2, pp. 84–95, 2016, doi: 10.1177/0092055X16631126. DOI: https://doi.org/10.1177/0092055X16631126
    9. [9] M. L. Sierra-Huedo, L. Bruton, and C. Fernández, “Becoming Global at Home: An Analysis of Existing Cases and A Proposal for the Future of Internationalization at Home,” Journal of Education, vol. 204, no. 1, pp. 241–254, 2024, doi: 10.1177/00220574221108053. DOI: https://doi.org/10.1177/00220574221108053
    10. [10] E. Bruhn-Zass, “Virtual internationalization in higher education,” WBV, 2020. DOI: https://doi.org/10.3278/6004797w
    11. [11] H. De Wit and L. Deca, “Internationalization of higher education, challenges and opportunities for the next decade,” European higher education area: Challenges for a new decade, pp. 3–11, 2020. DOI: https://doi.org/10.1007/978-3-030-56316-5_1
    12. [12] S. R. Asada, “Going beyond the binary of internationalisation: how international faculty programmes enable institutions to function at home and abroad,” Globalisation, Societies and Education, vol. 22, no. 4, pp. 707–719, 2024, doi: 10.1080/14767724.2022.2109127. DOI: https://doi.org/10.1080/14767724.2022.2109127
    13. [13] J. De Leersnyder, S. Gündemir, and O. Ağirdağ, “Diversity approaches matter in international classrooms: how a multicultural approach buffers against cultural misunderstandings and encourages inclusion and psychological safety,” Studies in Higher Education, vol. 47, no. 9, pp. 1903–1920, 2022, doi: 10.1080/03075079.2021.1983534. DOI: https://doi.org/10.1080/03075079.2021.1983534
    14. [14] M. Jarosiński, M. Kozma, and J. Sekliuckiene, “Comparison of Explicit and Implicit Methods of Cross-Cultural Learning in an International Classroom,” Sustainability, vol. 13, no. 19, pp. 10641, 2021, doi: 10.3390/su131910641. DOI: https://doi.org/10.3390/su131910641
    15. [15] C. Gal and S. Mor, “Global Classrooms, Local Impact: Transforming Education in Israel’s Periphery,” J. Stud. Int. Educ., vol. 30, no. 2, pp. 272–293, May 2026, doi: 10.1177/10283153251371032. DOI: https://doi.org/10.1177/10283153251371032
    16. [16] A. Soruç and C. Griffiths, “Inspiring Pre-service English Language Teachers to Become ELF-aware,” RELC Journal, vol. 54, no. 3, pp. 603–615, Dec. 2023, doi: 10.1177/00336882211001966. DOI: https://doi.org/10.1177/00336882211001966
    17. [17] E. Biricik Deniz, E. Kemaloglu-Er, and Y. Ozkan, “ELF-aware pre-service teacher education: Practices and perspectives,” elt Journal, vol. 74, no. 4, pp. 453–462, 2020. DOI: https://doi.org/10.1093/elt/ccaa040
    18. [18] S. Siqueira, “ELF with EFL: what is still needed for this integration to happen?,” ELT Journal, vol. 74, no. 4, pp. 377–386, 2020. DOI: https://doi.org/10.1093/elt/ccaa038
    19. [19] A. Teherani, D. M. Connor, S. DeCourcey, and K. E. Hauer, “Centering Equity: A Paradigm Shift for Program Evaluation and Education Continuous Quality Improvement in Medical Education,” Teach. Learn. Med., pp. 1–14, 2025, doi: 10.1080/10401334.2025.2605246. DOI: https://doi.org/10.1080/10401334.2025.2605246
    20. [20] B. Blankenberger, S. Gehlhausen Anderson, and E. Lichtenberger, “Improving Institutional Evaluation Methods: Comparing Three Evaluations Using PSM, Exact and Coarsened Exact Matching,” Res. High. Educ., vol. 62, no. 8, pp. 1248–1275, 2021, doi: 10.1007/s11162-021-09632-0. DOI: https://doi.org/10.1007/s11162-021-09632-0
    21. [21] D. L. Stufflebeam, “The CIPP Model for Evaluation,” in Evaluation Models, Dordrecht: Kluwer Academic Publishers, 2000, pp. 279–317. doi: 10.1007/0-306-47559-6_16. DOI: https://doi.org/10.1007/0-306-47559-6_16
    22. [22] Z. Lei, “The Application of CIPP Model in the Evaluation of Teaching Quality of College Education in the Context of New Era,” Applied Mathematics and Nonlinear Sciences, vol. 9, no. 1, 2024, doi: 10.2478/amns.2023.2.01568. DOI: https://doi.org/10.2478/amns.2023.2.01568
    23. [23] B. Aybek and O. Oğuz, “Sustainable and Inclusive Education Reform in Türkiye: A Cipp Evaluation of the Primary Turkish Language Curriculum,” Sustainability, vol. 17, no. 19, p. 8659, Sep. 2025, doi: 10.3390/su17198659.
    24. [24] F. Al Moubarak and B. Özer, “Evaluation of the Turkish language teaching program applied to foreigners using the context, input, process, and product (CIPP) model,” RumeliDE Dil ve Edebiyat Araştırmaları Dergisi, no. 30, pp. 36–48, 2022, doi: 10.29000/rumelide.1190280. DOI: https://doi.org/10.29000/rumelide.1190280
    25. [25] E. Esgaiar and S. Foster, “Implementation of CIPP Model for Quality Evaluation at Zawia University,” International Journal of Applied Linguistics and English Literature, vol. 8, no. 5, pp. 106, 2019, doi: 10.7575/aiac.ijalel.v.8n.5p.106. DOI: https://doi.org/10.7575/aiac.ijalel.v.8n.5p.106
    26. [26] T. Nuo, P. K. Nitiasih, M. H. Santosa, and P. N. Riastini, “Program Evaluation of Chinese–Foreign Cooperative Education at Fuzhou Vocational and Technical College Using the CIPP Framework,” Veredas do Direito, vol. 22, no. 5, pp. 223752, 2025, doi: 10.18623/rvd.v22.n5.3752. DOI: https://doi.org/10.18623/rvd.v22.n5.3752
    27. [27] B. Aybek and O. Oğuz, “Sustainable and Inclusive Education Reform in Türkiye: A Cipp Evaluation of the Primary Turkish Language Curriculum,” Sustainability, vol. 17, no. 19, pp. 8659, 2025, doi: 10.3390/su17198659. DOI: https://doi.org/10.3390/su17198659
    28. [28] S. Telli, R. Maulana, and M. Helms-Lorenz, “Students’ perceptions of teaching behaviour in Turkish secondary education: a Mokken Scaling of My Teacher Questionnaire,” Learn. Environ. Res., vol. 24, no. 2, pp. 315–337, 2021, doi: 10.1007/s10984-020-09329-8. DOI: https://doi.org/10.1007/s10984-020-09329-8
    29. [29] N. S. Kusumawati, I. D. A. Nurhaeni, and R. A. Nugroho, “Internationalization Of Indonesia Higher Education: Does Government Support?,” International Journal of Education and Social Science Research, vol. 03, no. 01, pp. 173–180, 2020, doi: 10.37500/IJESSR.2020.3015. DOI: https://doi.org/10.37500/IJESSR.2020.3015
    30. [30] J. Guimón and R. Narula, “When Developing Countries Meet Transnational Universities: Searching for Complementarity and Dealing With Dual Embeddedness,” J. Stud. Int. Educ., vol. 24, no. 3, pp. 314–336, Jul. 2020, doi: 10.1177/1028315319835536. DOI: https://doi.org/10.1177/1028315319835536
    31. [31] C. Jaime Ndaipa, K. Edström, and L. Geschwind, “Internationalisation of Higher Education Institutions in Mozambique: Exploring the Rationales, Strategies and Challenges,” J. Stud. Int. Educ., vol. 27, no. 3, pp. 501–519, 2023, doi: 10.1177/10283153221093126. DOI: https://doi.org/10.1177/10283153221093126
    32. [32] H. Haithem T. M. Ali and H. Taha, “Harmonizing Universities With Globalization by Creating Institutional Adaptability to Internationalization Approaches in Higher Education: A Case Study in Nawroz University,” Journal of Education and Development, pp. 8, 2023, doi: 10.20849/jed.v7i2.1342. DOI: https://doi.org/10.20849/jed.v7i2.1342
    33. [33] E. Brito, M. P. Neves, N. Gomes, and N. Lopes, “Inclusion and Internationalization: Perception of Higher Education Students,” Interchange, vol. 56, no. 3–4, pp. 259–283, 2025, doi: 10.1007/s10780-025-09544-3. DOI: https://doi.org/10.1007/s10780-025-09544-3
    34. [34] F. F. Guimarães, A. R. M. Mendes, L. M. Rodrigues, R. S. dos S. Paiva, and K. R. Finardi, “Internationalization at Home, COIL and Intercomprehension,” SFU Educational Review, vol. 12, no. 3, pp. 90–109, Dec. 2019, doi: 10.21810/sfuer.v12i3.1019. DOI: https://doi.org/10.21810/sfuer.v12i3.1019
    35. [35] H. R’boul, “Intercultural philosophy and internationalisation of higher education: epistemologies of the South, geopolitics of knowledge and epistemological polylogue,” J. Furth. High. Educ., vol. 46, no. 8, pp. 1149–1160, Sep. 2022, doi: 10.1080/0309877X.2022.2055451. DOI: https://doi.org/10.1080/0309877X.2022.2055451
    36. [36] T. Du, “Paulo Freire and the epistemic disobedience of the south in internationalization of higher education,” Educational Philosophy and Theory, vol. 58, no. 1–2, pp. 72–85, Jan. 2026, doi: 10.1080/00131857.2025.2552766. DOI: https://doi.org/10.1080/00131857.2025.2552766
    37. [37] K. J. Wilby, E. K. Black, A. Benetoli, and B. Paravattil, “Students’ conception of local responses to global problems for a more peaceful and sustainable world: A collaborative education project between Brazil, Canada, Qatar, and New Zealand,” JACCP: JOURNAL OF THE AMERICAN COLLEGE OF CLINICAL PHARMACY, vol. 5, no. 6, pp. 605–612, 2022, doi: 10.1002/jac5.1608. DOI: https://doi.org/10.1002/jac5.1608
    38. [38] T. A. Roman and S. Uttamchandani, “Researching pedagogy within small active learning classrooms: Examining enacted pedagogies of learner and instructor interactions,” International Journal of Research & Method in Education, vol. 41, no. 4, pp. 447–467, 2018, doi: 10.1080/1743727X.2018.1452199. DOI: https://doi.org/10.1080/1743727X.2018.1452199
    39. [39] M. C. Wright, I. Bergom, and T. Bartholomew, “Decreased class size, increased active learning? Intended and enacted teaching strategies in smaller classes,” Active Learning in Higher Education, vol. 20, no. 1, pp. 51–62, 2019, doi: 10.1177/1469787417735607.
    40. [40] T. Lin et al., “Shaping classroom social experiences through collaborative small‐group discussions,” British Journal of Educational Psychology, vol. 92, no. 1, pp. 131–154, Mar. 2022, doi: 10.1111/bjep.12442. DOI: https://doi.org/10.1111/bjep.12442
    41. [41] J. Premo and A. Cavagnetto, “Priming students for whole-class interaction: using interdependence to support behavioral engagement,” Social Psychology of Education, vol. 21, no. 4, pp. 915–935, 2018, doi: 10.1007/s11218-018-9445-y. DOI: https://doi.org/10.1007/s11218-018-9445-y
    42. [42] A. K. Kokko and L. Hirsto, “From physical spaces to learning environments: processes in which physical spaces are transformed into learning environments,” Learn. Environ. Res., vol. 24, no. 1, pp. 71–85, 2021, doi: 10.1007/s10984-020-09315-0. DOI: https://doi.org/10.1007/s10984-020-09315-0
    43. [43] Y.-T. Kao, “Promoting interaction and lowering speaking anxiety in an EMI course: a group dynamic assessment approach,” International Review of Applied Linguistics in Language Teaching, vol. 63, no. 4, pp. 2543–2566, 2025, doi: 10.1515/iral-2023-0174. DOI: https://doi.org/10.1515/iral-2023-0174
    44. [44] K. H. Chong, J. Price, D. Irwin, M. G. Dowens, and C. X. R. Leong, “Language anxiety in EFL and ESL academic environments,” Asian Englishes, vol. 27, no. 3, pp. 766–782, 2025, doi: 10.1080/13488678.2025.2548997. DOI: https://doi.org/10.1080/13488678.2025.2548997
    45. [45] T. Fang, H.-T. D. Huang, and S.-T. A. Hung, “Prepping Students for EMI: Effects on Performance and Affect,” Language Teaching Research, 2025, doi: 10.1177/13621688251352282. DOI: https://doi.org/10.1177/13621688251352282
    46. [46] O. Bälter, V. Kann, C. Mutimukwe, and H. Malmström, “English-medium instruction and impact on academic performance: a randomized control study,” Applied Linguistics Review, vol. 15, no. 6, pp. 2373–2396, 2024, doi: 10.1515/applirev-2022-0093. DOI: https://doi.org/10.1515/applirev-2022-0093
    47. [47] M. Alhamami, “Burnout in healthcare education programs and English as a Medium of Instruction: the dark side of the language of instruction,” Front. Med. (Lausanne)., vol. 12, 2025, doi: 10.3389/fmed.2025.1619177. DOI: https://doi.org/10.3389/fmed.2025.1619177
    48. [48] J. C. Richards, “Exploring Emotions in Language Teaching,” RELC Journal, vol. 53, no. 1, pp. 225–239, 2022, doi: 10.1177/0033688220927531. DOI: https://doi.org/10.1177/0033688220927531
    49. [49] D. Han and M. Ganapathy, “Teacher Support in Enhancing Willingness to Communicate: The Mediating Effect of Growth Language Mindset,” International Journal of Applied Linguistics, vol. 36, no. 2, pp. 1414–1424, 2026, doi: 10.1111/ijal.12864. DOI: https://doi.org/10.1111/ijal.12864
    50. [50] E. M. Bonem, H. N. Fedesco, and A. N. Zissimopoulos, “What you do is less important than how you do it: the effects of learning environment on student outcomes,” Learn. Environ. Res., vol. 23, no. 1, pp. 27–44, 2020, doi: 10.1007/s10984-019-09289-8. DOI: https://doi.org/10.1007/s10984-019-09289-8
    51. [51] D. M. S. Corkin, S. F. Lindt, and P. S. Williams, “Effects of positive college classroom motivational environments on procrastination and achievement,” Learn. Environ. Res., vol. 24, no. 2, pp. 299–313, 2021, doi: 10.1007/s10984-020-09331-0. DOI: https://doi.org/10.1007/s10984-020-09331-0
    52. [52] M. C. Wright, I. Bergom, and T. Bartholomew, “Decreased class size, increased active learning? Intended and enacted teaching strategies in smaller classes,” Active Learning in Higher Education, vol. 20, no. 1, pp. 51–62, 2019, doi: 10.1177/1469787417735607. DOI: https://doi.org/10.1177/1469787417735607

Categories