Integrated Science Education Journal
Integrated Science Education Journal

an Open Access Journal

SINTA

6.1

Impact

GScholar

18

H-Index

Integrated Science Education Journal

an Open Access Journal

The Measuring Energy Literacy: Validation of Knowledge, Attitude, and Behavior Instruments Using the Rasch Model

Inda Hasanah Bimastari ORCID
Sriwijaya University ROR
Indonesia
Muhamad Yusup ORCID
Sriwijaya University ROR
Indonesia
m_yusup@unsri.ac.id
Kistiono Kistiono ORCID
Sriwijaya University ROR
Indonesia
Share

  • Purpose of the study: This study aims to develop and validate a Rasch Model-based energy knowledge, attitude, and behavior assessment instrument to measure energy literacy among high school students.

    Methodology: The research design followed the stages of theory-based instrument development and the Rasch modeling approach. The quantitative approach and instrument development process were carried out through the stages of item preparation based on literature review and theoretical indicators, validation by experts, and field testing of 50 participants.

    Main Findings: The knowledge instrument has high quality, obtained as much as 9 data showing a fit for the Rasch model, such as MNSQ infit and outfit values ranging from 0.84 to 1.25. and positive point measure correlations. Instrument reliability shows infit and outfit results that are still within the ideal tolerance range, obtained sequentially the person reliability values of knowledge, attitude, and behavior of 0.50, 0.76 and 0.75. So that the instrument is suitable for accurate and consistent measurement.

    Novelty/Originality of this study: this study provides innovation in the energy literacy measurement literature (knowledge, attitude, and behavior) with an in-depth evaluation of item performance and respondent ability distribution using empirical and applicable methods for the development of evidence-based and Rasch model-based assessment instruments.

  • How to cite

    [1]
    “The Measuring Energy Literacy: Validation of Knowledge, Attitude, and Behavior Instruments Using the Rasch Model”, In. Sci. Ed. J, vol. 6, no. 3, pp. 153–162, Aug. 2025, doi: 10.37251/isej.v6i3.2025.

    More Citation Formats

  • 638
    Abstract views
    594
    Downloads

    Metrics — Badges

    1. US EIA, “World Energy Outlook 2023 - DOE/EIA (2023),” World Energy Outlook, 2023, 2023.
    2. K. L. Chen, S. Y. Liu, and P. H. Chen, “Assessing multidimensional energy literacy of secondary students using contextualized assessment,” Int. J. Environ. Sci. Educ., 2015, doi: 10.12973/ijese.2015.241a.
    3. S. Wu, Y. Li, C. Fang, and P. Ju, “Energy Literacy of Residents and Sustainable Tourism Interaction in Ethnic Tourism: A Study of the Longji Terraces in Guilin, China,” Energies, 2023, doi: 10.3390/en16010259. DOI: https://doi.org/10.3390/en16010259
    4. Y. F. Lee, H. B. N. Nguyen, and H. Te Sung, “Energy literacy of high school students in Vietnam and determinants of their energy-saving behavior,” Environ. Educ. Res., 2022, doi: 10.1080/13504622.2022.2034752. DOI: https://doi.org/10.1080/13504622.2022.2034752
    5. M. Maurer, P. Koulouris, and F. X. Bogner, “Green awareness in action-how energy conservation action forces on environmental knowledge, values and behaviour in adolescents’ school life,” Sustain., 2020, doi: 10.3390/su12030955. DOI: https://doi.org/10.3390/su12030955
    6. M. Yusup, A. Setiawan, N. Y. Rustaman, and I. Kaniawati, “Pre-service Physics Teachers’ Knowledge, Decision Making, and Self-system Toward Energy Conservation,” J. Pendidik. Fis. Indones., 2018, doi: 10.15294/jpfi.v14i2.16638. DOI: https://doi.org/10.15294/jpfi.v14i2.16638
    7. K. A. Babatunde, N. F. Wakimin, S. H. B. Zakaria, M. Soman, and K. Charman, “Determinants of Sustainable Energy Saving Behavior among University Students in Malaysia: A Case Study of Management & Science University (MSU),” Inf. Manag. Bus. Rev., 2023, doi: 10.22610/imbr.v15i3(i).3534. DOI: https://doi.org/10.22610/imbr.v15i3(I).3534
    8. OECD, “Revenue Statistics in Asia and the Pacific: Key findings for Indonesia,” OECD Tax Stat., 2022.
    9. R. Kc, J. Föhr, and T. Ranta, “Public Perception on the Sustainable Energy Transition in Rural Finland: A Multi-criteria Approach,” Circ. Econ. Sustain., 2023, doi: 10.1007/s43615-022-00206-5. DOI: https://doi.org/10.1007/s43615-022-00206-5
    10. P. Papon, “AIE (Agence internationale de l’énergie). World Energy Outlook 2023, Paris : AIE octobre 2023, 353 p. URL : https://iea.blob.core.windows.net/assets/42b23c45-78bc-4482-b0f9-eb826ae2da3d/WorldEnergyOutlook2023.pdf . Consulté le 10 janvier 2024,” Futuribles, 2024, doi: 10.3917/futur.459.0114. DOI: https://doi.org/10.3917/futur.459.0114
    11. K. S. Ermenc and E. K. Niemczyk, “Education for Sustainable Development,” Sodobna Pedagogika/Journal of Contemporary Educational Studies . 2022. doi: 10.21300/21.4.2020.2. DOI: https://doi.org/10.21300/21.4.2020.2
    12. A. Lange Salvia, L. Londero Brandli, W. Leal Filho, B. Gasparetto Rebelatto, and G. Reginatto, “Energy sustainability in teaching and outreach initiatives and the contribution to the 2030 Agenda,” Int. J. Sustain. High. Educ., 2020, doi: 10.1108/IJSHE-05-2020-0180. DOI: https://doi.org/10.1108/IJSHE-05-2020-0180
    13. H. Husamah, H. Suwono, H. Nur, and A. Dharmawan, “Sustainable development research in Eurasia Journal of Mathematics, Science and Technology Education: A systematic literature review,” Eurasia J. Math. Sci. Technol. Educ., 2022, doi: 10.29333/ejmste/11965. DOI: https://doi.org/10.29333/ejmste/11965
    14. D. R. E. Cotton, W. Miller, J. Winter, I. Bailey, and S. Sterling, “Developing students’ energy literacy in higher education,” Int. J. Sustain. High. Educ., 2015, doi: 10.1108/IJSHE-12-2013-0166. DOI: https://doi.org/10.1108/IJSHE-12-2013-0166
    15. J. DeWaters and S. Powers, “Establishing measurement criteria for an energy literacy questionnaire,” J. Environ. Educ., 2013, doi: 10.1080/00958964.2012.711378. DOI: https://doi.org/10.1080/00958964.2012.711378
    16. R. Rohmatulloh, A. Hasanah, L. Sahlani, M. T. Zuhri, N. Kholifah, and M. Nurtanto, “A Systematic Review of Energy Literacy Programs at Primary and Middle Schools,” Pegem Egit. ve Ogr. Derg., 2022, doi: 10.47750/pegegog.13.01.17. DOI: https://doi.org/10.47750/pegegog.13.01.17
    17. A. Reid, “Climate change education and research: possibilities and potentials versus problems and perils?,” Environmental Education Research. 2019. doi: 10.1080/13504622.2019.1664075. DOI: https://doi.org/10.1080/13504622.2019.1664075
    18. M. Wilson, CONSTRUCTING MEASURES: An Item Response Modeling Approach, Second Edition. 2023. doi: 10.4324/9781003286929. DOI: https://doi.org/10.4324/9781003286929
    19. W. J. Boone and J. R. Staver, “Correction to: Advances in Rasch Analyses in the Human Sciences,” in Advances in Rasch Analyses in the Human Sciences, 2020. doi: 10.1007/978-3-030-43420-5_21. DOI: https://doi.org/10.1007/978-3-030-43420-5
    20. A. A. Latif, M. Najib, W. H. Libunao, N. M. Amin, and C. J. Peter, “Enhancing student ’ s akhlaq behaviour through holistic assessment,” Int. Conf. Soc. Sci. Res. ICSSR 2013, 2013.
    21. B. D. Solomon, “United Nations Environment Programme (UNEP),” in Dictionary of Ecological Economics: Terms for the New Millennium, 2023. doi: 10.4337/9781788974912.U.7. DOI: https://doi.org/10.4337/9781788974912.U.7
    22. R. García-Sierra, M. I. Fernández-Cano, M. Jiménez-Pera, M. Feijoo-Cid, and A. Arreciado Marañón, “Knowledge about the best practice guidelines in the nursing degree: A non-randomized post-test design,” Nurs. Open, 2024, doi: 10.1002/nop2.2074. DOI: https://doi.org/10.1002/nop2.2074
    23. T. G. Bond, Z. Yan, and M. Heene, Applying the rasch model: Fundamental measurement in the human sciences. 2020. doi: 10.4324/9780429030499. DOI: https://doi.org/10.4324/9780429030499
    24. L. Tesio, A. Caronni, D. Kumbhare, and S. Scarano, “Interpreting results from Rasch analysis 1. The ‘most likely’ measures coming from the model,” Disabil. Rehabil., 2024, doi: 10.1080/09638288.2023.2169771. DOI: https://doi.org/10.1080/09638288.2023.2169771
    25. T. H. Fiskawarni, R. Rahmawati, W. Widiasih, and R. Saad, “The Design and Validation of the Four Tier Test Instrument for Energy Literacy Using the Rasch Model Analysis,” JIPF (Jurnal Ilmu Pendidik. Fis., vol. 9, no. 1, p. 74, 2024, doi: 10.26737/jipf.v9i1.4717. DOI: https://doi.org/10.26737/jipf.v9i1.4717
    26. E. Avinç and F. Doğan, Digital literacy scale: Validity and reliability study with the rasch model, vol. 29, no. 17. Springer US, 2024. doi: 10.1007/s10639-024-12662-7. DOI: https://doi.org/10.1007/s10639-024-12662-7
    27. P. Susongko, “Construct Validation with Rasch Modeling of Pedagogical Literacy Measurement Instrument for Teachers in Junior High School Environment,” vol. 10, no. 16, pp. 312–322, 2025. DOI: https://doi.org/10.31004/jele.v10i1.639
    28. J. Yang, Z. Reheman, Y. Liu, and S. Zhao, “Applying Rasch analysis in refinement and validation of interpersonal skills measure for gifted children,” Front. Psychol., 2023, doi: 10.3389/fpsyg.2023.1236640. DOI: https://doi.org/10.3389/fpsyg.2023.1236640
    29. G. H. Alnahdi, J. Goldan, and S. Schwab, “Psychometric Properties and Rasch Validation of the Teachers’ Version of the Perception of Resources Questionnaire,” Front. Psychol., 2021, doi: 10.3389/fpsyg.2021.633801. DOI: https://doi.org/10.1037/t86584-000
    30. A. Rahim and H. Haryanto, “Implementation of Item Response Theory (IRT) Rasch Model in Quality Analysis of Final Exam Tests in Mathematics,” J. Educ. Res. Eval., 2021, doi: 10.15294/jere.v10i2.51802. DOI: https://doi.org/10.15294/jere.v10i2.51802
    31. O. Aman, T. Z. Ningsih, and N. F. Abidin, “The Development of Historical Thinking Assessment to Examine Students’ Skills in Analyzing the Causality of Historical Events,” Eur. J. Educ. Res., 2022, doi: 10.12973/eu-jer.11.2.609. DOI: https://doi.org/10.12973/eu-jer.11.2.609
    32. M. Bond, S. Bedenlier, V. I. Marín, and M. Händel, “Emergency remote teaching in higher education: mapping the first global online semester,” Int. J. Educ. Technol. High. Educ., vol. 18, no. 1, 2021, doi: 10.1186/s41239-021-00282-x. DOI: https://doi.org/10.1186/s41239-021-00282-x
    33. R. Sari and M. N. I. Saleh, “Rasch Model Application: Instrument Development of Readiness to Conduct Inclusive Learning,” Psympathic J. Ilm. Psikol., 2023, doi: 10.15575/psy.v9i2.10058. DOI: https://doi.org/10.15575/psy.v9i2.10058
    34. N. V. Morgacheva, S. V. Shcherbatykh, and E. B. Sotnikova, “Assessment and analysis of the level of natural science literacy of students,” Perspekt. Nauk. i Obraz., 2023, doi: 10.32744/pse.2023.2.4. DOI: https://doi.org/10.32744/pse.2023.2.4
    35. M. Yusup, A. Setiawan, N. Y. Rustaman, and I. Kaniawati, “Developing a Framework for the Assessment of Pre-Service Physics Teachers’ Energy Literacy,” J. Phys. Conf. Ser., vol. 877, no. 1, 2017, doi: 10.1088/1742-6596/877/1/012014. DOI: https://doi.org/10.1088/1742-6596/877/1/012014
    36. M. Yusup, “Using Rasch model for the development and validation of energy literacy assessment instrument for prospective physics teachers,” in Journal of Physics: Conference Series, 2021. doi: 10.1088/1742-6596/1876/1/012056. DOI: https://doi.org/10.1088/1742-6596/1876/1/012056
    37. S. A. Alatas, M. Jahja, and M. Yusuf, “Assessment of students’ science literacy skills using diagnostic items on the concept of energy with Rasch modeling,” World J. Adv. Res. Rev., 2024, doi: 10.30574/wjarr.2024.21.1.2697. DOI: https://doi.org/10.30574/wjarr.2024.21.1.2697
    38. M. Yusup, A. Setiawan, N. Y. Rustaman, and I. Kaniawati, “Assessing Pre-Service Physics Teachers’ Energy Literacy: An Application of Rasch measurement,” J. Phys. Conf. Ser., vol. 895, no. 1, 2017, doi: 10.1088/1742-6596/895/1/012161. DOI: https://doi.org/10.1088/1742-6596/895/1/012161
    39. K. Thayaseelan, Y. Zhai, S. Li, and X. Liu, “Revalidating a measurement instrument of spatial thinking ability for junior and high school students,” Discip. Interdiscip. Sci. Educ. Res., vol. 6, no. 1, 2024, doi: 10.1186/s43031-024-00095-8. DOI: https://doi.org/10.1186/s43031-024-00095-8
    40. Y. Oktalia, A. B. Susila, and B. H. Iswanto, “Virtual test instruments to measure scientific literacy of high school students on work and energy,” in Journal of Physics: Conference Series, 2021. doi: 10.1088/1742-6596/2019/1/012009. DOI: https://doi.org/10.1088/1742-6596/2019/1/012009
    41. E. Bartholomew, N. Iqbal, and O. Medvedev, “Enhancing the Assessment of Gratitude in Mindfulness Research: a Rasch Analysis of the 6-Item Gratitude Questionnaire,” Mindfulness (N. Y)., 2022, doi: 10.1007/s12671-022-02006-2. DOI: https://doi.org/10.1007/s12671-022-02006-2
    42. L. Tesio, A. Caronni, A. Simone, D. Kumbhare, and S. Scarano, “Interpreting results from Rasch analysis 2. Advanced model applications and the data-model fit assessment,” Disabil. Rehabil., 2024, doi: 10.1080/09638288.2023.2169772. DOI: https://doi.org/10.1080/09638288.2023.2169772
    43. J. M. Linacre, “Rasch dichotomous model vs. one-parameter logistic model (1PL 1-PL),” Rasch Meas. Trans., 2005.
    44. A. Sukri, M. A. Rizka, E. Purwanti, S. Ramdiah, and M. Lukitasari, “Validating Student’s Green Character Instrument Using Factor and Rasch Model,” Eur. J. Educ. Res., 2022, doi: 10.12973/eu-jer.11.2.859. DOI: https://doi.org/10.12973/eu-jer.11.2.859
    45. M. N. Mamat and F. Mokhtar, “Reliable assessment model for affective environmental education: Rasch model made simple,” in 2012 International Conference on E-Learning and E-Technologies in Education, ICEEE 2012, 2012. doi: 10.1109/ICeLeTE.2012.6333387. DOI: https://doi.org/10.1109/ICeLeTE.2012.6333387
    46. H. Lahza, H. Khosravi, and G. Demartini, “Analytics of learning tactics and strategies in an online learnersourcing environment,” J. Comput. Assist. Learn., 2023, doi: 10.1111/jcal.12729. DOI: https://doi.org/10.1111/jcal.12729
    47. N. F. Ramli, O. Talib, S. A. Hassan, and U. K. A. Manaf, “Development and Validation of an Instrument to Measure STEM Teachers’ Instructional Preparedness,” Asian J. Univ. Educ., 2020, doi: 10.24191/ajue.v16i3.11084. DOI: https://doi.org/10.24191/ajue.v16i3.11084
    48. N. E. M. Razali, R. Z. Ramli, H. Mohamed, N. A. Mat Zin, F. Rosdi, and N. Mat Diah, “Identifying and validating game design elements in serious game guideline for climate change,” Heliyon, 2022, doi: 10.1016/j.heliyon.2022.e08773. DOI: https://doi.org/10.1016/j.heliyon.2022.e08773
    49. T. LeVasseur and C. Ciarcia, “Sustainability literacy in a time of socio-ecological crisis: Using reaccreditation as a leverage point for innovation in higher education,” Sustain., 2019, doi: 10.3390/su11185104. DOI: https://doi.org/10.3390/su11185104
    50. L. Wang, Y. Yuan, and G. Wang, “The Construction of Civil Scientific Literacy in China from the Perspective of Science Education,” Sci. Educ., 2024, doi: 10.1007/s11191-022-00367-7. DOI: https://doi.org/10.1007/s11191-022-00367-7

Categories