Journal Evaluation in Education (JEE)
Journal Evaluation in Education (JEE)

an Open Access Journal

SINTA

1.6519

Impact

GScholar

16

H-Index

Journal Evaluation in Education (JEE)

an Open Access Journal

Development of Critical Thinking Essay Test Instrument and Prosocial Intention Questionnaire for Environmental Care in Students

Muhammad Ikhsan ORCID
Yogyakarta State University ROR
Indonesia
mikhsan17821@gmail.com
Sri Atun ORCID
Yogyakarta State University ROR
Indonesia
Fauji Agusta ORCID
Yogyakarta State University ROR
Indonesia
Habibatul Unayah ORCID
Yogyakarta State University ROR
Indonesia
Rusdiman Buhera ORCID
Yogyakarta State University ROR
Indonesia
Oky Pamungkas ORCID
Yogyakarta State University ROR
Indonesia
Muhamad Sarip
Yogyakarta State University ROR
Indonesia
Patar Ariyanto Sitorus ORCID
Yogyakarta State University ROR
Indonesia
Share

  • Purpose of the study: Assessment of students' critical thinking skills and environmental care attitudes is crucial for science learning. This research aims to develop an essay test instrument for critical thinking and a questionnaire for environmental care attitudes, evaluating their validity through expert assessments and trials.

    Methodology: Utilizing the Research and Development (R&D) model by Oriondo & Dallo-Antoio (1998), the study comprises three stages: test planning, trials, and validation. A random sampling technique was employed, involving 267 students. The critical thinking instrument consists of essay questions, while the environmental care attitudes are measured using a prosocial intentions questionnaire.

    Main Findings: Validity results indicate a high Aiken index of 0.96 for critical thinking essays and 1.0 for the environmental care questionnaire. Reliability estimates were 0.73 for critical thinking and 0.71 for environmental attitudes, both good. The difficulty level for the critical thinking instrument was classified as medium (0.68), while the environmental care instrument was deemed difficult (1.65). Limitations include focusing solely on science subjects, trials restricted to one area, and reliance on self-reports for environmental attitudes, which may introduce bias.

    Novelty/Originality of this study: The novelty of this study lies in integrating critical thinking assessment with environmental care attitudes, a rare approach in previous research. In conclusion, the developed instruments effectively measure students' critical thinking skills and environmental care attitudes in science education, particularly regarding global warming.

  • How to cite

    [1]
    “Development of Critical Thinking Essay Test Instrument and Prosocial Intention Questionnaire for Environmental Care in Students”, Jor. Eva. Edu, vol. 6, no. 1, pp. 66–78, Jan. 2025, doi: 10.37251/jee.v6i1.1273.

    More Citation Formats

  • 892
    Abstract views
    464
    Downloads

    Metrics — Badges

    1. S. Hanipah, “Analisis kurikulum merdeka belajar dalam memfasilitasi pembelajaran abad ke-21 pada siswa menengah atas [Analysis of the independent learning curriculum in facilitating 21st century learning for high school students],” Jurnal Bintang Pendidikan Indonesia, vol. 1, no. 2, pp. 264-275, 2023, doi: 10.55606/jubpi.v1i2.1860. DOI: https://doi.org/10.55606/jubpi.v1i2.1860
    2. L. Kartina, N. Nurmeimana, I. Abamba, and A. J. Aswad, “Ability analysis of providing explanations and strategies in learning science,” Journal Evaluation in Education (JEE), vol. 4, no. 3, pp. 88–94, 2023, doi: 10.37251/jee.v4i3.699. DOI: https://doi.org/10.37251/jee.v4i3.699
    3. A. S. Wahyuni, “Literature review: Pendekatan berdiferensiasi dalam pembelajaran IPA [Literature review: Differentiated approach in science learning],” Jurnal Pendidikan Mipa, vol. 12, no. 2, pp. 118–126, 2022, doi: 10.37630/jpm.v12i2.562. DOI: https://doi.org/10.37630/jpm.v12i2.562
    4. A. Y. Septajati and A. Widowati, “Development of science electronic modules with an ethnoscience integrated STEM approach in traditional herbal medicine making,” Journal of Educational Science and Technology (EST), vol. 10, no. 2, pp. 161–170, 2024. DOI: https://doi.org/10.26858/est.v10i2.60750
    5. M. A. Putri and P. A. L. Simbolon, “Model pembelajaran problem solving dan korelasinya terhadap kemampuan berpikir kritis siswa [Problem solving learning model and its correlation with students' critical thinking skills],” Journal Evaluation in Education (JEE), vol. 3, no. 3, pp. 87–91, 2022, doi: 10.37251/jee.v3i3.263.
    6. A. T. Kartika, L. Eftiwin, M. F. Lubis, and A. Walid, “Profil kemampuan berpikir kritis siswa kelas viii smp pada mata pelajaran IPA [Profile of critical thinking skills of grade VIII junior high school students in science subjects],” Jurnal Riset Teknologi dan Inovasi Pendidikan, vol. 3, no. 1, pp. 1–10, 2020. DOI: https://doi.org/10.36765/jartika.v3i1.46
    7. R. Cui and P. Teo, “Thinking through talk: Using dialogue to develop students’ critical thinking,” Teach Teach Educ, vol. 125, p. 104068, 2023, doi: 10.1016/J.TATE.2023.104068. DOI: https://doi.org/10.1016/j.tate.2023.104068
    8. J. Kukkonen, S. Kärkkäinen, and T. Keinonen, “Examining the relationships between factors influencing environmental behaviour among university students,” Sustainability (Switzerland), vol. 10, no. 11, 2019, doi: 10.3390/su10114294. DOI: https://doi.org/10.3390/su10114294
    9. Y. Li, D. Yang, and S. Liu, “The impact of environmental education at Chinese Universities on college students’ environmental attitudes,” PLoS One, vol. 19, no. 2 February, Feb. 2024, doi: 10.1371/journal.pone.0299231. DOI: https://doi.org/10.1371/journal.pone.0299231
    10. Ennis R, “The Nature of Critical Thinking,” 2011. DOI: https://doi.org/10.5840/inquiryctnews20112613
    11. R. Hidayah and M. Salimi, “Critical thinking skill: Konsep dan inidikator penilaian [Critical thinking skills: Concepts and assessment indicators],” Taman Cendekia: Jurnal Pendidikan Ke-SD-an, vol. 1, no. 2, pp. 127–133, 2020. DOI: https://doi.org/10.30738/tc.v1i2.1945
    12. D. Nurulhasni, E. Nurbaiti, R. S. Nabila, and J. Jumadi, “Developing and implementing an instrument for assessing critical thinking and visual representations in learning Physics materials of Optical Instruments,” Jurnal Penelitian dan Evaluasi Pendidikan, vol. 1, no. 27, 2023, doi: 10.21831/pep.v27i1.53550 DOI: https://doi.org/10.21831/pep.v27i1.53550
    13. F. Facione, “The Nature of Critical Thinking,” 2011.
    14. P. A. Facione, Permission to Reprint for Non-Commercial Uses Critical Thinking: What It Is and Why It Counts. Peter A. Facione, Measured Reasons LLC, 2011.
    15. I. W. Distrik, C. Ertikanto, Y. S. Purwati, A. Saregar, and N. F. A. Rahman, “Digital Problem-Based worksheet with 3d pageflip: an effort to address concept understanding problems and enhance digital literacy skills,” Jurnal Pendidikan IPA Indonesia, vol. 13, no. 1, pp. 116–127, 2024, doi: 10.15294/jpii.v13i1.48604. DOI: https://doi.org/10.15294/jpii.v13i1.48604
    16. S. Suciati, “Environmental Conscious Attitudes of Geography Education Students,” Journal Evaluation in Education (JEE), vol. 5, no. 1, pp. 17–24, 2024, doi: 10.37251/jee.v5i1.841. DOI: https://doi.org/10.37251/jee.v5i1.841
    17. M. Laras and H. Komalasari, “Meningkatkan sikap peduli lingkungan dengan implementasi sustainable development goals (SDGs) pada pembelajaran Tari Buyung [Improving environmental awareness by implementing sustainable development goals (SDGs) in Buyung Dance learning],” Ringkang: Kajian Seni Tari dan Pendidikan Seni Tari, vol. 4, no. 1, pp. 149-160, 2024.
    18. United Cities and Local Goverments, “Tujuan Pembangunan Berkelanjutan SDGs,” 2019.
    19. Kementrian Lingkungan Hidup, “Peraturan Gerakan Peduli dan Berbudaya Lingkungan Hidup di Sekolah,” 2022.
    20. M. Jen Ismail, “Pendidikan karakter peduli lingkungan dan menjaga kebersihan di sekolah [Character education on caring for the environment and maintaining cleanliness at school],” Jurnal Pendidikan dan Pembelajaran , vol. 4, no. 1, 2021. DOI: https://doi.org/10.31970/gurutua.v4i1.67
    21. Z. Huang, Z. Gou, and S. Cai, “Energy justice in education sector: The impact of student demographics on elementary and secondary school energy consumption,” Heliyon, vol. 9, no. 5, p. e16191, 2023, doi: 10.1016/j.heliyon.2023.e16191. DOI: https://doi.org/10.1016/j.heliyon.2023.e16191
    22. J. Wang et al., “Changing Lengths of the Four Seasons by Global Warming,” Geophys Res Lett, vol. 48, no. 6, 2021, doi: 10.1029/2020gl091753. DOI: https://doi.org/10.1029/2020GL091753
    23. S. Alfonso, M. Gesto, and B. Sadoul, “Temperature increase and its effects on fish stress physiology in the context of global warming,” J Fish Biol, vol. 98, no. 6, pp. 1496–1508, 2021, doi: 10.1111/jfb.14599. DOI: https://doi.org/10.1111/jfb.14599
    24. F. Mutlu and O. Nacaroğlu, “Examination of perceptions of gifted students about climate change and global warming,” Journal of Baltic Science Education, vol. 18, no. 5, pp. 780–792, 2019, doi: 10.33225/jbse/19.18.780. DOI: https://doi.org/10.33225/jbse/19.18.780
    25. R. H. Ristanto, A. S. Ahmad, and R. Komala, “Critical thinking skills of environmental changes: A biological instruction using guided discovery learning-argument mapping (GDL-AM),” Participatory Educational Research, vol. 9, no. 1, pp. 173–191, Jan. 2022, doi: 10.17275/per.22.10.9.1. DOI: https://doi.org/10.17275/per.22.10.9.1
    26. G. Hillary, E. Djulia, and R. H. Hasibuan, “Analysis Critical Thinking Ability and Environmental Care Attitude of Junior High School Students on Global Warming Material,” Jurnal Penelitian Pendidikan IPA, vol. 9, no. 5, pp. 2383–2390, 2023, doi: 10.29303/jppipa.v9i5.2603. DOI: https://doi.org/10.29303/jppipa.v9i5.2603
    27. S. Chattuchai, A. Singseewo, and P. Suksringarm, “Development of knowledge, awareness, global warming decreasing behavior and critical thinking of grade 11 students using the four noble truths method with meta-cognitive techniques,” Educational Research and Reviews, vol. 10, no. 16, pp. 2268–2275, 2020. DOI: https://doi.org/10.5897/ERR2015.2360
    28. O. Çavdar, “Investigation of secondary school students’ knowledge levels about global warming in terms of various variables,” Educational Policy Analysis and Strategic Research, vol. 18, no. 3, pp. 336–358, 2023, doi: 10.29329/epasr.2023.600.16. DOI: https://doi.org/10.29329/epasr.2023.600.16
    29. M. Asi, A. Retnoningsih, and A. Irsadi, “Effectiveness of interactive e-book global warming and climate change integrated socio scientific issues peat ecosystem,” Jurnal Penelitian Pendidikan IPA, vol. 7, no. SpecialIssue, pp. 240–244, 2021, doi: 10.29303/jppipa.v7ispecialissue.1039. DOI: https://doi.org/10.29303/jppipa.v7iSpecialIssue.1039
    30. E. Suryawati, F. Suzanti, Zulfarina, A. R. Putriana, and L. Febrianti, “The implementation of local environmental problem-based learning student worksheets to strengthen environmental literacy,” Jurnal Pendidikan IPA Indonesia, vol. 9, no. 2, pp. 169–178, 2020, doi: 10.15294/JPII.V9I2.22892. DOI: https://doi.org/10.15294/jpii.v9i2.22892
    31. J. Wu, D. Long, N. Hafez, J. Maloney, Y. Lim, and H. Samji, “Development and validation of a youth climate anxiety scale for the Youth Development Instrument survey,” Int J Ment Health Nurs, vol. 32, no. 6, pp. 1473–1483, 2023, doi: 10.1111/inm.13201. DOI: https://doi.org/10.1111/inm.13201
    32. Y. Tanjung, T. Wulandari, F. Festiyed, Y. Yerimadesi, and Y. Ahda, “Development analysis of creative thinking test instruments on natural science materials,” Jurnal Pendidikan Fisika, vol. 12, no. 1, p. 22, 2023. DOI: https://doi.org/10.24114/jpf.v12i1.43340
    33. A. Adhitya, I. G. Astawan, and I. N. R. Adi, “Pengembangan instrumen penilaian keterampilan berpikir kritis dan berpikir kreatif berbasis google form [Development of critical thinking and creative thinking skills assessment instruments based on Google Forms],” Jurnal Ilmiah Pendidikan Citra Bakti, vol. 9, no. 2, pp. 250–261, 2022, doi: 10.38048/jipcb.v9i2.682. DOI: https://doi.org/10.38048/jipcb.v9i2.682
    34. S. M. Danczak, C. D. Thompson, and T. L. Overton, “Development and validation of an instrument to measure undergraduate chemistry students’ critical thinking skills,” Chemistry Education Research and Practice, vol. 21, no. 1, pp. 62–78, 2020, doi: 10.1039/c8rp00130h. DOI: https://doi.org/10.1039/C8RP00130H
    35. S. Qomariyah, R. Darmayanti, U. Rosyidah, and I. Ayuwanti, “Indicators and Essay Problem Grids on Three-Dimensional Material: Development of Instruments for Measuring High School Students’ Mathematical Problem-Solving Ability,” JEMS: Jurnal Edukasi Matematika dan Sains, vol. 11, no. 1, pp. 261–274, 2023, doi: 10.25273/jems.v11i1.14708.
    36. E. Hariyadi and E. Maryani, “Analisis instrumen literasi lingkungan siswa [Analysis of students' environmental literacy instruments],” Gulawentah: Jurnal Studi Sosial, vol. 6, 2021. DOI: https://doi.org/10.25273/gulawentah.v6i1.6685
    37. Y. Efriyani, “Pengembangan instrumen penilaian sikap peduli lingkungan siswa sekolah dasar [Development of an assessment instrument for elementary school students' environmental care attitudes],” Wiyata Dharma: Jurnal Penelitian dan Evaluasi Pendidikan, vol. 10, no. 2, pp. 157–166, 2022, doi: 10.30738/wd.v10i2.11177. DOI: https://doi.org/10.30738/wd.v10i2.11177
    38. W. Winarto, S. S., E. Cahyono, and W. Sumarni, “Developing a problem-solving essay test instrument (PSETI) in the instruction of basic science concepts in ethnoscience context,” Journal of Turkish Science Education, vol. 19, no. 1, pp. 37–51, 2022, doi: 10.36681/tused.2022.108. DOI: https://doi.org/10.36681/tused.2022.108
    39. H. Alderman, J. Friedman, P. Ganga, M. Kak, and M. Rubio-Codina, “Assessing the performance of the Caregiver Reported Early Development Instruments (CREDI) in rural India,” Ann N Y Acad Sci, vol. 1492, no. 1, pp. 58–72, 2021, doi: 10.1111/NYAS.14543. DOI: https://doi.org/10.1111/nyas.14543
    40. S. Ampuni and S. B. S. Buwono, “Pengembangan dan identifikasi properti psikometris kuesioner intensi prososial berbasis skenario untuk anak dan remaja [Development and identification of psychometric properties of a scenario-based prosocial intention questionnaire for children and adolescents],” Jurnal Psikologi Sosial, vol. 20, no. 2, pp. 149–167, 2022, doi: 10.7454/JPS.2022.18. DOI: https://doi.org/10.7454/jps.2022.18
    41. H. Retnawati, Analisis kuantitatif instrumen penelitian (panduan peneliti, mahasiswa, dan psikometrian) [Quantitative analysis of research instruments (guide for researchers, students, and psychometricians).]. 2016.
    42. W. F. Hanna and H. Retnawati, “Analisis kualitas butir soal matematika menggunakan model rasch dengan bantuan software quest [Analysis of the quality of mathematics problem items using the Rasch model with the help of Quest software],” AKSIOMA: Jurnal Program Studi Pendidikan Matematika, vol. 11, no. 4, p. 3695, 2022, doi: 10.24127/ajpm.v11i4.5908. DOI: https://doi.org/10.24127/ajpm.v11i4.5908
    43. F. Larasati and S Syamsurizal, “Validitas instrumen tes keterampilan berpikir kritis peserta didik kelas XII SMA/MA tentang materi mutase [Validity of critical thinking skills test instrument for grade XII SMA/MA students on mutation material],” Journal on Teacher Education, vol. 4, pp. 365–372, 2022.
    44. Mayasari E, “Instrumen tes sebagai alat evaluasi [Test instruments as evaluation tools],” Jurnal Pendidikan dan Pengajaran, vol. 2, p. 55, 2023.
    45. A. Saputra, CAMI: Aplikasi Uji Validitas dan Reliabilitas Instrumen Penelitian Berbasis Web CAMI: Web-Based Research Instrument Validity and Reliability Testing Application]. Yayasan Ahmar Cendekia Indonesia, 2020.
    46. H. Putri, D. Susiani, and NS Wandani, “Instrumen penilaian hasil pembelajaran kognitif pada tes uraian dan tes objektif [Cognitive learning outcome assessment instruments in descriptive tests and objective tests],” Jurnal Papeda: Jurnal Publikasi Pendidikan Dasar, vol. 4, no. 2, 2022. DOI: https://doi.org/10.36232/jurnalpendidikandasar.v4i2.2649
    47. Medina and Joneil B, “Description of environmental care analysis of students in elementary schools,” Journal Evaluation in Education (JEE), vol. 4, no. 3, pp. 95–103, 2023, doi: 10.37251/jee.v4i3.335. DOI: https://doi.org/10.37251/jee.v4i3.335
    48. M. A. Putri and P. A. L. Simbolon, “Model pembelajaran problem solving dan korelasinya terhadap kemampuan berpikir kritis siswa [Problem solving learning model and its correlation with students' critical thinking skills],” Journal Evaluation in Education (JEE), vol. 3, no. 3, pp. 87–91, 2022, doi: 10.37251/jee.v3i3.263. DOI: https://doi.org/10.37251/jee.v3i3.263
    49. A. Doelvia, V. Thi, T. Hien, S. Rathee, A. Kebidanan, and A. Muara Bungo, “Assessment: The effectiveness of video media through the tiktok application on teenagers’ knowledge about clean and healthy living behavior at junior high school level,” Journal Evaluation in Education (JEE), vol. 4, no. 4, pp. 168–174, 2023, doi: 10.37251/jee.v4i4.948. DOI: https://doi.org/10.37251/jee.v4i4.948
    50. M. Maria, S. Silalahi, Y. Aggarwal, and U. Galadima, “Implementation of science student work sheet based on multiple intelligence materials temperature and their changes,” Journal Evaluation in Education (JEE), vol. 4, no. 3, pp. 104–109, 2023, doi: 10.37251/jee.v4i3.698. DOI: https://doi.org/10.37251/jee.v4i3.698
    51. S. Mundarti and F. T. Aldila, “Affective assessment instrument based on krathwohl-anderson taxonomy in senior high school,” Journal Evaluation in Education (JEE), vol. 4, no. 2, pp. 74–79, 2023, doi: 10.37251/jee.v4i2.323. DOI: https://doi.org/10.37251/jee.v4i2.323