Development of Critical Thinking Essay Test Instrument and Prosocial Intention Questionnaire for Environmental Care in Students
Abstract
Purpose of the study: Assessment of students' critical thinking skills and environmental care attitudes is crucial for science learning. This research aims to develop an essay test instrument for critical thinking and a questionnaire for environmental care attitudes, evaluating their validity through expert assessments and trials.
Methodology: Utilizing the Research and Development (R&D) model by Oriondo & Dallo-Antoio (1998), the study comprises three stages: test planning, trials, and validation. A random sampling technique was employed, involving 267 students. The critical thinking instrument consists of essay questions, while the environmental care attitudes are measured using a prosocial intentions questionnaire.
Main Findings: Validity results indicate a high Aiken index of 0.96 for critical thinking essays and 1.0 for the environmental care questionnaire. Reliability estimates were 0.73 for critical thinking and 0.71 for environmental attitudes, both good. The difficulty level for the critical thinking instrument was classified as medium (0.68), while the environmental care instrument was deemed difficult (1.65). Limitations include focusing solely on science subjects, trials restricted to one area, and reliance on self-reports for environmental attitudes, which may introduce bias.
Novelty/Originality of this study: The novelty of this study lies in integrating critical thinking assessment with environmental care attitudes, a rare approach in previous research. In conclusion, the developed instruments effectively measure students' critical thinking skills and environmental care attitudes in science education, particularly regarding global warming.
References
[2] L. Kartina, N. Nurmeimana, I. Abamba, and A. J. Aswad, “Ability Analysis of Providing Explanations and Strategies in Learning Science,” Journal Evaluation in Education (JEE), vol. 4, no. 3, pp. 88–94, Jul. 2023, doi: 10.37251/JEE.V4I3.699.
[3] Ayu Sri Wahyuni, “Literature Review: Pendekatan Berdiferensiasi Dalam Pembelajaran IPA,” JURNAL PENDIDIKAN MIPA, vol. 12, no. 2, pp. 118–126, Jun. 2022, doi: 10.37630/jpm.v12i2.562.
[4] A. Y. Septajati and A. Widowati, “Development of Science Electronic Modules with an Ethnoscience Integrated STEM Approach in Traditional Herbal Medicine Making,” Journal of Educational Science and Technology (EST), vol. 10, no. 2, pp. 161–170, Aug. 2024, Accessed: Nov. 13, 2024. [Online]. Available: https://ojs.unm.ac.id/JEST/article/view/60750
[5] M. A. Putri and P. A. L. Simbolon, “Model Pembelajaran Problem Solving Dan Korelasinya Terhadap Kemampuan Berpikir Kritis Siswa,” Journal Evaluation in Education (JEE), vol. 3, no. 3, pp. 87–91, Jul. 2022, doi: 10.37251/JEE.V3I3.263.
[6] A. T. Kartika, L. Eftiwin, M. F. Lubis, and A. Walid, “Profil Kemampuan Berpikir Kritis Siswa Kelas VIII SMP Pada Mata Pelajaran IPA,” Jurnal Riset Teknologi dan Inovasi Pendidikan, vol. 3, no. 1, pp. 1–10, 2020.
[7] R. Cui and P. Teo, “Thinking through talk: Using dialogue to develop students’ critical thinking,” Teach Teach Educ, vol. 125, p. 104068, Apr. 2023, doi: 10.1016/J.TATE.2023.104068.
[8] J. Kukkonen, S. Kärkkäinen, and T. Keinonen, “Examining the relationships between factors influencing environmental behaviour among university students,” Sustainability (Switzerland), vol. 10, no. 11, Nov. 2019, doi: 10.3390/su10114294.
[9] Y. Li, D. Yang, and S. Liu, “The impact of environmental education at Chinese Universities on college students’ environmental attitudes,” PLoS One, vol. 19, no. 2 February, Feb. 2024, doi: 10.1371/journal.pone.0299231.
[10] Ennis R, “The Nature of Critical Thinking,” 2011.
[11] R. Hidayah and M. Salimi, “Critical thinking skill: konsep dan inidikator penilaian,” Taman Cendekia: Jurnal Pendidikan Ke-SD-an, vol. 1, no. 2, pp. 127–133, 2020, Accessed: Oct. 08, 2024. [Online]. Available: https://jurnal.ustjogja.ac.id/index.php/tamancendekia/article/download/1945/1127
[12] D. Nurulhasni, E. Nurbaiti, R. S. Nabila, and J. Jumadi, “Developing and implementing an instrument for assessing critical thinking and visual representations in learning Physics materials of Optical Instruments,” Jurnal Penelitian dan Evaluasi Pendidikan, vol. 1, no. 27, 2023, Accessed: Nov. 26, 2024. [Online]. Available: https://journal.uny.ac.id/index.php/jpep/article/view/53550
[13] Facione, “The Nature of Critical Thinking,” 2011.
[14] P. A. Facione, Permission to Reprint for Non-Commercial Uses Critical Thinking: What It Is and Why It Counts. Peter A. Facione, Measured Reasons LLC, 2011. [Online]. Available: www.insightassessment.com
[15] I. W. Distrik, C. Ertikanto, Y. S. Purwati, A. Saregar, and N. F. A. Rahman, “Digital Problem-Based Worksheet with 3D Pageflip: An Effort to Address Concept Understanding Problems and Enhance Digital Literacy Skills,” Jurnal Pendidikan IPA Indonesia, vol. 13, no. 1, pp. 116–127, 2024, doi: 10.15294/jpii.v13i1.48604.
[16] Suciati, “Environmental Conscious Attitudes of Geography Education Students,” Journal Evaluation in Education (JEE), vol. 5, no. 1, pp. 17–24, Jan. 2024, doi: 10.37251/JEE.V5I1.841.
[17] M. Laras and H. Komalasari, “Meningkatkan Sikap Peduli Lingkungan dengan Implementasi Sustainable Development Goals (SDGs) pada Pembelajaran Tari Buyung,” 2024.
[18] United Cities and Local Goverments, “Tujuan Pembangunan Berkelanjutan SDGs,” 2019.
[19] Kementrian Lingkungan Hidup, “Peraturan Gerakan Peduli dan Berbudaya Lingkungan Hidup di Sekolah,” 2022.
[20] M. Jen Ismail, “Pendidikan Karakter Peduli Lingkungan dan Menjaga Kebersihan di Sekolah,” Jurnal Pendidikan dan Pembelajaran , vol. 4, no. 1, 2021.
[21] Z. Huang, Z. Gou, and S. Cai, “Energy justice in education sector: The impact of student demographics on elementary and secondary school energy consumption,” Heliyon, vol. 9, no. 5, p. e16191, May 2023, doi: 10.1016/J.HELIYON.2023.E16191.
[22] J. Wang et al., “Changing Lengths of the Four Seasons by Global Warming,” Geophys Res Lett, vol. 48, no. 6, Mar. 2021, doi: 10.1029/2020GL091753.
[23] S. Alfonso, M. Gesto, and B. Sadoul, “Temperature increase and its effects on fish stress physiology in the context of global warming,” J Fish Biol, vol. 98, no. 6, pp. 1496–1508, Jun. 2021, doi: 10.1111/JFB.14599.
[24] F. Mutlu and O. Nacaroğlu, “Examination of perceptions of gifted students about climate change and global warming,” Journal of Baltic Science Education, vol. 18, no. 5, pp. 780–792, 2019, doi: 10.33225/jbse/19.18.780.
[25] R. H. Ristanto, A. S. Ahmad, and R. Komala, “Critical Thinking Skills of Environmental Changes: A Biological Instruction Using Guided Discovery Learning-Argument Mapping (GDL-AM),” Participatory Educational Research, vol. 9, no. 1, pp. 173–191, Jan. 2022, doi: 10.17275/PER.22.10.9.1.
[26] G. Hillary, E. Djulia, and R. H. Hasibuan, “Analysis Critical Thinking Ability and Environmental Care Attitude of Junior High School Students on Global Warming Material,” Jurnal Penelitian Pendidikan IPA, vol. 9, no. 5, pp. 2383–2390, May 2023, doi: 10.29303/JPPIPA.V9I5.2603.
[27] S. Chattuchai, A. Singseewo, and P. Suksringarm, “Development of Knowledge, Awareness, Global Warming Decreasing Behavior and Critical Thinking of Grade 11 Students Using the Four Noble Truths Method with Meta-Cognitive Techniques.,” Educational Research and Reviews, vol. 10, no. 16, pp. 2268–2275, Aug. 2020.
[28] O. Çavdar, “Investigation of Secondary School Students’ Knowledge Levels About Global Warming in Terms of Various Variables,” Educational Policy Analysis and Strategic Research, vol. 18, no. 3, pp. 336–358, Sep. 2023, doi: 10.29329/epasr.2023.600.16.
[29] M. Asi, A. Retnoningsih, and A. Irsadi, “Effectiveness of Interactive E-Book Global Warming and Climate Change Integrated Socio Scientific Issues Peat Ecosystem,” Jurnal Penelitian Pendidikan IPA, vol. 7, no. SpecialIssue, pp. 240–244, Dec. 2021, doi: 10.29303/jppipa.v7ispecialissue.1039.
[30] E. Suryawati, F. Suzanti, Zulfarina, A. R. Putriana, and L. Febrianti, “The Implementation of Local Environmental Problem-Based Learning Student Worksheets to Strengthen Environmental Literacy,” Jurnal Pendidikan IPA Indonesia, vol. 9, no. 2, pp. 169–178, Jun. 2020, doi: 10.15294/JPII.V9I2.22892.
[31] J. Wu, D. Long, N. Hafez, J. Maloney, Y. Lim, and H. Samji, “Development and validation of a youth climate anxiety scale for the Youth Development Instrument survey,” Int J Ment Health Nurs, vol. 32, no. 6, pp. 1473–1483, Dec. 2023, doi: 10.1111/INM.13201.
[32] Y. Tanjung, T. Wulandari, F. Festiyed, Y. Yerimadesi, and Y. Ahda, “Development analysis of creative thinking test instruments on natural science materials,” Jurnal Pendidikan Fisika, vol. 12, no. 1, p. 22, 2023, Accessed: Nov. 27, 2024. [Online]. Available: https://pdfs.semanticscholar.org/f12b/aba2a46a0dd4d55534ac1ebdbf08991e8a71.pdf
[33] A. Adhitya, I. G. Astawan, and I. N. R. Adi, “Pengembangan Instrumen Penilaian Keterampilan Berpikir Kritis dan Berpikir Kreatif Berbasis Google Form,” Jurnal Ilmiah Pendidikan Citra Bakti, vol. 9, no. 2, pp. 250–261, Nov. 2022, doi: 10.38048/JIPCB.V9I2.682.
[34] S. M. Danczak, C. D. Thompson, and T. L. Overton, “Development and validation of an instrument to measure undergraduate chemistry students’ critical thinking skills,” Chemistry Education Research and Practice, vol. 21, no. 1, pp. 62–78, Jan. 2020, doi: 10.1039/C8RP00130H.
[35] S. Qomariyah, R. Darmayanti, U. Rosyidah, and I. Ayuwanti, “Indicators and Essay Problem Grids on Three-Dimensional Material: Development of Instruments for Measuring High School Students’ Mathematical Problem-Solving Ability,” JEMS: Jurnal Edukasi Matematika dan Sains, vol. 11, no. 1, pp. 261–274, Mar. 2023, doi: 10.25273/JEMS.V11I1.14708.
[36] E. Hariyadi and E. Maryani, “Analisis Instrumen Literasi lingkungan Siswa,” Gulawentah: Jurnal Studi Sosial, vol. 6, 2021, Accessed: Nov. 27, 2024. [Online]. Available: https://www.academia.edu/download/90242717/pdf.pdf
[37] Y. Efriyani, “Pengembangan instrumen penilaian sikap peduli lingkungan siswa sekolah dasar,” Wiyata Dharma: Jurnal Penelitian dan Evaluasi Pendidikan, vol. 10, no. 2, pp. 157–166, Dec. 2022, doi: 10.30738/WD.V10I2.11177.
[38] W. Winarto, S. S., E. Cahyono, and W. Sumarni, “Developing a Problem-Solving Essay Test Instrument (PSETI) in the Instruction of Basic Science Concepts in Ethnoscience Context.,” Journal of Turkish Science Education, vol. 19, no. 1, pp. 37–51, 2022.
[39] H. Alderman, J. Friedman, P. Ganga, M. Kak, and M. Rubio-Codina, “Assessing the performance of the Caregiver Reported Early Development Instruments (CREDI) in rural India,” Ann N Y Acad Sci, vol. 1492, no. 1, pp. 58–72, May 2021, doi: 10.1111/NYAS.14543.
[40] S. Ampuni and S. B. S. Buwono, “Pengembangan dan identifikasi properti psikometris kuesioner intensi prososial berbasis skenario untuk anak dan remaja,” Jurnal Psikologi Sosial, vol. 20, no. 2, pp. 149–167, Aug. 2022, doi: 10.7454/JPS.2022.18.
[41] H. Retnawati, Analisis kuantitatif instrumen penelitian (panduan peneliti, mahasiswa, dan psikometrian). 2016. Accessed: Nov. 08, 2024. [Online]. Available: https://books.google.com/books?hl=id&lr=&id=brRoEAAAQBAJ&oi=fnd&pg=PP1&dq=Retnawati,+2016&ots=t_cA59i7J6&sig=xC7wiKpUeoky8tatulaPFmInhJ0
[42] W. F. Hanna and H. Retnawati, “ANALISIS KUALITAS BUTIR SOAL MATEMATIKA MENGGUNAKAN MODEL RASCH DENGAN BANTUAN SOFTWARE QUEST,” AKSIOMA: Jurnal Program Studi Pendidikan Matematika, vol. 11, no. 4, p. 3695, Dec. 2022, doi: 10.24127/ajpm.v11i4.5908.
[43] F. Larasati and S Syamsurizal, “Validitas Instrumen Tes Keterampilan Berpikir Kritis Peserta Didik Kelas XII SMA/MA tentang Materi Mutasi,” Journal on Teacher Education, vol. 4, pp. 365–372, 2022, Accessed: Nov. 29, 2024. [Online]. Available: https://journal.universitaspahlawan.ac.id/index.php/jote/article/view/6073
[44] Mayasari E, “Instrumen Tes Sebagai Alat Evaluasi,” Jurnal Pendidikan dan Pengajaran, vol. 2, p. 55, 2023, Accessed: Nov. 29, 2024. [Online]. Available: http://pedirresearchinstitute.or.id/index.php/Jurpen/article/view/258
[45] A. Saputra, CAMI: Aplikasi Uji Validitas dan Reliabilitas Instrumen Penelitian Berbasis Web. Yayasan Ahmar Cendekia Indonesia, 2020. Accessed: Nov. 29, 2024. [Online]. Available: https://books.google.com/books?hl=id&lr=&id=mZgMEAAAQBAJ&oi=fnd&pg=PA1&dq=instrumen+tes+essay&ots=YlHogAxxpR&sig=4hpuoLwd9bNWux-JjeNKsLYq2SI
[46] H. Putri, D. Susiani, and NS Wandani, “Instrumen penilaian hasil pembelajaran kognitif pada tes uraian dan tes objektif,” Jurnal Papeda: Jurnal Publikasi Pendidikan Dasar, vol. 4, no. 2, 2022, Accessed: Nov. 29, 2024. [Online]. Available: https://www.academia.edu/download/114163112/1078.pdf
[47] Medina and Joneil B, “Description of Environmental Care Analysis of Students in Elementary Schools,” Journal Evaluation in Education (JEE), vol. 4, no. 3, pp. 95–103, Jul. 2023, doi: 10.37251/JEE.V4I3.335.
Copyright (c) 2025 Muhammad Ikhsan, Sri Atun, Fauji Agusta, Habibatul Unayah, Rusdiman Buhera, Oky Pamungkas, Muhamad Sarip, Patar Ariyanto Sitorus
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and acknowledge that the Integrated Science Education Journal is the first publisher licensed under a Creative Commons Attribution 4.0 International License.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges and earlier and greater citation of published work.