Development of Scientific Literacy Skills Test Instruments in Elementary School: Analysis of The Rasch Model
Abstract
Purpose of the study: This study aims to develop and evaluate a context-based scientific literacy assessment instrument on the topic of global warming for sixth-grade elementary school students, employing the Rasch model to examine its validity, reliability, item difficult levels, and Differential Item Functioning (DIF).
Methodology: The research design followed a systematic instrument development procedure supported by Rasch model analysis. The instrument comprised 20 multiple-choice items based on the OECD scientific literacy framework and was piloted with 26 sixth-grade students. Data were analyzed using Ministep to examine validity, reliability, item difficult, and Differential Item Functioning (DIF).
Main Findings: The findings show that most items satisfied the validity criteria based on Outfit MNSQ, ZSTD and PTM Corr indices. Item difficulty levels were proportionally distributed from very easy to very difficult. Reliability analysis yielded a person reliability of 0.70, an item reliability of 0.72, and a Cronbach’s alpha of 0.78. DIF analysis indicated that all items were free from gender bias. As a pilot study with a limited sample from one school, these results represent preliminary evidence rather than as a final validation of the instrument.
Novelty/Originality of this study: This study aims to develop and evaluate a scientific literacy test specifically designed for elementary school students on the topic of global warming using Rasch analysis, an area that remains limited in prior research. The instrument integrates real-life contextual situations aligned with current curriculum demands and has the potential to strengthen scientific literacy assessment practices at the elementary education level.
References
F. Kasse and I. R. W. Atmojo, “Analisis kecakapan abad 21 melalui literasi sains pada siswa sekolah dasar [Analysis of 21st Century Skills through Scientific Literacy in Elementary School Students],” J. Educ. Dev. Pendidik. Tapanuli Selatan, vol. 10, no. 1, pp. 124–128, 2022, doi: 10.37081/ed.v10i1.3322.
I. S. Budiarti and Tanta, “Analysis on students’ scientific literacy of newton’s law and motion system in living things,” J. Pendidik. Sains Indones., vol. 9, no. 1, pp. 36–51, 2021, doi: 10.24815/jpsi.v9i1.18470.
I. Irsan, “Implemensi literasi sains dalam pembelajaran IPA di sekolah dasar [Implementation of scientific literacy in science learning at elementary school],” J. Basicedu, vol. 5, no. 6, pp. 5631–5639, 2020, doi: 10.31004/basicedu.v5i6.1682.
C. Z. L. Parisu, L. Sisi, and A. Juwairiyah, “Pengembangan literasi sains pada siswa sekolah dasar melalui pembelajaran IPA [Development of scientific literacy in elementary school students through science learning],” J. Pendidik. Multidisiplin, vol. 1, no. 1, pp. 11–19, 2025, doi: 10.54297/jpmd.v1i1.880.
C. Z. L. Parisu, E. E. Saputra, and Larisisi, “Integrasi pendidikan karakter dalam pembelajaran ipa di sekolah dasar [Integration of character education in science learning at elementary school],” Pendas J. Ilm. Pendidik. Dasar, vol. 5, no. 1, pp. 864–872, 2025, doi: 10.23969/jp.v8i1.7488.
S. Ayub, J. Rokhmat, A. Ramdani, and A. Hakim, “Karakteristik soal literasi sains programme for international student assesment (PISA) tahun 2015 [Characteristics of science literacy items in PISA 2015],” J. Ilm. Profesi Pendidik., vol. 7, no. 4b, pp. 2623–2629, 2022, doi: 10.29303/jipp.v7i4b.1039.
T. Tanti, W. Utami, D. Deliza, and M. Jahanifar, “Investigation in vocation high school for attitude and motivation students in learning physics subject”, Journal Evaluation in Education (JEE), vol. 6, no. 2, pp. 479-490, 2025, doi: 10.37251/jee.v6i2.1452.
H. Fuadi, A. Z. Robbia, J. Jamaluddin, and A. W. Jufri, “Analisis faktor penyebab rendahnya kemampuan literasi sains peserta didik [Analysis of the factors contributing to students’ low science literacy skills],” J. Ilm. Profesi Pendidik., vol. 5, no. 2, pp. 108–116, 2020, doi: 10.29303/jipp.v5i2.122.
F. Avvisati and R. Ilizaliturri, “PISA 2022 Results: Factsheets – Indonesia,” 2023.
Hasnawati, M. Syazali, and G. P. Putra, “Pengembangan asesmen literasi sains berbasis PISA untuk siswa sekolah dasar [Development of PISA-Based scientific literacy assessment for elementary school students],” J. Ilm. Pendidik. Dasar, vol. 5, no. 2, pp. 240–250, 2023, doi: 10.37216/badaa.v5i1.1213.
I. Magdalena, M. Hifziyah, V. N. Aeni, and R. P. Rahayu, “Pengembangan instrumen tes siswa tingkat sekolah dasar Kabupaten Tangerang [Development of a test instrument for elementary school students in Tangerang Regency],” J. Pendidik. dan Ilmu Sos., vol. 2, no. 2, pp. 227–237, 2020, doi: 10.36088/nusantara.v3i2.1244.
L. Zhang, X. Liu, and H. Feng, “Development and validation of an instrument for assessing scientific literacy from junior to senior high school,” Discip. Interdiscip. Sci. Educ. Res., vol. 5, no. 21, pp. 2–15, 2023, doi: 10.1186/s43031-023-00093-2.
H. B. Atta, Vlorensius, A. Irianto, and Ikhsanudin, “Developing an instrument for students scientific literacy Developing an instrument for students scientific literacy,” J. Phys. Conf. Ser., 2020, doi: 10.1088/1742-6596/1422/1/012019.
N. N. Faidah, M. Listiawati, and I. M. Yamin, “Pengaruh penggunaan media pembelajaran liveworksheets dalam meningkatkan hasil belajar kognitif siswa pada materi pemanasan global [The effect of using liveworksheets as an instructional media on improving students’ cognitive learning outcomes in global warming material],” J. Kiprah Pendidik., vol. 1, no. 2, pp. 194–208, 2023, doi: 10.33578/kpd.v2i2.182.
M. Yusup, “Using Rasch model for the development and validation of energy literacy assessment instrument for prospective physics teachers Using Rasch model for the development and validation of energy literacy assessment instrument for prospective physics teachers,” J. Phys. Conf. Ser., pp. 1–10, 2021, doi: 10.1088/1742-6596/1876/1/012056.
E. Nazharita et al., “Analisis butir soal tes literasi numerasi domain geometri siswa SMP menggunakan rasch model berbantuan ministep [Item analysis of numeracy literacy test in geometry domain for junior high school students using the rasch model assisted by ministep],” J. Pendidik. Mat., vol. 10, no. 3, pp. 989–1000, 2025, doi: 10.30605/pedagogy.v10i3.6785.
Y. Helsa and D. Fitria, Pengantar Statistik Untuk Mahasiswa Pendidikan Guru Sekolah Dasar dan Umum Jilid 2 [Introduction to Statistics for Elementary School Teacher Education and General Students, Volume 2]. Yogyakarta: Deepublish Digital, 2024.
W. Lestari, I. Wigati, M. I. Sholeh, and D. Pramita, “Instrumen literasi digital guru menggunakan model rasch [Teachers’ digital literacy instrument using the rasch model],” Orbital J. Pendidik. Kim., vol. 6, no. 2, pp. 104–113, 2022, doi: 10.19109/ojpk.v6i2.15019.
N. Monigir, Y. W. Tumbol, and N. V. Monolimay, “Use of The Rasch Model for Analysis of Test Instruments in Class V Science Subjects State 38 Primary School Manado,” Int. J. Inf. Technol. Educ., vol. 3, no. 2, pp. 1–7, 2024, doi: 10.62711/ijite.v3i2.171.
K. P. Prayoga, D. Suryana, M. Supriatna, and N. Budiman, “Penggunaan Rasch Model Untuk Menganalisis Konstruk Instrumen Kontrol Diri Pada Siswa Sekolah Menengah [The Use of the Rasch Model to Analyze the Construct of a Self-Control Instrument for Secondary School Students],” G-Couns J. Bimbing. dan Konseling, vol. 9, no. 1, pp. 367–381, 2024, doi: 10.31316/gcouns.v9i1.4459.
B. Sumintono and W. Widhiarso, Aplikasi Permodelan Rasch Pada Assesment Pendidikan [Application of Rasch Modeling in Educational Assessment]. Cimahi: Penerbit Trim Komunikata, 2015.
T. Tanti, A. Astalini, D. A. Kurniawan, D. Darmaji, T. O. Puspitasari, and I. Wardhana, “Attitude for physics: The condition of high school students,” Jurnal Pendidikan Fisika Indonesia, vol. 17, no. 2, pp. 126-132, 2021, doi: 10.15294/jpfi.v17i2.18919.
H. Noperi, V. Wiliyanti, and F. A. Yanti, “Validasi Instrumen Literasi Sains dengan Model Rasch untuk Socio-Scientific Issues [Validation of a Scientific Literacy Instrument Using the Rasch Model for Socio-Scientific Issues],” Nat. J. Ilm. Pendidik. IPA, vol. 11, no. 2, pp. 63–75, 2024, doi: 10.30738/natural.v11i2.18891.
R. E. Tornabene, E. Lavington, and R. H. Nehm, “Testing validity inferences for Genetic Drift Inventory scores using Rasch modeling and item order analyses,” Evol. Educ. Outreach, vol. 11, no. 6, pp. 2–16, 2018, doi: 10.1186/s12052-018-0082-x.
T. Tanti, A. Astalini, D. Darmaji, D. A. Kurniawan, and R. Fitriani, “Student perception review from gender: Electronic moduls of mathematical physics,” JPI (Jurnal Pendidikan Indonesia), vol. 11, no. 1, pp. 125-132, 2022, doi: 10.23887/jpiundiksha.v11i1.35107.
R. Athiyyah, S. Feranie, and T. R. Ramalis, “Development of scientific process-creative skills (sp-cs) test on light wave concept: Content validity and rasch model analysis,” Edusains, vol. 14, no. 2, pp. 111–125, 2022, doi: 10.15408/es.v13i2.28025.
H. Hadiyanti, P. Susongko, and Munadi, “Pengembangan instrumen higher order thinking skill mata pelajaran matematika dengan rasch model [Development of a higher order thinking skills instrument in mathematics using the rasch model],” J. Educ. Res., vol. 5, no. 1, pp. 399–407, 2024, doi: https://doi.org/10.37985/jer.v5i1.765.
R. A. Setiyawan and P. S. Wijayanti, “Analisis kualitas instrumen untuk mengukur kemampuan pemecahan masalah siswa selama pembelajaran daring di masa pandemi [Analysis of Instrument Quality to Measure Students’ Problem-Solving Skills during Online Learning in the Pandemic Period],” Lebesgue JurnalIlmiahPendidikan Mat. Mat. dan Stat., vol. 1, no. 2, pp. 130–139, 2020, doi: https://doi.org/10.46306/lb.v1i2.26.
H. A. Saputri, Zulhijrah, N. J. Larasati, and Shaleh, “Analisis instrumen assesmen: Validitas, reliabilitas, tingkat kesukaran, dan daya beda butir soal [Assessment instrument analysis: Validity, reliability, difficulty level, and discrimination index],” J. Ilm. PGSD FKIP Univ. Mandiri, vol. 9, no. 5, pp. 2986–2995, 2023, doi: 10.36989/didaktik.v9i5.2268.
R. I. Octaviana, M. B. Anggara, R. Jamilah, A. Darmana, and R. D. Suyanti, “Analisis item soal kimia SMA menggunakan rasch model “Analisis item soal kimia SMA menggunakan rasch model [Analysis of senior high school chemistry test items using the rasch model],” ORBITAL J. Pendidik. Kim., vol. 6, no. 1, pp. 26–37, 2022, doi: 10.19109/ojpk.v6i1.12248.
M. A. Setiawan, P. Susongko, and M. N. H. Hayati, “Pendeteksian DIF pada perangkat tes objektif penilaian akhir semester ipa dengan mengunakan permodelan rasch [Detection of DIF in science final semester objective test using rasch modeling],” PSEJ (Pancasakti Sci. Educ. Journal), vol. 5, no. 2, pp. 23–29, 2020, doi: 10.24905/psej.v5i2.25.
Harpina, S. A. Darfin, and U. N. Kholifatun, “Science literacy and climate change issues in elementary school science learning as a green education effort,” J. Humanit. Soc. Sci. Educ., vol. 1, no. 2, pp. 55–68, 2025, doi: 10.64690/jhuse.v1i2.34.
Copyright (c) 2026 Milan Nur Familia, Rosita Putri Rahmi Haerani, Erna Suhartini
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and acknowledge that the Integrated Science Education Journal is the first publisher licensed under a Creative Commons Attribution 4.0 International License.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges and earlier and greater citation of published work.
.png)
.png)
