Meningkatkan Validitas Instrumen Literasi Sains PISA: Sebuah Perbandingan Model Sebelum dan Sesudah Revisi dengan CFA

Siti Alifah, Riyan Arthur, Yetti Supriyati, Munali Munali, Ibnu Salman

Sari


Penelitian ini bertujuan membandingkan struktur faktor instrumen literasi sains PISA sebelum dan sesudah revisi menggunakan Confirmatory Factor Analysis (CFA) pada 1.108 siswa SMP di Indonesia. Instrumen awal terdiri dari 60 butir yang mengukur empat dimensi literasi sains (konteks, pengetahuan, kompetensi, dan sikap), namun analisis CFA mengidentifikasi lima butir dengan muatan faktor terstandar (SLF) di bawah 0,40 yang kemudian dihapus. Hasil menunjukkan model revisi dengan 55 butir memiliki kecocokan yang lebih baik (RMSEA turun dari 0,017 menjadi 0,016, SRMR dari 0,051 menjadi 0,049) dan seluruh SLF meningkat di atas 0,54, mengindikasikan validitas konstruk yang lebih kuat. Penghapusan butir bermasalah—yang disebabkan oleh ketidakfamiliaran konteks lokal, ambiguitas soal, atau kesulitan pemahaman prosedural—terbukti meningkatkan konsistensi internal dan reliabilitas instrumen tanpa mengurangi relevansi global PISA. Penelitian ini berkontribusi pada pengembangan instrumen literasi sains yang lebih adaptif terhadap konteks lokal serta memberikan wawasan penting tentang pentingnya evaluasi dan revisi instrumen berbasis empiris untuk meningkatkan kualitas pengukuran pendidikan di tingkat internasional maupun nasional.

Teks Lengkap:

PDF

Referensi


Abu Bakar, M. R., Halim, L., & Mohamad Arsad, N. (2023). Factor Influencing Students’ Scientific Literacy: An Exploratory Factor Analysis. International Journal of Academic Research in Business and Social Sciences, 13(12), 5844–5863. https://doi.org/10.6007/ijarbss/v13-i12/20393

Baumgartner, H., Weijters, B., & Pieters, R. (2018). Misresponse to Survey Questions: A Conceptual Framework and Empirical Test of the Effects of Reversals, Negations, and Polar Opposite Core Concepts. Journal of Marketing Research, 55(6), 869–883. https://doi.org/10.1177/0022243718811848

Chao, F., Dexian, Z., Tiejun, Y., & Hongliang, F. (2014). Measurement Method of the Grain Quantity Based on The Ground Pressure. TELKOMNIKA Indonesian Journal of Electrical Engineering, 12(7), 5552–5558. https://doi.org/10.11591/telkomnika.v12i7.4079

Cho, G., Hwang, H., Sarstedt, M., & Ringle, C. M. (2020). Cutoff criteria for overall model fit indexes in generalized structured component analysis. Journal of Marketing Analytics, 8(4), 189–202. https://doi.org/10.1057/s41270-020-00089-1

Douglas L. Inman. (1952). Measures for Describing the Size Distribution of Sediments. SEPM Journal of Sedimentary Research, Vol. 22(3), 125–145. https://doi.org/10.1306/d42694db-2b26-11d7-8648000102c1865d

Evans, C. L., & Napier-Munn, T. J. (2013). Estimating error in measurements of mineral grain size distribution. Minerals Engineering, 52, 198–203. https://doi.org/10.1016/j.mineng.2013.09.005

Fensham, P. J. (2013). International Assessments of Science Learning: Their Positive and Negative Contributions to Science Education. In Valuing Assessment in Science Education: Pedagogy, Curriculum, Policy (pp. 1–376). © Springer Science+Business Media. https://doi.org/10.1007/978-94-007-6668-6

Han, L., & Abdul Rahman, M. N. (2025). Development and Validation of the Children’s Approaches to Learning Questionnaire from Parent Ratings in China. International Journal of Early Childhood, 0123456789. https://doi.org/10.1007/s13158-025-00430-8

Helfrich, C. D., Li, Y. F., Mohr, D. C., Meterko, M., & Sales, A. E. (2007). Assessing an organizational culture instrument based on the Competing Values Framework: Exploratory and confirmatory factor analyses. Implementation Science, 2(1). https://doi.org/10.1186/1748-5908-2-13

Inga, C. E. C., Walton, G., & Holley, E. (2021). Statistical assessment of the effects of grain-structure representation and micro-properties on the behavior of bonded block models for brittle rock damage prediction. Sustainability (Switzerland), 13(14). https://doi.org/10.3390/su13147889

Jomtarak, C., Suwanjan, P., Pupat, P., & Jomtarak, R. (2019). Testing Construct Validity of Competency Indicators of Scientific Literacy in Junior Secondary Students. Mediterranean Journal of Social Sciences, 10(2), 81–92. https://doi.org/10.2478/mjss-2019-0025

Koskenniska, S., Seppälä, O., & Kömi, J. (2020). A study on grain growth using a novel grain size calculation tool. Procedia Manufacturing, 50(2019), 684–688. https://doi.org/10.1016/j.promfg.2020.08.123

Lai, K., & Green, S. B. (2016). The Problem with Having Two Watches: Assessment of Fit When RMSEA and CFI Disagree. Multivariate Behavioral Research, 51(2–3), 220–239. https://doi.org/10.1080/00273171.2015.1134306

Lorenzo-Seva, U. (2025). Mild-restricted confirmatory factor analysis: a new approach to assessing population factor models. Communications in Statistics: Simulation and Computation, 0(0), 1–19. https://doi.org/10.1080/03610918.2025.2453473

Manz, J. A., Todd, M. J., Iverson, L., Ball, S. J., Manning, L., & Topp, R. (2025). Validity and reliability testing of the Creighton Competency Evaluation Instrument 2.0© (CCEI 2.0). Clinical Simulation in Nursing, 103, 101736. https://doi.org/10.1016/j.ecns.2025.101736

National Research Council. (2012). A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas. The National Academies Press. https://doi.org/10.17226/13165.

Niemand, T., & Mai, R. (2018). Flexible cutoff values for fit indices in the evaluation of structural equation models. Journal of the Academy of Marketing Science, 46(6), 1148–1172. https://doi.org/10.1007/s11747-018-0602-9

Nurhayati, R., Aw, S., Dwiningrum, S. I. A., Hajaroh, M., & Herwin, H. (2024). Validity and Reliability of Child-Friendly School Policy Evaluation Instruments in Primary Schools: Confirmatory Factor Analysis. International Journal of Educational Methodology, volume-10-(volume-10-issue-1-february-2024), 165–177. https://doi.org/10.12973/ijem.10.1.965

OECD. (2017). PISA 2015 Assessment and Analytical Framework: Science, Reading, Mathematic, Financial Literacy and Collaborative Problem Solving (Revised Edition). In OECD Publishing.

OECD. (2019). PISA 2018 Results : What Students Know and Can Do (Volume I): Vol. I. OECD Publishing. https://doi.org/10.1787/5f07c754-en

Pavlov, G., Maydeu-Olivares, A., & Shi, D. (2021). Using the Standardized Root Mean Squared Residual (SRMR) to Assess Exact Fit in Structural Equation Models. Educational and Psychological Measurement, 81(1), 110–130. https://doi.org/10.1177/0013164420926231

Pavlů, J., Richterová, I., Šafránková, J., & Němeček, Z. (2006). Impact of surface properties on the dust grain charging. Advances in Space Research, 38(11), 2558–2563. https://doi.org/10.1016/j.asr.2005.02.002

Peeters, M. J., & Harpe, S. E. (2020). Updating conceptions of validity and reliability. Research in Social and Administrative Pharmacy, 16(8), 1127–1130. https://doi.org/10.1016/j.sapharm.2019.11.017

Premthaisong, S., & Srisawasdi, N. (2024). An effect of technology-infused active inquiry learning in primary school science on students’ conceptions of learning science. Eurasia Journal of Mathematics, Science and Technology Education, 20(6), 3–5. https://doi.org/10.29333/EJMSTE/14662

Rattanachaithada, R., Kwangmuang, P., Vongtathum, P., Gamlunglert, R., & Srikoon, S. (2025). A confirmatory factor analysis of scientific critical thinking in secondary school. Cogent Education, 12(1). https://doi.org/10.1080/2331186X.2025.2467508

Sadler, T. D., & Zeidler, D. L. (2009). Scientific literacy, PISA, and socioscientific discourse: Assessment for progressive aims of science education. Journal of Research in Science Teaching, 46(8), 909–921. https://doi.org/10.1002/tea.20327

Sathyanarayana, & Mohanasundaram, T. (2024). Fit Indices in Structural Equation Modeling and Confirmatory Factor Analysis: Reporting Guidelines. Asian Journal of Economics, Business and Accounting, 24(7), 561–577. https://doi.org/10.9734/ajeba/2024/v24i71430

Schreiber, J. B., Stage, F. K., King, J., Nora, A., & Barlow, E. A. (2006). Reporting structural equation modeling and confirmatory factor analysis results: A review. Journal of Educational Research, 99(6), 323–338. https://doi.org/10.3200/JOER.99.6.323-338

Shi, D., DiStefano, C., Maydeu-Olivares, A., & Lee, T. (2022). Evaluating SEM Model Fit with Small Degrees of Freedom. Multivariate Behavioral Research, 57(2–3), 179–207. https://doi.org/10.1080/00273171.2020.1868965

Shi, D., Lee, T., & Maydeu-Olivares, A. (2018). Understanding the Model Size Effect on SEM Fit Indices. Educational and Psychological Measurement, 79(2), 310–334. https://doi.org/10.1177/0013164418783530

Sjøberg, S., & Jenkins, E. (2020). PISA: a political project and a research agenda. Studies in Science Education, 58(1), 1–14. https://doi.org/10.1080/03057267.2020.1824473

Suwono, H., Maulidia, L., Saefi, M., Kusairi, S., & Yuenyong, C. (2022). The Development and Validation of an Instrument of Prospective Science Teachers’ Perceptions of Scientific Literacy. Eurasia Journal of Mathematics, Science and Technology Education, 18(1). https://doi.org/10.29333/EJMSTE/11505

Watson, J. C. (2017). Establishing evidence for internal structure using exploratory factor analysis. Measurement and Evaluation in Counseling and Development, 50(4), 232–238. https://doi.org/10.1080/07481756.2017.1336931

Xia, Y., & Yang, Y. (2019). RMSEA, CFI, and TLI in structural equation modeling with ordered categorical data: The story they tell depends on the estimation methods. Behavior Research Methods, 51(1), 409–428. https://doi.org/10.3758/s13428-018-1055-2

Yoon, K. L., Shaffer, V., & Benedict, A. (2020). Resolving ambiguity: Negative interpretation biases. In Cognitive Biases in Health and Psychiatric Disorders: Neurophysiological Foundations. Elsevier Inc. https://doi.org/10.1016/B978-0-12-816660-4.00006-4

Zetterqvist, A., & Bach, F. (2023). Epistemic knowledge–a vital part of scientific literacy? International Journal of Science Education, 45(6), 484–501. https://doi.org/10.1080/09500693.2023.2166372

Zhang, L., Liu, X., & Feng, H. (2023). Development and validation of an instrument for assessing scientific literacy from junior to senior high school. Disciplinary and Interdisciplinary Science Education Research, 5(1). https://doi.org/10.1186/s43031-023-00093-2


Refbacks

  • Saat ini tidak ada refbacks.