Unveiling the Pedagogical Paradox: A Quality Assessment of Explanatory Notes and Cognitive Demands in Singapore Primary Science Assessment Books

Main Article Content

Wai Mun Loke
https://orcid.org/0000-0002-7180-4327

Abstract

Empirical research on the quality and pedagogical effectiveness of Singaporean primary science assessment books is scarce despite their widespread use. This study aimed to evaluate their explanatory notes and assessment items. Twenty-six commercially available Primary Four Science assessment books (Singapore Ministry of Education syllabus-aligned, 2021-2025) were analyzed. Trained personnel assessed explanatory components for type, location, proportion, and quality (35-point rubric). Questions were evaluated for type, proportion, cognitive demand (Bloom's Taxonomy), science process skills, clarity, language, and context. Only 53.8% of books had explanatory notes (mean 32% of pages), universally in answer sections. Mean note quality was 62.9%, with ‘completeness’ and ‘examples’ scoring lowest. Questions formed 73.6% of pages, primarily multiple-choice and open-ended structured. All books addressed Bloom's Taxonomy up to ‘evaluating’ but omitted ‘creating’. Science process skill ‘Formulating a hypothesis’ was also universally absent. Question language was clear, but contexts lacked Singapore-specific scenarios. These assessment books largely function for practice and summative testing, often with inadequate or poorly placed explanations. A universal cognitive ceiling exists, failing to foster higher-order skills like ‘creating’ or ‘formulating hypotheses’. This indicates a market prioritizing question volume and standardized assessment, leading to pedagogically limited resources.

Article Details

How to Cite
Loke, W. M. (2025). Unveiling the Pedagogical Paradox: A Quality Assessment of Explanatory Notes and Cognitive Demands in Singapore Primary Science Assessment Books. The Journal of Quality in Education, 15(26), 69–82. https://doi.org/10.37870/joqie.v15i26.485
Section
Articles

References

Alnoori, B. S. M., “The Role of Visuals in Promoting Self-Learning of Grammatical Concepts”, In Conference Proceedings. Innovation in Language Learning 2023. URL: https://conference.pixel-online.net/library_scheda.php?id_abs=6224

Barta, A., Fodor, L. A., Tamas, B., & Szamoskozi, I., “The development of students critical thinking abilities and dispositions through the concept mapping learning method–A meta-analysis”, Educational Research Review, vol. 37, pp. 100481-100490, 2022. URL: https://www.sciencedirect.com/science/article/pii/S1747938X22000501 DOI: https://doi.org/10.1016/j.edurev.2022.100481

BouJaoude, S., “Conceptions of science teaching revealed by metaphors and by answers to open-ended questions”, Journal of Science Teacher Education, vol. 11, pp. 173-186, 2000. URL: https://www.tandfonline.com/doi/pdf/10.1023/A%3A1009477010693 DOI: https://doi.org/10.1023/A:1009477010693

Butler, A. C., “Multiple-choice testing in education: Are the best practices for assessment also good for learning?”, Journal of Applied Research in Memory and Cognition, vol. 7, pp. 323-331, 2018. URL: https://www.sciencedirect.com/science/article/abs/pii/S2211368118301426 DOI: https://doi.org/10.1016/j.jarmac.2018.07.002

Bytyqi-Damoni, A., Metaj-Macula, A., Veselaj, Z., & Wendt, H., “Quality of 8th-grade science books: A systematic analysis of end-of-chapters-tasks in 8th-grade science books using Revised Bloom Taxonomy”, Research in Science & Technological Education, 1-17, 2025. URL: https://www.tandfonline.com/doi/abs/10.1080/02635143.2025.2500033 DOI: https://doi.org/10.1080/02635143.2025.2500033

Chandio, M. T., Zafar, N., & Solangi, G. M., “Bloom's Taxonomy: Reforming Pedagogy through Assessment”, Journal of Education and Educational Development, vol. 8, pp. 109-140, 2021. URL: https://eric.ed.gov/?id=EJ1308485 DOI: https://doi.org/10.22555/joeed.v8i1.308

Chin, C., & Osborne, J., “Students’ questions: a potential resource for teaching and learning science”, Studies in Science Education, vol. 44, pp. 1–39, 2008. URL: https://www.tandfonline.com/doi/full/10.1080/03057260701828101 DOI: https://doi.org/10.1080/03057260701828101

Deehan, J., MacDonald, A., & Morris, C., “A scoping review of interventions in primary Science Education”, Studies in Science Education, vol. 60, pp. 1–43, 2022. URL: https://www.tandfonline.com/doi/full/10.1080/03057267.2022.2154997 DOI: https://doi.org/10.1080/03057267.2022.2154997

Fan, L., “Principles and processes for publishing textbooks and alignment with standards: A case in Singapore.” In APEC Conference on Replicating Exemplary Practices in Mathematics Education, Koh Samui, Thailand, pp. 7-12, 2010. URL: https://www.apec.org/docs/default-source/Publications/2010/7/Replicating-Exemplary-Practices-in-Mathematics-Education-among-APEC-Economies-July-2010/TOC/Lianghuo-Fan-Principles-and-Processed-for-Publishing-Textbooks-and-Alignment-with-Standards-A-Case-i.pdf

Fitzgerald, A., & Smith, K., “Science that matters: Exploring science learning and teaching in primary schools”, Australian Journal of Teacher Education (Online), vol. 41, pp. 64-78, 2016. URL: https://search.informit.org/doi/abs/10.3316/ielapa.994166311431331 DOI: https://doi.org/10.14221/ajte.2016v41n4.4

García-Carmona, A., “The use of analogies in science communication: Effectiveness of an activity in initial primary science teacher education”, International Journal of Science and Mathematics Education, vol. 19, pp. 1543-1561, 2021. URL: https://link.springer.com/article/10.1007/s10763-020-10125-2 DOI: https://doi.org/10.1007/s10763-020-10125-2

Gizaw, G., & Sota, S., “Improving science process skills of students: A review of literature”, Science Education International, 34, 216-224, 2023. URL: https://icaseonline.net/journal/index.php/sei/article/view/526 DOI: https://doi.org/10.33828/sei.v34.i3.5

Huang, R., Tlili, A., Zhang, X., Sun, T., Wang, J., Sharma, R. C., ... & Burgos, D., “A comprehensive framework for comparing textbooks: Insights from the literature and experts”, Sustainability, vol. 14, pp. 6940-6955, 2022. URL: https://www.mdpi.com/2071-1050/14/11/6940?trk=public_post-text DOI: https://doi.org/10.3390/su14116940

Ho, J., & Lee, Y. J., “Primary and secondary education in Singapore: Bringing out the best in every learner”, In Education in Singapore: People-Making and Nation-Building, pp. 49-68. Singapore: Springer Singapore, 2022. URL: https://link.springer.com/chapter/10.1007/978-981-16-9982-5_4 DOI: https://doi.org/10.1007/978-981-16-9982-5_4

Leong, W. S., & Tan, K., “What (more) can, and should, assessment do for learning? Observations from ‘successful learning context’in Singapore”, Curriculum Journal, vol. 25, pp. 593-619, 2014. URL: https://www.tandfonline.com/doi/abs/10.1080/09585176.2014.970207 DOI: https://doi.org/10.1080/09585176.2014.970207

Mayer, R. E., Bove, W., Bryman, A., Mars, R., & Tapangco, L., “When less is more: Meaningful learning from visual and verbal summaries of science textbook lessons”, Journal of Educational Psychology, vol. 88, pp. 64-68, 1996. URL: https://psycnet.apa.org/record/1996-01721-005 DOI: https://doi.org/10.1037//0022-0663.88.1.64

Ministry of Education, Singapore, “Primary Science Teaching & Learning Syllabus: Primary Three to Six Standard / Foundation.” Retrieved from https://www.moe.gov.sg/-/media/files/primary/syllabus/primary-science-syllabus-2023_may24.pdf (Updated May 2024).

Nowicki, B. L., Sullivan-Watts, B., Shim, M. K., Young, B., & Pockalny, R., “Factors influencing science content accuracy in elementary inquiry science lessons”, Research in Science Education, vol. 43, pp. 1135-1154, 2013. URL: https://link.springer.com/article/10.1007/s11165-012-9303-4 DOI: https://doi.org/10.1007/s11165-012-9303-4

Obe, W. H., “The teaching of science in primary schools”, David Fulton Publishers, 2018. URL: https://www.taylorfrancis.com/books/mono/10.4324/9781315398907/teaching-science-primary-schools-wynne-harlen-obe

Odiliobi, O. J., “Application of flowchart in teaching simple interest to Secondary School students: A panacea for sustainable development”, COOU Journal of Educational Research, vol. 6, 2021. URL: https://cooujer.com/index.php/COOUJER/article/view/25

Osborne, J., & Pimentel, D., “Science education in an age of misinformation”, Science Education, vol. 107, pp. 553-571, 2023. URL: https://onlinelibrary.wiley.com/doi/abs/10.1002/sce.21790 DOI: https://doi.org/10.1002/sce.21790

Rubin, J., & Chisnell, D., “Handbook of usability testing: How to plan, design, and conduct effective tests”, John Wiley & Sons, 2008. URL: https://books.google.com.sg/books?hl=en&lr=&id=MjNGDgAAQBAJ&oi=fnd&pg=PR11&dq=Handbook+of+usability+testing:+How+to+plan,+design,+and+conduct+effective+tests&ots=lPzFXRt1lH&sig=CWX3YZDOKFZGQDCxN0HXSpfbhQk#v=onepage&q=Handbook%20of%20usability%20testing%3A%20How%20to%20plan%2C%20design%2C%20and%20conduct%20effective%20tests&f=false

Sinha, T., & Kapur, M., “When problem solving followed by instruction works: Evidence for productive failure”, Review of Educational Research, vol. 91, pp. 761-798, 2021. URL: https://journals.sagepub.com/doi/full/10.3102/00346543211019105 DOI: https://doi.org/10.3102/00346543211019105

Silvia, R., & Rohaeti, E. E., “Analysis of editorial text teaching materials to improve student’s writing skills”, Journal of Language Education Research, vol. 5, pp. 1-11, 2022. URL: https://journal.ikipsiliwangi.ac.id/index.php/jler/article/view/7598 DOI: https://doi.org/10.22460/jler.v5i1.7598

Starko, A. J., “Creativity in the classroom: Schools of curious delight”, Routledge, 2021. URL: https://www.taylorfrancis.com/books/mono/10.4324/9781003105640/creativity-classroom-alane-jordan-starko DOI: https://doi.org/10.4324/9781003105640

Sutiani, A., “Implementation of an inquiry learning model with science literacy to improve student critical thinking skills”, International Journal of Instruction, vol. 14, pp.117-138, 2021. URL: https://digilib.unimed.ac.id/id/eprint/42164/3/ARTICLE.pdf DOI: https://doi.org/10.29333/iji.2021.1428a

Wittwer, J., & Renkl, A., “Why instructional explanations often do not work: A framework for understanding the effectiveness of instructional explanations”, Educational Psychologist, vol. 43, pp. 49-61, 2008. URL: https://www.tandfonline.com/doi/abs/10.1080/00461520701756420 DOI: https://doi.org/10.1080/00461520701756420

Yaman, S., “Investigating Consistency of Questions in Primary and Middle School Science Textbooks with Objectives in Science Curriculum”, Journal of Education and Training Studies, vol. 5, pp. 81-89, 2017. URL: https://eric.ed.gov/?id=EJ1133881 DOI: https://doi.org/10.11114/jets.v5i4.2020