Trends Stability of Reliability Coefficient Based on Sample Size and Ability of Test-takers

Busnawir Busnawir; Kodirun Kodirun; Zamsir Zamsir; Hafiludin Samparadja; Hasnawati Hasnawati

doi:10.21831/pythagoras.v18i2.59392

Trends Stability of Reliability Coefficient Based on Sample Size and Ability of Test-takers

Busnawir Busnawir, Department of Mathematics Education, Universitas Halu Oleo, Kendari, Indonesia
Kodirun Kodirun, Department of Mathematics Education, Universitas Halu Oleo, Kendari, Indonesia
Zamsir Zamsir, Department of Mathematics Education, Universitas Halu Oleo, Kendari
Hafiludin Samparadja, Department of Mathematics Education, Universitas Halu Oleo, Kendari, Indonesia
Hasnawati Hasnawati, Department of Mathematics Education, Universitas Halu Oleo, Kendari, Indonesia

10.21831/pythagoras.v18i2.59392

Abstract

One aspect that needs to be considered in the assessment of learning outcomes is the quality of the test by a stable reliability coefficient. This study aims to determine the trend of the stability of the reliability coefficient of the mathematics formative test based on the sample size and the ability of the test takers. The study was experimental in the form of a simulation, using a population of scores based on the answers of 403 test takers. The research sample was taken from the population of scores with 19 variations in sample sizes. Each sample size was repeated 31 times with the return technique; the reliability coefficient was calculated for each repetition and was used as the unit of analysis. In addition to the differences in sample sizes, the differences in the abilities of the test takers were also seen in two categories of high and low. Data were analyzed using exploratory-descriptive statistics and analysis of variance. Results showed as follows: first, the formative test of mathematics that was developed by the teacher at school has a reliability coefficient in the inadequate category; second, the reliability coefficient of the test tends to be more stable with increasing sample sizes; third, the difference in the ability of the test takers does not make a significant difference to the reliability coefficient; fourth, there is no interaction between sample sizes and abilities of the test takers on the reliability coefficient of the test.

Keywords

Ability of the test takers; sample size; stability of the reliability coefficient

Full Text:

PDF

References

Adom, D., Mensah, J. A., & Dake, D. A. (2020). Test, measurement, and evaluation: Understanding and use of the concepts in education. International Journal of Evaluation and Research in Education, 9(1), 109–119. https://doi.org/10.11591/ijere.v9i1.20457

Afif, M., Suminto, A., & Mubin, A. F. (2021). Pengaruh promosi media sosial dan Word of Mouth (WOM) terhadap keputusan pembelian konsumen (studi di toko buku La Tansa Gontor) [Effects of social media promotion and words of mouth (WOM) on consusumers’ decision to purchase (study in La Tansa bookstrore Gontor]. Journal of Islamic Economics (JoIE), 1(2), 1–23. https://doi.org/10.21154/joie.v1i2.3206

Alwi, I. (2015). Kriteria empirik dalam menentukan ukuran sampel pada pengujian hipotesis statistika dan analisis butir [Empirical criteria in determining sample sizes in hypothesis testing statistics and item analysis]. Formatif: Jurnal Ilmiah Pendidikan MIPA, 2(2), 140–148. https://doi.org/10.30998/formatif.v2i2.95

Antara, I. G. W. S., Sudarma, I. K., & Dibia, I. K. (2020). The assessment instrument of mathematics learning outcomes based on HOTS toward two-dimensional geometry topic. Indonesian Journal Of Educational Research and Review, 3(1), 19. https://doi.org/10.23887/ijerr.v3i2.25869

Argianti, A., & Retnawati, H. (2020). Characteristics of math national-standardized school exam test items in junior high school: What must be considered? Jurnal Penelitian Dan Evaluasi Pendidikan, 24(2), 156–165. https://doi.org/10.21831/pep.v24i2.32547

Ariawan, R., Zetriuslita, Z., Anggara, R. P., & Winanda, S. V. (2022). Pelatihan penyusunan soal HOTS bagi guru matematika [Training in HOTS test item writing for mathematics teachers]. Jurnal Altifani Penelitian Dan Pengabdian Kepada Masyarakat, 2(1), 65–74. https://doi.org/10.25008/altifani.v2i1.207

Arif, M. (2016). Pengembangan instrumen penilaian mapel sains melalui pendekatan keterampilan proses sains SD/MI [Developing evaluation instruments for science subjects through skill process approach public/Islamic primary schools]. Ta’allum: Jurnal Pendidikan Islam, 4(1), 123–148. https://doi.org/10.21274/ taalum.2016.4.1.123-148

Arisandi, D., & Dewi Putri, S. (2016). SATIN-Sains dan teknologi informasi simulasi produksi gambir dengan metode supply chain management [Information technology in simulation of gambir vine product by the mngement chain supply method]. Sains Dan Teknologi Informasi, 2(2), 1–8. http://jurnal.stmik-amik-riau.ac.id/index.php/satin/article/view/164

Ariyanti, E., & Bhakti, Y. B. (2020). Perbandingan bentuk tes pilihan ganda dan teknik penskoran terhadap reliabilitas tes mata pelajaran kimia [Comparison of multiple-choise test forms and scoring techniques on the reliability of the test in chemistry subject matter]. Titian Ilmu: Jurnal Ilmiah Multi Sciences, 12(2), 66–76. https://doi.org/10.30599/jti.v12i2.627

Arum, A. E., Khumaedi, M., & Susilaningsih, E. (2022). Validity and reliability of development of self-confidence assessment instruments for students on chemistry subject. Journal of Research and Educational Research Evaluation, 11(1), 62–69. https://journal.unnes.ac.id/sju/jere/article/view/55048

Atamimi, N. (2014). Perbedaan peran jenis kelamin, skala akademik,dan peran aktif berorganisasi dengan prestasi akademik [Differences in the roles of gender, academic scale, and active roles in organization with academic achievements]. Jurnal Cakrawala Pendidikan, 2(2), 236–244. https://doi.org/10.21831/cp.v2i2.2163

Ayu, S., & Rosli, M. S. Bin. (2020). Uji reliabilitas instrumen penggunaan SPADA [Reliability test on the use of SPADA instrument] (Sistem Pembelajaran Dalam Jaringan). Biormatika, 6(1), 145–155. https://ejournal.unsub.ac.id/index.php/FKIP/article/view/706

Bajpai, R., & Bajpai, S. (2014). Goodness of measurement: reliability and validity. International Journal of Medical Science and Public Health, 3(2), 112. https://doi.org/10.5455/ijmsph.2013.191120133

Bhakti, Y. B. (2015). Pengaruh jumlah alternatif jawaban dan teknik penskoran terhadap reliabilitas tes [Effects of number of alternatives and scoring technique on a reliability test]. Formatif: Jurnal Ilmiah Pendidikan MIPA, 5(1), 1–13. https://doi.org/10.30998/formatif.v5i1.168

Brown, G. T. L., & Harris, L. R. (2014). The future of self-assessment in classroom practice: reframing self-assessment as a core competency. Frontline Learning Research, 2(1), 22–30. https://doi.org/10.14786/flr.v2i1.24

Burmeister, E., & Aitken, L. M. (2012). Sample size: How many is enough? Australian Critical Care, 25(4), 271–274. https://doi.org/10.1016/j.aucc.2012.07.002

Calif, R., & Soubdhan, T. (2016). On the use of the coefficient of variation to measure spatial and temporal correlation of global solar radiation. Renewable Energy, 88, 192–199. https://doi.org/10.1016/j.renene.2015.10.049

Canchola, J. A. (2017). Correct use of percent coefficient of variation (%CV) formula for log-transformed data. MOJ Proteomics & Bioinformatics, 6(3), 4–7. https://doi.org/10.15406/mojpb.2017.06.00200

Cassettari, L., Mosca, R., & Revetria, R. (2012). Monte Carlo simulation models evolving in replicated runs: A methodology to choose the optimal experimental sample size. Mathematical Problems in Engineering, 2012. https://doi.org/10.1155/2012/463873

Chairunisa, E. D. (2016). Komparasi estimasi reliabilitas pada mata pelajaran sejarah ditinjau dari homogenitas dan heterogenitas kelompok [Reliability estimation comparison on history subject matter viewed from group homogeneity and heteriogeneity]. Jurnal Pendidikan Ilmu Sosial, 24(2), 179. https://doi.org/10.17509/jpis.v24i2.1454

Chalmers, R. P., Counsell, A., & Flora, D. B. (2016). It might not make a big dif: improved differential test functioning statistics that account for sampling variability. Educational and Psychological Measurement, 76(1), 114–140. https://doi.org/10.1177/0013164415584576

Crocker, L. & Algina, J. (1986) Introduction to classical and modern test theory. Harcourt, New York

Dewi, I. P. K., Ariawan, I. P., & Gita, I. N. (2019). Analisis kesalahan pemecahan masalah matematika siswa kelas XI SMA Negeri 1 Tabanan [Error analysis on mathematics problem-solving Year XI students of State Senior Hihgh School 1 Tabanan]. Jurnal Pendidikan Matematika Undiksha, 10(2), 43. https://doi.org/10.23887/jjpm.v10i2.19917

Eck, J. E., & Liu, L. (2008). Contrasting simulated and empirical experiments in crime prevention. Journal of Experimental Criminology, 4(3), 195–213. https://doi.org/10.1007/s11292-008-9059-z

Gillenwater, J., Kulesza, A., Mariet, Z., & Vassilvitskii, S. (2019). A tree-based method for fast repeated sampling of determinantal point processes. 36th International Conference on Machine Learning, ICML 2019, 2019-June, 4092–4103. https://proceedings.mlr.press/v97/gillenwater19a.html

Guna, J., Jakus, G., Pogačnik, M., Tomažič, S., & Sodnik, J. (2014). An analysis of the precision and reliability of the leap motion sensor and its suitability for static and dynamic tracking. Sensors (Switzerland), 14(2), 3702–3720. https://doi.org/10.3390/s140203702

Gunartha, I. W. (2022). Estimasi kesalahan pengukuran dalam bidang pendidikan berdasarkan teori tes klasik Estimation of mesurement error in the education field based on classical test theory]. Jurnal Widyadari, 23(1), 34–47. https://doi.org/10.5281/zenodo.6390889

Hadinata, S. (2018). Tingkat pengembalian (return), risiko, dan koefisien variasi pada saham syariah dan saham nonsyariah [Return levels, risks, and variation coefficient on syariah and nonsyariah share. AKTSAR: Jurnal Akuntansi Syariah, 1(2), 171. https://doi.org/10.21043/aktsar.v1i2.5089

Hamilton, D., McKechnie, J., Edgerton, E., & Wilson, C. (2021). Immersive virtual reality as a pedagogical tool in education: a systematic literature review of quantitative learning outcomes and experimental design. Journal of Computers in Education, 8. https://doi.org/10.1007/s40692-020-00169-2

Heale, R., & Twycross, A. (2015). Validity and reliability in quantitative studies. Evidence-Based Nursing, 18(3), 66–67. https://doi.org/10.1136/eb-2015-102129

Herman, H., Rahim, A. R., & Syamsuri, A. S. (2021). Analisis instrumen tes hasil belajar berbasis higher order thinking skill (HOTS) [Item analysis HOTS-based learning achievement test]. Jurnal Riset Dan Inovasi Pembelajaran, 1(3), 88–101. https://doi.org/10.51574/jrip.v1i3.65

Hidayad, A., Masrukan, M., & Kartono, K. (2017). Instrumen asesmen sikap siswa berbasis konservasi pada pembelajaran matematika SMP [Instrument assessment of students’ attitudes based on conversion of the mathematics subject matter in the junior high school]. Journal of Research and Educational Research Evaluation, 6(1), 30–38. https://journal.unnes.ac.id/sju/index.php/jere/article/view/16205

Hidayat, S. R., Setyadin, A. H., Hermawan, H., Kaniawati, I., Suhendi, E., Siahaan, P., & Samsudin, A. (2017). Pengembangan instrumen tes keterampilan pemecahan masalah pada materi getaran, gelombang, dan bunyi [Developing test instrument for problem-solving skills on the materials of vibration, wave, and sound]. Jurnal Penelitian & Pengembangan Pendidikan Fisika, 3(2), 157–166. https://doi.org/10.21009/1.03206

Hikamudin, E., & Hairun, Y. (2021). Analisis disparitas skor tampak dan estimasi skor murni dengan pengkategorian acuan normatif pada tes hasil belajar siswa [Analysis of seen score disparity and estimtion of pure score with norm-referenced categorization] . Delta-Pi: Jurnal Matematika Dan Pendidikan Matematika, 10(1), 138–154. https://doi.org/10.33387/dpi.v10i1.2905

Hopkins, W. G. (2000). Measures of reliability in sports medicine and science. Sports Medicine, 30(1), 1–15. https://doi.org/10.2165/00007256-200030010-00001

Idrus, S. W. Al. (2022). Analisis problematika evaluasi pembelajaran IPA pada masa pandemi: kajian Literatur [Problematics analysis Physics learning evaluation during the pandemic era: Literary Study]. Jurnal Ilmiah Profesi Pendidikan, 7(3c), 1979–1983. https://doi.org/10.29303/jipp.v7i3c.880

Iskandar, A., & Rizal, M. (2018). Analisis kualitas soal di perguruan tinggi berbasis aplikasi TAP [Analysis of TAP application-based test item quality in the university]. Jurnal Penelitian Dan Evaluasi Pendidikan, 22(1), 12–23. https://doi.org/10.21831/pep.v22i1.15609

Jalilibal, Z., Amiri, A., Castagliola, P., & Khoo, M. B. C. (2021). Monitoring the coefficient of variation: A literature review. Computers and Industrial Engineering, 161. https://doi.org/10.1016/j.cie.2021.107600

Jian, H., & Shaoqian, L. (2014). Formative assessment in L2 classroom in China: The current situation, predicament and future. Indonesian Journal of Applied Linguistics, 3(2), 18–34. https://doi.org/10.17509/ijal.v3i2.266

Junika, N., Izzati, N., & Tambunan, L. R. (2020). Pengembangan soal statistika model PISA untuk melatih kemampuan literasi statistika siswa [Developing PISA-model statistics test item to train students’ statistical literacy. Mosharafa: Jurnal Pendidikan Matematika, 9(3), 499–510. https://doi.org/10.31980/mosharafa.v9i3.615

Jusrianto, J., Zahir, A., Nur, H., & Parubang, D. (2022). Pendampingan penyusunan analisis tes di SD Negeri 156 Wonosari [Advocating test analysis development in State Primary School 156 Wonosari]. Abdimas Singkerru, 2(1), 19–22. https://doi.org/10.59563/singkerru.v2i1.123

Kapantow, B., Mananoma, T., & Sumarauw, J. S. F. (2017). Analisis debit dan tinggi muka air sungai paniki di kawasan Holland Village [Analysis of water.discharge and surface of the paniki river in Holland Village] Jurnal Sipil Statik, 5(1), 21–29. https://ejournal.unsrat.ac.id/v2/index.php/jss/article/view/15734

Kartowagiran, B., & Jaedun, A. (2016). Model asesmen autentik untuk menilai hasil belajar siswa sekolah menengah pertama (SMP): implementasi asesmen autentik di SMP [Authentic assessment model to measure learning achievement of junior high school students: implementation of authentuc assessment in the junior high school]. Jurnal Penelitian Dan Evaluasi Pendidikan, [Research and Educational Evaluatuion Journal] 20(2), 131–141. https://doi.org/10.21831/pep.v20i2.10063

Kasli, E., Farhan, A., Susanna, S., Herliana, F., & Wahyuni, S. (2022). Overview of teacher ability using core type cooperative model with blended learning method to increase student learning outcomes. Jurnal Penelitian Pendidikan IPA, 8(2), 1012–1017. https://doi.org/10.29303/jppipa.v8i2.1241

Kennedy, I. (2022). Sample size determination in Test-Retest and Cronbach Alpha reliability estimates. British Journal of Contemporary Education, 2(1), 17–29. https://doi.org/10.52589/bjce-fy266hk9

Khumaedi, M. (2012). Reliabilitas instrumen penelitian [Reliability of research instrument]. Jurnal Pendidikan Teknik Mesin [Mechanical Engineering Educational Journal] Unnes, 12(1), 25-30. https://journal.unnes.ac.id/nju/JPTM/article/view/5273

Komperda, R., Pentecost, T. C., & Barbera, J. (2018). Moving beyond Alpha: a primer on alternative sources of single-administration reliability evidence for quantitative chemistry education research. Journal of Chemical Education, 95(9), 1477–1491. https://doi.org/10.1021/acs.jchemed.8b00220

Kuh, G. D., & Ewell, P. T. (2010). The state of learning outcomes assessment in the United States. Higher Education Management and Policy, 22(1), 1–20. https://doi.org/10.1787/hemp-22-5ks5dlhqbfr1

Kumar, A., & Misra, D. K. (2020). A review on the statistical methods and implementation to homogeneity assessment of certified reference materials in relation to uncertainty. Mapan - Journal of Metrology Society of India, 35(3), 457–470. https://doi.org/10.1007/s12647-020-00383-4

Kummerfeld, E., & Rix, A. (2019). Simulations evaluating resampling methods for causal discovery: ensemble performance and calibration. Proceedings - 2019 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2019, 2586–2593. https://doi.org/10.1109/BIBM47256.2019.8983327

Livingston, S. A. (2018). Test Reliability - Basic Concepts. In Research Memorandum ETS RM-18-01 (Issue January). https://www.ets.org/research/policy_research_reports/publications/report/2018/jysw.html

Magdalena, I., Hifziyah, M., Aeni, I. N., & Rahayu, R. P. (2020). Pengembangan instrumen tes siswa tingkat sekolah dasar Kabupaten Tangerang Developing test instrument for primary level students in Tangerang Regency]. Nusantara : Jurnal Pendidik Dan Ilmu Sosial, 2(2), 227–237. https://ejournal.stitpn.ac.id/index.php/nusantara/article/view/808

Makhrus, M. (2018). Analisis rencana pelaksanaan pembelajaran (RPP) terhadap kesiapan guru sebagai “Role Model” keterampilan abad 21 pada pembelajaran IPA SMP [Analysis of teacher lesson plan on teacher’s readiness as 21st-skill role model in junior high school physics learning]. Jurnal Penelitian Pendidikan IPA, 5(1). https://doi.org/10.29303/jppipa.v5i1.171

Mudanta, K. A., Astawan, I. G., & Jayanta, I. N. L. (2020). Instrumen penilaian motivasi belajar dan hasil belajar IPA siswa kelas V sekolah dasar [Evaluation instrument learning motivation and learning achievement Grade V Physics primary school]. Mimbar Ilmu, 25(2), 101. https://doi.org/10.23887/mi.v25i2.26611

Muluki, A. (2020). Analisis kualitas butir tes semester ganjil mata pelajaran IPA kelas IV MI Radhiatul Adawiyah [Analysis of test item quality Physics subject matter Grade IV odd semester Islamic primary school ]. Jurnal Ilmiah Sekolah Dasar, 4(1), 86. https://doi.org/10.23887/jisd.v4i1.23335

Mustopa, A., Jasim, J., Basri, H., & Barlian, U. C. (2021). Analisis standar penilaian pendidikan [Analysis of Educational Evaluation standard]. Jurnal Manajemen Pendidikan, 9(1), 24–29. https://doi.org/10.33751/jmp.v9i1.3364

Ndiung, S., & Jediut, M. (2020). Pengembangan instrumen tes hasil belajar matematika peserta didik sekolah dasar berorientasi pada berpikir tingkat tinggi [Developing HOTS-oriented mathematics learning result test for students of the primary school]. Premiere Educandum: Jurnal Pendidikan Dasar Dan Pembelajaran, 10(1), 94. https://doi.org/10.25273/pe.v10i1.6274

Nopriyeni, Prasetyo, Z. K., & Djukr. (2019). The implementation of mentoring based learning to improve pedagogical knowledge of prospective teachers. International Journal of Instruction, 12(3), 529–540. https://doi.org/10.29333/iji.2019.12332a

Nunnally, J. C., Jr. (1970). Introduction to psychological measurement. McGraw-Hill.

Nunnally, J. C., Jr. (1978). Psychometric theory. 2nd Edition. McGraw-Hill. New York.

Nuriyah, N. (2014). Evaluasi pembelajaran: Sebuah kajian teori [Learning evaluatrion: a theoretical analysis]. Jurnal Edueksos, 3(1), 73–86. https://doi.org/10.1165/rcmb.2013-0411OC

Oktadini, N. R., Sevtiyuni, P. E., & Bardadi, A. (2022). Pelatihan aplikasi pengolah nilai rapor berbasis komputer pada guru di SMP Negeri 58 Palembang [Training of computer-based Grade-report management application teachers of State Junior High School 58 Palembang]. Bulletin of Community Service in Information System (BECERIS), 1(1), 7–13. https://doi.org/10.36706/beceris.v1i1.2

Ono, S. (2020). Uji validitas dan reliabilitas alat ukur SG Posture Evaluation [Validity and reliability test SG Posture Evaluation instrument]. Jurnal Keterapian Fisik, 5(1), 55–61. https://doi.org/10.37341/jkf.v5i1.167

Osborne, J. F., Henderson, J. B., MacPherson, A., Szu, E., Wild, A., & Yao, S. Y. (2016). The development and validation of a learning progression for argumentation in science. Journal of Research in Science Teaching, 53(6), 821–846. https://doi.org/10.1002/tea.21316

Parsons, S., Kruijt, A. W., & Fox, E. (2019). Psychological science needs a standard practice of reporting the reliability of cognitive-behavioral measurements. Advances in Methods and Practices in Psychological Science, 2(4), 378–395. https://doi.org/10.1177/2515245919879695

Pélabon, C., Hilde, C. H., Einum, S., & Gamelon, M. (2020). On the use of the coefficient of variation to quantify and compare trait variation. Evolution Letters, 4(3), 180–188. https://doi.org/10.1002/evl3.171

Phillips, J. J., & Phillips, P. P. (2016). Handbook of training evaluation and measurement methods, fourth edition. in handbook of training evaluation and measurement methods, Fourth Edition. Routledge. https://doi.org/10.4324/9781315757230

Primasari, I. F. N. D., Marini, A., & Sumantri, M. S. (2021). Analisis kebijakan dan pengelolaan pendidikan terkait standar penilaian di sekolah dasar [Analysis of educational policy and management releted to evaluation standard primary school]. Jurnal Basicedu, 5(3), 1479–1491. https://doi.org/10.31004/basicedu.v5i3.956

Putri, D., & Nahadi. (2019). Perbandingan reliabilitas tes hasil belajar matematika SMA berdasarkan teknik penskoran dan ukuran sampel [Comparison of reliabilty tests mathematics learning achievement senior high school based on scoring techniques and sample sizes]. Journal Education and Chemistry (JEDCHEM), 1(1), 10–24. https://doi.org/https://dx.doi.org/10.36378/jedchem.v1i1.86

Rapono, M., Safrial, S., & Wijaya, C. (2019). Urgensi penyusunan tes hasil belajar: Upaya menemukan formulasi tes yang baik dan benar Urgencies of learning achievement test construction: Efforts finding correct and good test formulations]. Jupiis: Jurnal Pendidikan Ilmu-Ilmu Sosial, 11(1), 95. https://doi.org/10.24114/ jupiis.v11i1.12227

Reiter-Palmon, R., Forthmann, B., & Barbot, B. (2019). Scoring divergent thinking tests: A review and systematic framework. Psychology of Aesthetics, Creativity, and the Arts, 13(2), 144–152. https://doi.org/10.1037/aca0000227

Retnawati, H., Hadi, S., & Nugraha, A. C. (2016). Vocational high school teachers’ difficulties in implementing the assessment in curriculum 2013 in Yogyakarta Province of Indonesia. International Journal of Instruction, 9(1), 33–48. https://doi.org/10.12973/iji.2016.914a

Sarwanto, Fajari, L. E. W., & Chumdari. (2020). Open-Ended questions to assess critical-thinking skills in indonesian elementary school. International Journal of Instruction, 14(1), 615–630. https://doi.org/10.29333/ IJI.2021.14137A

Savalei, V., & Reise, S. P. (2019). Don’t forget the model in your model-based reliability coefficients: A reply to McNeish (2018). Collabra: Psychology, 5(1), 1–8. https://doi.org/10.1525/collabra.247

Schiel, J. E., Turner, A., Mouchahoir, T., Yandrofski, K., Telikepalli, S., King, J., DeRose, P., Ripple, D., & Phinney, K. (2018). The NISTmAb reference material 8671 value assignment, homogeneity, and stability. Analytical and Bioanalytical Chemistry, 410(8), 2127–2139. https://doi.org/10.1007/s00216-017-0800-1

Setiyawan, A. (2014). Faktor-faktor yang mempengaruhi reliabilitas tes [Factors affecting test reliability]. Jurnal An Nûr, 6(2), 341–354. https://jurnalannur.ac.id/index.php/An-Nur/article/view/53

Shavelson, R. J., Zlatkin-Troitschanskaia, O., & Mariño, J. P. (2018). International performance assessment of learning in higher education (iPAL): Research and Development. Assessment of Learning Outcomes in Higher Education, March, 193–214. https://doi.org/10.1007/978-3-319-74338-7_10

Shoukri, M. M., Asyali, M. H., & Donner, A. (2004). Sample size requirements for the design of reliability study: Review and new results. Statistical Methods in Medical Research, 13(4), 251–271. https://doi.org/10.1191/0962280204sm365ra

Sianturi, R. (2022). Uji homogenitas sebagai syarat pengujian analisis [Test of homogeneity as a requirement for testing analysis]. Jurnal Pendidikan, Sains Sosial, Dan Agama, 8(1), 386–397. https://doi.org/10.53565/pssa.v8i1.507

Sinaga, N. A. (2016). Pengembangan tes kemampuan pemecahan masalah dan penalaran matematika siswa SMP kelas VIII [Developing problem-solving skill test and mathematics reasoning students of Year VIII junior high school]. PYTHAGORAS: Jurnal Pendidikan Matematika, 11(2), 169. https://doi.org/10.21831/pg.v11i2.10642

Singh, R., & Sarkar, S. (2015). Does teaching quality matter? Students learning outcome related to teaching quality in public and private primary schools in India. International Journal of Educational Development, 41, 153–163. https://doi.org/10.1016/j.ijedudev.2015.02.009

Suardipa, I. P., & Primayana, K. H. (2020). Peran desain evaluasi pembelajaran untuk meningkatkan kualitas pembelajaran [Roles of learning evaluation design to improve quality of instruction]. Widyacarya, 4(2), 88–100. https://doi.org/https://doi.org/10.55115/widyacarya.v4i2.796

Suchyadi, Y., Sundari, F. S., Sutisna, E., Sunardi, O., Budiana, S., Sukmanasa, E., & Windiyani, T. (2020). Improving the ability of elementary school teachers through the development of competency based assessment instruments in teacher working group, north bogor city. Journal of Community Engagement, 2(1), 1–5. https://journal.unpak.ac.id/index.php/jce/article/view/2742

Suciati, S., Munadi, S., Sugiman, S., & Febriyanti, W. D. R. (2020). Design and validation of mathematical literacy instruments for assessment for learning in Indonesia. European Journal of Educational Research, 9(2), 865–875. https://doi.org/10.12973/eu-jer.9.2.865

Taherdoost, H. (2016). Validity and reliability of the research instrument; how to test the validation of a questionnaire/survey in a research. SSRN Electronic Journal, 5(3), 28–36. https://doi.org/10.2139/ssrn.3205040

Umami, R., Rusdi, M., & Kamid, K. (2021). Pengembangan instrumen tes untuk mengukur higher order thinking skills (HOTS) berorientasi programme for international student asessment (PISA) pada peserta didik [Developing test instrument to measure higher order thinking skills (HOTS) oriented to programme for international student asessment (PISA). JP3M (Jurnal Penelitian Pendidikan Dan Pengajaran Matematika), 7(1), 57–68. https://doi.org/10.37058/ jp3m.v7i1.2069

Utami, R. F., Prasetyo, S., & Nuridzin, D. Z. (2022). Validitas dan reliabilitas kuesioner Chinese Positive Youth Development Scales (CPYDS) mengukur keterampilan hidup pelajar SMP di Babakan Madang Kabupaten Bogor 2019 [Validity and reliability of questionnaire Chinese Positive Youth Development Scales (CPYDS) measuring life skills of junior high school students in Babakan Madang Bogor Rrgrncy]. Jurnal Biostatistik, Kependudukan, dan Informatika Kesehatan, 2(3), 125. https://doi.org/10.51181/bikfokes.v2i3.6082

Van der Colff, J. J., & Rothmann, S. (2009). Occupational stress, sense of coherence, coping, burnout and work engagement of registered nurses in South Africa. SA Journal of Industrial Psychology, 35(1), 1–10. https://doi.org/10.4102/sajip.v35i1.423

Yuniartik, H., Hidayah, T., & Nasuka. (2017). Evaluasi pembelajaran pendidikan jasmani olahraga dan kesehatan di SLB C se-kota Yogyakarta [Evaluation learning physical education sport and health C Special Schools through out Yogyakarta City]. Journal of Physical Education and Sports, 6(2), 148–156. https://journal.unnes.ac.id/sju/jpes/article/view/17389

Zlatkin-Troitschanskaia, O., Shavelson, R. J., & Pant, H. A. (2018). Assessment of learning outcomes in higher education. Handbook on Measurement, Assessment, and Evaluation in Higher Education (2nd Edition). Routledge. https://doi.org/10.4324/9781315709307-54

DOI: https://doi.org/10.21831/pythagoras.v18i2.59392