Menu
Home
People
Places
Arts
History
Plants & Animals
Science
Life & Culture
Technology
Reference.org
Large-scale learning assessments
open-in-new
<h2 id="principles-and-implementations">Principles and implementations</h2> <p>LSLAs are a specific subset of learning assessment systems.<a class="footnote-ref" id="fnref:6" href="#fn:6"><sup>6</sup></a> They are system-level assessments that provide information of learning achievement for a given group of learners (based on age or grade) in a given year and in a limited number of domains. They are often categorized as national or cross-national (regional/international) assessments.<a class="footnote-ref" id="fnref:7" href="#fn:7"><sup>7</sup></a><a class="footnote-ref" id="fnref:8" href="#fn:8"><sup>8</sup></a> </p><p>LSLAs are uniform and standardized in content, administration process, timing and scoring.<a class="footnote-ref" id="fnref:9" href="#fn:9"><sup>9</sup></a> They are frequently referred to as standardized tests, particularly within <a href="/facts/Anglo-Saxons/qWLes0LP">Anglo-Saxon</a> countries and <a href="/facts/Literature/CmUDxokU">literature</a>. They are generally sample-based, but over the last decades, some countries have adopted a census-based approach.<a class="footnote-ref" id="fnref:10" href="#fn:10"><sup>10</sup></a> They can be <a href="/facts/School/AxxKew5Y">school</a> or household-based, <a href="/facts/Curriculum/FEAlV1PH">curriculum</a>-based or not.<a class="footnote-ref" id="fnref:11" href="#fn:11"><sup>11</sup></a> </p><p>LSLAs are generally used by education authorities to determine learners’ overall achievement levels. They help <a href="/facts/Government/N4bYL0VC">governments</a> monitor changes in learning outcomes over time and highlight inequalities in learning achievement among population groups.<a class="footnote-ref" id="fnref:12" href="#fn:12"><sup>12</sup></a> By identifying correlates of learning outcomes and by providing a deeper insight on how a range of variables interact, LSLA <a href="/facts/Data/AUBFN97o">data</a> also provide better understanding of the dynamics behind the performance of education systems. They inform the design of <a href="/facts/Policy/0DtXG95q">policies</a> and strategies aimed at improving student <a href="/facts/Knowledge/joozoaup">knowledge</a> and competences as well as equity in <a href="/facts/Learning/lehEKRjC">learning</a>.<a class="footnote-ref" id="fnref:13" href="#fn:13"><sup>13</sup></a><a class="footnote-ref" id="fnref:14" href="#fn:14"><sup>14</sup></a> </p><p>LSLAs are designed and implemented to meet a certain level of standards. Despite there being no vetted international standard for the characteristics that define robust LSLAs (i.e. that yield reliable data), there is agreement among test developers, statisticians and psychometricians on the technical requirements of such assessments.<a class="footnote-ref" id="fnref:15" href="#fn:15"><sup>15</sup></a> </p><p>LSLAs are developed and implemented based on at least three principles:<a class="footnote-ref" id="fnref:16" href="#fn:16"><sup>16</sup></a> </p> <ol><li>Technically sound. They are assessment <a href="/facts/Methodology/dk5X9Hxx">methodologies</a>, analysis and interpretation of data that follow scientific principles;</li> <li>Following standardized field operations;</li> <li>Designed to be <a href="/facts/Ethics/wNVNgL5q">ethical</a>, <a href="/facts/Fair/sHnqj1em">fair</a> and inclusive of the target population.<a class="footnote-ref" id="fnref:17" href="#fn:17"><sup>17</sup></a></li></ol> <h2 id="perceived-benefits">Perceived benefits</h2> <p>Developing a national learning assessment or participating in cross-national initiatives are multiple and driven by interconnected factors.<a class="footnote-ref" id="fnref:18" href="#fn:18"><sup>18</sup></a> </p><p>Four main factors that enhance the use of LSLAs are: the growing number of perceived benefits, an evolving global culture of evaluation, a shift in the focus of global education policy, and priorities and demands of development donors.<a class="footnote-ref" id="fnref:19" href="#fn:19"><sup>19</sup></a><a class="footnote-ref" id="fnref:20" href="#fn:20"><sup>20</sup></a> </p> <h3>Data analysis</h3> <p><a href="/facts/Data/AUBFN97o">Data</a> from LSLAs give governments evidence to address system inefficiencies by providing answers to key questions, such as who is learning what and who is not, where, when and why.<a class="footnote-ref" id="fnref:21" href="#fn:21"><sup>21</sup></a> Learning achievement scores and information from the background questionnaires are generally used by experts and researchers to describe the knowledge and <a href="/facts/Skill/XKyAfgBg">skills</a> of a target population.<a class="footnote-ref" id="fnref:22" href="#fn:22"><sup>22</sup></a> This involves several types of analyses.<a class="footnote-ref" id="fnref:23" href="#fn:23"><sup>23</sup></a><a class="footnote-ref" id="fnref:24" href="#fn:24"><sup>24</sup></a> First, understanding the factors that influence learning achievement (e.g. home and school context and practices), and if these are changing over time.<a class="footnote-ref" id="fnref:25" href="#fn:25"><sup>25</sup></a> Second, identifying general trends in learning achievements and evaluating progress towards specific targets using a set of indicators. Third, highlighting disparities in cognitive abilities among sub-populations of learners by relevant dimension, including <a href="/facts/Socioeconomics/ywuuTTUN">socio-economic</a>, regional, <a href="/facts/Gender/LfjRHcJy">gender</a>, <a href="/facts/Human_migration/r2oTzF6F">migration</a> status and <a href="/facts/First_language/1yK3tnLb">mother tongue</a>.<a class="footnote-ref" id="fnref:26" href="#fn:26"><sup>26</sup></a> </p><p><a href="/facts/Policy/0DtXG95q">Policy-makers</a> use the results or evidence from LSLAs for many purposes including:<a class="footnote-ref" id="fnref:27" href="#fn:27"><sup>27</sup></a><a class="footnote-ref" id="fnref:28" href="#fn:28"><sup>28</sup></a> </p> <ul><li>Monitoring and evaluation: to monitor a set of issues and trends towards national, regional or global goals and targets; and to evaluate <a href="/facts/Educational_policies_and_initiatives_of_the_European_Union/sY9MKstL">education policies</a>.</li> <li>Inform policy formulation: to orient policy formulation, design and implementation or improve the effectiveness of policy measures already in place.</li> <li>Agenda setting: to set agendas by raising awareness on certain issues, stimulating debate within civil society and government circles, identifying priority issues for reform and generating ‘positive pressure’ to incite governments to undertake reforms or advance policy change.</li> <li>Accountability: to hold a range of agents accountable, including immediate education stakeholders (administrators, principals, teachers, school boards, private providers).</li> <li>In-depth analysis: to add depth and perspective to the analysis of education systems, and direct policy-makers and practitioners to focused studies that reflect their local and contextual realities.<a class="footnote-ref" id="fnref:29" href="#fn:29"><sup>29</sup></a></li></ul> <h2 id="limitations">Limitations</h2> <p>LSLAs generally focus on a limited range of learning dimensions and address a defined number of the multiple purposes of education.<a class="footnote-ref" id="fnref:30" href="#fn:30"><sup>30</sup></a> It may not measure other variables such as classroom and school settings. According to a 2019 UNESCO publication three main limitations arise: its under-use, over-use and the combination with (or subordinate to) accountability measures.<a class="footnote-ref" id="fnref:31" href="#fn:31"><sup>31</sup></a> </p> <h2 id="see-also">See also</h2> <ul><li><a href="/facts/Educational_assessment/howrvhhV">Educational assessment</a></li> <li><a href="/facts/Standardized_test/PkunTjfB">Standardized test</a></li></ul> <h2 id="sources">Sources</h2> <p> This article incorporates text from a <a href="/facts/Free_content/jHYHARSN">free content</a> work. Licensed under CC BY-SA 3.0 IGO. Text taken from <a href="https://unesdoc.unesco.org/ark:/48223/pf0000369697"><i>The promise of large-scale learning assessments: acknowledging limits to unlock opportunities</i></a>, UNESCO, UNESCO. UNESCO. </p> <h2 id="references">References</h2> <ol> <li id="fn:1"><p>UNESCO (2019). The promise of large-scale learning assessments: acknowledging limits to unlock opportunities. UNESCO. ISBN 978-92-3-100333-2. <a href="978-92-3-100333-2" target="_blank">978-92-3-100333-2</a> <a href="#fnref:1" class="footnote-back-ref">↩</a></p></li> <li id="fn:2"><p>Chudowsky, Naomi; Pellegrino, James W. (2003-02-01). "Large-Scale Assessments That Support Learning: What Will It Take?". Theory into Practice. 42 (1): 75–83. doi:10.1207/s15430421tip4201_10. ISSN 0040-5841. S2CID 143791579. <a href="https://muse.jhu.edu/pub/32/article/41407/pdf" target="_blank">https://muse.jhu.edu/pub/32/article/41407/pdf</a> <a href="#fnref:2" class="footnote-back-ref">↩</a></p></li> <li id="fn:3"><p>Maddox, Bryan (2023). "The uses of process data in large-scale educational assessments" (PDF). OECD Education Working Papers. 286. doi:10.1787/5d9009ff-en. Retrieved 5 June 2023. <a href="https://www.oecd-ilibrary.org/docserver/5d9009ff-en.pdf?expires=1685959058&id=id&accname=ocid195767&checksum=9F5C57D779351DF37D4B49C8077572A8" target="_blank">https://www.oecd-ilibrary.org/docserver/5d9009ff-en.pdf?expires=1685959058&id=id&accname=ocid195767&checksum=9F5C57D779351DF37D4B49C8077572A8</a> <a href="#fnref:3" class="footnote-back-ref">↩</a></p></li> <li id="fn:4"><p>UNESCO (2019). The promise of large-scale learning assessments: acknowledging limits to unlock opportunities. UNESCO. ISBN 978-92-3-100333-2. <a href="978-92-3-100333-2" target="_blank">978-92-3-100333-2</a> <a href="#fnref:4" class="footnote-back-ref">↩</a></p></li> <li id="fn:5"><p>UNESCO (2019). The promise of large-scale learning assessments: acknowledging limits to unlock opportunities. UNESCO. ISBN 978-92-3-100333-2. <a href="978-92-3-100333-2" target="_blank">978-92-3-100333-2</a> <a href="#fnref:5" class="footnote-back-ref">↩</a></p></li> <li id="fn:6"><p>UNESCO (2019). The promise of large-scale learning assessments: acknowledging limits to unlock opportunities. UNESCO. ISBN 978-92-3-100333-2. <a href="978-92-3-100333-2" target="_blank">978-92-3-100333-2</a> <a href="#fnref:6" class="footnote-back-ref">↩</a></p></li> <li id="fn:7"><p>UNESCO (2019). The promise of large-scale learning assessments: acknowledging limits to unlock opportunities. UNESCO. ISBN 978-92-3-100333-2. <a href="978-92-3-100333-2" target="_blank">978-92-3-100333-2</a> <a href="#fnref:7" class="footnote-back-ref">↩</a></p></li> <li id="fn:8"><p>"Learning assessments | Unesco IIEP Learning Portal". learningportal.iiep.unesco.org. Retrieved 2020-03-10. <a href="https://learningportal.iiep.unesco.org/en/issue-briefs/monitor-learning/learning-assessments" target="_blank">https://learningportal.iiep.unesco.org/en/issue-briefs/monitor-learning/learning-assessments</a> <a href="#fnref:8" class="footnote-back-ref">↩</a></p></li> <li id="fn:9"><p>UNESCO (2019). The promise of large-scale learning assessments: acknowledging limits to unlock opportunities. UNESCO. ISBN 978-92-3-100333-2. <a href="978-92-3-100333-2" target="_blank">978-92-3-100333-2</a> <a href="#fnref:9" class="footnote-back-ref">↩</a></p></li> <li id="fn:10"><p>Verger, Antoni; Parcerisa, Lluís; Fontdevila, Clara (2019-01-02). "The growth and spread of large-scale assessments and test-based accountabilities: a political sociology of global education reforms". Educational Review. 71 (1): 5–30. doi:10.1080/00131911.2019.1522045. hdl:2445/192993. ISSN 0013-1911. S2CID 150242878. <a href="https://zenodo.org/record/1465986" target="_blank">https://zenodo.org/record/1465986</a> <a href="#fnref:10" class="footnote-back-ref">↩</a></p></li> <li id="fn:11"><p>Maddox, Bryan (2023). "The uses of process data in large-scale educational assessments" (PDF). OECD Education Working Papers. 286. doi:10.1787/5d9009ff-en. Retrieved 5 June 2023. <a href="https://www.oecd-ilibrary.org/docserver/5d9009ff-en.pdf?expires=1685959058&id=id&accname=ocid195767&checksum=9F5C57D779351DF37D4B49C8077572A8" target="_blank">https://www.oecd-ilibrary.org/docserver/5d9009ff-en.pdf?expires=1685959058&id=id&accname=ocid195767&checksum=9F5C57D779351DF37D4B49C8077572A8</a> <a href="#fnref:11" class="footnote-back-ref">↩</a></p></li> <li id="fn:12"><p>UNESCO (2019). The promise of large-scale learning assessments: acknowledging limits to unlock opportunities. UNESCO. ISBN 978-92-3-100333-2. <a href="978-92-3-100333-2" target="_blank">978-92-3-100333-2</a> <a href="#fnref:12" class="footnote-back-ref">↩</a></p></li> <li id="fn:13"><p>UNESCO (2019). The promise of large-scale learning assessments: acknowledging limits to unlock opportunities. UNESCO. ISBN 978-92-3-100333-2. <a href="978-92-3-100333-2" target="_blank">978-92-3-100333-2</a> <a href="#fnref:13" class="footnote-back-ref">↩</a></p></li> <li id="fn:14"><p>Chudowsky, Naomi; Pellegrino, James W. (February 2003). "Large-Scale Assessments That Support Learning: What Will It Take?". Theory into Practice. 42 (1): 75–83. doi:10.1207/s15430421tip4201_10. ISSN 0040-5841. S2CID 143791579. <a href="https://muse.jhu.edu/pub/32/article/41407/pdf" target="_blank">https://muse.jhu.edu/pub/32/article/41407/pdf</a> <a href="#fnref:14" class="footnote-back-ref">↩</a></p></li> <li id="fn:15"><p>Clarke, Marguerite; Luna-Bazaldua, Diego (26 April 2021). Primer on Large-Scale Assessments of Educational Achievement. Washington, DC: World Bank. ISBN 978-1-4648-1659-8. Retrieved 5 June 2023. <a href="978-1-4648-1659-8" target="_blank">978-1-4648-1659-8</a> <a href="#fnref:15" class="footnote-back-ref">↩</a></p></li> <li id="fn:16"><p>UNESCO (2019). The promise of large-scale learning assessments: acknowledging limits to unlock opportunities. UNESCO. ISBN 978-92-3-100333-2. <a href="978-92-3-100333-2" target="_blank">978-92-3-100333-2</a> <a href="#fnref:16" class="footnote-back-ref">↩</a></p></li> <li id="fn:17"><p>UNESCO (2019). The promise of large-scale learning assessments: acknowledging limits to unlock opportunities. UNESCO. ISBN 978-92-3-100333-2. <a href="978-92-3-100333-2" target="_blank">978-92-3-100333-2</a> <a href="#fnref:17" class="footnote-back-ref">↩</a></p></li> <li id="fn:18"><p>UNESCO (2019). The promise of large-scale learning assessments: acknowledging limits to unlock opportunities. UNESCO. ISBN 978-92-3-100333-2. <a href="978-92-3-100333-2" target="_blank">978-92-3-100333-2</a> <a href="#fnref:18" class="footnote-back-ref">↩</a></p></li> <li id="fn:19"><p>UNESCO (2019). The promise of large-scale learning assessments: acknowledging limits to unlock opportunities. UNESCO. ISBN 978-92-3-100333-2. <a href="978-92-3-100333-2" target="_blank">978-92-3-100333-2</a> <a href="#fnref:19" class="footnote-back-ref">↩</a></p></li> <li id="fn:20"><p>Bennett, Randy Elliot. (1998). Reinventing Assessment. Speculations on the Future of Large-Scale Educational Testing. a Policy Information Perspective. Policy Information Center. OCLC 967116582. <a href="/wiki/OCLC_(identifier)" target="_blank">/wiki/OCLC_(identifier)</a> <a href="#fnref:20" class="footnote-back-ref">↩</a></p></li> <li id="fn:21"><p>Montoya, S. 2016. The Cost of Ignorance Revisited: A Reply. "Measuring Learning: the Cost of Ignorance By Silvia Montoya". 8 February 2016. Retrieved 2020-12-21. (Accessed December 2020). <a href="https://www.norrag.org/measuring-learning-the-cost-of-ignorance/" target="_blank">https://www.norrag.org/measuring-learning-the-cost-of-ignorance/</a> <a href="#fnref:21" class="footnote-back-ref">↩</a></p></li> <li id="fn:22"><p>Lietz, Petra; Tobin, Mollie (2016-10-19). "The impact of Large-Scale Assessments in Education on education policy: evidence from around the world". Research Papers in Education. 31 (5): 499–501. doi:10.1080/02671522.2016.1225918. ISSN 0267-1522. <a href="https://doi.org/10.1080%2F02671522.2016.1225918" target="_blank">https://doi.org/10.1080%2F02671522.2016.1225918</a> <a href="#fnref:22" class="footnote-back-ref">↩</a></p></li> <li id="fn:23"><p>UNESCO (2019). The promise of large-scale learning assessments: acknowledging limits to unlock opportunities. UNESCO. ISBN 978-92-3-100333-2. <a href="978-92-3-100333-2" target="_blank">978-92-3-100333-2</a> <a href="#fnref:23" class="footnote-back-ref">↩</a></p></li> <li id="fn:24"><p>"Learning about learning assessments". blogs.worldbank.org. Retrieved 2020-03-10. <a href="https://blogs.worldbank.org/education/learning-about-learning-assessments" target="_blank">https://blogs.worldbank.org/education/learning-about-learning-assessments</a> <a href="#fnref:24" class="footnote-back-ref">↩</a></p></li> <li id="fn:25"><p>Stecher, Brain (November 1998). "The Local Benefits and Burdens of Large-scale Portfolio Assessment". Assessment in Education: Principles, Policy & Practice. 5 (3): 335–351. doi:10.1080/0969595980050303. ISSN 0969-594X. <a href="/wiki/Doi_(identifier)" target="_blank">/wiki/Doi_(identifier)</a> <a href="#fnref:25" class="footnote-back-ref">↩</a></p></li> <li id="fn:26"><p>Clarke, Marguerite; Luna-Bazaldua, Diego (26 April 2021). Primer on Large-Scale Assessments of Educational Achievement. Washington, DC: World Bank. ISBN 978-1-4648-1659-8. Retrieved 5 June 2023. <a href="978-1-4648-1659-8" target="_blank">978-1-4648-1659-8</a> <a href="#fnref:26" class="footnote-back-ref">↩</a></p></li> <li id="fn:27"><p>UNESCO (2019). The promise of large-scale learning assessments: acknowledging limits to unlock opportunities. UNESCO. ISBN 978-92-3-100333-2. <a href="978-92-3-100333-2" target="_blank">978-92-3-100333-2</a> <a href="#fnref:27" class="footnote-back-ref">↩</a></p></li> <li id="fn:28"><p>Clarke, Marguerite; Luna-Bazaldua, Diego (26 April 2021). Primer on Large-Scale Assessments of Educational Achievement. Washington, DC: World Bank. ISBN 978-1-4648-1659-8. Retrieved 5 June 2023. <a href="978-1-4648-1659-8" target="_blank">978-1-4648-1659-8</a> <a href="#fnref:28" class="footnote-back-ref">↩</a></p></li> <li id="fn:29"><p>Maddox, Bryan (2023). "The uses of process data in large-scale educational assessments" (PDF). OECD Education Working Papers. 286. doi:10.1787/5d9009ff-en. Retrieved 5 June 2023. <a href="https://www.oecd-ilibrary.org/docserver/5d9009ff-en.pdf?expires=1685959058&id=id&accname=ocid195767&checksum=9F5C57D779351DF37D4B49C8077572A8" target="_blank">https://www.oecd-ilibrary.org/docserver/5d9009ff-en.pdf?expires=1685959058&id=id&accname=ocid195767&checksum=9F5C57D779351DF37D4B49C8077572A8</a> <a href="#fnref:29" class="footnote-back-ref">↩</a></p></li> <li id="fn:30"><p>Butler, Frances A. (1997). Accommodation strategies for English language learners on large-scale assessments : student characteristics and other considerations. Center for Research on Evaluation, National Center for Research on Evaluation, Standards, and Student Testing, Graduate School of Education & Information Studies, University of California, Los Angeles. OCLC 41041578. <a href="/wiki/OCLC_(identifier)" target="_blank">/wiki/OCLC_(identifier)</a> <a href="#fnref:30" class="footnote-back-ref">↩</a></p></li> <li id="fn:31"><p>UNESCO (2019). The promise of large-scale learning assessments: acknowledging limits to unlock opportunities. UNESCO. ISBN 978-92-3-100333-2. <a href="978-92-3-100333-2" target="_blank">978-92-3-100333-2</a> <a href="#fnref:31" class="footnote-back-ref">↩</a></p></li> </ol>