Kathy Strunk, Martha L. Thurlow, and Justin Arner
Robin Stripling and Tabitha Riendeau (Arkansas)
Dan Wiener and Deb Hand (Massachusetts)
John Jaquith, Marcia O’Brien, Antoinette Dorsett (Michigan)
Sharon Heater (Nebraska)
Iris Jacobson (Wisconsin)
In collaboration with NCEO’s 1.0% Community of Practice (CoP)
July 2020
All rights reserved. Any or all portions of this document may be reproduced and distributed without prior permission, provided the source is cited as:
Strunk, K., Thurlow, M. L., & Arner, J. (2020). State spotlights: Reducing AA-AAAS state-level participation rates to meet the 1.0% threshold, 2016-17 to 2017-18 (NCEO Report 421). National Center on Educational Outcomes.
This report was developed through a truly collaborative process with the 48 states participating in the 1% Cap CoP during its bi-weekly webinar calls in 2019. Although the CoP was formed at the request of states to provide them the opportunity for private state conversations, it was with mutual agreement among the CoP, including the states highlighted here, that this report should be shared publicly on the NCEO website.
The states participating in the 1% Cap CoP are listed here. Many of the states had multiple representatives on the CoP webinar calls. This report would not exist had it not been for their active participation and sharing during the CoP calls.
Alabama
Arizona Arkansas California Colorado Connecticut Delaware Florida Georgia Hawaii Idaho Illinois Indiana Iowa Kansas Kentucky Louisiana Maine Maryland Massachusetts Michigan Minnesota Mississippi Missouri Montana |
Nebraska New Hampshire New Jersey New Mexico New York North Carolina North Dakota Ohio Oklahoma Oregon Pennsylvania Rhode Island South Carolina South Dakota Tennessee Texas Utah Vermont Virginia Washington West Virginia Wisconsin Wyoming |
This report highlights the work of states in the National Center on Educational Outcomes (NCEO) 1% Community of Practice (CoP) that reduced their alternate assessment participation rates from school year 2016-17 to school year 2017-18. At the time this report was developed, these were the most recent data verified by the U.S. Department of Education. Data were available for reading/language arts and mathematics; participation data for science assessments were not available to us.
U.S. Department of Education data for those states over the required 1.0% alternate assessment participation rate indicated that 11 states had a reduction of at least 0.1 percentage points in either reading/language arts, mathematics, or both. The 0.1 percentage points criterion is used by the U.S. Department of Education as a significant reduction in the participation rate.
Five states volunteered to share information on their approaches to decreasing the state-level participation rate in their states’ alternate assessments based on alternate academic achievement standards (AA-AAAS). The states highlighted in this report are Arkansas, Massachusetts, Michigan, Nebraska, and Wisconsin. Each state provided information on the strategies that it took; several provided examples of some of the materials they used (see appendices).
The report concludes with a discussion of additional considerations. These include the definition of “substantial progress,” the 95% assessment participation requirement, and meeting the 1.0% threshold in science AA-AAAS.
The 2015 reauthorization of the Every Student Succeeds Act (ESSA) placed a state-level 1.0% threshold on student participation in the alternate assessment based on alternate academic achievement standard (AA-AAAS). ESSA also stipulated that state education agencies (SEAs) may not impose on any local educational agency (LEA) a cap on the percentage of students administered an alternate assessment. Nevertheless, LEAs are required to submit information to the SEA justifying the need to exceed 1.0% and SEAs must provide appropriate oversight of these districts.
The National Center on Educational Outcomes (NCEO), at the request of states, initiated a 1% Cap Community of Practice (CoP) as a private forum for regular videoconferences. A password-protected website was established by NCEO so that the 1% CoP states could learn how other states were approaching implementation of the ESSA 1.0% requirements, including oversight of LEAs, and to share resources and information with and among states that would further the purpose of the ESSA legislation in this regard. Since that time states have been addressing the challenges of meeting the 1.0% requirement and searching for and implementing strategies that would help ensure that all students, including students with the most significant cognitive disabilities, are assigned to the appropriate assessment.
The purpose of this report is to highlight the work of states in the 1% CoP that have successfully reduced their alternate assessment participation rates of students with the most significant cognitive disabilities. We used the criterion of at least a 0.1 percentage point decrease in the percentage of students for a subject area that the U.S. Department of Education (2019) established as a benchmark for a state making “substantial progress” in reducing the number of students taking alternate assessments. The states included in this report also met ESSA’s requirement to assess 95% of all students and students with disabilities.
This report identifies the strategies, challenges, resources, and plans for the future of five states that volunteered to share these with the CoP in an effort to provide a collective base of knowledge about “what works” to reduce alternate assessment participation and improve appropriate assessment participation decision making for students with the most significant cognitive disabilities.
The data used to identify states for this report were those reported to the U.S. Department of Education via the EdFacts system. We examined the difference between the state-level percentage in 2017-18 and the state-level percentage in 2016-17 for those states that were over 1.0% in any subject area. The year 2017-18 was the most recent year for which data verified by the U.S. Department of Education were available to us. We examined the data for reading/language arts and mathematics. We did not have access to science data at the time this report was developed.
Table 1 shows those states that were over 1.0% that had any reduction of at least 0.1 percentage points in at least one subject area. All but two states met the decrease of 0.1 percentage point criterion in both reading/English language arts and mathematics. One of the states that did not meet the 0.1 percentage point decrease criterion did not meet it in reading/language arts and one did not meet it in math. Also notable in the table is that the degree of difference in rates from 2016-17 to 2017-18 ranged from just over -0.1 percentage points to just over -0.4 percentage points. Most changes in rates, though, ranged from -0.15 percentage points to -0.20 percentage points.
Table 1. States with Significant Reductions in the State-Level Percentage of Students Participating in the AA-AAAS (2016-17 to 2017-18)a
State | Reading/Language Arts | Mathematics | ||||
---|---|---|---|---|---|---|
2017-18 | 2016-17 | Difference | 2017-18 | 2016-17 | Difference | |
Arkansas | 1.21 | 1.37 | -0.16 | 1.21 | 1.38 | -0.17 |
Illinois | 1.12 | 1.10 | NA | 1.12 | 1.54 | -0.42 |
Louisiana | 1.30 | 1.54 | -0.24 | 1.30 | 1.54 | -0.24 |
Maine | 1.00 | 1.19 | -0.19 | 1.00 | 1.20 | -0.20 |
Massachusetts | 1.45 | 1.56 | -0.11 | 1.47 | 1.58 | -0.11 |
Michigan | 2.08 | 2.28 | -0.20 | 2.15 | 2.32 | -0.17 |
Missouri | 1.06 | 1.27 | -0.21 | 1.06 | 1.26 | -0.20 |
Nebraska | 1.12 | 1.25 | -0.13 | 1.12 | 1.26 | -0.14 |
South Dakota | 1.15 | 1.33 | -0.18 | 1.15 | 1.33 | -0.18 |
Virginia | 1.16 | 1.30 | -0.13 | 0.99 | 0.97 | NA |
Wisconsin | 1.01 | 1.16 | -0.15 | 1.00 | 1.16 | -0.16 |
a The U.S. Department of Education definition of a significant reduction being at least 0.1 percentage points was used here.
We asked volunteer states in the NCEO 1% Cap CoP to provide us with information they believed was relevant to their success in decreasing the state-level participation rate. In this report, we provide information shared by Arkansas, Massachusetts, Michigan, Nebraska, and Wisconsin.
States are using a variety of approaches to reduce their state-level AA-AAAS participation rates. The five states we showcased here were included because they reduced their rates more than 0.1 percentage points in at least one subject area and provided us with information on their strategies, challenges, resources, and plans for the future.
Arkansas showed a decrease in percentage points of 0.16 in reading/language arts and 0.17 in mathematics from 2016-17 to 2017-18. Arkansas started in 2016-17 with participation rates of 1.37% in reading/language arts and 1.38% in mathematics for its alternate assessment, the Arkansas Alternate Assessment.
Arkansas engaged in two general strategies to work on its AA-AAAS participation rates: (a) focused training, and (b) tier-based training and technical assistance. The specific approaches that Arkansas used under each of these general strategies are listed here.
Arkansas brought in a five- to six-member team for at least a full day for folder review of two large districts. A report was created and shared back with the districts. The review was conducted student by student, and when needed, a suggestion was made that the IEP teams review decisions.
Arkansas identified a few challenges that it had encountered as it worked to reduce state-level participation rates in the Arkansas Alternate Assessment.
Arkansas has made numerous resources available. Some were used during training. Others were also posted online. Some of these resources are listed here:
Massachusetts reduced AA-AAAS participation by 0.11 percentage points in both reading/language arts and mathematics between the 2016-2017 and 2017-2018 school years, after starting 2016-17 with a relatively high alternate assessment participation rate of 1.56% in reading/language arts and 1.58% in mathematics.
Massachusetts undertook two general strategies to work to reduce its AA-AAAS participation rates: (a) work directly with the highest-percentage districts, and (b) clarify participation guidelines to help IEP teams make appropriate assessment participation decisions. The specific approaches used by Massachusetts for each of these general strategies are listed here.
Massachusetts noted some challenges:
Three tools that Massachusetts provides to its districts are listed here and included in Appendix A.
Massachusetts used the data displays to focus on comparisons between the district and state, highlighting areas in need of further reflection and investigation by the district.
The data displays Massachusetts shared with districts show information based on the following metrics (see Appendix A):
Massachusetts indicated that it expects to continue decreasing its statewide percent over the next 2-3 years, as long as it maintains technical assistance and pressure on districts. However, the rate of decrease will likely diminish over time since most of the likely candidates for re-designation have already been removed from the alternate assessment. The state would need to re-designate an additional 2,000 of 7,000 students now participating in the AA-AAAS for it to reach one percent, which may not be possible or realistic. Massachusetts will continue to target specific districts for individualized site visits and assistance, plus send out annual letters requesting justification and other information if the district will continue to exceed one percent in the coming year.
Despite concerns about future rates of decrease in AA-AAS participation, Massachusetts has reported a decrease from 1.6 percent in 2017-2018 to 1.4 percent in 2018-2019, a reduction of about 1,000 students taking alternate assessments over the past two school years.
Michigan showed a decrease in percentage points of 0.20 in reading/language arts, from 2.28 in 2016-17 to 2.08 in 2017-18. It also showed a decrease of 0.17 percentage points in mathematics, from 2.32 in 2016-17 to 2.15 in 2017-18.
Michigan employed several strategies to reduce the state-level participation rate in the AA-AAAS, as listed here.
Michigan identified several challenges that it had encountered, including the following:
Michigan has resources that are publicly available, as noted here. In addition, three resources are provided in Appendix B.
Michigan noted that in addition to its significant change in AA-AAAS participation rates from 2016-17 to 2017-18, it has projected its rates for 2018-19 (see Display in Appendix B), as follows:
Nebraska saw a decrease in AA-AAAS reading/language arts participation rates from 1.25% in 2016-17 to 1.12% in 2017-2018 (a 0.13 percentage point decrease), and a decrease in AA-AAAS mathematics participation rates from 1.26% in 2016-17 to 1.12% in 2018 (a 0.14 percentage point decrease).
Nebraska identified several strategies that it has used to support the reduction in AA-AAAS participation rates, as noted here:
Nebraska identified several challenges it is addressing as it works to reduce the state’s alternate participation rate:
Nebraska has developed many resources. The ones listed here are available in Appendix C.
Wisconsin showed a decrease in percentage points of 0.15 in reading/language arts and 0.16 in mathematics from 2016-17 to 2017-18. Wisconsin’s alternate assessment participation rates in 2016 were 1.16 in both reading/language arts mathematics.
Wisconsin undertook a number of strategies to work on its alternate assessment participation rates. These strategies were:
Wisconsin has addressed several challenges in its work to lower AA-AAAS participation rates.
Wisconsin has made the following resources available:
Wisconsin reported that the state did see a decrease in AA-AAAS participation rates from 1.0% in 2017-18 to 0.9% in 2018-19.
New for 2019-20:
In 2019 the U.S. Department of Education established that substantive progress is defined as having at least a 0.1 percentage point decrease in the percentage of alternate assessment participation for a subject area. Although this report highlights five states that met this criterion in both reading/language arts and mathematics, other states in the NCEO 1% Community of Practice shared evidence of progress in their plans, strategies, guidance, timelines, and district oversight activities, along with their expectation that these efforts would lead to reductions in AA-AAAS participation rates in the future. Examples include Idaho’s initiative to update its participation criteria and provide intensive technical assistance to districts with high participation rates. Another example is Kentucky’s requirement for mandatory participation in online statewide training modules for administrators and educators with a training emphasis on IEP simulation using student case scenarios.
Some states are grappling with their assessment participation rates for all students and for students with disabilities. States that wish to apply for a waiver or waiver extension (if the state expects to exceed the 1.0% AA-AAAS participation threshold) must meet this requirement [§200.6(c)(4)(ii)] in order to be approved for a waiver or waiver extension. Opting out movements in some states have contributed to the state’s inability to meet the 95% participation rate requirements. There is currently little to no guidance, research, or best practices to help states address this problem. Nevertheless, it will undoubtedly receive more attention in the future.
The U.S. Department of Education’s 1.0% threshold requirements apply to reading, math, and science. Some states are finding it more difficult to meet the threshold in science. Education leaders have suggested that a history of exclusion of students with disabilities from science coursework has contributed to this issue.
As states continue to address the requirements of meeting the 1.0% threshold in the AA-AAAS they find the NCEO 1% Community of Practice state sharing of approaches, ideas, questions, discussion, and resources to be an invaluable support to the 1.0% work in their own state. The 1% CoP and NCEO’s sharing of state spotlights to highlight successes (through this and future reports) hopefully will continue to contribute to states’ efforts to address AA-AAAS participation rates.
Arkansas Resource 1: Selected Slides (identified as Examples A, B, and C) from PowerPoint Training and Link to the training is at http://dese.ade.arkansas.gov/divisions/learning-services/special-education/presentations. Select the last item on the page to view the video.
Slide A Example:
Slide B Example:
Slide C Example:
Arkansas Resource 2: Guidance for IEP Teams at http://dese.ade.arkansas.gov/public/
userfiles/Learning_Services/Student%20
Assessment/DLM/Guidance_for_IEP_
Teams_on_Alternate_Assessment_2018-2019.pdf
Arkansas Resource 3: Arkansas Participation Guidelines at
http://adecm.arkansas.gov/
Attachments/LS-16-084
ArkansasAlternate
Assessment
ParticipationDecisionGuidelines.pdf
Arkansas Resource 4: List of Arkansas Districts Over the 1.0%
Threshold at
Districts
required to provide justifications for alternate assessment
participation rates
Arkansas Resource 5: LEA Justification Documentation:
LEA
Alternate Assessment Justification Documentation
Massachusetts Resource 1: Decision-Making Tool
Massachusetts Resource 2: 2019 MCAS-Alt by Disability
Massachusetts Resource 3: Sample MCAS-Alt District Data Display
Michigan Resource 1: Assessment Selection Guidelines Training at
https://mdoe.state.mi.us/mdedocuments/AssessmentSelectionGuidelinesTraining/index.html
Michigan Resource 2: Flow Chart, “Should My Student Take the
Alternate Assessment?” at
https://www.michigan.gov/documents/mde/Should_My_Student_Take_
the_Alternate_Assessment_556705_7.pdf
Michigan Resource 3: Interactive Decision-Making Tool
at
https://mdoe.state.mi.us/MDEDocuments/InteractiveDecision-MakingTool/index.html
Michigan Resource 4: Data Display: 1% Cap – Where is Michigan Now?
|
Spring 2017 |
Spring 2018 |
Spring 2019 |
|||
---|---|---|---|---|---|---|
Subject |
Percent |
Count |
Percent |
Count |
Percent |
Count |
ELA |
2.28 |
17,867 |
2.08 |
15,875 |
1.97 |
14,825 |
Mathematics |
2.32 |
18,151 |
2.15 |
16,388 |
2.02 |
15,179 |
Subject |
Percent Change |
Count change |
---|---|---|
ELA |
-0.31 |
-3,042 |
Mathematics |
-0.30 |
-2,972 |
Nebraska Resource 1: Letter to Superintendents and Special Education Directors
Nebraska Resource 2: District Justification Form
https://www.education.ne.gov/assessment/nscas-alternate-summative-assessment/#1574203734112-50356b4d-9bc8. See NSCAS Alternate Documents.
Nebraska Resource 3: District Justification Support Worksheet at
https://www.education.ne.gov/assessment/nscas-alternate-summative
-assessment/#1574203734112-50356b4d-9bc8.
See NSCAS Alternate Documents.
Nebraska Resource 4: Data Projections
Participation Data | |||||||
---|---|---|---|---|---|---|---|
NSCAS Alternate Assessment | |||||||
2017 | 2018 | 2019 | 2020 Projections |
||||
Number | Percent | Number | Percent | Number | Percent | Number | |
ELA | 2054 | 1.27 | 1833 | 1.12 | 1716 | 1.04 | 1778 |
MATH | 2058 | 1.27 | 1831 | 1.12 | 1715 | 1.04 | 1778 |
SCIENCE | 892 | 1.30 | 817 | 1.19 | 733 | 1.04 | 785 |
Nebraska Resource 6: Engaging Educators Training (this will be on Nebraska’s website soon)
Selected slides are shown below, labeled as A. B. and C.
Slide A Example:
Slide B Example:
Slide C Example
Nebraska Resource 7: Nebraska Department of Education: Training PowerPoint for Alternate Assessment (this will be on Nebraska’s website soon)
Selected slides are shown below, labeled as A. B. and C.
Slide A Example:
Slide B Example:
Slide C Example:
Wisconsin Resource 1: IEP forms I-7A Participation Guidelines for
Alternate Assessment
This resource may be accessed at Participation
Guidelines for Alternate Assessment.
Wisconsin Resource 2: Guide to Determining Students with the Most Significant Cognitive Disability: This resource may be accessed at: https://dpi.wi.gov/sites/default/files/imce/sped/pdf/mscd-guide-to-determining-students-with-mscd.pdf
Wisconsin Resource 3: Webpage, Students with a Most Significant Cognitive Disability at https://dpi.wi.gov/sped/program/students-most-significant-cognitive-disabilities