NCEO Report 421

State Spotlights: Reducing AA-AAAS State-Level Participation Rates to Meet the 1.0% Threshold, 2016-17 to 2017-18

Kathy Strunk, Martha L. Thurlow, and Justin Arner

With contributions from:

Robin Stripling and Tabitha Riendeau (Arkansas)
Dan Wiener and Deb Hand (Massachusetts)
John Jaquith, Marcia O’Brien, Antoinette Dorsett (Michigan)
Sharon Heater (Nebraska)
Iris Jacobson (Wisconsin)

In collaboration with NCEO’s 1.0% Community of Practice (CoP)

July 2020

All rights reserved. Any or all portions of this document may be reproduced and distributed without prior permission, provided the source is cited as:

Strunk, K., Thurlow, M. L., & Arner, J. (2020). State spotlights: Reducing AA-AAAS state-level participation rates to meet the 1.0% threshold, 2016-17 to 2017-18 (NCEO Report 421). National Center on Educational Outcomes.

Table of Contents


Acknowledgments

This report was developed through a truly collaborative process with the 48 states participating in the 1% Cap CoP during its bi-weekly webinar calls in 2019. Although the CoP was formed at the request of states to provide them the opportunity for private state conversations, it was with mutual agreement among the CoP, including the states highlighted here, that this report should be shared publicly on the NCEO website.

The states participating in the 1% Cap CoP are listed here. Many of the states had multiple representatives on the CoP webinar calls. This report would not exist had it not been for their active participation and sharing during the CoP calls.

Alabama
Arizona
Arkansas
California
Colorado
Connecticut
Delaware
Florida
Georgia
Hawaii
Idaho
Illinois
Indiana
Iowa
Kansas
Kentucky
Louisiana
Maine
Maryland
Massachusetts
Michigan
Minnesota
Mississippi
Missouri
Montana
Nebraska
New Hampshire
New Jersey
New Mexico
New York
North Carolina
North Dakota
Ohio
Oklahoma
Oregon
Pennsylvania
Rhode Island
South Carolina
South Dakota
Tennessee
Texas
Utah
Vermont
Virginia
Washington
West Virginia
Wisconsin
Wyoming

Executive Summary

This report highlights the work of states in the National Center on Educational Outcomes (NCEO) 1% Community of Practice (CoP) that reduced their alternate assessment participation rates from school year 2016-17 to school year 2017-18. At the time this report was developed, these were the most recent data verified by the U.S. Department of Education. Data were available for reading/language arts and mathematics; participation data for science assessments were not available to us.

U.S. Department of Education data for those states over the required 1.0% alternate assessment participation rate indicated that 11 states had a reduction of at least 0.1 percentage points in either reading/language arts, mathematics, or both. The 0.1 percentage points criterion is used by the U.S. Department of Education as a significant reduction in the participation rate.

Five states volunteered to share information on their approaches to decreasing the state-level participation rate in their states’ alternate assessments based on alternate academic achievement standards (AA-AAAS). The states highlighted in this report are Arkansas, Massachusetts, Michigan, Nebraska, and Wisconsin. Each state provided information on the strategies that it took; several provided examples of some of the materials they used (see appendices).

The report concludes with a discussion of additional considerations. These include the definition of “substantial progress,” the 95% assessment participation requirement, and meeting the 1.0% threshold in science AA-AAAS.


Introduction

The 2015 reauthorization of the Every Student Succeeds Act (ESSA) placed a state-level 1.0% threshold on student participation in the alternate assessment based on alternate academic achievement standard (AA-AAAS). ESSA also stipulated that state education agencies (SEAs) may not impose on any local educational agency (LEA) a cap on the percentage of students administered an alternate assessment. Nevertheless, LEAs are required to submit information to the SEA justifying the need to exceed 1.0% and SEAs must provide appropriate oversight of these districts.

The National Center on Educational Outcomes (NCEO), at the request of states, initiated a 1% Cap Community of Practice (CoP) as a private forum for regular videoconferences. A password-protected website was established by NCEO so that the 1% CoP states could learn how other states were approaching implementation of the ESSA 1.0% requirements, including oversight of LEAs, and to share resources and information with and among states that would further the purpose of the ESSA legislation in this regard. Since that time states have been addressing the challenges of meeting the 1.0% requirement and searching for and implementing strategies that would help ensure that all students, including students with the most significant cognitive disabilities, are assigned to the appropriate assessment.

The purpose of this report is to highlight the work of states in the 1% CoP that have successfully reduced their alternate assessment participation rates of students with the most significant cognitive disabilities. We used the criterion of at least a 0.1 percentage point decrease in the percentage of students for a subject area that the U.S. Department of Education (2019) established as a benchmark for a state making “substantial progress” in reducing the number of students taking alternate assessments. The states included in this report also met ESSA’s requirement to assess 95% of all students and students with disabilities.

This report identifies the strategies, challenges, resources, and plans for the future of five states that volunteered to share these with the CoP in an effort to provide a collective base of knowledge about “what works” to reduce alternate assessment participation and improve appropriate assessment participation decision making for students with the most significant cognitive disabilities.


The Data

The data used to identify states for this report were those reported to the U.S. Department of Education via the EdFacts system. We examined the difference between the state-level percentage in 2017-18 and the state-level percentage in 2016-17 for those states that were over 1.0% in any subject area. The year 2017-18 was the most recent year for which data verified by the U.S. Department of Education were available to us. We examined the data for reading/language arts and mathematics. We did not have access to science data at the time this report was developed.

Table 1 shows those states that were over 1.0% that had any reduction of at least 0.1 percentage points in at least one subject area. All but two states met the decrease of 0.1 percentage point criterion in both reading/English language arts and mathematics. One of the states that did not meet the 0.1 percentage point decrease criterion did not meet it in reading/language arts and one did not meet it in math. Also notable in the table is that the degree of difference in rates from 2016-17 to 2017-18 ranged from just over -0.1 percentage points to just over -0.4 percentage points. Most changes in rates, though, ranged from -0.15 percentage points to -0.20 percentage points.

Table 1. States with Significant Reductions in the State-Level Percentage of Students Participating in the AA-AAAS (2016-17 to 2017-18)a

State Reading/Language Arts Mathematics
2017-18 2016-17 Difference 2017-18 2016-17 Difference
Arkansas 1.21 1.37 -0.16 1.21 1.38 -0.17
Illinois 1.12 1.10 NA 1.12 1.54 -0.42
Louisiana 1.30 1.54 -0.24 1.30 1.54 -0.24
Maine 1.00 1.19 -0.19 1.00 1.20 -0.20
Massachusetts 1.45 1.56 -0.11 1.47 1.58 -0.11
Michigan 2.08 2.28 -0.20 2.15 2.32 -0.17
Missouri 1.06 1.27 -0.21 1.06 1.26 -0.20
Nebraska 1.12 1.25 -0.13 1.12 1.26 -0.14
South Dakota 1.15 1.33 -0.18 1.15 1.33 -0.18
Virginia 1.16 1.30 -0.13 0.99 0.97 NA
Wisconsin 1.01 1.16 -0.15 1.00 1.16 -0.16

a The U.S. Department of Education definition of a significant reduction being at least 0.1 percentage points was used here.

We asked volunteer states in the NCEO 1% Cap CoP to provide us with information they believed was relevant to their success in decreasing the state-level participation rate. In this report, we provide information shared by Arkansas, Massachusetts, Michigan, Nebraska, and Wisconsin.


State Spotlights

States are using a variety of approaches to reduce their state-level AA-AAAS participation rates. The five states we showcased here were included because they reduced their rates more than 0.1 percentage points in at least one subject area and provided us with information on their strategies, challenges, resources, and plans for the future.

Arkansas

Data

Arkansas showed a decrease in percentage points of 0.16 in reading/language arts and 0.17 in mathematics from 2016-17 to 2017-18. Arkansas started in 2016-17 with participation rates of 1.37% in reading/language arts and 1.38% in mathematics for its alternate assessment, the Arkansas Alternate Assessment.

Strategies

Arkansas engaged in two general strategies to work on its AA-AAAS participation rates: (a) focused training, and (b) tier-based training and technical assistance. The specific approaches that Arkansas used under each of these general strategies are listed here.

Focused Training

Tier-based Training and Technical Assistance

Arkansas brought in a five- to six-member team for at least a full day for folder review of two large districts. A report was created and shared back with the districts. The review was conducted student by student, and when needed, a suggestion was made that the IEP teams review decisions.

Challenges

Arkansas identified a few challenges that it had encountered as it worked to reduce state-level participation rates in the Arkansas Alternate Assessment.

Resources

Arkansas has made numerous resources available. Some were used during training. Others were also posted online. Some of these resources are listed here:

Plans for the Future

 

Massachusetts

Data

Massachusetts reduced AA-AAAS participation by 0.11 percentage points in both reading/language arts and mathematics between the 2016-2017 and 2017-2018 school years, after starting 2016-17 with a relatively high alternate assessment participation rate of 1.56% in reading/language arts and 1.58% in mathematics.

Strategies

Massachusetts undertook two general strategies to work to reduce its AA-AAAS participation rates: (a) work directly with the highest-percentage districts, and (b) clarify participation guidelines to help IEP teams make appropriate assessment participation decisions. The specific approaches used by Massachusetts for each of these general strategies are listed here.

Work Directly with Districts

Help IEP Teams Make Appropriate Decisions

Challenges

Massachusetts noted some challenges:

Resources

Three tools that Massachusetts provides to its districts are listed here and included in Appendix A.

Massachusetts used the data displays to focus on comparisons between the district and state, highlighting areas in need of further reflection and investigation by the district.

The data displays Massachusetts shared with districts show information based on the following metrics (see Appendix A):

Plans for the Future

Massachusetts indicated that it expects to continue decreasing its statewide percent over the next 2-3 years, as long as it maintains technical assistance and pressure on districts. However, the rate of decrease will likely diminish over time since most of the likely candidates for re-designation have already been removed from the alternate assessment. The state would need to re-designate an additional 2,000 of 7,000 students now participating in the AA-AAAS for it to reach one percent, which may not be possible or realistic. Massachusetts will continue to target specific districts for individualized site visits and assistance, plus send out annual letters requesting justification and other information if the district will continue to exceed one percent in the coming year.

Despite concerns about future rates of decrease in AA-AAS participation, Massachusetts has reported a decrease from 1.6 percent in 2017-2018 to 1.4 percent in 2018-2019, a reduction of about 1,000 students taking alternate assessments over the past two school years.

 

Michigan

Data

Michigan showed a decrease in percentage points of 0.20 in reading/language arts, from 2.28 in 2016-17 to 2.08 in 2017-18. It also showed a decrease of 0.17 percentage points in mathematics, from 2.32 in 2016-17 to 2.15 in 2017-18.

Strategies

Michigan employed several strategies to reduce the state-level participation rate in the AA-AAAS, as listed here.

Challenges

Michigan identified several challenges that it had encountered, including the following:

Resources

Michigan has resources that are publicly available, as noted here. In addition, three resources are provided in Appendix B.

Michigan noted that in addition to its significant change in AA-AAAS participation rates from 2016-17 to 2017-18, it has projected its rates for 2018-19 (see Display in Appendix B), as follows:

Plans for the Future

 

Nebraska

Data

Nebraska saw a decrease in AA-AAAS reading/language arts participation rates from 1.25% in 2016-17 to 1.12% in 2017-2018 (a 0.13 percentage point decrease), and a decrease in AA-AAAS mathematics participation rates from 1.26% in 2016-17 to 1.12% in 2018 (a 0.14 percentage point decrease).

Strategies

Nebraska identified several strategies that it has used to support the reduction in AA-AAAS participation rates, as noted here:

Challenges

Nebraska identified several challenges it is addressing as it works to reduce the state’s alternate participation rate:

Resources

Nebraska has developed many resources. The ones listed here are available in Appendix C.

Plans for the Future

 

Wisconsin

Data

Wisconsin showed a decrease in percentage points of 0.15 in reading/language arts and 0.16 in mathematics from 2016-17 to 2017-18. Wisconsin’s alternate assessment participation rates in 2016 were 1.16 in both reading/language arts mathematics.

Strategies

Wisconsin undertook a number of strategies to work on its alternate assessment participation rates. These strategies were:

Challenges

Wisconsin has addressed several challenges in its work to lower AA-AAAS participation rates.

Resources

Wisconsin has made the following resources available:

Plans for the Future

Wisconsin reported that the state did see a decrease in AA-AAAS participation rates from 1.0% in 2017-18 to 0.9% in 2018-19.

New for 2019-20:


Additional Considerations

What is Substantial Progress?

In 2019 the U.S. Department of Education established that substantive progress is defined as having at least a 0.1 percentage point decrease in the percentage of alternate assessment participation for a subject area. Although this report highlights five states that met this criterion in both reading/language arts and mathematics, other states in the NCEO 1% Community of Practice shared evidence of progress in their plans, strategies, guidance, timelines, and district oversight activities, along with their expectation that these efforts would lead to reductions in AA-AAAS participation rates in the future. Examples include Idaho’s initiative to update its participation criteria and provide intensive technical assistance to districts with high participation rates. Another example is Kentucky’s requirement for mandatory participation in online statewide training modules for administrators and educators with a training emphasis on IEP simulation using student case scenarios.

95% Assessment Participation Requirement

Some states are grappling with their assessment participation rates for all students and for students with disabilities. States that wish to apply for a waiver or waiver extension (if the state expects to exceed the 1.0% AA-AAAS participation threshold) must meet this requirement [§200.6(c)(4)(ii)] in order to be approved for a waiver or waiver extension. Opting out movements in some states have contributed to the state’s inability to meet the 95% participation rate requirements. There is currently little to no guidance, research, or best practices to help states address this problem. Nevertheless, it will undoubtedly receive more attention in the future.

Meeting the 1.0% Threshold in the Science AA-AAAS

The U.S. Department of Education’s 1.0% threshold requirements apply to reading, math, and science. Some states are finding it more difficult to meet the threshold in science. Education leaders have suggested that a history of exclusion of students with disabilities from science coursework has contributed to this issue.


Conclusion

As states continue to address the requirements of meeting the 1.0% threshold in the AA-AAAS they find the NCEO 1% Community of Practice state sharing of approaches, ideas, questions, discussion, and resources to be an invaluable support to the 1.0% work in their own state. The 1% CoP and NCEO’s sharing of state spotlights to highlight successes (through this and future reports) hopefully will continue to contribute to states’ efforts to address AA-AAAS participation rates.


Appendix A

Arkansas Resources

Arkansas Resource 1: Selected Slides (identified as Examples A, B, and C) from PowerPoint Training and Link to the training is at http://dese.ade.arkansas.gov/divisions/learning-services/special-education/presentations. Select the last item on the page to view the video.

Slide A Example:

Slide A Example
Slide A Example: Definition: Students with the Most Significant Cognitive Disabilities

 

Slide B Example:

Slide B Example

 

Slide C Example:

Slide C Example

 

Arkansas Resource 2: Guidance for IEP Teams at http://dese.ade.arkansas.gov/public/
userfiles/Learning_Services/Student%20 Assessment/DLM/Guidance_for_IEP_
Teams_on_Alternate_Assessment_2018-2019.pdf

Arkansas Resource 2: Guidance for IEP Teams

Arkansas Resource 3: Arkansas Participation Guidelines at
http://adecm.arkansas.gov/ Attachments/LS-16-084 ArkansasAlternate Assessment
ParticipationDecisionGuidelines.pdf

Arkansas Resource 3: Arkansas Participation Guidelines

Arkansas Resource 3: Arkansas Participation Guidelines

Arkansas Resource 3: Arkansas Participation Guidelines

Arkansas Resource 4: List of Arkansas Districts Over the 1.0% Threshold at
Districts required to provide justifications for alternate assessment participation rates

Image58896.PNG

Arkansas Resource 5: LEA Justification Documentation:
LEA Alternate Assessment Justification Documentation

Arkansas Resource 5: LEA Justification Documentation

Appendix B

Massachusetts Resources

Massachusetts Resource 1: Decision-Making Tool

Massachusetts Resource 1: Decision-Making Tool

Massachusetts Resource 2: 2019 MCAS-Alt by Disability

Massachusetts Resource 2: 2019 MCAS-Alt by Disability

Massachusetts Resource 3: Sample MCAS-Alt District Data Display

Massachusetts Resource 3: Sample MCAS-Alt District Data Display

Appendix C

Michigan Resources

Michigan Resource 1: Assessment Selection Guidelines Training at
https://mdoe.state.mi.us/mdedocuments/AssessmentSelectionGuidelinesTraining/index.html

Michigan Resource 1: Assessment Selection Guidelines Training

Michigan Resource 2: Flow Chart, “Should My Student Take the Alternate Assessment?” at
https://www.michigan.gov/documents/mde/Should_My_Student_Take_
the_Alternate_Assessment_556705_7.pdf

Michigan Resource 2: Flow Chart, “Should My Student Take the Alternate Assessment?”

Michigan Resource 3: Interactive Decision-Making Tool at
https://mdoe.state.mi.us/MDEDocuments/InteractiveDecision-MakingTool/index.html

Michigan Resource 3: Interactive Decision-Making Tool

 

Michigan Resource 4: Data Display: 1% Cap – Where is Michigan Now?

 

Spring 2017

Spring 2018

Spring 2019

Subject

Percent

Count

Percent

Count

Percent

Count

ELA

2.28

17,867

2.08

15,875

1.97

14,825

Mathematics

2.32

18,151

2.15

16,388

2.02

15,179

 

Subject

Percent Change

Count change

ELA

-0.31

-3,042

Mathematics

-0.30

-2,972


Appendix D

Nebraska Resources

Nebraska Resource 1: Letter to Superintendents and Special Education Directors

Nebraska Resource 1: Letter to Superintendents and Special Education Directors

Nebraska Resource 2: District Justification Form

https://www.education.ne.gov/assessment/nscas-alternate-summative-assessment/#1574203734112-50356b4d-9bc8. See NSCAS Alternate Documents.

District Justification Form

District Justification Form, continued

District Justification Form, continued

Nebraska Resource 3: District Justification Support Worksheet at
https://www.education.ne.gov/assessment/nscas-alternate-summative
-assessment/#1574203734112-50356b4d-9bc8.

See NSCAS Alternate Documents.

Nebraska Resource 3: District Justification Support Worksheet

District Justification Support Worksheet, continued

District Justification Support Worksheet, continued
District Justification Support Worksheet, continued

Nebraska Resource 4: Data Projections

Participation Data
NSCAS Alternate Assessment
  2017 2018 2019 2020
Projections
  Number Percent Number Percent Number Percent Number
ELA 2054 1.27 1833 1.12 1716 1.04 1778
MATH 2058 1.27 1831 1.12 1715 1.04 1778
SCIENCE 892 1.30 817 1.19 733 1.04 785

Nebraska Resource 5: Nebraska Definition of "Significant Cognitive Disability"

Nebraska Resource 6: Engaging Educators Training (this will be on Nebraska’s website soon)

Selected slides are shown below, labeled as A. B. and C.

Slide A Example:

Nebraska Resource 6: Engaging Educators Training - Slide A example

Slide B Example:

Nebraska Resource 6: Engaging Educators Training - Slide B example

Slide C Example

Slide C Example

Nebraska Resource 7: Nebraska Department of Education: Training PowerPoint for Alternate Assessment (this will be on Nebraska’s website soon)

Selected slides are shown below, labeled as A. B. and C.

Slide A Example:

Nebraska Resource 7: Nebraska Department of Education: Training PowerPoint for Alternate Assessment  - Slade A example

Slide B Example:

Slide B Example

Slide C Example:

Nebraska Resource 7: Nebraska Department of Education: Training PowerPoint for Alternate Assessment  - Slade C example

Appendix E

Wisconsin Resources

Wisconsin Resource 1: IEP forms I-7A Participation Guidelines for Alternate Assessment
This resource may be accessed at Participation Guidelines for Alternate Assessment.

Wisconsin Resource 1: IEP forms I-7A Participation Guidelines for Alternate Assessment

IEP forms I-7A Participation Guidelines for Alternate Assessment, continued

IEP forms I-7A Participation Guidelines for Alternate Assessment, continued

Wisconsin Resource 2: Guide to Determining Students with the Most Significant Cognitive Disability: This resource may be accessed at: https://dpi.wi.gov/sites/default/files/imce/sped/pdf/mscd-guide-to-determining-students-with-mscd.pdf

Wisconsin Resource 2: Guide to Determining Students with the Most Significant Cognitive Disability
Wisconsin Resource 2: Guide to Determining Students with the Most Significant Cognitive Disability
Wisconsin Resource 2: Guide to Determining Students with the Most Significant Cognitive Disability

Wisconsin Resource 3: Webpage, Students with a Most Significant Cognitive Disability at https://dpi.wi.gov/sped/program/students-most-significant-cognitive-disabilities

Wisconsin Resource 3: Webpage, Students with a Most Significant Cognitive Disability