2017-2018 APR Snapshot #24:
AA-AAAS Participation and Performance

Yi-Chen Wu, Sheryl S. Lazarus, and Kristin K. Liu

January 2021

All rights reserved. Any or all portions of this document may be reproduced and distributed without prior permission, provided the source is cited as:

Wu, Y.-C., Lazarus, S. S., & Liu, K. K. (2021). 2017-2018 APR snapshot #24: AA-AAAS participation and performance. Minneapolis, MN: University of Minnesota, National Center on Educational Outcomes.


Table of Contents

 

Background

An Alternate Assessment based on Alternate Academic Achievement Standards (AA-AAAS) has been developed by each state to measure the academic achievement of students with significant cognitive disabilities. This brief summarizes AA-AAAS data used for Elementary and Secondary Education Act (ESEA) accountability. Using federally submitted data for the 2017-2018 school year, we present information on the number of students participating in the AA-AAAS and the performance of those students.

We present data for the 50 regular states as well as the 10 unique states (American Samoa, Bureau of Indian Education, District of Columbia, Federated States of Micronesia, Guam, Northern Marianas, Puerto Rico, Republic of Palau, Republic of The Marshall Islands, and Virgin Islands). Figures displaying statewide assessment data for other grades are provided in this report following each figure. Data tables for all grade levels are available at nceo.info/Resources/publications/APRsnapshot/data.

AA-AAAS participation and performance data for 47 states are reported in this brief; three states’ data were not available for this analysis because data were not reported. Participation and performance data for grade 8 (or grades 4 and 8) are presented in this brief; figures displaying data for other grades are provided in this report following each figure. Data tables for all grades are available at nceo.info/Resources/publications/APRsnapshot/data.

Calculations for this brief used only data available through state-submitted Annual Performance Reports (APRs). Two types of participation rates and one proficiency rate were calculated for this brief. One of the participation rates used the number of enrolled students with disabilities as the denominator, and the other one used the number of total tested students as the denominator. The denominator for the proficiency rate was the number of students with disabilities who participated in the AA-AAAS. The number of enrolled students was calculated by adding together the number of students with disabilities participating in each of a state’s assessments, plus any students with medical exemptions and any students who did not participate in an assessment. Typically, the state assessments included the regular assessment and the AA-AAAS. The number of enrolled students with disabilities was calculated separately for reading and mathematics assessments for each grade.

Throughout this brief, we use the term “students with disabilities” to refer to students receiving special education services. Thus, students on 504 accommodation plans are not included in these analyses.

Table of Contents

 

Data

Participation and proficiency rates for reading and mathematics AA-AAAS were calculated by content area and state (including regular states and unique states) at all grade levels for students with disabilities and for the total population. For each state, there were four possible data circumstances for each content area for both the general assessment and AA-AAAS from the IDEA data set (https://www2.ed.gov/programs/osepidea/618-data/state-level-data-files/part-b-data/assessment/bassessment2017-18.csv). These conditions were: (a) data were not available; (b) data were reported; (c) data were reported but were suppressed for data quality concerns; and (d) data were reported but were suppressed because of the small number of students. States were excluded from our analysis if they met one of the following criteria:

  1. The participation or the performance data were excluded due to quality concerns or small cell sizes identified by the U.S. Department of Education,
  2. The state’s participation information for the general assessment was not available (meaning that AA-AAAS participation information, even though available, was excluded (this criterion only applied to calculations based on students with disabilities).
  3. The state’s participation data were not available (meaning that the state’s proficiency data were also excluded).
  4. The state did not have data for all grades (grades 3-8 and high school) (this criterion only applied to calculations based on total enrollment).

In addition, we made additional decisions when data were incomplete. First, assessment participation percentages were only calculated for states that had both general assessment and AA-AAAS participation data for a particular content area. Second, if a state provided assessment participation data for both the general and AA-AAAS, but only provided proficiency information for one of the two assessments, we calculated the overall proficiency rate based on that assessment. All of these results are included in this brief, but only results of 8th graders are highlighted in detail as an example.

Table of Contents

 

Findings

Participation

AA-AAAS participation based on students with disabilities

Regular States

Forty-seven regular states reported data on both reading and math AA-AAAS participation, and 48 states reported data on math AA-AAAS. Two states were excluded from this brief because they had no data available for both reading and math assessments. The general reading assessment data from another state were suppressed due to data quality concerns, so the AA-AAAS participation data were not calculated for this state’s reading AA-AAAS. Thus, in this brief 47 states were included in the reading AA-AAAS participation rates and 48 states were included in the math AA-AAAS participation rates based on students with disabilities.

Overall statewide participation in the grade 8 reading AA-AAAS, based on the number of students with disabilities, in 47 regular states is presented in Figure 1. For the majority of states (n = 33), less than 10% of all students with disabilities took the AA-AAAS in 2017-2018. Similar participation rates existed for grade 8 mathematics AA-AAAS (n = 34).

Figure 1. Participation Rates for Grade 8 Reading AA-AAAS (Based on Students with Disabilities) in Regular States (N = 47)

Figure 1 Bar Chart

Reading: Grades 3 - 7 and High School. Click the images to enlarge.

Image2633.PNG Image2642.PNG Image2650.PNG Image2659.PNG Image2667.PNG Image2677.PNG
Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade HS

Mathematics: Grades 3 - High School. Click images to enlarge.

Image2698.PNG Image2706.PNG Image2716.PNG Image2725.PNG
Grade 3 Grade 4 Grade 5 Grade 6
Image2733.PNG Image2742.PNG Image2750.PNG
Grade 7 Grade 8 Grade HS

 

Unique States

Reading AA-AAAS participation rates in unique states that reported data greater than zero for both grade 8 regular reading assessments and reading AA-AAAS (n = 5) are presented in Figure 2. The reading participation rates varied from 2.6% to 21.9% of students with disabilities (also 2.6% to 21.9% for math AA-AAAS). Data for the unique states are available at nceo.info/Resources/publications/APRsnapshot/data.

Figure 2. Participation Rates for Grade 8 Reading AA-AAAS (Based on Students with Disabilities) in Unique States (N = 5)

Figure 2 Bar Chart

Reading: Grades 3 - 7 and High School. Click the images to enlarge.

Image2773.PNG Image2782.PNG Image2792.PNG Image2805.PNG Image2814.PNG Image2823.PNG
Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade HS

Mathematics: Grades 3 - High School. Click images to enlarge.

Image2845.PNG Image2855.PNG Image2864.PNG Image2875.PNG
Grade 3 Grade 4 Grade 5 Grade 6
Image2885.PNG Image2893.PNG Image2903.PNG
Grade 7 Grade 8 Grade HS

 

AA-AAAS participation based on total tested students

Regular States

States varied in their rates of students receiving special education services, from 8.3% to 16.5% of the total student population,1 so it is important to look at participation rates based on the total student population as well. To be consistent with federal requirements for calculating participation in the AA-AAAS, the analysis was based on the number of test takers with valid scores (total tested) at each grade level; these numbers were obtained from the U.S. Department of Education.

The rates of total tested students participating in the AA-AAAS for the grade 8 reading AA-AAAS in 47 regular states are presented in Figure 3. States typically assessed less than 2 percent of their total tested student population (which included both students with disabilities and students without disabilities) for the reading AA-AAAS; only about one-seventh of states (n = 7) were below 1 percent. Similar participation rates existed for grade 8 mathematics AA-AAAS when viewed in terms of the total tested student population; one out of every seven states (n = 7) was below 1 percent.

Figure 3. Participation Rates for Grade 8 Reading AA-AAAS (Based on Total Tested Grade 8 Students) in Regular States (N = 47)

Figure 3 Bar Chart

Reading: Grades 3 - 7 and High School. Click the images to enlarge.

Image2927.PNG Image2940.PNG Image2950.PNG Image2959.PNG Image2970.PNG Image2979.PNG
Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade HS

Mathematics: Grades 3 - High School. Click images to enlarge.

Image2998.PNG Image3008.PNG Image3017.PNG Image3025.PNG
Grade 3 Grade 4 Grade 5 Grade 6
Image3034.PNG Image3044.PNG Image3057.PNG
Grade 7 Grade 8 Grade HS

 

Unique States

Participation rates in unique states (n = 5) that reported data greater than zero students participating in both the grade 8 general reading assessment and reading AA-AAAS are presented in Figure 4. The denominator is the number of test takers with valid scores. These unique states reported participation rates ranging from as low as 0.8% to as high as 23.7% for both reading and math AA-AAAS. Data for the unique states are included in data tables available at nceo.info/Resources/publications/APRsnapshot/data.

Figure 4. Participation Rates for Grade 8 Reading AA-AAAS (Based on Total Tested Grade 8 Students) in Unique States (N = 5)

Figure 4 Bar Chart

Reading Grades 3 - 7 and High School. Click the images to enlarge.

Image3082.PNG Image3091.PNG Image3102.PNG Image3111.PNG Image3121.PNG Image3130.PNG
Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade HS

Mathematics: Grades 3 - High School. Click images to enlarge.

Image3151.PNG Image3159.PNG Image3168.PNG Image3178.PNG
Grade 3 Grade 4 Grade 5 Grade 6
Image3192.PNG Image3201.PNG Image3210.PNG
Grade 7 Grade 8 Grade HS

 

AA-AAAS participation grade comparisons based on total tested students

Regular States

Figure 5 shows reading AA-AAAS participation rates (based on the total tested population of all students) for grade 4 and grade 8 in regular states. Forty-seven states reported reading AA-AAAS for both grades 4 and 8. Across these states, an average of 1.2 percent of the total population of students participated in the AA-AAAS at grade 4 and 1.3 percent at grade 8. Differences between these two grades did not show any consistent trends. The majority of states (n = 18) reported higher rates in grade 4 than in grade 8. More than half of the states (n = 29) reported higher rates in grade 8 than in grade 4.

Figure 5. Participation Rates for Reading AA-AAAS (Based on Total Tested Students) in Grades 4 and 8 in Regular States (N = 47)

Figure 5 Chart

Reading: Grades 4 & 8 vs. High School. Click the images to enlarge.

Image3236.PNG

Image3247.PNG

Grade 4 vs HS Grade 8 vs HS

Mathematics: Grades 4 vs. 8, 4 vs. High School, and 8 vs High School. Click images to enlarge.

Image3266.PNG Image3275.PNG Image3284.PNG
Grade 4 vs 8 Grade 4 vs HS Grade 8 vs HS

 

Unique States

Four unique states reported more than zero students with disabilities participating in both the regular reading assessment and the reading AA-AAAS at grades 4 and 8. The majority of unique states (n = 3) showed a slightly higher participation rate (based on the total tested population) in grade 4 than in grade 8. The other unique state reported higher participation rates in grade 8 than in grade 4.

Figure 6. Participation Rates for Reading AA-AAAS (Based on Total Tested Students) in Grades 4 and 8 in Unique States (N = 4)

Figure 6 Chart

Reading: Grades 4 & 8 vs. High School. Click the images to enlarge.

Image3305.PNG Image3314.PNG
Grade 4 vs HS Grade 8 vs HS

Mathematics: Grades 4 vs. 8, 4 &8 vs. High School. Click images to enlarge.

Image3334.PNG Image3350.PNG Image3359.PNG
Grade 4 vs 8 Grade 4 vs HS Grade 8 vs HS

 

AA-AAAS participation across grades based on total tested students

The 1% cap on participation in the AA-AAAS required by the Every Student Succeeds Act (ESSA) is to be calculated by content across all tested grades.2 In this analysis, we examine not only the total participation rate across grade levels (grades 3-8 and high school; see Figure 7 and 8) but also the contribution of each grade to the total participation rate based on all test takers (see Figures 9 and 10).

AA-AAAS data from 47 regular states are included in this analysis of participation rates in the reading AA-AAAS at grades 3-8 and high school. Three states’ data were excluded: one state’s data were suppressed due to data quality issues; the other states’ data were excluded because no data were reported. Figure 7 shows the participation rates of students participating in the reading AA-AAAS in the regular states. Only twelve states reported a participation rate that was less than 1%. The average rate across the states was 1.2%, with a range of 0.8% to 2.1%. Similar participation rates existed for mathematics AA-AAAS (see Figure 8).

Figure 7. Overall Participation Rates for Reading AA-AAAS Across All Grade Levels (Based on Total Tested Students)

Figure 7 Bar Chart

Figure 8. Overall Participation Rates for Math AA-AAAS Across All Grade Levels (Based on Total Tested Students)

Figure 8 Bar Chart

Figure 9. Overall Participation Rates for Reading AA-AAAS by Grade Level (Based on Total Tested Students)

Figure 9 Bar Chart

Figure 10. Overall Participation Rates for Reading AA-AAAS by Grade Level (Based on Total Tested Students)

Figure 10 Bar Chart

Table of Contents

 

Proficiency

AA-AAAS proficiency

Regular States

AA-AAAS data from 44 regular states were included in this analysis of proficiency for reading and 45 states for math assessments at grade 8. Data from four states were not included in Figure 9 because data were suppressed either because of data quality issues or small cell sizes.

Figure 11 shows the rates of students participating in the reading AA-AAAS who were proficient or above in grade 8 in the regular states. The denominator is the number of students who participated in the AA-AAAS and the numerator is the number of students who participated in the AA-AAAS and scored at or above proficient. Proficiency rates ranged from 13.2% to 93.7% of students participating in the AA-AAAS. In three states, more than 90% of the students participating in the AA-AAAS were proficient or above. In eight states, less than 30% of students who participated in the AA-AAAS were considered proficient.

Figure 11. Proficiency Rates for Grade 8 Reading AA-AAAS in Regular States (N = 44)

Figure 11 Chart

Reading: Grades 3 - 7 and High School. Click the images to enlarge.

Image3388.PNG Image3398.PNG Image3407.PNG Image3416.PNG Image3425.PNG Image3434.PNG
Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade HS

Mathematics: Grades 3 - High School. Click images to enlarge.

Image3454.PNG Image3464.PNG Image3476.PNG Image3489.PNG
Grade 3 Grade 4 Grade 5 Grade 6
Image3499.PNG Image3508.PNG Image3518.PNG
Grade 7 Grade 8 Grade HS

 

Unique States

Rates of students proficient or above on the reading AA-AAAS in unique states for grade 8 are presented in Figure 12. Three unique states reported proficiency rates for students in grade 8 for reading, and four unique states reported proficiency rates in math. In reading, rates of students with disabilities proficient or above varied from 35.7% to 48.4%, while the rates of students proficient or above in math varied from 21.1% to 71.4%. Proficiency data for the unique states are available at nceo.info/Resources/publications/APRsnapshot/data.

Figure 12. Proficiency Rates for Grade 8 Reading AA-AAAS in Unique States (N=3)

Figure 12 Bar Chart

Reading: Grades 3 – 7 and High School. Click the images to enlarge.

Image3544.PNG Image3556.PNG Image3565.PNG Image3574.PNG Image3583.PNG Image3593.PNG
Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade HS

Mathematics: Grades 3 - High School. Click images to enlarge.

Image3614.PNG Image3628.PNG Image3638.PNG Image3647.PNG
Grade 3 Grade 4 Grade 5 Grade 6
Image3657.PNG Image3666.PNG Image3675.PNG
Grade 7 Grade 8 Grade HS

 

Grade level comparisons of percent proficient

Regular States

Figure 13 provides a comparison of the percentage of students proficient on the AA-AAAS in grade 8 for reading and mathematics in regular states. This figure shows states ordered by proficiency rates for math AA-AAAS from high to low. Forty-three states reported proficiency data for both reading and math assessments. A majority of states (n = 31) reported higher proficiency rates for the reading AA-AAAS compared to the math AA-AAAS; 12 states had higher rates of proficiency on the math AA-AAAS.

Figure 13. Proficiency Rates for Grade 8 Reading and Math AA-AAAS in Regular States (N = 43)

Figure 13 Chart

Grades 3 - 7 and High School. Click the images to enlarge.

Image3699.PNG Image3708.PNG Image3716.PNG Image3725.PNG Image3736.PNG Image3750.PNG
Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade HS

 

Unique States

A comparison of the percentage of students proficient on the AA-AAAS in grade 8 in unique states for reading and mathematics is shown in Figure 14. Three of 10 unique states reported proficiency rates for both reading and math in grade 8. Two unique states showed a higher proficiency rate for math compared to reading, and the other state showed a higher proficiency rate for reading compared to math.

Figure 14. Proficiency Rates for Grade 8 Reading and Math AA-AAAS in Unique States

Figure 14 Bar Chart

Grades 3 – 5, 7, 8, and High School. Click the images to enlarge.

Image3771.PNG Image3781.PNG Image3791.PNG Image3800.PNG Image3809.PNG Image3818.PNG
Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade HS

 

Endnotes

1 The percentage of students in special education was calculated by dividing the number of students with disabilities ages 6-21 (https://www2.ed.gov/programs/osepidea/618-data/state-level-data-files/part-b-data/child-count-and-educational-environments/bchildcountandedenvironments2017-18.csv) by the number of students in K-12 enrollment from ELSi (https://nces.ed.gov/ccd/elsi/tableGenerator.aspx).

2 ESSA indicates that the calculation is based on the number of total tested students.

Table of Contents

 

Conclusions

The data presented in this report represent a snapshot of the participation and performance of students with disabilities who participate in the Alternate Assessment based on Alternate Achievement Standards (AA-AAAS). To some extent, variability in the participation and performance rates reflects the differences in the states’ AA-AAAS themselves, including where the proficient cuts were set.

The participation rates described in this report are provided in two ways: (1) based on the total number of students with disabilities in a grade for each content area; and (2) based on the total tested population in a grade for each content area. Participation rates under each approach were fairly consistent across states. Participation rates for the AA-AAAS tend to be higher than one percent of the total tested population of students (or about 10 percent of all students with disabilities).

Proficiency rates were extremely variable across states, with most states having quite high rates of students in the AA-AAAS deemed proficient or above. Still, the rates do not appear to be influenced by the percentage of students participating in the AA-AAAS. Proficiency rates tended to be slightly higher for reading compared to mathematics.

According to the U.S. Department of Education (Quenemoen & Thurlow, 2007), holding students who participate in the AA-AAAS to high expectations greatly increases the learning opportunities provided to those students (see also Quenemoen & Thurlow, 2019; Thurlow & Quenemoen, 2019). It is important to keep these expectations in mind when examining proficiency rates of students with significant cognitive disabilities compared to proficiency rates of students with disabilities on the regular assessment (see Thurlow & Wu, 2016, 2018; Wu & Thurlow, 2017).

Table of Contents

 

Resources

Kearns, J. F., Towles-Reeves, E, Kleinert, H. L, Kleinert, J. O., & Thomas, M. K. (2011). Characteristics of and implications for students participating in alternate assessments based on alternate achievement standards. Journal of Special Education, 45(1), 3-14.

Quenemoen, R. (2008). A brief history of alternate assessments based on alternate achievement standards (Synthesis Report 68). Minneapolis, MN: University of Minnesota, National Center on Educational Outcomes.

Quenemoen, R., & Thurlow, M. (2007). Learning opportunities for your child through alternate assessments. Washington, DC: U.S. Department of Education, Office of Special Education and Rehabilitative Services. 

Quenemoen, R. F., & Thurlow, M. L. (2019). Students with disabilities in educational policy, practice, and professional judgment: What should we expect? (NCEO Report 413). Minneapolis, MN: University of Minnesota, National Center on Educational Outcomes.

Thurlow, M. L., & Quenemoen, R. F. (2019). Revising expectations for students with disabilities (NCEO Brief 17). Minneapolis, MN: University of Minnesota, National Center on Educational Outcomes.

Thurlow, M., & Y.-C. Wu (2016). 2013-2014. APR snapshot #12: State assessment participation and performance of students receiving special education services. Minneapolis, MN: University of Minnesota, National Center on Educational Outcomes.

Thurlow, M., & Y.-C. Wu (2018). 2015-2016. APR snapshot #18: State assessment participation and performance of students receiving special education services. Minneapolis, MN: University of Minnesota, National Center on Educational Outcomes.

Thurlow, M. L., Wu, Y., Quenemoen, R. F., & Towles, E. (2016). Characteristics of students with significant cognitive disabilities (NCSC Brief #8). Minneapolis, MN: University of Minnesota, National Center and State Collaborative.

Wu, Y.-C., & Thurlow, M. (2017). 2014-2015. APR snapshot #15: State assessment participation and performance of students receiving special education services. Minneapolis, MN: University of Minnesota, National Center on Educational Outcomes.

Wu, Y.-C., Thurlow, M. L., Albus, D. A., & Liu, K. (2019). Percent of Students with Disabilities by Disability Category for 2005-06 to 2016-17 (Data Analytics #8). Minneapolis MN: University of Minnesota, National Center on Educational Outcomes.