Testing Students with Disabilities Special Education Administrators Spring

Testing Students with Disabilities Special Education Administrators Spring Conference March 24, 2011

Office of Assessment Suzanne Swaffield Douglas Alexander Chris Webster

South Carolina Assessments

Top 10 Testing Quotes from 2010 10. “Johnny broke his wrist last night. Can he use dictation for the writing test? ” 9. “We didn’t like the way the man was signing on the DVD, so we just turned it off and signed it ourselves. ” 8. “The CD-ROMs didn’t read all of the answer choices, so the TA read them to the student. ” 7. “I thought cueing meant that I could rephrase the questions. ” 6. “ We ran out of CD-ROMs, so we just read all of the questions and all of the answers to the student. ”

Top 10 Testing Quotes (cont. ) 5. “She refused to spell every third word in her writing composition. ” 4. “The teacher let them use the computer for the writing test and forgot to disable spell-check. ” 3. “ We didn’t order test booklets for the students using CD-ROMs. ” 2. “They were not supposed to get an oral administration, but the teacher read it to them anyway. ” 1. “He was supposed to get an oral administration, but we forgot!”

Test Security Violations 60 to 70 percent of all test security violations relate to testing students with disabilities.

Resources

Accommodations Manual The five-step process : q STEP 1: Expect students with disabilities to achieve grade-level academic content standards q STEP 2: Learn about accommodations for instruction and assessment q STEP 3: Select accommodations for instruction and assessment for individual students q STEP 4: Administer accommodations for instruction and assessment q STEP 5: Evaluate and improve use of accommodations

Accommodations Manual http: //ed. sc. gov/agency/Accountabi lity/Assessment/old/assessment/pro grams/amc/documents/Accom. Manu al. Jan 11. pdf

Accommodations Selection Process (Acc. Sel. Pro) A research-based Web tool designed by the SCDE through the AVAAD Enhanced Assessment Grant to assist IEP and 504 plan teams with making appropriate decisions regarding individual student accommodations. www. accselpro. org

Test Administration Manuals Appendix C: Testing Students with Disabilities Appendix D: ESOL/LEP Students http: //ed. sc. gov/agency/Accountability/A ssessment/

Customized Materials ¡ Order customized materials including oral administration CDs and any scripts for a specific student through pre-code. ¡ Order oral administration scripts per test administrator through on-line enrollment.

Alternate Assessments on Alternate Achievement Standards (AA-AAS) 1% Assessments – No more than one percent of all students assessed can be counted as proficient for AYP on AA-AAS. SC-Alt is the state assessment on alternate achievement standards.

Alternate Assessment on Modified Achievement Standards (AA-MAS) 2% Assessments. No more than two percent of all students assessed can be counted as proficient for AYP on AA-MAS.

Use of Accommodations and Performance of Students with Disabilities on PASS 2010

Participation of Students with Disabilities in Statewide Testing ¡ 43, 257 students with disabilities (SWD) were tested in grades 3 -8 in 2010 (includes PASS and SC-Alt students) ¡ SWD made up 13. 4% of all students tested in grades 3 -8 ¡ 6. 0% of SWD were tested with SC-Alt ¡ The number of students tested with SC-Alt was 0. 8% of all students tested with PASS and SC-Alt (SWD and Non-SWD)

Standard Accommodations All Content Areas Grades 3 -8 with Exceptions Noted ¡ ¡ Setting Timing Scheduling Oral or Signed Administration l ¡ Use of calculator with Math l ¡ ¡ (except ELA grades 3 -4) (except grades 3 -4) Response Options Supplementary Materials or Devices

Non-Standard Accommodations ¡ Oral Administration of ELA Grades 3 -4 ¡ Writing Extended Response –Non-standard Procedures Use of spell check, grammar check, word prediction software ¡ Use of calculator in math Grades 3 -4

Use of Accommodations with PASS 2010 Percent of SWD Students Using: Content Area Any Accom. Oral/ Signed Admin Calculator Non. Standard Accom ELA 61. 9 24. 9 1. 4 Writing 61. 6 40. 8 0. 1 Math 63. 9 49. 5 Science 62. 0 49. 5 Social Studies 61. 6 49. 4 14. 4 0. 1

Six-year Trends for Oral Administration of ELA and Calculator Use with PACT/PASS Oral Administration 20. 0% in 2005 26. 3% in 2006 26. 2% in 2007 26. 6% in 2008 30. 7% in 2009 24. 9% in 2010 Calculator Use 8. 6% in 2005 11. 7% in 2006 14. 3% in 2007 15. 7% in 2008 15. 0% in 2009 14. 4% in 2010

Use of Oral Administration with ELA ¡ 24. 9% of all SWD students received oral administrations for PASS ELA in 2010. ¡ Oral administrations were predominantly in grades 5 -8 where they are standard accommodations. ¡ The overall rate of oral administrations for grades 5 -8 was 37. 2%.

Percent of SWD Receiving Oral Administration of ELA by Grade 2008 -2010

Rates of Oral Administration by Disability Groups ¡ By disability group percentage, students with mild and moderate cognitive disability had the largest oral administration rates (53 – 65%). ¡ Used by 29% of students with learning disabilities, and being the largest disability group, made up approximately 70% of all students receiving oral administrations.

ELA Performance of SWD Tested With and Without Oral Administration (OA)

Use of Calculators with PASS ¡ 14. 4% of all SWD used a calculator with PASS mathematics ¡ Calculator administrations were predominantly in grades 5 -8 where they are standard accommodations ¡ The overall rate of calculator administrations for grades 5 -8 was 22. 5%

Percent of SWD Using Calculator Administrations by Grade 2008 -2010

Rates of Calculator Use by Disability Groups ¡ By disability group percentage, students with mild and moderate cognitive disability and students with traumatic brain injury had the largest calculator use rates (19 – 25%). ¡ Used by 16% of students with learning disabilities, and being the largest disability group, made up approximately 68% of all students receiving calculator administrations.

Math Performance of SWD Tested With and Without Calculators

South Carolina Accountability Workbook Link for information on AYP inclusion: See Critical Element 5. 3 http: //ed. sc. gov/agency/Accountability/Federa l-and-State. Accountability/old/fp/title_i/documents/SCAcc ountability. Plan. June 92010. pdf

Including Students with Disabilities in NAEP To Help Ensure Validity of Results

Overview ¡ National Assessment of Educational Progress l Only ongoing nationwide assessment l Representative sample across states l State- and national-level results ¡ State grades 4 and 8 ¡ National-grades 4, 8, and 12 l Valid cross-state comparisons

Overview (continued) l l Designed primarily to provide data to state- and national-level policy makers With passage of ESEA/NCLB, state’s participation became required The National Center for Education Statistics (NCES) in the U. S. Department of Education is responsible for NAEP implementation NAEP policy is set by the National Assessment Governing Board (NAGB)

New NAEP Inclusion Policy ¡ ¡ New policy becomes effective with NAEP 2013 Focus on states’ inclusion of students with disabilities (SD) and English language learners (ELLs) As a percentage of total population, total excluded (SD/ELL) should not be more than 5%. As a percentage of the identified group, excluded should not exceed 15%.

Recent Exclusion Rates: NAEP 2009 Subject Grade Excluded % of SD % of Total Group Mathematics 4 2. 0 12. 2 Mathematics 8 4. 4 31. 9 Reading 4 5. 3 31. 1 Reading 8 6. 4 42. 4

Inclusion Rates: State vs. National (2009 NAEP Data)

Increasing Inclusion ¡ NAEP participation is now addressed in the online IEP tool. –Other key points– ¡ NAEP provides most accommodations typically offered on state tests. Federal law requires that schools notify parents of their child’s selection. l No student-level scores reported. Results only reported for the nation, states, and groups within states. ¡

Contact Information Suzanne Swaffield Chris Webster Accommodations and SC-Alt NAEP sswaffie@ed. sc. gov Douglas Alexander SC-Alt dgalexan@ed. sc. gov cwebster@ed. sc. gov