Assessment and Accountability Updates Chun-Wu Li, Ph. D. Instructional Services Division of Educational Services March 17, 2017
Assessment Update 2
English Language Proficiency Assessments for California (ELPAC) 3
General Overview of the ELPAC Paper-based assessment Meets federal accountability requirements Consists of a separate IA and SA Grades/grade spans: K, 1, 2, 3– 5, 6– 8, 9– 10, 11 – 12 All items are aligned with the 2012 California English Language Development Standards (2012 CA ELD Standards) 4
General Overview of the ELPAC (continued) ELPAC task types are set within a communicative context. Some task types assess collaborative standards. Some task types involve integrated skills (e. g. , Speaking with Listening). The most complex/challenging task types on the California English Language Development Test become mid-range ELPAC task types. The IA Operational will be shorter and contain fewer task types than the SA Operational. The IA Operational materials will remain in your district from year to year. 5
List of Districts Participating in Spring 2017 ELPAC Field Test District Alvord Unified Banning Unified Beaumont Unified Coachella Valley Unified Desert Sands Unified Hemet Unified Jurupa Unified Lake Elsinore Unified Moreno Valley Unified Murrieta Valley Unified Palm Springs Unified Perris Elementary River Springs Charter Riverside Unified San Jacinto Valley Academy Temecula Valley Unified Val Verde Unified 6
7
ELPAC Update March 6 – April 14, 2017: ELPAC Summative Assessment Field Test. Student results will not be generated. August 28 – September 22, 2017: ELPAC Initial Assessment Field Test. Student results will not be generated. January 2018: Standard Setting for the Summative Assessment to the SBE. Posting of the 2017 -18 ELPAC Information Guide. February 1 – May 31, 2018: Operational ELPAC Summative Assessment. LEAs’ results will be received 6 -8 weeks after submission for scoring. July 1, 2018 -June 30, 2019: Operational ELPAC Initial Assessment. 8
Reclassification Criteria for 2017 -2018 Since the 2015– 16 school year, the reclassification criteria, pursuant to California Education Code Section 313, has remained unchanged. LEAs are to continue using the following four criteria to establish local reclassification policies, unless and until SB 463 becomes law: 1. Assessment of English language proficiency, using an objective assessment instrument, including, but not limited to, the state test of English language development 2. Teacher evaluation, including, but not limited to, a review of the student’s curriculum mastery 3. Parent opinion and consultation 4. Comparison of student performance in basic skills against an empirically established range of performance in basic skills based on the performance of English proficient students of the same age April 2017: Joint letter from ELSD and ADAD to LEAs with guidance on reclassification beginning in school year 2017– 18. Further guidance may follow if Senate Bill (SB) 463, currently under discussion, becomes law. 9
“DRAFT” Reclassification Criteria for 2017 -2018 (continued) However, for the 2017– 18 year only, LEAs may select from the following options to meet the criteria for number one “Assessment of English language proficiency, using an objective assessment instrument, including, but not limited to, the state test of English language development”, at their discretion. These options do not exempt LEAs from administering the ELPAC Summative Assessment in spring 2018. 1. An LEA may use the 2016– 17 CELDT scores. a. Use the ELPAC performance levels for reclassification. b. If a student (a) scores a level 3 (Intermediate) overall on the 2016– 17 CELDT and (b) has met the other district reclassification criteria; and if the teacher can confirm that the student has made one year’s progress in his/her English language proficiency, the LEA may consider reclassification. c. The 2016– 17 CELDT scores can be combined with 2017– 18 information pertaining to criteria two through four to determine reclassification. For example, if a student obtains a level 4 (Early Advanced) or level 5 (Advanced) overall on the 2016– 17 CELDT but has not met the basic skills criterion, the LEA could use 2017– 18 results in combination with the 2016– 17 CELDT scores to determine reclassification. 10
“DRAFT” Reclassification Criteria for 2017 -2018 (continued) 2. OR an LEA may elect to have a more current English language proficiency assessment result. If so, the following options will be made available*: a. An LEA can download and print a posted PDF version of the CELDT documents from the secure CELDT District Portal, and then locally score the assessment. b. An LEA can enter into a contract with the CELDT contractor, Educational Data Systems, to obtain CELDT test materials and have them scored by Educational Data Systems. Please Note: * Since the CELDT Annual Assessment will be supplemental to the mandated ELPAC, LEAs may use Title I and/or Title III funds to pay for the local printing of CELDT test materials or to enter into a contract with Educational Data Systems to procure test materials and have the contractor score the CELDT. 11
English Learner Progress Indicator (EPLI) November 2017: Public posting of the English Learner Progress Indicator through the California School Dashboard. This indicator calculates a performance level based on Status and Change using 2015– 16 and 2016– 17 CELDT data files. November 2018: Public posting of the English Learner Progress Indicator through the California School Dashboard. For 2017– 18 ELPAC data, the indicator will only calculate Status based on the 2018 operational ELPAC summative assessment results. 12
California English Language Development Test (CELDT) 13
CELDT Update On February 13, the registration window for the 2017– 18 CELDT Scoring Training of Trainers Workshop opened. Workshop dates and locations are available on the www. celdt. org Web site. The CELDT Data Review Module (DRM) for district data correction of annual assessment (AA) Window records opened on Monday, February 27 and closes on Friday, March 24, 2017. LEAs can prepare for the DRM by reviewing the monthly Student Score Files for missing and inaccurate information (e. g. , missing previous CELDT scores, incorrect test purpose, etc. ). The 2017– 18 Edition Initial Ordering Window opens Monday, March 13, 2017. LEAs can only order materials to administer the IA in 2017– 18. 14
California Assessment of Student Performance and Progress (CAASPP) 15
CAASPP Workshops 2016 -17 CAASPP Hand-Scoring Training April 20, 2017: University of California, Riverside Extension Center To register, complete the online registration form, located at https: //etsformstack. com/forms/caaspp_operational_hand_sco ring_workshop_registration_2017. 2016 -17 CAASPP Post-Test Workshop May 31, 2017: University of California, Riverside Extension Center To register, complete the online registration form, located at http: //www. surveygizmo. com/s 3/3219953/Post-Test-Workshop. 16
California Alternate Assessments (CAAs) Update A training sample of the CAA for Science, embedded performance task, is now available on the CAASPP Portal California Alternate Assessments Web page at http: //www. caaspp. org/administration/about/caa/index. html. CDE is currently producing an informational video about the new CAA for Science; the CDE will announce the release of the video in the CAASPP Weekly Update. 17
CAAs Update (continued) CAAs for ELA, mathematics, and the pilot science will be available for LEAs with testing windows open on or before March 20 and will remain available until the LEAs testing window closes. CAA version assignments have been posted on the CAASPP Portal CAA for ELA and Mathematics Version Assignments for 2016– 17 Test Administration Web page at http: //www. caaspp. org/administration/about/caa-assignments. 2016 -17. html. The online Test Examiner Tutorial (video) is now available at http: //www. brainshark. com/ets/CAA-tutorial_2017. This tutorial covers the administration of the CAA for ELA and mathematics as well as the CAA for Science. Educators who complete this tutorial and respond to all answers correctly will receive a certificate. For the pilot test, one embedded performance task for each grade (i. e. , grades five and eight, and high school) will be posted within Test Operations and Management System (TOMS) on the CAA Secure Materials tab on the help page at http: //www. CAASPP. org. CDE and ETS will use responses to the student and test examiner surveys to collect feedback on the CAA pilot test. Student’s survey responses must be entered into the test delivery system by creating a test session with the test administrator interface and logging into student survey using the secure browser. The test examiner survey will be available on the CAASPP portal. 18
Accountability Update 19
Dashboard is Released At 10: 30 a. m. on March 15, 2017, the Dashboard was released to the public. The State Superintendent of Public Instruction’s press release announcement is accessible on the CDE Web page at: http: //www. cde. ca. gov/nr/ne/yr 17/. Dashboard Web Address: https: //www. caschooldashboard. org/. Five-by-Five Placement Report Web Address: http: //www. cde. ca. gov/dashboard. 20
Latest Dashboard Updates Grade 11 Smarter Balanced Assessment Results can be viewed on the College/Career Indicator (CCI) report. The grade 11 results are based on using the “Distance from Level 3” (DF 3) methodology. 21
Latest Dashboard Updates (Cont. ) The CCI will be available next month within the Detailed Reports tab. The reported data will reflect the percent of students who were “Prepared, ” “Approaching Prepared, ” and “Not Prepared” on the CCI levels. Keep in mind that the assessments used are based on the performance level results (not DF 3). 22
Latest Dashboard Updates (Cont. ) For the Spring 2017 release of the CCI, the Detailed Report will be based on data from the class of 2014. CCI Measure Data Source Year(s) of Data The table below shows the years of data used. AP exam The College Board 2011, 2012, 2013, 2014 Grade 11 EAP results STAR file From Educational Testing Service (ETS) 2013 a-g completion CALPADS 2014 (Yes/No filled in by LEA ) CTE pathway completion CALPADS Last 3 years in high school (2012, 2013, 2014) Dual enrollment CALPADS Last 3 years in high school (2012, 2013, 2014) 23
Latest Dashboard System Updates (Cont. ) English Learner (EL) Only and Reclassified English Fluent Proficient (RFEP) Only data are now displayed within the ELA and mathematics reports. The “EL” student group data includes both EL and students reclassified within the past 4 years (i. e. , reclassified after April 15, 2012). The “EL Only” student group contains only the EL students The “RFEP Only” student group data are based on only those students who were reclassified within the past 4 years (i. e. , reclassified after April 15, 2012). 24
25
Latest Dashboard System Updates (Cont. ) Narrative Box is now operational. There is a 500 character limit. Since the system does not automatically accept Web addresses, if you need to include Web addresses to direct the reader to a particular site, please write out the URL (e. g. , http: //www. districtreport. org) 26
Latest Dashboard System Updates (Cont. ) Local Indicators ratings will be based on Met / Not Met for Two or More Years. This was determined by the SBE at their March 2017 meeting. A glossary containing definitions of the terms for each of the state indicators is now available on the Dashboard. A one page fast start guide and a video are now available. 27
Available Resources The California Accountability Model and School Dashboard Web page (http: //www. cde. ca. gov/dashboard) contains: • Link to the Dashboard • Link to the Five-by-Five Placement Report. • Five tabs of information: 1. Overview Tab includes a five-minute video covering general information of the new accountability system classroom. The Spanish version of this video is also now available. 28
Available Resources (Cont. ) 2. Parents Tab: Contains a link to the English and Spanish videos. While Spanish is the only current translation to the Parent information, the other translations (for the top four languages) will be posted by April 1. 3. Resources Tab: All Power. Points presented during the Webinar series on the state indicators are posted. The final Webinar on “Statements of Model Practices, Local Performance Indicators and Chronic Absenteeism” was held on March 14 th and the Power. Point will be posted shortly. Resources Tab also includes the: Five-by-Five Colored Tables for each of the state indicators The approved standards and tools (i. e. , self-reflection tools) that LEAs can use to rate local indicators 29
Available Resources (Cont. ) 4. Data Files and Guide Tab: • The data files and associated record layouts are now posted. • The technical guide has been updated. See Appendix G for the list of all the major updates made. • This tab also contains the Quick Reference Guide. 30
Available Resources (Cont. ) 5. • • • Communications Toolkit Tab: Core Messages Key Points Two-page document titled “Getting to Know the California School Dashboard” (now available) • Sample Letter to Parents (also translated into additional languages) • Frequently Asked Questions • A video on the Dashboard developed by ACSA Coming soon: Training modules on understanding the State Indicators 31
New Data Included in the Fall 2017 Dashboard California Alternate Assessment (CAA): Two years of CAA data will be incorporated into the ELA and math for the fall 2017 Dashboard. The methodology for how to include this assessment will be brought forth to the Technical Design Group at their April 2017 meeting. Foster Youth and Homeless Student Groups will be reported. At the LEA-level, the N size for both groups will be 15 students (not 30). If an LEA has 15 or more Foster Youth or Homeless students, each student group will receive Status, Change, and a performance color. At the school-level, the N size for both groups will be 30 students. 32
New Data Included in the Fall 2017 Dashboard (Cont. ) The CCI will be reported as Status only using the 2015 -16 four-year cohort graduation (Class of 2016). Since the Class of 2016 took the Smarter Balanced assessments as grade 11 students in 2015, the 2015 Smarter Balanced results will be used to calculate Status. Chronic Absenteeism may be released as information in the Detailed Report on the Dashboard. 33
Additional Item to Note The demographic data will annually be extracted out of the CALPADS ODS on June 15, 2017. Therefore, the CDE encourages LEA and schools to make appropriate corrections prior to the extraction date. (See section on Student Groups [starting on page 18] in the guide for the data corrections. ) 34
Assessment and Accountability Related Items 35
Materials for CCEE's Spring 2017 Workshops be directly accessed at: http: //www. ccee-ca. org/workshops-trainingsspring 2017 -materials. asp. 36
Designing High-Quality Performance Tasks Training on April 25, 2017 (Location Changed) Designing High-Quality Performance Tasks Training on April 25, 2017 has been changed to: Bourns Technology Center 1200 Columbia Avenue, Room 103 Riverside, CA 92507 Online registration is available at http: //rcoe. k 12 oms. org/. During this interactive training, participants will: - Deepen understanding of the evidence elicited from students through different types of performance tasks. Experience an exemplar performance task. Deepen understanding of SBAC claims. Build knowledge to become better consumers and adapters of high quality performance tasks. Prepare for participation in collaborative task design process. 37
2017 -2018 RCAN Dates (All Wednesdays) Wednesday, August 16, 2017 Wednesday, October 18, 2017 Wednesday, December 6, 2017 Wednesday, January 31, 2018 Wednesday, March 28, 2018 Wednesday, May 23, 2018 38
Скачать презентацию Assessment and Accountability Updates Chun-Wu Li Ph D
b461c4745ae7b3bd549fec6c3660b869.ppt