Texas English Language Proficiency Assessment System TELPAS By

Texas English Language Proficiency Assessment System (TELPAS) By Cindy Blair, Robert Forti & Shara Contreras

Security Training Modules Web-based Texas Test Administrator Online Training Modules www. Texas. Assessment. com/TAonlinetraining All three modules must be completed by certified campus personnel by the start of the testing window.

It’s the law! Procedures for maintaining the security and confidentiality of assessments are specified in the Test Security Supplement, the District and Campus Coordinator Manual, and in the appropriate test administration materials. This training does not replace your responsibility to read and comply with all manuals.

PRINCIPAL’S RESPONSIBILITIES ØReceive annual training in test security & administration procedures ØEnsure that test security is maintained ØOversee the implementation of the test administration process as stated in the District and Campus Coordinator Manual (DCCM), test administrator manuals and Security Supplement ØEstablish in conjunction with the CTC, test administration processes specific to the campus ØOversee the training of campus personnel in cooperation with the CTC ØReport any suspected violation of test security to the DTC

General Security Information The following govern test security Ø Texas Education Code (TEC) Chapter 39, Subchapter B Ø Texas Administrative Code (TAC) 19 Subchapter 101, Assessment Ø Family Educational Rights and Privacy Act of 1974 (FERPA) Ø Texas Penal Code 37. 10 - Tampering

Penalties for Prohibited Conduct ØPlacement of restrictions on the issuance, renewal, or holding of a Texas educator certificate, either indefinitely or for a set term ØIssuance of an inscribed or non-inscribed reprimand ØSuspension of a Texas educator certificate for a set term; or ØRevocation or cancellation of a Texas educator certificate without opportunity for reapplication for a set term or permanently ØRelease or disclosure of confidential test content is a Class C misdemeanor and could result in criminal prosecution under TEC ξ 39. 0303, Section 552. 352 of the Texas Government Code, and Section 37. 10 of the Texas Penal Code. ØSBEC may take any of the above action if a educator fails to cooperate with TEA in an investigation

Active Monitoring during test administrations is the responsibility of the test administrator, the campus test coordinator and administrators. What is NOT active monitoring? Anything that takes the test administrator’s attention away from the students during testing. Examples include: • Working on the computer, using cell phones, or checking email • Reading a book, magazine, or newspaper • Grading papers or working on lesson plans • Leaving the room without a trained substitute test administrator in the room • Leaving students unattended during meals or breaks

Secure TELPAS Information ØContent of the online tests are secure and confidentiality must be maintained ØStudent Test Tickets are to be kept secure ØAll student data in the TELPAS system or entered into the system is confidential ØPasswords and user IDs are secure and should be kept confidential. DO NOT SHARE! ØStudent Writing Collections and ratings are secure materials ØAll student scratch paper must be collected and destroyed after the completion of the test

Secure TELPAS Information ØThere is no collaboration allowed during the calibration sets ØScratch paper and/or notes must be collected and destroyed after the completion of each calibration set ØSign in sheets must be collected and turned in as part of the Required Documentation for TELPAS

BEFORE Testing ØEmphasize the importance of reading all manuals and attending training ØAccount for all test material ØDesignate an area with limited access to store testing materials (includes collections and tickets) ØVerify the accuracy of student information ØVerify testing requirements for students receiving accommodations ØVerify the accuracy of test exclusions and exceptions

DURING Testing ØEnsure each student receives the correct assessment level and testing ticket ØEmphasize and verify active monitoring (test monitoring logs) ØEnsure only trained test administrators are allowed to serve as relief personnel ØEnsure all testing personnel understand that they may NOT: - provide assistance - view the tests without authorization - discuss confidential student information - check for strategies

AFTER Testing ØNo unauthorized viewing (only TEA may permit) ØNo scoring of student responses ØShred student test tickets, scratch paper or reference material that has been written on ØNo discussion of confidential student information ØAccount for all test materials ØEnsure an answer document has been submitted for all students that tested ØEnsure all transcriptions from paper to online are to the correct student and complete

Testing Irregularities Incidents resulting in a deviation from documented testing procedures are defined as testing irregularities The following are viewed as a “procedural” irregularity - improper accounting of secure materials - eligibility error - monitoring error - accommodation error - test procedural error

Testing Irregularities Serious Examples Directly or indirectly assisting students with responses to test questions Tampering with student responses Viewing secure content unless specifically authorized Discussing or disclosing secure test content or student responses Formally or informally scoring student tests Duplicating or recording test content Falsifying TELPAS holistic ratings or STAAR Alternate 2 student responses Fraudulently exempting or preventing a student from participating in the administration of a required state assessment Receiving or providing unallowable assistance during the TELPAS calibration activities Encouraging or assisting an individual to engage in the conduct described above Failing to report to an appropriate authority any of the above 9 2 o 1 t DC CM O- 2 O-

Reporting Irregularities Remain calm and contact the DTC CTCs will obtain the facts, secure any evidence and determine the necessary steps Statements must be typed, dated and signed Include a Plan of Action. Refer to District Plan of Action A test irregularity is reported to you Assess the situation, investigate and contact the DTC If the irregularity is ruled an incident obtain statements, fill out incident form and submit both to the DTC Follow up with an action plan to correct the error Keep a copy of the incident form and statements in your testing binder Do not discuss with anyone until cleared by the DTC CTCs will scan statements and incident form to the DTC by the end of the day the incident occurred Testing binders are kept on campus for 5 years and are TEA auditable

Reporting & Documentation If You become aware of any irregularities, the CTC must contact the DTC immediately with the who, when, where, what and why. If the irregularity is deemed an incident the following documentation is required: üIncident report including a plan of action (local form and district plan of action) üSigned statement(s) from individual(s) involved (typed, printed and signed name, role during testing, and dated) üStatements will not include names or IDs of students üThe local disciplinary referral form used to report disciplinary actions taken against students for cheating, cell phone issues or disruptions

Security Oaths • TEA requires that everyone be trained and sign a security oath before handling secure testing materials or participating in the administration of a state test • A person who has several roles during TELPAS testing must sign all oaths that apply to their role(s) (Test Administrator, Rater, Verifier, etc) • The ability to view a test booklet for transcribing requires additional training and completion of the addition information on the oath

Security Oaths ØTest Administrator- signed after training and prior to administrating the test ØTELPAS oaths- signed on the appropriate campus if applicable for each role ØNEW TELPAS Calibration Proctor Oath

Security Oaths Initial each line Sign and clearly print name

What is TELPAS? TELPAS is an assessment program for students in Texas Public schools who are learning the English language. TELPAS stands for the Texas English Language Proficiency Assessment System. TEA developed TELPAS to meet state and federal testing requirements. Texas assess English language learners annually in listening, speaking, reading, and writing. All current LEP Students K-12 (including denials) must be assessed in TELPAS annually. ARDCs in conjunction with LPAC may determine, in rare cases, that a student receiving Special Education services should not be tested in one or more domains.

TELPAS Acronyms • ELPS – English Language Proficiency Standards. – Federally required instructional standards designed to ensure that ELLs are taught the academic English they need for school purposes. • PLDs – Proficiency Level Descriptors – Rubrics teachers use to determine students’ English language proficiency for ongoing formative assessments and the spring TELPAS administration. • • 6 sets of PLDs Listening Grades K– 12 Speaking Grades K– 12 Reading Grades K– 1 Grades 2– 12 Writing Grades K– 1 Grades 2– 12 Beginning, Intermediate, Advanced, & Advanced High

TELPAS Considerations 1. Continue to clear up discrepancy rosters ! ARDCs in conjunction with the LPAC may determine that a student receiving Special Education Services should not be tested in one or more domain of TELPAS. Participation should be considered on a domain by domain basis. 2. Selection of Raters and Verifiers should be finalized! Make sure that a assigned rater is not planning on retiring soon. Paraprofessionals may not serve as raters. Also note that a Rater can not be a Verifier. 3. Make sure to include a specials teacher, in elementary only, (Art, Music, PE etc. ) as a rater. They are best suited as backup Raters 4. Caution: Given the length of the Writing Collection Window, it is TEA’s position that all required students have a completed set of writing samples collected (5) that meet the minimum requirements in spite of such issues such as poor attendance, behavior problems etc. Please note district schedule.

TELPAS Considerations 6. Because of the requirements of online testing, it is recommended to have students test on two separate days. 7. Start reviewing computer labs for total number of computers. Plan testing students on every other computer to minimize distractions for the online speaking and listening tests. 8. Students that transfer to your school on or after February 26 only have to be given the online tests (Reading, Speaking & Listening) 9. E-11 TELPAS Deadline is February 9, 2018 10. DO NOT FORGET YOUR DENIALS!

TELPAS Spring Dates Date Jan 10 Jan 26 Feb 9 Feb 12 Feb 26–Mar 29 Activity Assembling and Verifying Grades 2– 12 Writing Collections course available Online basic training courses for new K– 1 and 2– 12 raters available End date for training raters and verifiers on administration procedures Calibration window opens for new and returning raters Earliest eligibility date for TELPAS writing samples TELPAS assessment window Important to Note: TELPAS data verification must be conducted within the assessment window. There will not be a separate data verification window.

2018 TELPAS Timeline & Reference Guide TELPAS digital library can be found at http: //avocet. pearson. com/TX/Home

CTC Responsibilities • Read and adhere to all manuals • Attend required coordinator training sessions • CTC and campus principal are responsible for test security and confidentiality on the campus • Supervise and actively monitor testing • Be the campus contact for all questions about testing • Report testing irregularities and security violations immediately to the district testing coordinator • Compile required documentation and turn in to testing office

CTC Responsibilities • Identify and train a writing collection verifier(s) • Identify and train Raters • Monitor calibration sessions • Identify and train Online Test Administrators • Ensure computers are working, headsets are available for teacher calibration sessions and student online testing • Ensure that all students are identified and tested • Oversee the implementation of validity and reliability • Coordinate collaborations of inputting student ratings

CTC Responsibilities for Training Raters • Identify Raters and the type of online training they need to complete and for which grade cluster • Ensure Raters understand the importance of being properly trained on the holistic rating process • Ensure Raters have obtained access to the online training site for TELPAS http: //www. pearsononlinetesting. com/tx/TELPAS/ratertraining/ • Monitor that all Raters complete their training requirements and calibration is completed in a monitored session with a seating and sign in sheet

TELPAS Online Training and Calibration

TELPAS Holistic Rating Training – NEW This Year The Grades 2 -12 Online Basic Training Course and calibration activities will now only include the domain of writing. A separate holistically-rated listening and speaking rater training will be available for the rare circumstances in which a student can’t access the online listening and speaking assessment. Each training course will now have a practice activity outside of the modules. After completing the modules and practice activities, certificates of completion will be available to print in the scoring summary tab. Testing coordinators will no longer need to print certificates.

Two Types of Training • Online basic training course This course is for new raters and raters that have not completed calibration in the last three school years. It provides instruction on using the PLD rubrics and gives raters practice rating students. There are separate courses for K– 1 and 2– 12. • Online calibration This is for all raters. Raters use the PLDs to rate students. Raters have two opportunities to calibrate on assigned grade cluster.

When and where do raters take the online basic training course? • Depending on campus arrangements, raters may either complete the online basic training course during school hours, after school, or on weekends. • The online training system allows raters to access the training from any computer that meets the minimum system requirements. It is a violation of state assessment procedures to record, discuss, or share answers to the rating practice and calibration activities. Prior to creating a TELPAS Online Training Center account, raters are required to read an online statement and affirm that they will complete the rating activities independently.

When and where do raters complete calibration? • Both new and returning raters must complete calibration in a monitored setting. • Monitored calibration sessions may take place during the school day, after school, or as part of professional development. Most raters will need 1 to 2 hours to complete a calibration set. It is a violation of state assessment procedures to record, discuss, or share answers to the rating practice and calibration activities. Prior to creating a TELPAS Online Training Center account, raters are required to read an online statement and affirm that they will complete the rating activities independently.

Planning Calibration Sessions • A trained proctor must actively monitor each session • Sign In sheets and seating charts will be required • A daily passcode must be used for raters to access the calibration set • Raters must complete a calibration set once it has started

Planning Calibration Sessions • Raters are allowed to use their TELPAS Rater Manual and/or a copy of the PLDs without notes • Raters will need headsets • Scratch paper may also be used but must be turned in and destroyed after the session • There is NO collaboration allowed during the calibration sessions • Campuses must plan multiple calibration sessions in case raters need the 2 nd opportunity • Supplemental support is available upon request from the ELL department

Login Info Make Sure to scroll down to the bottom of the page to find the log in link.

Pearson Access Next

TELPAS Online Training Center Log In/Sign Up Texas. Assessment. com/TELPASTraining. Center

Create Account § Coordinators will receive a keyword for users to create an account. § All fields are required. Check box for Rater Agreement and click the Submit button.

Educator Homepage

Choose Your Training § Raters must know their assigned grade cluster to select the appropriate online training. § Raters should consult with their campus coordinator if they are unsure of their training requirements.

Holistically Rated Listening and Speaking Training § TEA approval required to holistically rate a student in listening and speaking. § Passcode will be provided with TEA approval. Specific instructions and the request form can be found on TEA’s District and Campus Coordinator Manual Resources webpage.

Writing Training Course

Listening and Speaking Course

Sufficient Calibration • For K– 1, each set contains ten students to be rated. Raters must rate at least 70 percent of the students correctly. • For 2– 12 grade clusters, each set contains ten writing collections to be rated. Raters must rate at least 70 percent of the collections correctly. • For 2 -12 listening and speaking, each set contains six students to be rated. Raters must rate at least 67 percent of the collections correctly.

Review Calibration Set and Submit for Scoring

Scoring Summary

Online Training and Calibration must be completed in a monitored setting (sign in and seating charts required). Raters have two opportunities to calibrate. For grades 2 -12, raters will calibrate only on the domain of writing. Local procedures must be established for verifying the completion of online courses and calibration activities. The TELPAS Online Training Center does not save training histories or certificates. Accounts and certificates will be purged from training site at the end of each training window. Raters need to print and retain a copy of their training and calibration certificates. Certificates are also emailed to raters upon course completion and successful calibration. Make sure you can find the past certificates in previous years binders. Otherwise teachers will need to provide a copy or re-do the online courses.

Monitored Calibration Sessions • All raters must receive administration procedures training prior to attending a calibration session and must have a signed oath on file. A roster of participants in each session will be maintained (sign in sheet). • Raters will be given a passcode by the session proctor in order to access calibration. • Raters may use their TELPAS Rater Manual (must be a clean copy) or a copy of the PLDs. • Notes taken during calibration should be done on scratch paper. The scratch paper must be turned in to the proctor at the end of the calibration session and then shredded. Please account for all scratch paper before and after testing. • Raters will need to complete calibration activities individually within the monitored group session. Therefore, the use of headphones is required. • Passcodes change daily. Session proctors should ensure they have the correct passcode before beginning a monitored session. They will be emailed out to the TELPAS coordinators.

Monitored Calibration Sessions • Raters must begin calibration with set 1. If successful, a certificate will be available in the scoring summary tab of the TELPAS Online Training Center. The certificate should be printed and turned in to the proctor. • If raters are unsuccessful on set 1, they will be notified by CTC when a monitored session for set 2 will be held. Raters may not take both sets in the same day. • After completing a calibration set, raters immediately see their results and annotations explaining the correct ratings. • Raters will need 1 -2 hours to complete a calibration set. Raters must finish a calibration set once it is started. They will not be able to save their progress and return later to complete the set. This is not a stipend event.

What happens if a rater is unsuccessful in calibrating? • CTC will document the score of the calibration and assign an additional qualified rater • Rater will still rate students of record • The additional qualified rater will also rate the students • Both raters must sign the Rating Roster • Individuals are not authorized to serve as raters unless they complete all required training components.

Recap of Calibration Process • Calibration is conducted in monitored sessions. Raters can get a clean copy of PLDs • A passcode is required to access calibration. • There are 2 calibration sets. • Raters who successfully calibrate on set 1 are done. • Raters who don’t successfully calibrate on set 1 must complete set 2. • Certificates must be printed and turned in to the proctor. • After completing the modules and practice activities for the K-1 or 212 online basic training course or the Assembling and Verifying Writing Collections course, a certificate of completion will be available in the scoring summary tab of the TELPAS online training center. • After you have successfully calibrated, go to the scoring summary tab of the TELPAS Online Training Center to access a certificate. Print a

Rater Credentials Each teacher selected to rate an ELL must; 1) have the student in a class this spring term 2) be knowledgeable about the student’s ability to use English in instructional and informal settings for K-1 3) hold valid teacher certificate 4) be appropriately trained, as required by TEA 5) rate the student in all eligible language domains 6) May included bilingual, ESL/ELL, general ed. SPED, G/T and teachers of enrichment subjects. 7) A kindergarten or 1 st grade student’s rater must rate the student in all domains for which the student is eligible. It is not permitted for a student to have one rater for some domains and another rater for other domains.

Rater Responsibilities • Attend training on administrative procedures • Obtain access to online training site for TELPAS • Complete holistic rating training requirements (online calibration sets) • Print Certificate of Completion and turn in to CTC • Assemble and verify student writing collections

Rater Responsibilities • Rate writing collection and the listening & speaking domains • Complete required documentation • Maintain security and confidentiality of student writing collections and ratings • Collaborate with CTC to input student ratings • Report test irregularities • Sign all oaths

New and Returning Rater Definitions for K– 1 and 2– 12 • Campuses may, at their discretion, require a returning rater to complete the online basic training course prior to online calibration. • Returning raters that have not successfully completed calibration activities within the last three school years are required to complete the online basic training course before calibrating.

Holistic Rating Training

Raters with Students in Multiple Grade Clusters within Grades 2– 12 • Raters are required to train and calibrate in the cluster in which they have the most ELLs. • As a best practice, these raters should also review online basic training course practice activities in the additional cluster(s). • Grade Clusters • Grades K– 1 Grade 2 • Grades 3– 5 • Grades 6– 8 • Grades 9– 12 Example: A grade 2– 5 ESL teacher has most of her ELLs in grade 3. She must complete training course and calibration in grades 3– 5. As a best practice, she should review the online practice activities for grade 2 to check her readiness to apply the rubrics appropriately.

Raters with Students in Multiple Grade Clusters that Include Grades K– 1 • Because of differences in the instructional content and rating rubrics, these raters must complete training and calibration for K– 1 and at least one other cluster in 2– 12. • Raters with more than one additional cluster should train in the cluster in which they have the most ELLs. • As a best practice, these raters should also review online basic training course practice activities in the additional cluster(s). Example: A grade 1– 3 ESL teacher has most of his ELLs in grade 2. He must complete training course and calibration in grades K– 1 and 2. As a best practice, he should review the online practice activities for grades 3– 5 to check his readiness to apply the rubrics appropriately for his 3 rd grade students.

TELPAS 2017 Reading Released Tests • The 2017 TELPAS Reading Tests for Grades 2 -12 have been released and posted in the Related Webpages section on the TELPAS Resources page at http: //tea. texas. gov/student. assessment/ell/telpas/.

Tutorials • New TELPAS tutorials have been released in November. They are redesigned to assist students with the functionality of the TELPAS online testing interface. The tutorials can be found in the Related Webpages section on the TELPAS Resources page at http: //tea. texas. gov/student. assessment/ell/telpas/. Update

TELPAS Grade Clusters • Reading Test • Grade 2 • • • Listening & speaking TEST* • Grades 2 -3 Grade 3 Grades 4 -5 Grades 6 -7 Grades 8 -9 Grades 10 -12 • Grades 4 -5 • Grades 6 -8 • Grades 9 -12 *The listening and speaking test is one test, not two separate tests. DO NOT FOR GET TO INCLUDED YOUR DENIALS!

Exceptions • In rare cases, it may be necessary for the ARD committee, in conjunction with the LPAC, to determine that an ELL receiving special education services should not be assessed in reading, writing, listening, and/ or speaking for reasons associated with the student’s particular disability. • Participation must be considered on a domain-by-domain basis. • The reason for not assessing the student must be well-supported and documented in the student’s IEP by the ARD committee and the student’s permanent record file by the LPAC. • An ELL from another Texas school district, state, or country who enrolls on or after the first day of the TELPAS testing window will not be assessed by the receiving district in the holistically-rated domains. • Newly enrolled students in grades 2 -12 are required to take the TELPAS online tests.

Paper Reading Test or Holistically-Rated Listening and Speaking Assessments • In rare cases, a student may require an accommodation that requires a paper administration of the TELPAS online reading test. Paper administrations of the TELPAS online reading test must be approved by TEA. • For a student that cannot be assessed with the TELPAS online listening and speaking assessments, the student will need to be holistically rated in listening and speaking which will also need to be approved by TEA. • Special request must be received by TEA ONE WEEK PRIOR to the window opening. • Specific instructions and the request form can be found on TEA’s District and Campus Coordinator Manual Resources webpage.

TELPAS Writing Collection window opens February 12 and closes February 26

Assembling the Writing Collection • K-12 th teachers will collect writing samples during the window and turn in to the CTC (K-1 collect 3 only) • Writing collections and ratings are considered to be secure materials • Writing Sample Collection window is February 12 – February 26 • All Writing Sample Collections must be returned to the CTC by February 26 • Must follow the guidelines for collecting writing samples

Writing Collection • Raters assemble a collection of each student’s writing from a variety of content areas • A rater bases a student’s English writing proficiency rating solely on the content of their writing collection Reminder: The characteristics you consider must come from the PLDs.

Goal in Assembling Writing Collections To make sure the collections portray the students’ overall English language writing proficiency

Some Eligible Types of Writing Basic descriptive writing on a personal/familiar topic Writing about a familiar process Writing that elicits use of past tense Personal narratives and reflective pieces Expository and other extended writing on a topic from language arts • Expository or procedural writings from science, mathematics, and social studies • • •

TELPAS Writing Samples • TELPAS writing samples included in the collections should be taken from authentic classroom activities grounded in content area TEKS and ELPS. • Collections should contain some papers in which students showcase English they know and feel comfortable using. • Collections should also include papers in which students are stretched and pushed beyond their comfort zone so the collection shows that a student has not yet reached the next level (the student is beginning but not yet intermediate, intermediate but not yet advanced, advanced but not yet advanced high).

Samples Required • At least 5 total samples are required in each collection. • Strive to gather more than 5 writing samples for each student • In each collection there must be - at least 1 writing sample that elicits the use of past tense - collection must contain at least 2 writing samples from a combination the content areas of math, science, or social studies

Tips • Build writing collections that have a balance of writing from language arts and other core content areas • Collections should show what the student knows and can do as well as what the student struggles with in second language acquisition • Remember, build the collections to portray the student’s overall ability to communicate in writing in English

Papers Not to Include • Papers containing copied language • Papers in which student relies heavily on resources (dictionary, thesaurus, etc. ) • Papers showing teacher comments and corrections • Worksheets and question-answer assignments • Papers that have been polished through editing with help from peers or teachers • Papers written primarily in student’s native language • Papers that are brief, incomplete, or rushed

Verifier Responsibilities • Attend training on administrative procedures • Obtain access to TELPAS Online Training Center • Complete online training “Assembling and Verifying Writing Collections” and print certificate of completion • Verify student writing collections in accordance with the checklist • Complete verifying of the writing collection and return to CTC (Feb 28 -Mar 2) • Sign Oath • Verifier cannot be a TELPAS Rater or the CTC

Verifiers Responsibilities The writing collection verifier must complete the verification checklist to ensure that; • Each collection contains at least five total writing samples • Each writing collection includes at least two academic writing samples from mathematics, science, or social studies • All writing samples included the student’s name and date • No samples come from before February 12, 2018 • No papers showing teacher corrections are included • No worksheets or questions-answer assignments are included, and • Each collection includes samples written primarily in English Collections that do not meet the requirements will be returned to the rater. Note: The rater is responsible for the assembling of the writing collections according to criteria in the TELPAS manual. The rater, not the verifier, is solely responsible for ensuring writing samples are correct.

Online Training- Verifiers need to create an account in the TELPAS Online Training Center http: //www. pearsononlinetesting. com/tx/TELPAS/ratertraining/

Spring 2018

Rating Students • Raters should review pages 22 -25 in Rater Manual prior to rating students in each domain (writing, & if needed listening & speaking) • CTCs will return the Writing Collection to the Raters during the Rating Window March 5 – March 23 • Raters must use the District required Rating Roster form to indicate the student’s rating • While rating students, Raters must refer to the PLDs (Proficiency Level Descriptors) pages 26 -30 in Rater Manual • Rating Roster must be signed by Rater, Additional Rater (if needed) Teacher Collaborator(s) and Campus Principal • All student ratings and Writing Collections must be returned to the CTC by March 23

Rating Roster An Additional Rater is required if the Rater did not pass the Calibration set with at least a 70% (K-1) or 70% (2 -12) after the 2 nd attempt There must be teacher collaboration on ratings as part of the Validity & Reliability process

Validity and Reliability • TEA requires districts to implement one or more rating support and verification procedures for every campus with TELPAS-rated students • SAISD has developed a TELPAS validity and reliability plan that meets TEA requirements • Campus testing coordinators will submit required documents to the DTC by the deadline, in order to comply with the district validity and reliability plan • An internal audit will be conducted by the DTC in conjunction with the ELL Department

SAISD TELPAS Validity and Reliability Procedures • For writing– grades 2 -12: • 5% of all writing collections will be randomly pulled for assembly verification by the campus testing coordinator • Qualified raters will collaborate with other qualified raters in determining the ratings in the writing collections for students in grades 2 -12 and obtained signatures on the Rating Roster. Each rater will do this with 10% of their assigned students. • K-1 raters will collaborate with other teachers in determining the ratings in the speaking and listening domains and obtained signatures on the Rating Roster. Each rater will do this with 10% of their assigned students.

Validity & Reliability Form

Principal Responsibilities The campus principal has full oversight of the test administration to include but not limited to campus logistics, scheduling, training, security & confidentiality. The principal plays a key role in ensuring holistic rating accuracy by reviewing and signing each rater’s Student Rating Roster prior to the final verification of student data.

Managing the online system (PAN) Administering the Online Tests

Online Testing User’s Guide Below is the link to the TELPAS System User’s Guide. One of the following training dates is mandatory for those that have never been trained on the PAN system. Any others are encouraged to attend. Please sign up in Eduphoria as space may be limited. http: //avocet. pearson. com/TX/Home TELPAS Labs Feb. 12, 13, 14, or 15 8: 30 -11: 30

TELPAS Online Testing Grades 2– 12 online TELPAS reading tests and entry of holistic rating information are delivered through the Test. Nav. Entering a student’s holistic ratings does not require a student test ticket. Holistic rating sessions still need to be created before entering ratings information. After selecting the individual student in the Texas Assessment Management System a Test. Nav window will pop-up for designated personnel to enter ratings information.

TELPAS Online • TELPAS Reading and Listening/Speaking is an online assessment • Administered to all LEP students 2 nd-12 th (including denials) • No test booklets or answer documents • (unless there is a special circumstance- must request through the Testing Office) • All students must be tested within the testing window • TELPAS Lab is available to set up online testing sessions (February 12 -15)

Online Test Window WHO WHEN Grades 2 -12 February 26 to March 29 Make ups February 27 to March 29 By March 29, 2018 CTCs must ensure all ratings, demographic information (including Years in US Schools), special circumstance information and score codes have been entered

TELPAS Online Make-Ups • All students must be assessed within the assessment window • If a student is absent the day you have them scheduled to take TELPAS online ensure that they make-up the assessment(s) within the TELPAS window • The TEA expectation is that we test every eligible student within the TELPAS assessment window

Preparing for the Test • Ensure students participate in the TELPAS tutorial • Train online test administrators by February 23 • Create online test sessions and assign students to sessions in PAN (TELPAS Lab training on February 12 -15) • Print Student Test Tickets (secure material)

Tutorials to Prepare Students for online TELPAS • Students are required to have seen and complete a tutorial prior to testing (not the day of testing) • Tutorials are about how to use the online interface functions not necessary the type of test questions • Keep a student roster for documentation of the tutorials

TELPAS Online Training • Online Test Administrators must be trained and sign their specific oath • Test administrator MUST read the TELPAS Online Test Administrator Manual • Test administrators must be trained by February 23

Online Test Administrator Responsibilities • Guide students through starting the online test • Maintain test security and confidentiality • Manage breaks /interruptions • Attend training and sign oath • Ensure proper test procedures • Start & monitor test sessions • Read manual and be familiar with test directions • Online Test Administrator can be: • • Rater Certified Teacher

Testing Environment • At least one trained administrator for every 30 students • Computer monitors prepared to discourage students from viewing each other’s monitor and minimizing noise • Bulletin boards and instructional displays that might aid students during testing must be removed or covered • The testing room should be quiet, well lighted, comfortable, with enough space to work (will other students talking affect testing) • “Testing-Do Not Disturb” sign must be posted • TAs must actively monitor

Testing Procedures • Seating chart is completed to include students’ names, locations, and test administrator information • The tests are untimed • Work stations are cleared of books and other materials • Student MUST remain seated and no talking while testing • Each student must be allowed to work at his or her individual speed • NO reference materials are allowed

Testing Procedures • Allowed to use scratch paper, but all scratch paper must be turned in to the CTC after testing • Active monitoring during the test session • After students have finished, they may read or leave the room • BEFORE allowing a student to leave, the test administrator must ensure the student’s test is in “Submitted” status • IMMEDIATELY after testing, turn in all test materials and sign the bottom portion of the reading test administrator oath

Student Test Tickets • Generate and print Student Test Tickets • Go to the Students in Session screen • Open the Download Resources menu and select Student Test Tickets • Test tickets are considered secure material

Starting a Test • A test session MUST be started before any students can log in to Test. Nav and begin the test. • A test session does not start until the TEST ADMINISTRATOR clicks the Start button on the Students in Session screen and unlocks each students test.

Launching the Test • Login to computers using the testing login • Before students can begin the test, Test. Nav must be launched on each student’s computer • The student’s login ID and test code found on each Student Test Ticket MUST be entered by the student • Directions for test administrations start on page 31

Monitoring Sessions

Resuming a Student’s Test • If a student exits Test. Nav--- • Return to Students in Session screen and select the checkbox next to that student’s name • A resume checkbox is only available if that student’s status is Started, Exited, or Resume • Click the Resume Test button to resume all students you checked • Students launch Test. Nav and login using same Login ID and code from Test Tickets

Stopping a Session CTCs will need to complete the following • Ensure each student’s status is Completed or Marked Complete on the Session Details screen • Click the Stop button to stop the test session • Call us if you have questions/concerns

Verify Score Codes • Once students click Final Submit the test defaults to scored • Codes below are for non-tested students as needed Absent Student was absent throughout the entire testing window (should be rare) X ARD Decision Student does not participate in reading test based on the disability and was determined by the ARDC in conjunction with the LPAC O Other Student experienced illness or a testing irregularity during testing A

Verify Score Codes “Do Not Score” (requires DTC approval) • On the Edit Student Tests screen select student’s name • Click Edit button • Select Reading “Do Not Score” Score Code • A designation must be selected (A, X, or O) • If a student withdrew during the testing window, DO NOT mark a student “Do Not Score”- take them out of the session • Press SAVE

Testing Accommodations Refer to the TELPAS Reading manual, CTC is responsible for ensuring accommodations are marked DS Designated Supports = • Individualized structured reminders • Manipulating test materials • Basic transcribing • Large print (approved paper only)

TELPAS Test Administration Process 1 Register Students and Verify Test Assignments Test assignments: ‒ K– 1: Holistic rating tests ‒ 2– 12: Holistic rating writing test; online listening and speaking test and reading test Must also update years in U. S. schools. 3 2 Administer Listening and Speaking Test and Reading Test/Enter Holistic Ratings Create Online Test Sessions Coordinators or assigned staff will need to create and manage sessions. ‒ K– 1 holistic rating sessions ‒ 2– 12 holistic rating writing session ‒ 2– 12 online listening and speaking sessions and reading sessions Administer and monitor listening and speaking sessions and reading sessions for students in grades 2– 12. Authorized administrators will launch test and enter holistic ratings. . 4 Enter Score Code and Accommodation Information If directed by coordinator, score codes and accommodations will need to be entered. ‒ Some score codes are determined by the ARD committee and must be documented in a student’s IEP. ‒ If a student was provided accommodations, it must be indicated.

Listening and Speaking Headset Test – Test. Nav App

TELPAS Grades 2 -12 Listening and Speaking

2018 TELPAS Listening, Grades 2 -12 For listening items, the text of the stimulus and/or prompt is not available on screen. To interact with online listening items, students will be using “click on the correct answer” and drag-and-drop functionalities, as well as responding to multiple-choice questions for passage-based and nonpassaged-based items. Students will need to wear headsets. All audio is recorded in a studio; no text-to-speech audio is used. Audio is provided for the stimulus/task gray-box direction lines.

Audio: Click on the ball. * *The audio script noted above is only heard by the student. It is not on the student’s screen.

TELPAS Speaking, Grades 2 -12 For speaking items, the text of the prompt is available on screen for students to read and also available in an audio file for students to listen to. To interact with speaking items, students will be using audio capture functionality to record a response, listen to the response, and delete and re-record if not satisfied with their first response. Students will need to wear headsets with a microphone. (Screen will flash if mute has been activated by the student) The computer will capture student’s spoken responses. Students have up to 90 seconds of recording time for a response. Students will only have two attempts to record a clean response.

Read the information below. You will use the map to give directions. When you are ready to speak, tell as much as you can. Imagine that you are at the library. You are going to meet your friend at the park. Explain how you would get there.

TELPAS Extenuating Circumstances • Information on page T-28 of the 2018 District and Campus Coordinator Manual • Required to be indicated for ELLs in grades 1– 12 with special circumstances that have extenuating needs

Extenuating Circumstance • Unschooled Asylees/Refugees • Lack literacy skills in first language and basic subjectmatter knowledge and skills • May also lack basic social skills and may have experienced trauma as a result of previous circumstances • This information is necessary to exclude eligible students’ STAAR results from state accountability ratings and will NOT be gathered during STAAR data collection

Extenuating Circumstance • Students With Interrupted Formal Schooling (SIFE) • Attend school in the U. S. , withdraw and leave the U. S. for a period of time, and return to the U. S. • Gaps in schooling (in the U. S) significantly affect growth in English and learning of subject matter • Once coded as a SIFE always coded as SIFE

Verify Years in U. S. Schools • Start with grade 1 • Follow 60 Day Rule- ELLs enrolled for 60 consecutive days in a school year for that school year count as one year in the calculation of years in US Schools. Therefore, ELL students enrolling within the last 60 school days of a year will be considered to be in their first year for the following year. • Years in U. S. schools are important because they are used to determine accountability performance requirements for AYP and the Progress Measurement • CTC is responsible for ensuring that years in US schools has been correctly entered

Unique Situations • Newly enrolled LEP student: • If LEP from another Texas school they are LEP • If newly enrolled, student is not LEP until the LPAC has been held • A student that enrolls during the online window must be registered in PAN by the campus and added to the test session. Contact Testing Department to confirm that the student needs to test • Students that un-enroll during the window, that have not tested, must be removed from the online test session (contact Testing Dept)

TELPAS Operational Reports From Reports > Operational Reports > Select Online Testing under Report Categories TELPAS Summary Report (District and Campus Level) TELPAS Combined Status Report (District and Campus Level) • This report displays the status of the entry of K-12 TELPAS holistic rating information and grades 2 -12 listening & speaking and reading tests for a district and the campuses within that district. The report indicates the number of students with each status (Not Started, Incomplete, and Completed) for each portion of the assessment. This report can be used to track the progress of a district or campus throughout the testing window. • This report displays the status of the K-12 TELPAS holistic rating entry and grades 212 listening & speaking and reading test for each student registered within a selected organization. This allows coordinators to verify holistic ratings and rater information, completion of TELPAS listening & speaking and reading tests for grades 2 -12, and entry of Years in U. S. Schools information. Certain key elements must be completed before the system will acknowledge a record as complete.

Required Documentation Ø Binder contents will be kept for 5 years Ø All documentation is auditable Ø Keep documents in the same order of the checklist

For TELPAS help call 210 -554 -2465