Tests of Adult Basic Education Workshop Objectives

Tests of Adult Basic Education

Workshop Objectives • Practical knowledge needed for implementation, including planning, scheduling tests, registration and the preparation of students • Introduction to scoring and reporting TABE results • Discussion of how to accommodate students with disabilities • Discussion of basic test management • Discussion of other organization and implementation needs

Why TABE? • It provides a complete picture of adult student performance – Provides both norm-referenced and competency-based/ criterion-referenced information – Helps educators and other users evaluate clients’ abilities in basic skills (reading, language, mathematics) • Provides data for initial placement in an Educational Functioning Level (EFL) and subsequent promotion to a higher EFL • Approved for NRS Reporting

Tests of Adult Basic Education • Most widely used adult test in the United States (ABE) • Proven “Validity” and “Reliability” • Norms based on adult reference groups • Content reflects adult learning • Built on 45 years of experience • Grounded in Basic Skills/Higher Order Thinking Skills – Cognitive Complexity – Bloom, Rankin-Hughes, Norm Webb

History of CTB/Mc. Graw-Hill’s Tests of Adult Basic Education (TABE) § TABE 1 & 2 1964 § TABE 3 & 4 1974 -1975 § TABE 5 & 6 1983 § TABE 7 & 8 1994 § TABE 9 & 10 2003 -2004 § TABE Online 2006 § TABE Adaptive 2012 § TASC 2014

TABE Content Validity • Higher Order Thinking Skills – Cognitive Complexity • National Adult Literacy Survey (NALS) • Standards and Guidelines – NCTM, IRA, NCTE • Culturally Diverse Content • Maximum Bias Elimination – Ethnicity – Age – Gender

Content Validity Content measures three types of literacy needed for the High School Equivalency and today’s jobs: – Prose literacy —reading and understanding written text – Document literacy —understanding content of common documents (diagrams, maps, charts, tables, forms, and consumer labels ) – Numeracy —merging knowledge of numerical and word content (the ability to understand complex documents such as tax forms or advertisements that require both text and math skills 2003 NALS Comparative Report to the Nation on Adult Literacy Performance

Versions of TABE l Two Alternate Forms – 9 &10 l Two versions for each form l Complete Battery (3 hours, 37 minutes) l Complete norm- and criterion-referenced information l Detailed diagnostic information l Survey (2 hours, 8 minutes) l Shorter testing time l Easy screening and placement

TABE Test Booklets • Level L Form 9 or 10 (consumable) • Complete Battery Form 9 or 10 (reusable) – Levels E, M, D, or A • Survey Form 9 or 10 (reusable) – Levels E, M, D, or A • Large Print Test Books • Braille (9 only) • Audio (9 only)

TABE 9 and 10: A Flexible, Modular Structure *Core Tests: • Reading • Language • Mathematics – Mathematics Computation – Applied Mathematics Plus Tests (Optional): – Language Mechanics – Vocabulary – Spelling *approved for federal reporting Advanced Tests (Optional): • Social Studies and Science • Algebra/Geometry • Writing ( 2 prompts) Instructional Support • Getting to Know TABE • Building Skills With TABE Scoring Options • Hand-scoring • TABE-PC or Test. Mate TABE • TABE Online

Literacy Level Content Area Items Time Pre-Reading 18 : 13 Reading 32 : 32 Math Computation 16 : 15 Applied Math 34 : 45

TABE Administration and Support Materials • • • Test Directions Norms Book Technical Report Individual Diagnostic Profiles Building Skills with TABE Getting to Know TABE

TABE 9 & 10 Flexible Options: TABE Online • • • Web based version of TABE 9&10 Rapid Registration of student in the system Test scored immediately and automatically Auto Locator for placing students in test level Completely secure test administration and data storage • Timer and book marking features • Reports allow for aggregation of data • Improved accommodation functionality – font color/size

TABE 9 & 10 Flexible Options: TABE PC • • Entire test or any part completed on computer Test scored immediately and automatically Auto Locator for placing students in test level Option for randomizing distractors/ correct answer to improve test security • Timer and book marking features • Option for integrating data with Test. Mate TABE testing and upload • Same reporting formats as Test. Mate TABE

Understanding and Using TABE Appropriately

Frequency of TABE assessments? • Time prior to post-testing ● 50 - 60 hours of instruction (40 min) recommended for ABE students ● 30 -59 hours of instruction recommended for ASE students ● same level, different form ● 120 hours of instruction recommended ● same level, same form

TABE Levels by Content Difficulty L 0 - 1. 9 E 2. 0 - 3. 9 M 4. 0 - 5. 9 D 6. 0 - 8. 9 A 9. 0 - 12. 9 • Most questions on tests are written at the content difficulty indicated • Small amount of questions above and below content range for vertical scaling

Using Best Practices to Administer TABE 9 and 10

Pre-test/Post-test Evaluation

Best Practices in Administering TABE • Inform student about the test experience. – Purpose of testing and use of results – When and where the test will be given – What subject matter will be tested – Types of test questions – Timing and test length – Practice questions • Create and maintain appropriate testing environment. – Trained administrators and proctors – Appropriate spacing/seating of students

Variables That Can Affect Test Results Student • Fatigue • Motivation level • Physical discomfort • Test anxiety Environmental • Light levels • Temperature • Noise level • Ventilation • Other distractions

Best Practices in Administering TABE • Use “Locator” to determine appropriate test level. – – May not be used instead of test level Is not an absolute prediction of ability Has limited number of items Avoid administering a level “too easy” or “too difficult” • Use determined test level in a “standardized” manner. – – Use proper timing Read script verbatim Follow test directions explicitly Ensure comparable testing situation for all examinees

How to Help Examinees Do explain: • Won’t know all the answers • Time frame • No preparation needed • Current skills • Breaks • No trick questions Do not say: • Easy test • Extra time is allowed

Hand Scoring • Must have the following to complete: – Scoreze Answer Sheet or Compu. Scan Answer Sheet – Stencil overlay or Answer Key to score – Norms Book – Diagnostic Profile Sheet

Using TABE with Special Needs Students

Adult Students with Disabilities • Must self-identify • Must provide approved documentation • Must request accommodation

Modifications / Accommodations of Testing Procedures • • • Flexible scheduling Flexible setting Flexible responding Flexible presentation Flexible timing

TABE Accommodations • Making Test Accessible for Adult Students with Special Needs – TABE 9 & 10 -Large Print-(available in Complete and Survey editions) – TABE 9 -Braille-(available in Complete and Survey Editions). – TABE 9 -Audio Taped Edition-(available in Complete and Survey Editions). – Use of TABE Online or TABE PC.

Maintaining Security and Integrity of TABE 9 and 10

Security Issues • Handling Testing Materials – Tracking with TABE Administrators, Students – Keeping Materials in Locked Storage • • No cell phones or electronic devices Number tests and answer sheets Plan for contingencies Active monitoring – 1 proctor for every 15 students being tested – Direct observation for entire test period

Interpreting and Using TABE Results

Score Range vs. Content Range Grade Equivalent Content Range

How to interpret scores – The “raw score” (number correct) cannot be compared from Form to Form • Forms are “alternate” • but not 100% equal item by item – Number Correct (NC) is starting point for determining meaningful scores • For manual scoring, use norms book to interpret NC • Test. Mate TABE, TABE PC & TABE Online generate instant test reports

Interpretation of Grade Equivalent Scores • A GE of 7. 6 in mathematics does NOT mean the student is capable of doing 7 th grade math – it depends on the level of the test being given • The GE score may not always keep pace with academic growth. – Is a 5. 5 GE on M level the same as 5. 5 on the D level? – Can a student’s GE stay the same, but still demonstrate academic growth?

TABE 9 & 10 Score Types • Norm-referenced Scores – – National Percentile (NP) Stanine (1 -9) Scale Score (0 -999) GE (0 – 12. 9) • Standard Error of Measurement (SEM) – All tests have error, but how much? • Criterion-referenced Scores – Number correct – Percent mastery

Scale Scores… 0 to 999 • Scale scores are used as – a basis for deriving the other TABE 9&10 norm-referenced scores that can be used to describe test performance • The scale score takes into consideration – the difficulty of the form: • it takes more items correct in “M” than it does in “D” to get the same scale score • Scale score is the only way to assess educational gain – All items are on a “vertical” scale – Being on an equal-interval scale means that the distance between the two scale scores has the same meaning at different points on the scale

Standard Error of Measurement (SEM) • Every test has error; important to use SEM for correct interpretation of test scores – Estimate of amount of error to be expected in a particular score from a particular test • SEM is: – Attached to each scale score and takes a student’s “true score” into account – Much larger near the floor or ceiling of the range of performance for a given test • Range of performance may be calculated by adding and subtracting the SEM to/from the scale score

38

Linking Data to Instruction

Linking Data to Instruction • Building Skills with TABE • Achieving TABE Success • Contemporary • Steck-Vaughn • Number Power and Number Sense

Turning the Focus to Instruction • Diagnostic Reports - Why Create Them? – Gives an instant view of TABE skills on which to focus prior to post-testing – Gives teachers the opportunity to look at their entire class or select individuals performance on TABE Pre-test – Helps teachers plan instruction – Small group and/or entire class activities based on common skill weaknesses – Target specific weak skills utilizing the Study Guides books and – Form daily lesson plans – Provides a reference for pulling extra materials for supplemental practice – Shapes daily, direct instruction between teacher and student

Turning the Focus to Instruction: Item Analysis Data 1. Individual Diagnostic Profile 2. Test. Mate for TABE software or TABE PC 3. TABE Online Group Item Analysis Report 4. TABE Teachers Guides Instructional Binders Julie Anne Kornahrens, Director, Dorchester County

43

44

45

Turning the Focus to Instruction Correlations from Publishers Content § Where to find them? § In the front of some of the Instructional materials § Links each question to targeted skill lessons in that publisher’s materials § Used for an Individual Students

Turning the Focus to Instruction Creating & Using a TABE Study Plan (Prescriptive) • WHY Create Them? – Provides relevant information to the student about areas of skill strength & weakness – Ties relevance to TABE skills & skills needed for other academic areas (e. g. , HSAP, HSE, etc. ) – Gives an immediate assignment – Focuses on appropriate TABE – Skill practice along with the use of HSE materials – Gives instant success – Promotes student confidence Julie Anne Kornahrens, Director, Dorchester County

49

Assessment Results • Results of both pre- and post-tests are important to the: – Learner: They should know the reason they are placed at a certain level, in certain materials, etc. They can also see how much progress they make. – Teacher: Results should be used to guide instruction and curriculum development. – Program: Critical for program improvement and accountability for achieving targeted outcomes. Results should DRIVE the Instructional Program & TRANSLATE into POSITIVE Program Performance

New TABE Instructional Information: Lexiles • A Lexile is a measure related to reading level of text • TABE reading scale score is matched to a Lexile scale • Books & other texts have been assigned Lexile measures • You can: – Match your learner with materials that are right for his/her reading ability – Monitor growth in reading – Differentiate instruction for your learners – Classify and manage reading materials

Grade and Lexile Ranges by TABE Level A TABE Level D Grade 6 -8 TABE Level M Grade 4 -6 TABE Level E TABE Level L Grade 1 -2 Grade 2 -4 Up to 300 L 140 L – 700 L 445 L-910 L Grade 9 -12 665 L-1100 L 855 L-1210 L

A Portrait of Adult Reading Demands ● ● ● ● Aetna Health Care Discount Form (1360 L) Medical Insurance Benefit Pkg (1280 L) Application for Student Loan (1270 L) Federal Tax Form W-4 (1260 L) Installing Your Child Safety Seat (1170 L) Microsoft Windows User Manual (1150 L) GM Protection Plan (1150 L) CD-DVD Player Instructions (1080 L)

Using Lexiles Achieving Reading Proficiency for All, Willard R. Daggett, ED. D. International Center for Leadership in Education, 2003

Free! How to Access Lexile Information for Your Learners • Call CTB Customer Services at 1 -800 -538 -9547 • Ask for your TABE Lexile Web Access • Go to http: //tabe. lexile. com and log in with your user name and password

2014 Plans and Beyond • TABE Adaptive released in 2012 – No Locator – No E, M, D, A – No 9/10 – Reading, Math (Applied & Computation) and Language tests only – Adaptive engine will select test questions base on the student response on the previous question – Testing time is shortened but diagnostics data similar to the Complete Battery • Next version of TABE - Development scope work to begin – New Forms (rolled out over time from a collection of unscored test items from TABE Adaptive and TABE Formative tests) – Higher level content above the current Level A – Aligned to TASC, OVAE/NRS standards and Common Core Standards • TABE CLAS-E Online - TBA – Computer based testing for Adult ESL students – Reading, Listening, Writing and Speaking

TABE Paper and Pencil • Currently TABE 9/10 – NRS approved through 2017 • New Version needs NRS and State approval • Content for TABE 11 & 12 – Common Core – OVAE Adult Ed Standards – High School Equiv • Levels and Forms – TBD

Test. Mate TABE • • • Scans TABE 9/10 answer sheets Updated reports Updated to support new scanners Updated to support new version of Windows Researching an enterprise version that would scan to a web database (TABE Online) for easier aggregation and data sharing

TABE PC • Currently TABE 9/10 – NRS approved through 2017 • New USB option replaces Floppy Disk – Support for Windows 7 (above) • Plans for 2014 and beyond – New interface – Adaptive – Linking to centralized database (TABE Off. Line)

TABE Online • Currently TABE 9/10 – NRS approved through 2017 • New Prescriptive Reports • New Interface • New Functionality – Selecting multiple students • New Content – Testlets - FREE – Common Core aligned

Sample CBT Item

Best Practices for Administering TABE • Follow test publisher’s recommended testing procedures – Be concerned about test security – Follow NRS and state guidelines regarding the timing and frequency of testing – Use the TABE to drive instruction

Questions? - Thank you ! Mike Johnson National Adult Assessment Manager (630) 789 -4586 mike. johnson@ctb. com