FY 2007 Federal Performance for Staff Overview and

FY 2007 Federal Performance for Staff Overview and Discussion of Performance Measures for FY 07 June 2006 FY 2007 Federal Performance for Staff 1

Objectives for the Day n Performance Measures At-A-Glance n Performance Reporting Cohorts n Key Definitions You Need to Know n Performance Measures Methodologies n Who’s In/Out of the Measure n How the Measures are Calculated n How does MOSES data entry affect performance? June 2006 FY 2007 Federal Performance for Staff 2

FY 2007 Performance Measures At-A-Glance Adult Measures Youth Adults Dislocated Workers Trade NEG Veterans Labor Exchange Older Youth Entered Employment Rate Retention Rate Average Earnings Employment & Certificate Rate Performance Measures Younger Youth All Youth Earnings Gain Skill Attainment Rate Youth Diploma Rate Attainment Degree/Certificate Placed in Employment/ Education Rate Literacy/Numeracy Gain June 2006 FY 2007 Federal Performance for Staff 3

FY 2007 LABOR EXCHANGE, VETERAN AND TITLE I PERFORMANCE MEASURES COHORTS Performance Measures Report Cohort Entered Employment Rate (Adult, DW, OY, LX) Exit Cohort 10/01/2005 – 09/30/2006 Retention Rate (Adult, DW, OY, YY, LX) Exit Cohort 04/01/2005 – 03/31/2006 Average Earnings (Adult, DW, LX) Exit Cohort 04/01/2005 – 03/31/2006 Employment/Certificate Rate (Adult, DW, OY) Exit Cohort 10/01/2005 – 09/30/2006 Earnings Gain (OY) Exit Cohort 04/01/2005 – 03/31/2006 Skill Attainment Rate (YY) Participation/Goals Cohort 04/01/2006 – 03/31/2007 Youth Diploma Rate (YY) Exit Cohort 04/01/2006 – 03/31/2007 Attainment of Degree/ Certificate Rate (All Youth) Placed in Employment/ Education Rate (All Youth) Literacy and Numeracy Gain (All Youth) June 2006 Exit Cohort 10/01/2005 – 09/30/2006 Participation/Test Cohort 07/01/2006 – 06/30/2007 FY 2007 Federal Performance for Staff 4

FY 2007 Performance Measures A Few Key Definitions § Who is a Participant? § What is a Program Exit? § What is the Exit Quarter? § What are the 1 st, 2 nd and 3 rd Quarters After Exit? § What is an Exclusionary Exit? § What is Supplemental Employment Data? § What is Wage Matching? – A Discussion June 2006 FY 2007 Federal Performance for Staff 5

A Few Key Definitions… n Participant - A participant is an individual who is determined eligible to participate in the program and receives a service funded by the program in either a physical location (One-Stop Career Center or affiliate site) or remotely through electronic technologies. n Self Service Participants For Labor Exchange, we will begin counting as self-service participants, those who receive only self-service or informational services whether through the virtual career center (i. e. MJQ) or at a physical career center. Labor Exchange self-service participants will be counted in performance calculations. June 2006 FY 2007 Federal Performance for Staff 6

A Few Key Definitions… n Program Exit - The term “program exit” means a participant does not receive a service funded by the program or funded by a partner program for 90 consecutive calendar days and is not scheduled for future services. Operational Parameters: Title I participants will be reported as exiters according to the exit date entered by local staff on the Basic tab of MOSES. Local operators are responsible for assuring that participants that receive no service in 90 days are exited. Labor Exchange participants who receive no service for 90 days will be reported as exiters. To the extent possible, it is the responsibility of local staff to assure that a program exit is not entered until all services are completed (e. g. Labor Exchange, NEG, etc. ). This will assure that the participant enters the exit cohort for all programs on a common exit date. June 2006 FY 2007 Federal Performance for Staff 7

A Few Key Definitions… n Exit Quarter - Represents the calendar quarter in which the date of exit is recorded for the individual. Quarter 1 JAN June 2006 FEB Quarter 2 MAR APR MAY Quarter 3 JUN JUL AUG FY 2007 Federal Performance for Staff Quarter 4 SEP OCT NOV DEC 8

AExample-Quarters Definitions… Few Key n 1 st, 2 nd and 3 rd Quarters After Exit Quarter 1 JAN FEB Quarter 2 MAR 3 rd Quarter after exit June 2006 APR MAY Quarter 3 JUN Exit Quarter JUL AUG Quarter 4 SEP 1 st Quarter after exit FY 2007 Federal Performance for Staff OCT NOV DEC 2 nd Quarter after exit 9

A Few Key Definitions… n Wage Matching Process n Massachusetts UI Wage Processing (from DOR) n WRIS (Wage Record Interchange System) n A nationwide system to exchange wage records n Importance of accurate Social Security Numbers n Incorrect Social Security Numbers n Pseudo n Supplemental Wage Information n MOSES “Employment Follow Up” Button June 2006 FY 2007 Federal Performance for Staff 10

A Few Key Definitions… n Exclusionary Exit: A participant in any of the following categories either at the time of exit or during the three quarter measurement period following the exit quarter, will be excluded from all performance measures: n n n June 2006 Institutionalized Health/Family Medical Care Deceased Reservist Called to Active Duty Youth Relocated to a Mandated Program Invalid SSN FY 2007 Federal Performance for Staff 11

A Few Key Definitions… n Supplemental Employment Data: Grantees may use supplemental sources of data to document a participant’s entry and retention in employment for those participants not covered by wage records; e. g. selfemployment, federal jobs, etc. Operational Parameters: Supplemental employment data is entered on MOSES via the Services/Employment Information tab. All supplemental data and methods must be documented and are subject to audit. June 2006 FY 2007 Federal Performance for Staff 12

FY 07 Adult Performance Measures (Labor Exchange, Veterans, Trade, Title I Adults, DW, NEG) ■ Entered Employment Rate ■ Employment Retention Rate ■ Average Earnings ■ Employment & Certificate Rate (Title I Adult and Disloc Worker) June 2006 FY 2007 Federal Performance for Staff 13

FY 07 Adult Performance Measures… Entered Employment Rate Of those who are not employed at the date of participation: # of adults who are employed in the first quarter after the exit quarter divided by # of adults who exit during the quarter June 2006 FY 2007 Federal Performance for Staff 14

FY 07 Adult Performance Measures… 180 adults employed 1 st qtr. after exit – 15* = 165 = 73% 240 total exiters – 15* = 225 *These 15 exiters were already employed at participation and are excluded from the entire calculation. [ADULT ENTERED EMPLOYMENT RATE] June 2006 FY 2007 Federal Performance for Staff 15

MOSES Documentation… Employed At Participation Status From “Eligibility Criteria” June 2006 FY 2007 Federal Performance for Staff 16

MOSES Documentation… Employed At Participation Status Full Tab June 2006 FY 2007 Federal Performance for Staff 17

MOSES Documentation… Supplemental Employment Data Services/Employment Tab June 2006 FY 2007 Federal Performance for Staff 18

MOSES Documentation… Supplemental Employment Data June 2006 FY 2007 Federal Performance for Staff 19

MOSES Documentation… Supplemental Employment Data June 2006 FY 2007 Federal Performance for Staff 20

MOSES Documentation… Supplemental Employment Data June 2006 FY 2007 Federal Performance for Staff 21

FY 07 Adult Performance Measures… Employment Retention Rate Of those who are employed in the first quarter after the exit quarter: # of adults who are employed in both the second and third quarters after the exit quarter divided by # of adults who exit during the quarter June 2006 FY 2007 Federal Performance for Staff 22

FY 07 Adult Performance Measures… Of those who are employed in the 1 st quarter after exit: 145 adults employed in both 2 nd and 3 rd qtr after exit = 81% 180 adults exited during the quarter Exiters who were employed at time of participation are included [ADULT EMPLOYMENT RETENTION RATE] June 2006 FY 2007 Federal Performance for Staff 23

FY 07 Adult Performance Measures… Adult Average Earnings Of those adults who are employed in the first, second and third quarters* after the exit quarter: Total earnings in the second plus the total earnings in the third quarters after the exit quarter divided by # of adult participants who exit during the quarter * via wage match only June 2006 FY 2007 Federal Performance for Staff 24

FY 07 Adult Performance Measures… Of those adults who are employed in the 1 st, 2 nd AND 3 rd qtr after the exit quarter: Summed wages from quarters 2 and 3 after exit = $1, 225, 000 = $15, 909 77 exiters [ADULT AVERAGE EARNINGS] June 2006 FY 2007 Federal Performance for Staff 25

FY 07 Adult Performance Measures… Employment & Certificate Measure (Adults and Dislocated Workers) Of those who receive training services: # of participants who were employed in the first quarter after the exit quarter and received a credential/certificate by the end of the third quarter after the exit quarter divided by # of participants who exit during the quarter June 2006 FY 2007 Federal Performance for Staff 26

FY 07 Adult Performance Measures… Of the Adults and Dislocated Workers who receive training services, 110 were employed 1 st qtr after exit – 12* = 98 = 61% 160 exiters during the quarter *12 did not receive a certificate by the end of the 3 rd quarter after exit. [ADULT EMPLOYMENT & CERTIFICATE RATE] June 2006 FY 2007 Federal Performance for Staff 27

FY 07 Adult Performance Measures… Enrollment into a training course, indicates that a participant is/has receiving training services. Training Enrollment Detail June 2006 FY 2007 Federal Performance for Staff 28

FY 07 Adult Performance Measures… Once the status of a course is “Completed Satisfactorily”, an enhancement service of “Attained …” should be posted if the course results in a degree, certificate or license. June 2006 FY 2007 Federal Performance for Staff 29

FY 07 Adult Performance Measures… Information on the Additional Info tab will indicate if the course results in a Degree, License or Certificate. Training / Training Services / Additional Info June 2006 FY 2007 Federal Performance for Staff 30

FY 07 Adult Performance Measures… Certificates can be earned up to 3 quarters after the exit quarter Services / General June 2006 FY 2007 Federal Performance for Staff 31

FY 07 Adult Performance Measures…Entered Employment Rate Quiz Carmen enrolled as a dislocated worker in Carmen's performance outcome for September 2005. She wasis positive when she Entered Employment still working registered, but had received notice of layoff. She because she was employed during the first June 2006. She starts a new job in exited in quarter after exit, July-September. Remember Notice is her performance September 2006. Whatof Layoff or Military Separation means “unemployed” at outcome for Entered Employment? participation. Positive June 2006 Negative FY 2007 Federal Performance for Staff Excluded 32

FY 07 Adult Performance Measures…Empl/Credential Rate Quiz Ben's performance outcome training Ben completed an A+ Certification for the and Employment and Credential earned his certificate while enrolled in WIA. He measure is negative because he was exits with a job in April, but loses the job in June not employed during his first and does not find another until October. What is quarter after exit, July-September. Ben’s performance outcome for the Employment and Credential measure? Positive June 2006 Negative FY 2007 Federal Performance for Staff Excluded 33

FY 07 Adult Performance Measures…Employment Retention Quiz Julie is excluded from the Julie. Employment Retention December and is an adult. She exits in Measure because she until April. She keeps does not find workwas not employed the job during her first quarter after exit, through September. What is her performance January-March. outcome for Employment Retention? Positive June 2006 Negative FY 2007 Federal Performance for Staff Excluded 34

FY 07 Adult Performance Measures…Average Earnings Quiz John is a dislocated worker. He exits in March John new job in July making about and finds a is excluded from the Average Earnings measure because he was not $38, 000/year and keeps on working. What is employed during his first quarter after John’s performance outcome for Average exit. Earnings measure? (April – June) Positive June 2006 Negative FY 2007 Federal Performance for Staff Excluded 35

FY 07 Youth Performance Measures (Older, Younger and All Youth) Older Youth (19 -21 years old) n Entered Employment Rate n Employment Retention Rate n Earnings Change n Employment & Certificate/Education Rate June 2006 FY 2007 Federal Performance for Staff 36

FY 07 Older Youth Performance Measures… Entered Employment Rate Of those Youth who are not employed at the date of participation and who are either not enrolled in post-secondary education or advanced training in the first quarter after the exit quarter or are employed in the first quarter after the exit quarter: # of youth who are employed in the first quarter after the exit quarter divided by # of youth who exit during the quarter June 2006 FY 2007 Federal Performance for Staff 37

FY 07 Older Youth Performance Measures… 105 youth employed 1 st qtr. after exit – 4* – 7** = 94 = 68% 150 exiters – 4* - 7** = 139 *These 4 youth were excluded from the entire calculation because they were employed at registration. **These 7 youth are not employed and are enrolled in advanced training or post secondary education in the quarter after exit, they are excluded. [OLDER YOUTH ENTERED EMPLOYMENT RATE] June 2006 FY 2007 Federal Performance for Staff 38

FY 07 Older Youth Performance Measures… Employment Retention Rate Of those youth who are employed in the first quarter after the exit quarter and who are either not enrolled in post-secondary education or advanced training in the third quarter after the exit quarter or are employed in the third quarter after the exit quarter: # of youth who are employed in the third quarter after the exit quarter divided by # of participants who exit during the qtr June 2006 FY 2007 Federal Performance for Staff 39

FY 07 Older Youth Performance Measures… Of those youth who are employed in the first quarter after the exit quarter and who are either not enrolled in post-secondary education or advanced training in the third quarter after the exit quarter or are employed in the third quarter after the exit quarter: 75 youth employed in 3 rd qtr. after exit = 82% 99 youth employed in 1 st qtr. after exit – 7* = 92 *These 7 youth are excluded because they are enrolled in post secondary education or advanced training and not employed in 3 rd quarter after exit. [OLDER YOUTH EMPLOYMENT RETENTION RATE] June 2006 FY 2007 Federal Performance for Staff 40

FY 07 Older Youth Performance Measures… Earnings Gain Measure Of those youth who are employed in the first qtr after the exit quarter and who are either not enrolled in post-secondary education or advanced training in the third quarter after the exit quarter or are employed in the third quarter after the exit quarter: Post-Earnings in the [second + third qtrs] after the exit qtr minus Pre-Earnings in the [second + third qtrs] prior to the participation qtr divided by # of participants who exit during the quarter June 2006 FY 2007 Federal Performance for Staff 41

FY 07 Older Youth Performance Measures… Of those youth who are employed in the first qtr after the exit quarter and who are either not enrolled in post-secondary education or advanced training in the third quarter after the exit quarter or are employed in the third quarter after the exit quarter: $950, 000 - $550, 000 = 400, 000 = $2381 240 exiters - 60 * - 12** = 168 *These 60 customers were not employed in the 1 st quarter after exit, so they are excluded. **Supplemental data was used to verify employment for these 12 customers, so they are excluded. [OLDER YOUTH EARNINGS GAIN MEASURE] June 2006 FY 2007 Federal Performance for Staff 42

FY 07 Older Youth Performance Measures… Employment/Education & Credential Measure # of older youth participants who were either employed, in post-secondary education or in advanced training in the first qtr after the exit qtr and received a credential by the end of the third quarter after the exit quarter divided by # of older youth participants who exit during the quarter June 2006 FY 2007 Federal Performance for Staff 43

FY 07 Older Youth Performance Measures… 120 w/credential by the 3 rd quarter after exit - 25* = 95 = 63% 150 exiters *These 25 were not employed or enrolled in advanced training or post secondary education in the quarter after exit. [OLDER YOUTH EMPL/CREDENTIAL RATE] June 2006 FY 2007 Federal Performance for Staff 44

FY 07 Older Youth Performance Measures… Certificates can be earned up to 3 quarters after the exit quarter Services / General June 2006 FY 2007 Federal Performance for Staff 45

FY 07 Older Youth Performance Measures… Entered Employment Quiz Adam, an Older Youth, entered the WIA youth Adam's outcome for the Entered program last year without a job. He exited Employment measure is positive January 5 th withwas employed during his job. a job. April 3 rd he lost because he What is first quarter after exit, Entered his Adam's outcome for the April. Employment measure? June. Positive June 2006 Negative FY 2007 Federal Performance for Staff Excluded 46

FY 07 Older Youth Performance Measures… Employment Retention Quiz Miriam, an Older Youth, exits with a job on October 15. outcome for Employment Miriam's She leaves that job December 15, finds another one April 7, and keeps she Retention is excluded because it through thewas not employed during her first following September. What is her outcome for quarter after exit, January-March. Employment Retention? Positive June 2006 Negative FY 2007 Federal Performance for Staff Excluded 47

FY 07 Older Youth Performance Measures…Empl/Educ & Credential Quiz Tanya, an Older Youth, entered WIA and completed a GED. She exits in June and travels (jobless) through the summer before beginning Tanya's outcome for Credential is classes for her Associate's she was not negative because Degree in October. What is her outcome for her Credential measure? employed during the first quarter after exit, July-September. Positive June 2006 Negative FY 2007 Federal Performance for Staff Excluded 48

FY 07 Younger Youth Performance Measures Younger Youth (14 - 18 years old) ■ Skill Attainment Rate ■ Diploma or Equivalent Attainment ■ Retention Rate June 2006 FY 2007 Federal Performance for Staff 49

FY 07 Younger Youth Performance Measures… Skill Attainment Rate Of all in-school youth and any out-of-school youth assessed to be in need of basic skills, work readiness skills, and/or occupational skills: Total # of goals attained divided by Total # goals set June 2006 FY 2007 Federal Performance for Staff 50

FY 07 Younger Youth Performance Measures… 125* Youth Goals with a Status of “Attained” = 83% 150 Youth Goals set *These goals are required to have the status changed to “Attained” within one (1) year of being set to be include in the numerator. [YOUNGER YOUTH SKILL ATTAINMENT RATE] June 2006 FY 2007 Federal Performance for Staff 51

FY 07 Younger Youth Performance Measures… - Date first goal is established must be the same date as Title I Participation Date. - Younger Youth require at least one goal per year. Case Management goals do not apply Services / Youth Goals June 2006 FY 2007 Federal Performance for Staff 52

FY 07 Younger Youth Performance Measures… Diploma or Equivalent Attainment Rate Of those who participate in the program without a diploma or equivalent: # of participants who attained a secondary school diploma or equivalent by the end of the first quarter after the exit qtr divided by # of participants who exit during the qtr (except those still in secondary school at exit) June 2006 FY 2007 Federal Performance for Staff 53

FY 07 Younger Youth Performance Measures… Of those who participate in the program without a diploma or equivalent and did not exit as Still in secondary school at Exit : 60 Youth attained Diploma or Equivalent = 60 = 71% 105 Youth exiters – 20* = 85 *These 20 Younger Youth were still enrolled in secondary school at exit, and they are excluded. [YOUNGER YOUTH DIPLOMA/EQUIVALENCY RATE] June 2006 FY 2007 Federal Performance for Staff 54

FY 07 Younger Youth Performance Measures… Full Tab June 2006 - A Diploma or GED may be earned up to 1 Quarter After Exit. - If “Highest Degree” is changed to - “High School” for Job Matching, remember to change it back to “Less than High School” for performance measurement. - if an individual has completed the 12 th grade, but has failed to pass the MCAS, users should select “Less than High School”. FY 2007 Federal Performance for Staff 55

FY 07 Younger Youth Performance Measures… Add a general service of Attained High School Diploma when the diploma or GED is received. Services / General June 2006 FY 2007 Federal Performance for Staff 56

FY 07 Younger Youth Performance Measures… Retention Rate # of participants who were found in either post-secondary education, advanced training, employment, military service or a qualified apprenticeship in the third qtr after the exit qtr divided by # of participants who exit during the qtr (except those still in secondary school at exit) June 2006 FY 2007 Federal Performance for Staff 57

FY 07 Younger Youth Performance Measures… Of those younger youth who did not exit as Still in Secondary School at Exit: 85 were retained in 3 rd qtr after exit = 71% 120 Youth Exiters [YOUNGER YOUTH RETENTION RATE] June 2006 FY 2007 Federal Performance for Staff 58

FY 07 Younger Youth Performance Measures… Services / General June 2006 FY 2007 Federal Performance for Staff 59

FY 07 Younger Youth Performance Measures… -Youth are considered retained if they are in employment, military, qualified apprenticeship, post secondary education and/or advanced training in the 3 rd quarter after exit. - Use Retention service 3 Month and 9 Month to indicate Retention in 1 st Quarter After Exit and 3 rd Quarter After Exit, respectively. June 2006 FY 2007 Federal Performance for Staff 60

FY 07 Younger Youth Performance Measures… Diploma or Equiv Rate Quiz Tamika exits from WIA in December. She is enrolled in high school and expectsthe Tamika's outcome on to attain her Diploma/Equivalent Attainment diploma in June. What is her outcome on the measure is excluded because she Diploma/Equivalent Attainment measure? is in secondary school at exit. Positive June 2006 Negative FY 2007 Federal Performance for Staff Excluded 61

FY 07 Younger Youth Performance Measures… Retention Quiz Javier exits WIA on September 23. He gets a Javier's outcome on the Retention job right away and works through April 4, when measure is positive because is was he suddenly decides to quit. Whathe his in a positive outcome (employment) outcome on the Retention measure? during his third quarter after exit, April-June. Positive June 2006 Negative FY 2007 Federal Performance for Staff Excluded 62

FY 07 All Youth Performance Measures ■ Attainment of a Degree or Certificate ■ Placement in Employment or Education ■ Literacy and Numeracy Gains [Common Measures makes no distinction between Older and Younger Youth] June 2006 FY 2007 Federal Performance for Staff 63

FY 07 All Youth Performance Measures… Attainment of a Degree or Certificate Of those enrolled in education (at the date of participation or at any point during the program): # of youth participants who attain a diploma, GED or certificate by the end of the third quarter after the exit quarter divided by # of youth participants who exit during the quarter June 2006 FY 2007 Federal Performance for Staff 64

FY 07 All Youth Performance Measures… Of those enrolled in education (at the date of participation or at any point during the program): 120 Youth attained a diploma or certificate by 3 rd qtr after exit = 77% 156 Youth exiters in Education [YOUTH ATTAINMENT OF DEGREE OR CERTIFCATE] June 2006 FY 2007 Federal Performance for Staff 65

FY 07 All Youth Performance Measures… A participant is considered Enrolled In Education, if In School is Yes on the Full Tab, or if enrolled in an education component. Full Tab June 2006 FY 2007 Federal Performance for Staff 66

FY 07 All Youth Performance Measures… Certificates can be earned up to 3 quarters after the exit quarter Services / General June 2006 FY 2007 Federal Performance for Staff 67

FY 07 All Youth Performance Measures… Placement in Employment or Education Of those who are not in post-secondary education or employment (including the military) at the date of participation: # of youth participants who are in employment (including military) or enrolled in post-secondary education and/or advanced training/ occupational skills training in the first quarter after the exit quarter divided by # of youth participants who exit during the quarter June 2006 FY 2007 Federal Performance for Staff 68

FY 07 All Youth Performance Measures… 142 Youth in qualifying outcomes in 1 st qtr. after exit = 77% 185 Youth Exiters Excluded from this measure are those that were employed, in the military, or in post-secondary education at date of participation. [YOUTH PLACEMENT IN EMPLOYMENT OR EDUCATION] June 2006 FY 2007 Federal Performance for Staff 69

FY 07 Younger Youth Performance Measures… Services / General June 2006 FY 2007 Federal Performance for Staff 70

FY 07 Younger Youth Performance Measures… - Use Retention service 3 Month to indicate Retention in 1 st Quarter After Exit June 2006 FY 2007 Federal Performance for Staff 71

MOSES Documentation… Supplemental Employment Data Services/Employment Tab June 2006 FY 2007 Federal Performance for Staff 72

MOSES Documentation… Supplemental Employment Data June 2006 FY 2007 Federal Performance for Staff 73

MOSES Documentation… Supplemental Employment Data For supplemental employment data, you can refer to the Supplemental Employment Data chart, but remember that the 3 Month service will always indicate 1 st quarter after exit. June 2006 FY 2007 Federal Performance for Staff 74

FY 07 All Youth Performance Measures… Literacy and Numeracy Gains Of those out-of-school youth who are basic skills deficient (and enroll on or after July 1, 2006): # of youth participants who increase one or more educational functioning levels divided by # of youth participants who have completed a year in the program (i. e. , one year from the date of first youth program service) plus the # of youth participants who exit before completing a year in the program June 2006 FY 2007 Federal Performance for Staff 75

FY 07 All Youth Performance Measures… Of those out-of-school youth who are basic skills deficient (and enroll on or after July 1, 2006): 88 Youth advance one or more educational levels = 62% 120 program completers + 22 program drop-outs = 142 [YOUTH LITERACY AND NUMERACY GAIN] June 2006 FY 2007 Federal Performance for Staff 76

FY 07 All Youth Performance Measures… Tests such as TABE, CASAS and ABLE provide numerical scores that correspond with one of six Adult Basic Education educational functioning levels. Adult Basic Education (ABE) Educational Functioning Levels High Adult Secondary Education Low Adult Secondary Education High Intermediate Basic Education Low Intermediate Basic Education Beginning ABE Literacy June 2006 FY 2007 Federal Performance for Staff 77

FY 07 All Youth Performance Measures… Tests such as CASAS, Oral BEST, BEST Plus and Literacy BEST provide numerical scores that correspond with one of six ESL educational functioning levels. English As A Second Language (ESL) Ed Functioning Levels High Advanced ESL Low Advanced ESL High Intermediate ESL Low Intermediate ESL Beginning ESL Literacy June 2006 FY 2007 Federal Performance for Staff 78

FY 07 All Youth Performance Measures… For Literacy/Numeracy measure: n Individual must advance one or more levels n Gain can occur in literacy or numeracy – i. e. participant can pre-test at different levels in each category n Levels consistent with Adult Basic Education National Reporting System (NRS) n Pre-tested within 60 days of participation and post-tested before the end of one year (or at exit if in program less than one year) n Participants only included in measure a second time if they complete a second full year of participation n Must use one of National Reporting System cross-walked tests or equate alternate test to NRS scale June 2006 FY 2007 Federal Performance for Staff 79

FY 07 All Youth Performance Measures… NRS Assessment Tools n Must use one of NRS cross-walked tests or equate alternate test to NRS scale n Tests cross-walked with ABE and ESL levels include: n Comprehensive Adult Student Assessment System (CASAS) n Test of Adult Basic Education (TABE) n Adult Basic Learning Examination (ABLE) n Student Performance Levels for ESL n Basic English Skills Test (BEST) for ESL n Work. Keys (for the top 3 ABE levels) June 2006 FY 2007 Federal Performance for Staff 80

FY 07 All Youth Performance Measures… Services / Testing June 2006 FY 2007 Federal Performance for Staff 81

FY 07 All Youth Performance Measures… Services / Testing June 2006 FY 2007 Federal Performance for Staff 82

FY 07 All Youth Performance Measures… Services / Testing June 2006 FY 2007 Federal Performance for Staff 83

FY 07 All Youth Performance Measures… Services / Testing June 2006 FY 2007 Federal Performance for Staff 84

FY 07 All Youth Performance Measures… Youth Performance Measures Different Cohorts Placement Measure ISY—has a summer job Certificate Measure Literacy Gain Measure Yes In In Out ISY--earns HS diploma but nothing else In In Out UE/OSY/BSD-- increases basic skills & earns GED In In In Out Out In In OSY, Not BSD -- gets job Employed OSY/BSD-increases basic skills OSY/BSD--starts GED but drops out; no skill gain POSITIVE June 2006 Yes In NEGATIVE FY 2007 Federal Performance for Staff 85

FY 07 All Youth Performance Measures… OTHER HELPFUL STUFF June 2006 FY 2007 Federal Performance for Staff 86

WIA Title I: Youth Goals and Elements Report June 2006 FY 2007 Federal Performance for Staff 87

WIA Title I: Performance Review Lists Please Refer to Workforce Issuance No. 06 -35 for more information June 2006 FY 2007 Federal Performance for Staff 88

ADDITIONAL RESOURCES Workforce Issuance 06 -35 - Performance Review Tool TEGL 17 -05: Common Measures Policy for the Employment and Training Administration (ETA) http: //wdr. doleta. gov/directives/corr_doc. cfm? DOCN=2195 PPV/SPRA Performance Enhancement Project On-Line Tutorials http: //www. spra. com/PEP/online_intro. shtml (not 100% up to date for FY 2007) MOSES Help Desk: 617 -626 -5656 MOSES Training Manuals June 2006 FY 2007 Federal Performance for Staff 89