Welcome to the Common Measures Webinar Press *6 to mute your telephone Please do not put your phone on HOLD In the ‘chat’ box, please enter and send us your MWA or organization name, email address, and the names of everyone participating at your location. Thanks!! We’ll get started soon!
AGENDA Webinar Housekeeping Introductions Common Measures TEGL 17 -05 DLEG-BWP PI 05 -41 Performance Measures VAPIS MIS Changes
TEGL 17 -05
Establishing Common Measures • Effort led by OMB as part of President’s Management Agenda – Linking performance to budget – Supporting effective programs – Comparing similar programs across agencies • Includes six federal departments
The Common Measures Adult Measures – Entered Employment – Employment Retention – Average Earnings* * Average Earnings become effective PY 2006; for PY 2005, the measure is an Earnings Change.
The Common Measures Youth Measures – Placement in Employment or Education – Attainment of a Degree or Certificate – Literacy or Numeracy Gains
Common Measures Benefits ü Focus on the core purposes of the workforce system ü Break down barriers to integration ü Resolve questions regarding consistency and reliability of data ü Reduce confusion
PY 2005 Accountability Accountable for specific Common Measures – Entered Employment Rate (WIA, W-P, VETS, Trade) – Employment Retention Rate (WIA, W-P, VETS, Trade)
PY 2005 Accountability Accountable for specific WIA statutory performance measures – Adult, DW, and OY Average Earnings Gain/Replacement (WIA, W-P, VETS, Trade) – Adult and DW Employment and Credential – OY Entered Employment, Retention, Earnings, Credential – YY Retention, Skill Attainment, Diploma Attainment – Customer Satisfaction (Participants and Employers)
PY 2005 Accountability Accountable for reporting on specific Common Measures – Youth Attainment of Degree/ Certificate – Youth Placement in Employment/ Education
PY 2005 Accountability • Reporting recommended for Youth Literacy/Numeracy – Required beginning in PY 2006 • WIA performance accountability for PY 2005 still consists of the “ 17” measures – With some changed definitions
Program Reporting In general, individuals who are eligible for a program and receive any service should be reported in participant counts
Youth Program Design Implication #1 Long-Term Participation Common Measure outcomes are unlikely to be met unless youth participate for extended periods
Youth Program Design Implication #2 Network of Services Since long-term participation is needed to achieve outcomes, now more than ever, WIA youth must have access to a network of services, not a single program or provider
Youth Program Design Implication #3 Assessment • Youth friendly assessments • Tell youth why they are being tested and how the test will be used • Do not retest too soon • Consider other assessments • Remove the high-stake test pressure
QUESTIONS
DLEG BWP – PI 05 -41
Definition of a “Participant”
Required Data to Record Participant Counts
Services That Commence Participation
Definition of an “Exiter”
Services That Extend the Exit Date
Services That Do Not Commence Participation or Extend Exit
QUESTIONS
Performance Measures
Adult Common Measures Entered Employment Rate Employment Retention Rate Average Earnings
Programs Covered WIA Adult WIA Dislocated Worker Trade Act Wagner-Peyser VETS
Entered Employment Rate Definition: For those not employed at participation, the percentage employed in the 1 st quarter after exit
Entered Employment Rate • Calculation: Of those not employed at participation… Number employed in 1 st quarter after exit Number who exit during the quarter
Highlights of Adult Entered Employment Rate ü Excludes Adults employed at participation ü Employment at participation is based on information collected from the individual
Highlights of Adult Entered Employment Rate ü Those who received a notice of termination or the employer has filed a WARN or similar notice are considered not employed ü Transitioning Service Members (expected to retire within 12 months) are considered not employed
Employment Retention Rate ü Definition: For those employed in the 1 st quarter after exit, the percentage employed in the 2 nd and 3 rd quarter after exit • Calculation: Of those employed in the first quarter after exit… Number employed in the 2 nd and 3 rd quarter after exit Number who exit during the quarter
Highlights of Adult Employment Retention Rate ü Includes all those employed in the 1 st quarter after exit regardless of employment status at participation ü Positive outcome requires employment in two post-exit quarters (does not have to be with the same employer)
PY 2006 Average Earnings Definition: For those employed in the 1 st, 2 nd, and 3 rd quarter after exit, average six-month earnings in the 2 nd and 3 rd quarter after exit
PY 2006 Average Earnings • Calculation: Of those employed in the 1 st, 2 nd and 3 rd quarters after exit… Earning from the 2 nd and 3 rd quarter after exit Number who exit during the quarter
Highlights of Adult Average Earnings ü Includes those employed in 1 st, 2 nd, and 3 rd quarter after exit ü Only allowable data source is wage records
Highlights of Adult Average Earnings ü Those whose employment was determined based on supplemental data are excluded from the earnings measure ü WIA programs will use the current Adult Earnings Change measure for PY 2005
QUESTIONS
Youth Common Measures • Placement in Employment or Education • Attainment of Degree or Certificate • Literacy/Numeracy Gains
Program Covered WIA Youth
Placement in Employment or Education Definition: Of those not in postsecondary education, employment, or the military at participation, the percentage in employment, the military or enrolled in post-secondary education and/or advance training/occupational skills training in the 1 st quarter after exit.
Placement in Employment or Education Calculation: Of those not employed, in the military, or in post-secondary education at participation… Number of youth employed, in the military, or enrolled in post-secondary education and/or advanced training or occupational skills training in the 1 st quarter after exit Number of exiters
Highlights of Youth Placement in Employment or Education ü Excludes youth in employment, the military, or post-secondary education at participation ü Employment, military, and education status at participation is based on information collected from the individual ü Employment and military status in the 1 st quarter after exit is based on wage records (supplemental data allowed)
Highlights of Youth Placement in Employment or Education ü Education status in the 1 st quarter after exit is based on administrative records ü Youth in secondary school at exit are included, consistent with ETA’s vision to ensure youth successfully complete their secondary education
Defining Specific Terms Post-Secondary Education A program at an accredited degree-granting institution leading to an academic degree.
Defining Specific Terms Advanced Training/Occupational Skills Training
Attainment of Degree or Certificate Definition: Of those enrolled in education at or during participation, the percentage who attained a diploma, GED, or certificate by the end of the 3 rd quarter after exit.
Attainment of Degree or Certificate • Calculation: Of those enrolled in education at participation or any time during the program… Number or youth who attained a diploma, GED, or certificate by the end of the 3 rd quarter after exit Number of exiters
Highlights of Youth Attainment of Degree or Certificate Youth in secondary school at exit are included, which is consistent with ETA’s vision to ensure youth successfully complete their secondary education
Highlights of Youth Attainment of Degree or Certificate ü Diplomas, GEDs, or certificates can be obtained during participation or at any point by the end of the 3 rd quarter after exit ü Work readiness certificates will not be accepted for this measure
Defining Specific Terms Education Participation in secondary or postsecondary school, adult education programs, or any other organized program of study leading to a degree or certificate
Defining Specific Terms Diploma Any credential accepted by the State educational agency as equivalent to a HS diploma; also includes post-secondary degrees
Defining Specific Terms Certificate Awarded in recognition of an individual’s attainment of technical or occupational skills. Does not include work readiness certificates or certificates awarded by local boards.
Literacy/Numeracy Gains Definition: Of those out-of-school youth who are basic skills deficient, the percentage who increase one or more education functioning levels within one year of participation.
Literacy/Numeracy Gains Calculation: Of those out-of-school youth who are basic skills deficient… Number of Youth participants who increase one or more educational functioning levels Number of youth who completed a year of participation (based on date of 1 st youth service) Number of youth who exit before completing a year of participation
Highlights of Literacy & Numeracy Gains ü Only common measure that is not exitbased ü Excludes in-school youth and out-ofschool youth who are not basic skills deficient ü Includes individuals with learning disabilities
Highlights of Literacy /Numeracy Gains ü A positive outcome means the youth must advance one or more ABE or ESL functioning levels ü Gains can occur in literacy or numeracy ü Educational levels are consistent with Department of Education’s National Reporting System (NRS) ü Reporting begins July 1, 2006
About the Assessments The same standardized assessment must be used for pre- and posttesting
About the Assessments If a youth continues to be basic skills deficient after the first 12 months of participation, they should continue to receive training in literacy and/or numeracy skills
About the Assessments All out-of-school youth must be assessed in basic reading, writing, and math
About the Assessments Pre-testing must occur within 60 days of the first youth program service; can use pre-test from up to six months prior to date of first youth service
About the Assessments Must use one of the assessment tools listed in Attachment C of TEGL 17 -05
About the Assessments Youth should be post-tested by the end of one year of participation and compared to pre-test results obtained during the initial assessment
About the Assessments Youth should be post-tested and included in the measure at the completion of the 2 nd year if they complete two years in the program
Exclusions from Common Measures A participant in any of the following categories, may be excluded – Institutionalized – Health/Medical or Family care – Deceased – Reserve Forces Called to Active Duty – Relocated to a Mandated Program – Invalid or Missing Social Security Number
WIA Program Accountability • MWAs will continue to be held accountable for all current (17) WIA performance measures • WIA Adult performance measures will utilize the Adult Common Measures definitions
QUESTIONS
VAPIS VALUE ADDED PERFORMANCE IMPROVEMENT SYSTEM
VAPIS • Provides adjusted performance data for the State and local areas. • Predicts local area performance. • Provides data to support identification of local area strengths and weaknesses, leading to system improvements.
Programs Included WIA Adult WIA Dislocated Worker Wagner-Peyser
Common Measures Entered Employment Rate Employment Retention Rate Average Earnings
Quarterly VAPIS Report by Program Measure • Actual and Adjusted performance results. • Prediction of future performance results. • Measure of Value Added by local area.
QUESTIONS
Common Terminology Participant = Enrollment = Registrant Activity = Service = Transaction
Participant Counts For new participants in Wagner-Peyser, the system will create a new participant in WIA.
Participant Counts For new participants in WIA, the system will create a new participant in Wagner-Peyser.
Participant Counts For new participants in Trade, the system will create a new participant in Wager-Peyser and WIA.
Wagner-Peyser Changes The activity “Assigned to Case Management” will now require a manual End Date entry.
Wagner-Peyser Changes • Exit information will be available for User Input • All records will now have an Exit Date
WIA Changes The pre-registration screen will be altered to capture Employment Status, Education Status, UI Claim Data and Migrant Worker
WIA Changes A new section for Youth Assessment data will be added to the system
WIA Changes A temporary Exit Date will be added for User input
Estimated Activity End Dates All activities that have Manual End Dates will have the Estimated End Date pre-filled by the system
Reports A new report will be created to list those individuals who are approaching the 90 -day Exit limit.
Conversion of Data All WIA pre-registration, pending Trade and Wagner-Peyser records that are 91 -days old or more will be Exited
Conversion of Data All other records will be checked to determine if they can be considered a concurrent participation
Conversion of Data All records 90 -days old or less will have a new display page showing concurrent participation and other information pertaining to when the record will be Exited
Open Record Display Information 1 Latest Reg. Date: 01/01/2006 Has Activities: Y Latest Act End Date: 03/04/2006 Wagner. Peyser? : Y WIA Y TAA? N Latest Gap Date: 06/07/2006 Latest ----Future Svc: When Exit Will Occur: 06/08/2006
Open Record Display Information 2 Latest Reg. Date: 01/01/2006 Has Activities: Y Latest Act End Date: 03/04/2006 Wagner. Peyser? : Y WIA Y TAA? N Latest Future Svc: ---- When Exit Will Occur: 06/05/2006 Latest Gap Date:
Open Record Display Information 3 Latest Reg. Date: 01/01/2006 Has Activities: Y Latest Act End Date: Wagner. Peyser? : Y WIA Y TAA? Latest Gap Date: Latest ----Future Svc: When Exit Will Occur: N
Exited Record Display Information Latest Reg. Date: 01/01/2006 Has Activities: Y Latest Act End Date: 03/04/2006 Wagner. Peyser? : Y WIA Y TAA? N Exit Date: 03/04/2006 Latest Gap Date: Latest Future Svc:
Exit from the System The system will now Exit all Records
Exit from the System The Exit will occur 90 -days after the latest Activity has Ended and there are no GAPs or Future Services planned.
Exit from the System For concurrently enrolled participants, all records will have the same Exit Date.
Exit from the System For concurrently enrolled participants, if an Exclusionary Exit reason is recorded in any of the programs, that reason will be used for all of the programs.
Questions
www. michigan. gov/bwptraining
For More Information and Q & A’s Please Visit www. Michigan. gov/b wptraining Common Measures
Скачать презентацию Welcome to the Common Measures Webinar Press 6
8a75c729ef426a0220529f56d4ce43c0.ppt