Welcome to Salt Lake City ICESA s 64 th

Welcome to Salt Lake City ICESA’s 64 th Annual Conference September 2000 WIA & WRIS: Florida’s Experience to date. . .

Presentation Topics Brief FETPIP Overview W. I. A. Customer Types & Categories W. I. A. Performance Measures Florida’s Negotiated Goals & Results to date Timing of Florida UI data availability & reports W. R. I. S. Usage & Results Review of electronic resources on CD

Florida Education & Training Placement Information Program (F. E. T. P. I. P) n n Is an interagency data consumer reporting system, administered through the State Department of Education It was designed & developed to follow-up all participants from Florida’s education and vocational training programs

Cooperating Agencies U. S. Govt. Agencies Florida State Depts. of n Postal Service n Education n Dept. of Defense n Labor n Office of Personnel n Corrections Mgt. n Families & Children n Management Services n Board of Regents

Data Items Collected n. Employment – Industry, Occupation, Florida Earnings – Federal Employment, Military Service n. Florida Postsecondary Education – School, College, or University w/program n. Public Assistance in Florida – TANF, Foodstamps n. Corrections – Incarcerations, Releases

FETPIP RECORD MATCHING n Quarterly record matches with Florida’s Wage Records for the W. I. A. , Welfare Reform, Dept. ’s of Corrections, Children & Families, Blind Services, Voc. Rehab, others… n Annual record linkages with 11 external automated databases performed annually for 300+ different follow-up files.

MAJOR USES OF FETPIP DATA n Placement & Accountability n Community College Performance Budgeting & Accountability Occupational Forecasting Conference Performance Based Program Budgeting Federal Vocational Reporting University System Program Reviews Corrections Performance Based Funding Return on Investment & Program Audit Reviews Career Counseling and Guidance Information n W. I. A. Performance Measures n n n n

Dissemination of Data n n n Internet & Electronic Media Articulation Reports OIS Screens Ad Hoc Reports Presentations n n n Annual Publications Performance & Accountability Reports Employer Opinion Survey

Federal Performance Initiatives • WIA requires, and Perkins III urges use of wage and administrative records.

WIA Customer Groups • • Adults Youths 19 -21 years old Dislocated Workers Youths 14 -18 years old

Adults • All “exiters” aged 18 or more who received core services, intensive services or training services funded by adult programs • Excludes those who receive services that are self-service or informational

Dislocated Workers • All “exiters” who received core services, intensive services or training services funded by the dislocated worker program • Excludes those who receive services that are self-service or informational

Youths 19 -21 Years Old • Exiters aged 19 or more on the last service date • Received Services from the youth program

Youths 14 -18 Years Old • Were between the ages of 14 to 18 on their registration date • Received services from the youth program

WIA Core Indicators • • • 1 Adult Entered Employment Rate 2. Adult Employment Retention Rate at 6 months 3. Adult Average Earnings Change in 6 months 4. Adult Employment & Credential Rate 5. Dislocated Worker Entered Employment Rate 6. Dislocated Worker Employment Retention Rate 7. Dislocated Worker Earnings Replacement Rate 8. Dislocated Worker Employment & Credential Rate 9. Older Youth (19 -21) Entered Employment Rate 10. Older Youth (19 -21) Employment Retention Rate 11. Older Youth (19 -21) Average Earnings Change 12. Older Youth (19 -21) Credential Rate Note: Indicators in black are determinable from UI records, those listed in italics are not or not entirely. .

WIA Core Indicators cont’d • • • 13. 14. 15. 16. 17. Younger Youth (14 -18) Skill Attainment Rate Younger Youth Diploma or Equivalent Attainment Younger Youth Retention Rate Participant Satisfaction Employer Satisfaction

Entered Employment Rate (Adults and Dislocated Workers only) Of those who are not employed at registration: Number of customers who have entered employment by the end of the 1 st quarter after exit the number of individuals who exit during the quarter *Employment at registration is based on information collected from the registrant, not on UI wage records. **Dislocated Workers are unemployed by definition; therefore, all are included.

Employment Retention at 6 months (Adults and Dislocated Workers only) Of those who are employed in the 1 st quarter after exit: Number of individuals who are employed in third quarter after exit number of adults who exit during the quarter * Employment in the 1 st and 3 rd quarters following exit does not have to be with the same employer

Average Earnings Change in 6 months (Adults only) Of those who are employed in the first quarter after exit: Total post-program earnings (earnings in quarter 2 + quarter 3 after exit) minus pre-program earnings (earnings in quarter 2 + quarter 3 prior to registration) Number of individuals who exit during the quarter * UI wage records will be the only data source for this measure. Individuals with pre or post-program supplementary employment data should be excluded.

Earnings Replacement Rate (Dislocated Workers only) Of those who are employed in the 1 st quarter after exit: Total post-program earnings (earnings in quarter 2 + quarter 3 after exit) Pre-dislocation earnings (earnings in quarter 2 + quarter 3 prior to dislocation) * UI wage records will be the only data source for this measure. ** If there is no date of dislocation or if the date of dislocation is after registration, use the 2 nd & 3 rd quarters prior to registration.

Employment and Credential Rate (Adults and dislocated workers only) Of individuals who received training services: Number of individuals who were employed in the 1 st quarter after exit and received a credential by the end of the 3 rd quarter after exit Number of individuals who exited services during the quarter * Credentials can be obtained while a person is still participating in services and up to 3 quarters following exit.

Older Youth Entered Employment Rate Of those who are not employed at registration AND who are not enrolled in post-secondary or advanced training in the 1 st quarter after exit: Number of older youth who have entered employment by the end of the 1 st quarter after exit Number of older youth who exit during the quarter * Employment at registration is based on information collected from the registrant, not on UI wage records ** Individuals in both employment and post-secondary or advanced training in the first quarter after exit will be included in the denominator

Older Youth Employment Retention Of those who are employed in the 1 st quarter after exit and who are not enrolled in post-secondary education or advanced training in the 3 rd quarter after exit: Number of older youth who are employed in the third quarter after exit Number of older youth who exit during the quarter * Employment in the 1 st and 3 rd quarters following exit does not have to be with the same employer

Older Youth Average Earnings Change Of those who are employed in the 1 st quarter after exit and who are not enrolled in post-secondary education or advanced training in the third quarter after exit: Total post-program earnings (earnings in quarter 2 + quarter 3 after exit) minus pre-program earnings (earnings in quarter 2 + quarter 3 prior to registration) number of individuals who exit during the quarter * UI wage records will be the only data source for this measure. Individuals with pre or post-program supplementary employment data should be excluded.

Older Youth Credential Rate Number of older youth who are in employment, postsecondary education, or advanced training in the 1 st quarter after exit and received a credential by the end of the third quarter after exit Number of older youth who exit during the quarter * All older youth exiters will be included in this measure ** Credentials can be obtained while a person is still participating in services.

Younger Youth Skill Attainment Rate Of all in-school and any out-of-school youth assessed to be in need of basic skills, work readiness skills, and/or occupational skills: Total number of basic skills goals attained by younger youth plus the number of work readiness skills goals attained by younger youth plus the number of occupational skills goals attained by younger youth The total number of basic skills goals + the number of work readiness skills goals + the number of occupational skills goals set. *All youth must have a minimum of one goal set per year and a maximum of three goals per year.

Younger Youth Diploma or Equivalent Attainment Of those who register without a diploma or equivalent: Number of younger youth who attained secondary school diploma or equivalent by the end of the 1 st quarter after exit Number of younger youth who exit during the quarter (except those still in secondary school at exit)

Younger Youth Retention Rate Number of younger youth found in one of the following categories in the third quarter following exit: - post secondary education - advanced training - employment - military service - qualified apprenticeships divided by: the number of younger youth who exit during the quarter (except those still in secondary school at exit)

Participant Satisfaction • The weighted average of participant ratings on each of the three questions regarding overall satisfaction are reported on a 0 - 100 point scale. The score is a weighted average, not a percentage. • 500 completed participant surveys must be obtained each year for calculation of the indicator. • Responses are obtained using a uniform telephone methodology. • Participants should be contacted within 60 days of the exit date or the date that an exit has been determined.

Participant Satisfaction Questions • Utilizing a scale of 1 to 10, where “ 1” means “Very Dissatisfied” and “ 10” means “Very Satisfied, ” What is your overall satisfaction with the services provided? • Considering all of the expectations you may have had about the services, to what extent have the services met your expectations? “ 1” now means “Falls Short of Your Expectations” and “ 10” means “Exceeds Your Expectations. ” • Now think of the ideal program for people in your circumstance. How well do you think the services you received compare with the ideal set of services? “ 1” now means “Not very Close to the Ideal” and “ 10” means “Very Close to the Ideal. ”

Employer Satisfaction • The weighted average of employer ratings on each of the three questions regarding overall satisfaction are reported on a 0 - 100 point scale. The score is a weighted average, not a percentage. • 500 completed participant surveys must be obtained each year for calculation of the indicator. • Responses are obtained using a uniform telephone methodology. • Employers should be contacted within 60 days of the completion of service or 30 -60 days after a job order has been listed where no referrals have been made.

Employer Satisfaction Questions • Utilizing a scale of 1 to 10, where “ 1” means “Very Dissatisfied” and “ 10” means “Very Satisfied, ” What is your overall satisfaction with the service(s) provided? • Considering all of the expectations you may have had about the services, to what extent have the service(s) met your expectations? “ 1” now means “Falls Short of Your Expectations” and “ 10” means “Exceeds Your Expectations. ” • Now think of the ideal service(s) for people in your circumstance. How well do you think the service(s) you received compare with the ideal set of service(s)? “ 1” now means “Not very Close to the Ideal” and “ 10” means “Very Close to the Ideal. ”

Negotiated vs Actual Florida Performance Levels (984, 991, 992) Adults • • Negotiated Actual Entered Employment Rate 64. 3% 65. 94% Retention rate 78. 11% 80. 54% Earnings Gain $3, 755 $4, 367 Employment & Cred. Rate 40. 0% ---

Negotiated vs Actual Florida Performance Levels (984, 991, 992) Dislocated Workers • • Negotiated Entered Employment Rate 60% Retention Rate 75% Earnings Replacement 80% Employment & Cred. Rate 35% Actual 73. 15% 84. 71% 169. 59% ---

Negotiated vs Actual Florida Performance Levels (984, 991, 992) Youth 19 -21 • • Negotiated Actual Entered Employment Rate 65. 63% 68. 11% Retention Rate 75. 00% 80. 32% Earnings Gain $3, 452 $3, 916 Credential Rate 15. 00% ---

Youth 14 -18 Years Old Negotiated Florida Performance Levels • Skill Attainment Rate • Diploma or Equivalent Rate • Retention Rate = 65% = 20% = 5%

Florida UI Data Availability

Florida WIA “File Types” • New participant files for obtaining pre- registration UI quarters (batched by reg. Qtr) • Participant Exit Files- used for record linkages • Outcome files with pre-registration UI qtrs & post program UI quarters per “Exit” quarter

“Exit” identification strategies. . . Hard Exits vs. Soft Exits Hard Exit - a participant who has a date of case closure, completion or known exit from WIA-funded or non-WIA funded partner service within the quarter. Soft Exit - a participant who does not receive any WIA-funded or non-WIA funded partner service for 90 days and is not scheduled for future services except follow-up services. By default, the last date of service is the exit date.

Florida’s Schedule for 1 st “True” WIA QTR Exit File Delivery, Match Schedule and Reports for 1 st Quarter PY 99 of WIA

Suggestions. . . • “Clean up” prior records before transition or as soon as possible… • Have WIA performance measure baseline data on former JTPA participants for regional and statewide users, know where you are at when setting goals and prior to negotiations… • Implement System design changes as soon as possible with proper training. . .

• Develop new means and systems for capturing educational enrollments and credentials following services. . . ! • Develop reports from WIA client systems for timelier information for management. WIA measurement occurs s l o w l y… • Use client system reports for monitoring reporting quality and “reasonableness”, spotting & reporting data anomolies early, building incentives for on-time, right the first time reporting.

other various state level WIA contacts. . . • Florida: Mike Switzer - (850) 922 -9047 Antonio Carter - (850) 487 -0900 • Indiana: Nina Babich (317) 232 -7381 • Kentucky: William Gaunce - (502) 564 -5360 • Nevada: Liv Jones (702) 486 -6511 Val Hopkins (775) 684 -4076 • Oklahoma: Glen Roberts (405) 557 -5329 • Pennsylvania: Mary Ann Regan (717) 787 -3266 • Tennessee: Carol Groppel - (615) 253 -1330 • Texas: Robert Milne (512) 936 -3300 Shu-Ching Chen - (512) 936 -3300 • Utah: Rick Little (801) 526 -9719 • Vermont: Ted Kinerson (802) 828 -4166

Visit our homepage at. . . www. firn. edu/doe/fetpip/fmain. htm Duane Whitfield 325 W. Gaines St Rm 844 Tallahassee, Fl 32303 -0400 (850) 487 -0900 whitfid@mail. doe. state. fl. us