UKCAT Future Developments Research Research Panel Jon Dowell

UKCAT Future Developments (Research) Research Panel Jon Dowell, John Mclachlan, Paul Dennis, Rachel Greatrix

Objectives • • • Inform about basis of access Wet appetite with UKCAT WP related data Produce discussion about potential WP research Inform UKCAT re likely data requirements Generate interest to propose studies. UKCAT Research Panel 2

Task • Introductions - who and why here? • In groups of about 4 – discuss what WP related research you’d like to be able to do (Post its) UKCAT Research Panel 3

History Key objective since outset which stumbled over • Concerns regarding the need for consent • Technical issues with data formats • Possibly also ‘academic undercurrents’ Outcome was that few schools agreed to provide progress data and not clear what could legitimately be done with it. UKCAT Research Panel 4

Core Principles Can proceed without individual consent provided – Data / identities adequately protected – Work in ‘legitimate interests’ of UKCAT Requires ‘buy in’ from universities Access open to contributing universities Eager to support worthwhile work whatever the outcome UKCAT Research Panel 5

Research Strategy Establish • Progress data collection • More structured data management Four core themes • • Predictive validity Widening participation Non-cognitive attributes Open call (including bespoke additional data) UKCAT Research Panel 6

Progress • • • Process redesigned with legal guidance University agreements coming in re progress data(12/26) Data collection details being clarified and discussed on individual basis Data exchanges with Pearson VUE and UCAS now OK Data ‘management’ via Paul Dennis, Oxford Data collected from the first four cohorts who took the test in the 2006 – 2009 application rounds. 2006 -2008 will have ‘full’ UCAS data available Research ‘contract’ drafted Timetable for ‘calls’ • WP – mid 2010 • Predictive validity Late 2010 Support – up to 10 K/study UKCAT Research Panel 7

Basic UCAS matching Numbers with UCAS Data 2006 2007 2008 2009 Total All UKCAT 18542 20167 20512 23719 82940 Full Match with UCAS 16186 18139 18825 21258 74408 1. 5 2. 2 1. 3 0. 0 1. 2 11. 2 7. 8 6. 9 10. 4 9. 1 No application data (%) No UCAS data at all UKCAT Research Panel 8

WP Data overview 2006 All UKCAT 2007 2008 2009 Total 18542 20167 20512 23719 82940 Missing NSSEC data 6590 7301 7585 5400 26876 (%) Missing 35. 5 36. 2 37. 0 22. 8 32. 4

Distribution (%) by NS-SEC (Both parents declared) 2006 2007 2008 2009 Class 1 80. 5 80. 4 80. 9 81. 6 Class 2 5. 5 5. 0 5. 6 Class 3 8. 5 8. 0 7. 9 6. 7 Class 4 2. 5 2. 7 2. 5 Class 5 3. 3 3. 7 3. 5 3. 6 UKCAT Research Panel 10

Single-parent families 2006 Single-parent/Carer 2007 2008 2009 Total 1065 1254 1314 1391 5024 Two-parent/Carer 11952 12866 12927 18319 56064 Potential valid data 13017 14120 14241 19710 61088 29. 8 30. 0 30. 6 16. 9 26. 3 Still missing UKCAT Research Panel 11

Combined data (%) 2006 2007 2008 2009 Class 1 79. 1 78. 9 79. 6 80. 5 Class 2 5. 7 5. 9 5. 2 6. 0 Class 3 8. 8 8. 4 8. 1 6. 8 Class 4 2. 6 2. 9 2. 6 Class 5 3. 8 4. 3 4. 2 4. 1 UKCAT Research Panel 12

6 year courses (WP? ) Overall Class 1 2006 2007 2008 2009 73. 5 70. 9 63. 8 68. 8 Class 2 7. 0 6. 2 6. 3 9. 2 Class 3 10. 7 9. 5 11. 0 5. 8 Class 4 4. 2 6. 2 5. 6 5. 2 Class 5 4. 6 7. 2 13. 2 11. 0 Single parent families 10 20 21 17 UKCAT Research Panel 13

Broader data overview Current • NS-SES (74%), UCAS SES (65%), Postcode, school code • UCAS - Uni choices, A level, degree, Highers • UKCAT cognitive data (subscales/Total) Anticipated • Confirmed entry (from 2007) • Progress and performance data each year UKCAT Research Panel 14

UKCAT WP Research What studies would be worth doing with this resource? Now? (Post its) Future? (Post its) UKCAT Research Panel 15

UKCAT WP Research Choose one study What data would you require to do it? (Post its) UKCAT Research Panel 16

The ‘rules’ All research must be performed ‘on behalf of UKCAT’ (a DPA requirement) • Under ‘contract’ to and in ‘legitimate interests’ of UKCAT • Individual identity protected by data provider, analyst and Board • Schools identity ‘respected’ • Data security ensured • All with access to data required to sign ‘contract’ to this effect. Funding could cover incidental research costs, materials, data transfer, security and analysis (including any statistical consultancy required) and travel and subsistence. UKCAT is a charity and is not able to fund ‘full economic costing’ or provide university overheads. UKCAT Research Panel 17

Conclusion UKCAT research strategy has been delayed but is back on track – live in July is target for first call, re WP. The quality of whole resource depends on widespread participation, which requires careful management. There is potential for a wide range of studies. (But ensure your university is going to provide performance data) We anticipate being able to fund reasonable costs for work we are commissioning. UKCAT Research Panel 18