Use of a CD ROM to Support Teaching of Trainee Doctors M Williams – Specialist Registrar D King – Ph. D Student S Carr – Consultant Nephrologist
Background • Recent pressures impacting upon the training of postgraduate doctors: – Reduced hours and Shift working reduces experience formal lecture style/seminar sessions are less workable. – Modernising Medical Careers - complete revision of postgraduate training including the introduction of formalised assessment procedures. – Growing demand to disseminate medical knowledge to other medical staff and to patients.
Aims of the Training package • To supplement experiential teaching of renal biopsy to their trainee doctors. • To be available to individual Doctors at the appropriate time in training. • Needs no training to perform the education session. • Leicester General Hospital's Nephrology Department produced a CD-ROM.
Development • Primary constraint – money. • Solution – develop material in house. • Success – outside usability evaluation only showed one minor improvement.
Evaluation preparation • Effectiveness – Pre and Post MCQ • Free text – Likes / Dislikes – Learn/ Missing • Usability – – Likert scales (1 -6) Reaction Learning Behaviour • Respondant demographics (Anonymous) • Length of time training in nephrology
Evaluation ongoing • Evaluation updated after 1 x pilot study • All Leicester Trainees (14 in total) – All trainees requested to complete the evaluation material – Do pre- and post-tests – 10 results so far (3 months later) • One odd result not followed up.
Evaluation • Material aimed at trainee doctors • Effective for learning: – Reduction in correlation between prior experience and assessment scores: • • • Pre-test 0. 727 Post-test 0. 306 Average 13% increase in test scores 20% mean average increase among least experienced 2% mean average increase among most experienced
Evaluation • Also effective for revision: – 5. 125 for Consolidation – 4. 333 for Learning (Based on pseudo-Likert scale from 1 to 6, 6 being highest)
Evaluation • Met authors’ objectives: – 4. 056 for Performing – 4. 778 for Selecting – 4. 889 for Preparing (Based on pseudo-Likert scale from 1 to 6, 6 being highest)
Evaluation • Met trainees’ objectives: – 5. 444 for Well Presented – 5. 222 for Relevant – 5. 111 for Good Use of Time – Down to – 4. 111 for Challenging (Based on pseudo-Likert scale from 1 to 6, 6 being highest)
Exploitation • Continued use for trainees in Leicester General Hospital's Nephrology Department • Offer of commercial development
Exploitation • • Extend use beyond Doctors Initially, Renal Specialist Nurses Later, potentially, to patients Though this may involve a move to different delivery medium, ie the Web.
Conclusion • • Successful in-house development Met authors’ immediate objectives Appreciated by target users Potential for wider audience