Collection Analysis: Overview Sponsored by ALCTS CMDS Measures & Education Committees Peggy Johnson, Associate University Librarian University of Minnesota m-john@umn. edu
“Culture of Assessment/Evaluation” n Way to demonstrate • Relevance • Value • Impact n Considered from the view of • Users • Stakeholders Amos Lakos & Shelley Phipps – “Culture of Assessment” John Crawford – “Culture of Evaluation”
“Those who fail to move in the direction of systematic assessment will be unable to cope with the increasingly difficult questions that promise to confront collection officers in years to come. ” Mark Sandler, Univ. of MI
Why do we do it? As part of good management. n Accountability: To demonstrate to funders and clients that the service is delivering the benefits expected when the investment was made n Decision-making: To ensure that resources are being used efficiently and effectively (an internal control mechanism) n Marketing: To report success and accomplishments (public relations)
Collection assessment assumes that the criteria for success are defined and understood by those doing the assessment and those to whom it is being reports.
What is it? A mechanism to determine: n If the collection is meeting its objectives n How well it is serving its users n In which ways or areas it is deficient, and what remains to done to develop the collection n If selectors are performing their responsibilities effectively n How to allocate collections/access funds
How is assessment different from evaluation? n n Evaluation determines how well the collection supports the goals, needs, and curriculum of the parent organization. Assessment examines or describes collections either in their own terms or relative to other collections and checklists.
Who is the audience ? n n n n Accreditation agencies Parent organization (administration, board, senior management) Library administration CDM supervisor Selector User community or communities Consortial partners
How can we do it well? n n n n Simple Practical Repeatable Clear focus Understandable results Meaningful results Results lead to action
Collection-based Measures Look at: n Size n Growth n Coverage (depth, breadth, balance)
Collection-based Measures n Checking lists, catalogs, bibliographies n Evaluating the collection directly n Compiling comparative statistics n Application of collection standards
Use- and User-based Measures Look at: n Who is using the collection? n How often? n What are users’ expectations? n What are user’s needs? n What are their perceptions?
Use- & User-based Measures n Circulation studies n In-house studies n Survey of users n Shelf availability studies n Analysis of online usage of electronic resources n Analysis of ILL statistics n Citation studies n Document delivery tests n Cost-per-use
Quantitative Measures n Count things • Use • Expenditures • Titles • Physical items
Quantitative Measures n Titles n Circulation transactions n Expenditures n E-metrics n ILL transactions n Ratios (monographs/serials; volumes/students; expenditures/degree programs; electronic/print)
E-Metrics n n n n Online sessions Documents downloaded Records downloaded Virtual visits Turn-aways Alert usage Personal profile users Remote versus onsite usage
Qualitative Research “A process of inquiry that draws data from the context in which events occurs. . . using induction to derive possible explanations based on observed phenomena” Gorman and Clayton, Qualitative Research for the Information Professional: A Practical Handbook, 2 nd ed. (London: Facet, 2005)
Qualitative Measures Look at: n Strengths n Weaknesses n Non-strengths
Qualitative Measures n n Provide the context Offer a way to understand the attitudes that inform the statistics
Quantitative Measures n n Focus groups Online or printed surveys Interviews (structured or unstructured) Observation
Collection Analysis Methods Use- or User-based Quantitative • ILL Qualitative n. User Collection-based statistics • Collection size and growth • Circulation statistics • Materials budget size and • In-house statistics growth • Document delivery • Collection size standards statistics and formulas • Shelf availability • Expenditures by subject statistics • Ratios • E-metrics opinion surveys n. User observation n. Focus groups n. Interviews n. List checking n. Verification studies n. Citation analysis n. Direct collection checking n. Collection mapping (assigning conspectus levels)
Steps in a Collection Analysis Project Plan Do Act Study
Where to start? n n n Define the question or problem Determine metrics to use Decide: • Where to locate the information • Who will collect the information • Who will analyze and report the information • Who will act on the information
Remember n n n Chose measures that matter Chose an approach that is simple Don’t aim for perfection—good ‘nuff is OK Don’t do it once and never again Know your audience Present data in a context—explain what it means
Скачать презентацию Collection Analysis Overview Sponsored by ALCTS CMDS Measures
74e761a0eb73cf70dce0e29f0314772a.ppt