Quality Assurance During Coding Operations 1 What

Quality Assurance During Coding Operations 1

What Is Coding? The conversion of human language provided in censuses, surveys, or other forms into numbered (coded) categories for data processing and tabulation. 2

Two Ways to Collect Data 1. Closed (check-box) categories 2. Open-ended (write-in) responses 3

Open-ended Responses in the U. S. Census 1. General (race, ethnicity, ancestry, language, relationship) 2. Geographic (place of birth, place of work, migration) 3. Employment and jobs (industry and occupation - “I & O”) 4

Essential Steps in a Coding Operation 1. 2. 3. 4. Classification system - a set of categories and codes that represent them Rules or procedures for assigning the codes Reference materials or examples that provide the information needed to follow the rules Coding method - automated or clerical 5

For Automated Coding Software development, including time and cost ü Testing against human coders (called “validation”) ü Determining what is acceptable output ü Assigning unacceptable and uncoded work to clerks ü 6

For Clerical Coding Determining time, staff, and cost needed for completion Ø Acquiring space and equipment Ø Determining logistics (supervision and workflow) Ø Hiring staff Ø Training and testing staff Ø Process for difficult cases - perhaps problem referral Ø 7

Monitoring Operations and Quality Assurance (QA) Developing resources for helping coders (experts and procedural updates) Monitoring workflow, keeping everyone busy (assignment clerks and specialized coders) Developing quality assurance methods 8

Quality Assurance Methods 1. Verification of codes 2. Select samples to be checked 3. Process for selection of samples 4. Method of verification (dependent or independent) 5. Process for comparing results (matcher) 9

Verification Options Dependent 2 -way Ø 3 -way Ø Independent 2 -way Ø 3 -way Ø 10

Coding Operation Reports Daily and weekly reports that provide results to supervisors and managers 1. Error rates per item by coder 2. Simple calculation to determine acceptable/unacceptable work 11

Decision Strategies 1. 2. 3. Determining what is acceptable work Determining incentives for quality work (award system) Determining what to do about unacceptable work (re-work, retrain, other disciplinary actions) 12