consulting technology digitization services January 2008 CCS Content

consulting technology digitization services © January/2008 CCS Content Conversion Specialists Gmb. H Weidestr. 134, 22083 Hamburg, Germany

doc. WORKS/METAe, a tool for converting documents into structured digital objects Accessible e-books, Paris, January 28 th, 2008 Claus Gravenhorst, Director Strategic Initiatives © January/2008 CCS Content Conversion Specialists Gmb. H Weidestr. 134, 22083 Hamburg, Germany

Background e-books 3 • Only a fraction of the world-wide cultural and scientific heritage is available in electronic form • Limited access to digitised documents • No common metadata standard for ingest and long-term preservation • In-house digitisation: set up and operation of an efficient workflow based on a patchwork of various digitisation tools is complicated and expensive • Manual work takes the largest part of these costs • Outsourced digitisation: limited control and administration mechanisms regarding quality, quantity and adherence to schedules • Cost for a digitised page is still high © January/2008 CCS Content Conversion Specialists Gmb. H Weidestr. 134, 22083 Hamburg, Germany

Challenges e-books 4 • Increase the amount of accessible content in a reasonable timeframe – Enable digitisation on a larger scale • Enable quick and enhanced access by high structured documents – for everyone • Provide integrated digitisation/conversion technologies as well as efficient workflows to lower the total cost of content creation • Provide a standardized output format • Open up new dimensions for research, presentation and distribution of digital content © January/2008 CCS Content Conversion Specialists Gmb. H Weidestr. 134, 22083 Hamburg, Germany

Goals of new technologies e-books 5 • Automate the digitisation and conversion process to create more content at lower costs, less than 10 Euro. Cent a book page! • Increase the added value of digital content through automated tagging and metadata extraction • Provide effective workflow environments for integration of various “state of the art” technologies • Full integration into the given environment and workflow of content owners • Scalability for enabling the setup of networked and distributed production environments © January/2008 CCS Content Conversion Specialists Gmb. H Weidestr. 134, 22083 Hamburg, Germany

Workflow: Value Chain e-books 6 Automated workflow for the conversion of printed items into fully structured digital objects based on common open metadata standards Items: + Books + Newspapers + Journals + Manuscripts + etc. . . Scan from originals and microfilm OS Independent OCR (text) ISR (structure) Source: + Original + Microfilm + Digital Image + PDF Non-proprietary format Layout analysis Import from digital image or PDF files Image preprocessing QA Feedback: + Resolution + Deskew + OCR accuracy + Page sequence Metadata Extraction Automated QA METS/ALTO compliant XML data compatible with multiple presentation systems Improved navigation and search through structured information reverse migration © January/2008 CCS Content Conversion Specialists Gmb. H Weidestr. 134, 22083 Hamburg, Germany

Traditional OCR e-books 7 THE AMERICAN MISSIONARY. Vo. . XXXII JANUARY, 1878 No. 1 American Missionary Association 1877 - 1888 xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxx © January/2008 CCS Content Conversion Specialists Gmb. H Weidestr. 134, 22083 Hamburg, Germany

Physical and Logical Structure e-books 8 © January/2008 CCS Content Conversion Specialists Gmb. H Weidestr. 134, 22083 Hamburg, Germany

Structure Analysis e-books 9 FRONT MAIN BACK © January/2008 CCS Content Conversion Specialists Gmb. H Weidestr. 134, 22083 Hamburg, Germany

Structure Analysis Subchapter 1 e-books 10 Subchapter 2 Chapter 1 Chapter 2 © January/2008 CCS Content Conversion Specialists Gmb. H Weidestr. 134, 22083 Hamburg, Germany

Physical and Logical Structure e-books 11 Preface Title Page Statement Page Table of Contents © January/2008 CCS Content Conversion Specialists Gmb. H Weidestr. 134, 22083 Hamburg, Germany

METS/ALTO – open metadata standard e-books 12 Advantages of fully tagged objects based on XML and open metadata standards: • Supporting open metadata standards like METS, DC, MODS, NISO MIX, ALTO • Full description of the original -> “Digital Original” • With logical structures search results are improved (chapter-, article- based) and more easily accessed (chapter titles, headlines, pictures with captions, footnotes, etc. ) • Enables data exchange with any XML based 3 rd party system • Provides the source for transformation to other formats being used for distribution (various e. Book-formats up to the XML based open e. Book format EPUB (International Digital Publishing Forum -IDPF), navigation and adapted visual or audio-visual presentation (e. g. DAISY) • Supporting Digital long-term preservation • Enables migration to meet future standards © January/2008 CCS Content Conversion Specialists Gmb. H Weidestr. 134, 22083 Hamburg, Germany

METS/ALTO – open metadata standard document e-books 13 METS Metadata Encoding and Transmission Standard TIFF ALTO – Analyzed Layout and Text Object METS/ALTO XML object A document processed in doc. WORKS is converted into one METS XML file. It reflects the whole physical and logical structure, manages all links to the image files and the related ALTO XML files. There is exactly one ALTO file for one image file. ALTO is based on a standardized page description schema and contains all information of a page (print space, margins, coordinates, OCR results). © January/2008 CCS Content Conversion Specialists Gmb. H Weidestr. 134, 22083 Hamburg, Germany

Workflow: Institution-based, integrated Re-Scan Document e-books 14 QA+Correction Book Delivery offshore UID Barcode ISBN Conversion Scanning Image Metadata Reject Condition Imaging Layout Analysis OCR ISR Post OCR Correction Final Output Z 39. 50 Metadata Database ----------- Repository Delivery QA random Automated Quality Assurance © January/2008 CCS Content Conversion Specialists Gmb. H Weidestr. 134, 22083 Hamburg, Germany

Selected Reference e-books 15 CCS technology is in use at digitisation service providers as well as ivy-league cultural and scientific institutions around the world: British Library • Institution-based centre, fully operated by CCS staff • Process aligned with standards, data bases and workflows in use at the library • Employment of robotic scanning technology (colour) • 1 million pages per month, 25 million in 2 years • Full production since begin of September 2007 • Out of copyright books, 19 th century • Output in METS/ALTO, JPEG 2000 and PDF (e-book) © January/2008 CCS Content Conversion Specialists Gmb. H Weidestr. 134, 22083 Hamburg, Germany

Conclusion and Perspective e-books 16 • doc. WORKS/METAe reached a high degree of automation and supports a broad range of document types • Improved accessibility through highly structured digital objects for everyone • doc. WORKS in use at in-house digitisation centres of various content owners all around the world • Growing demand of the publishing industry • Scalable technology enables mass digitisation • Constantly increasing the level of automation • Major goal is lowering the cost of digitisation while assuring high quality standards © January/2008 CCS Content Conversion Specialists Gmb. H Weidestr. 134, 22083 Hamburg, Germany

Contact e-books 17 Claus Gravenhorst Director Strategic Initiatives CCS Content Conversion Specialists Gmb. H information: accessible Weidestr. 134, D-22083 Hamburg, Germany +49 (0) 402 271316 phone +49 (0) 402 2713011 fax +49 (0) 163 271316 mobile Internet: www. content-conversion. com © January/2008 CCS Content Conversion Specialists Gmb. H Weidestr. 134, 22083 Hamburg, Germany