Скачать презентацию Long-term preservation and accessing of digital documents in Скачать презентацию Long-term preservation and accessing of digital documents in

042aef0777eedc775e1332f5c85509b9.ppt

  • Количество слайдов: 50

Long-term preservation and accessing of digital documents in national and international context Bohdana Stoklasova Long-term preservation and accessing of digital documents in national and international context Bohdana Stoklasova National Library of the Czech Republic bohdana. [email protected] cz Jan Hutar National Library of the Czech Republic jan. [email protected] cz Pavel Krbec Charles University, Prague [email protected] cz

Content • Preservation of digital cultural heritage in Europe – DPE survey • Preservation Content • Preservation of digital cultural heritage in Europe – DPE survey • Preservation of digital cultural heritage in the Czech Republic – Introduction – National policy – National Library of the Czech Republic – Charles University, Prague (Pavel Krbec)

 DPE introduction Objective 1. To create a coherent platform for proactive cooperation, collaboration, DPE introduction Objective 1. To create a coherent platform for proactive cooperation, collaboration, exchange and dissemination of research results and experience in the preservation of digital objects. • • To identify and raise awareness of sources on the issues surrounding the curation and preservation of digital objects across the broad spectrum of national and regional cultural and scientific heritage activity in Europe To contribute to the elimination of the duplication of effort of research activities by researchers at different institutions and to enable identification, collection and sharing of knowledge and expertise. To create a conduit between the research community and practitioner community that will foster the collaborative approaches to preservation needs. To stimulate and co-ordinate further research on digital preservation in key areas and encourage the development of standards where gaps and opportunities have been identified. This will include promoting and developing research agendas.

 DPE introduction Objective 2: To increase prevalence of preservation services and their viability DPE introduction Objective 2: To increase prevalence of preservation services and their viability and accountability. • • • To support the development of a European-wide approach to the audit and certification of digital repositories as an essential stage in creating content management and delivery services and to repository federation. To stimulate ICT companies and software developers to incorporate some of the curation and preservation thinking into newer generations of software. To relate the digital preservation research agenda more directly to the development of exploitable product opportunities and to develop links with the industrial sectors.

 DPE introduction Objective 3: To improve awareness, skills and available resources. • • DPE introduction Objective 3: To improve awareness, skills and available resources. • • • To examine core issues that will deliver essential guidelines, methods and tools to enable preservation action with European public and private sectors. To implement a suite of training seminars based on best practice and to identify where and what further practitioner training and staff development initiatives might be undertaken.

 Market and technology trends analysis Objectives of the Market and technology trends analysis Market and technology trends analysis Objectives of the Market and technology trends analysis • • Market analysis based on experience and knowledge of all the contributors and the consultation of main stakeholders on their needs and plans so that the outputs of the DPE project meet their present and future demands. Examine core issues that will deliver essential guidelines, methods and tools to enable preservation action with European public and private sectors. Technology trends analysis providing main DPE target groups with information on technological solutions available for digital preservation.

 Market and technology trends analysis Survey 7 questions 1. 2. 3. National libraries Market and technology trends analysis Survey 7 questions 1. 2. 3. National libraries (36 answers) Archives (37) Industry (28 – difficult to reach them) – 4. (ICT companies; Media) Research institutions (54) – 5. (inc. universities) Others (17) – – (Non-governmental institutions and organisations; Related projects, coalitions and initiatives; Governmental institutions and local authorities) not addressed, but we received 17 answers „ by chance“ ; -)

 Market and technology trends analysis Survey Conclusion results of the survey -> • Market and technology trends analysis Survey Conclusion results of the survey -> • The answers to some questions are very similar. • There also some differences. Some of these could have been predicted, others are a bit surprising. Conclusion is for all survey targets. . . for more detailed information see DPE Market and Analysis document •

 Market and technology trends analysis Question 1: Is digital long-term preservation (including migration, Market and technology trends analysis Question 1: Is digital long-term preservation (including migration, emulation, preservation metadata and planning etc. ) one of the key strategic priorities of your institution? • We got positive answers from 83% of national libraries, 78% of archives, 70% of research institutions, 78% of ICT companies and media and 82% of ‘Others’. • This means that long-term preservation is a key strategic priority for all targeted institutions without any measure of doubt.

 Market and technology trends analysis Question 2: Do you (or will you) have Market and technology trends analysis Question 2: Do you (or will you) have a trusted digital repository (according to the criteria listed in An Audit Checklist for the Certification of Trusted Digital Repositories)? • • • 29% of national libraries answered yes, 9% of them answered no and 62% answered not yet. The 62% ‘not yet’ is the highest value of all targets. All the others answered ‘not yet’ in around 30% of their answers. This could show that libraries are more aware of the importance of having a trusted digital repository. 43% of Archives, 31% of Research institutions, 39% of ICT companies and Media and 29% of ‘Others’ stated they have a trusted digital repository.

 Market and technology trends analysis Question 3: Digital preservation is too big an Market and technology trends analysis Question 3: Digital preservation is too big an issue for individual institutions to address independently. Who will your institution cooperate in this area with. . . ? • • Respondents were given the choice of memory institutions, research institutions, digital document producers and software developers. For all our target groups of respondents memory institutions were the first choice for cooperation in these areas. They were followed in second place by research institutions (except for ICT companies and Media and ‘Others’). .

 Market and technology trends analysis Question 3 cont. • SW developers and vendors Market and technology trends analysis Question 3 cont. • SW developers and vendors are important for Archives and, not surprisingly, especially for ICT companies and Media (second place) and for ‘Others’ (third place). • In all the charts it is obvious that it is very important and comfortable to cooperate with institutions from the same area as the institution seeking cooperation.

 Market and technology trends analysis Question 4: The building and operation of a Market and technology trends analysis Question 4: The building and operation of a trusted digital repository is a big and expensive business. Will you create and operate the repository only for your library or share it with others? • • • The answers were very different. Only 20% of national libraries plan to create and operate a repository exclusively for themselves, while 38% of Archives plan to have one just for their own institution. Completely different situation was for Research institutions, ICT companies and ‘Others’, where 48%, 75% and 71% of these want to have one exclusively for their own use.

 Market and technology trends analysis Question 5: What system will your digital repository Market and technology trends analysis Question 5: What system will your digital repository use? • • Not surprising that national libraries plan combined solutions with a relatively high percentage (52%) opting for commercial systems. Research institutions rely mainly (38%) on Open Source solutions (also expected). All charts except Libraries are more or less the same. About 20% opt for systems developed in their own institution. Only 11% of ICT companies and Media would like to have an Open Source system, the reason being more than clear. On the other hand, Research institutions were 38% for Open Source systems, ‘Others’ and Archives 25% and 24%.

 Market and technology trends analysis Question 6: Which of the outputs listed in Market and technology trends analysis Question 6: Which of the outputs listed in the model of DPE dissemination do you consider to be the most relevant for your institution? • The DPE website is the favourite output for all our targets. Only Libraries ranked Conferences, seminars and workshops at the same level of importance. • Conferences, seminars and workshops are important outputs for ICT companies and Media and for Research institutions. • All DPE targets are interested in Guidelines and Recommendations. Newsletters are not popular at all (except for libraries).

 Market and technology trends analysis Question 7: In the vision of FP 7, Market and technology trends analysis Question 7: In the vision of FP 7, national competence centres are seen as an integral way of ensuring effective development of expertise and services. Which institutions in your country do you consider to have the best background for becoming fully operational and trusted national competence centres? • • Memory institutions are the leading candidates mentioned by all the institutions. Research institutions were ranked second by Libraries and by Research institutions themselves. Governmental institutions are significant for almost all DPE targets, especially for Archives and Libraries. Only ICT companies notably stated that private companies and industry could be a good candidate to become a competence centre.

 Market and technology trends analysis Technological solutions • • • Commercial Open source Market and technology trends analysis Technological solutions • • • Commercial Open source Combinations

DP in the Czech Republic Introduction • • • Czech Republic - long tradition DP in the Czech Republic Introduction • • • Czech Republic - long tradition in digitization and web harvesting. National Library of the Czech Republic was awarded the first UNESCO/Jikji Memory of the World Prize for its contribution to the preservation and accessibility of its documentary heritage in 2005. When we look at digital preservation in all its complexity, we have to admit that digital preservation has been underestimated and that it is only in its infancy. Thanks to large national grant projects, our digitization projects including endangered books and periodicals and historical manuscripts started in the early ‘ 90 s. We started with harvesting and archiving of Czech web resources in 2000. We have about 35 TB together, covering the core of the national cultural heritage. These documents are accessible via the three national subsystems, Manuscriptorium, Kramerius, and Web. Archiv, covered by the Czech National Digital Library. There also many projects running in other libraries and universities that are expected to enrich the Czech National Digital Library in the future. The concept will be presented from the point of view of the National Library and also by one of the participating institutions – the Charles University.

National policy Broader context: • Concept of long-term preservation of and access to national National policy Broader context: • Concept of long-term preservation of and access to national document cultural heritage (both analogue and digital) – prepared by the Ministry of Culture, to be approved by the Czech Government (delayed as result of political situation, Operational Programme “Czech Republic Integrated Operational Programme” – Programme under the Convergence and Regional Competitiveness and Employment Objectives, co-funded by the European Regional Development Fund (ERDF), „Smart Administration“ • Czech Digital Library - conceptualizes a new national integration of the different digital libraries in the CR with digital repositories of other cultural heritage and research institutions

National policy Digital preservation: • Central trusted repository – national digital cultural heritage – National policy Digital preservation: • Central trusted repository – national digital cultural heritage – funding Ministry of Culture (Manuscriptorium for digitised historical and rare documents, Kramerius for digitised books and periodicals, Web. Archiv for archiving of web – all the projects have national framework), opportunity for others – funding from other resources • Institutional repositories – subject-oriented, regional. . . inst. funding

Central repository • • • Data storage As the central disk storage two IBM Central repository • • • Data storage As the central disk storage two IBM Systems Storage DS 4800 are installed, one in Klementinum and the second one in Hostivar data centre. These data centres are connected via dark fibre with CWDM modules and fibre channel switches SAN 16 B-2 built Storage Area Network (SAN) are used in each of above mentioned localities. For the backup and archiving services the Tivoli Storage Manager (TSM) together with an IBM tape library is used. The currently implemented solution for the Central Data Storage provides the possibility to store digitalized data on the safe platform with flexible capacity. The CDS offers also services concerning Disaster Recovery. Data are replicated between two data centres more than 20 km distant. Both this replication and distance between localities protect data against the physical destruction of the building, long power outage, etc. Together with CDS both backup and archiving systems are available to protect operating data against human or software error. Next steps beside appropriate CDS capacity for digitalization in year 2008 are to be finalization of backup and archiving strategy for selected applications to enhance data security. DOMS – to be selected in 2009 -10 Internal audit – DRAMBORA - recommendations

Introduction of the National Library of the CR and its key role in preservation Introduction of the National Library of the CR and its key role in preservation in the national cultural heritage • National library, more than 6 million volumes (many of them candidates for digitization) • Digitisation since 1992 • Web harvesting since 2000 • Negotiations with publishers (legal deposit also in digital form – to avoid digitization of printed legal deposit in the future) • National coordination of digitization and digital preservation • International cooperation

Seat of the NL • Klementinum (+ Hostivar) – no space after 2010, long-term Seat of the NL • Klementinum (+ Hostivar) – no space after 2010, long-term preservation of printed documents endangered) • New building – Letna - ? ? ?

CDR Self Audit • DRAMBORA (Digital Repository Audit Method Based on Risk Assessment) • CDR Self Audit • DRAMBORA (Digital Repository Audit Method Based on Risk Assessment) • • • DPE and DCC (2007) – version 1 paper 6 pilot audits over the Europe one of them at NKP – summer 2007 – – • feedback for Drambora Team to further development feedback for us about CDR situation April 2008 – version 2 online interactive

CDR Self Audit – problematic areas 1. 2. 3. 4. 5. 6. 7. Organisational CDR Self Audit – problematic areas 1. 2. 3. 4. 5. 6. 7. Organisational issues in the NKP Not sufficient funding Overall concept of the National Digital Library is not submitted We dont have DOM System Metadata Lack of sufficient number of appropriately qualified staff Government support – doesn't exist basically

Risks - examples Risk ID Risk name R 34 Overall concept of the National Risks - examples Risk ID Risk name R 34 Overall concept of the National Digital Library is not submitted 21 R 08 Our system doesn’t provide transformation of submitted objects to archival packages 20 R 10 Integrity and authenticity of the digital objects in the repository is not controlled. 20 R 18 Unclear what is within AIP 20 R 19 Identifier of digital objects is not persistent 20 R 21 Preservation metadata for archived content are not acquired 20 R 26 Documented change history is incomplete or incorrect 20 R 43 Allocated insufficient resources for the activity 20 R 52 Uncertainty of getting money for purchasing the DOM system for the repository 20 R 47 Lack of sufficient number of appropriately qualified staff 20

Institutional repositories • Data storage – different solutions • Institutional repositories management systems – Institutional repositories • Data storage – different solutions • Institutional repositories management systems – research institutions – mainly open-source (Fedora, DSpace etc. , some – commercial - Digi. Tool)

Introduction of the Charles University in Prague and its role in digital preservation • Introduction of the Charles University in Prague and its role in digital preservation • founded in 1348 • 17 faculties • 40000 students, 7000 employees

Charles University and its role in digital preservation NDL – Charles University documents Charles University and its role in digital preservation NDL – Charles University documents

 Charles University and National Digital Library SW Charles University - Digitool, stress on Charles University and National Digital Library SW Charles University - Digitool, stress on Presentation NDL- Preservation

PS Architecture Search tools Preservation Management Publishing Manual process Deposit SIP Automated process Ingest/ PS Architecture Search tools Preservation Management Publishing Manual process Deposit SIP Automated process Ingest/ Staging Repository AIP ORACLE Deposit storage area Staging storage area Permanent Repository MD DIP ORACLE Permanent storage area Delivery

 Charles University digital documents · Thesis, Papers, e-learning support, … · Rare historical Charles University digital documents · Thesis, Papers, e-learning support, … · Rare historical manuscripts Maps Administration

Charles University and its role in digital preservation NDL – Charles University documents Charles University and its role in digital preservation NDL – Charles University documents

Charles University and its role in digital preservation NDL – Charles University documents Charles University and its role in digital preservation NDL – Charles University documents

Charles University and its role in digital preservation NDL – Charles University documents Charles University and its role in digital preservation NDL – Charles University documents

Audit – Charles University Computer Centre • DRAMBORA version 2 (online) • v 2 Audit – Charles University Computer Centre • DRAMBORA version 2 (online) • v 2 much more user friendly compared to v 1

DRAMBORA version 2 • • • April 2008 Interactive online tool + manuál Audit DRAMBORA version 2 • • • April 2008 Interactive online tool + manuál Audit and results evaluation Connection to DB containing previous audits data Roadmap, hints for auditors Manual containing metodology

Audit – Charles University Computer Centre • Revealed problems: – Continuity of knowledge – Audit – Charles University Computer Centre • Revealed problems: – Continuity of knowledge – Crisis plans – Legal Aspects (stored documents copyright problems)

DRAMBORA AUDIT RESULTED in Immediate Actions • Knowledge Base and virtual training centre • DRAMBORA AUDIT RESULTED in Immediate Actions • Knowledge Base and virtual training centre • Legal aspects • Strategy (long run strategy) and forthcoming actions plan • Risk evaluation and disaster prevention • Crisis plan

Dlouhodobá archivace Dlouhodobá archivace