Open Source Software The Show Moves On

Open Source Software: The Show Moves On … ECPRD ICT WG Meeting House of Representatives Nicosia, Cyprus. 6 November 2003 Andrew Hardie, Information Architect 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 1

OSS – The Show Moves On … z Topics: y We have moved on from: x OSS is free! y to: x OSS provides better security y to: x OSS provides better diversity and choice x OSS provides better value for money x OSS provides open file formats 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 2

OSS – The Show Moves On … z Topics: y Open file formats y Microsoft’s “Shared Source” and File Format Licensing for Public Sector y Other OSS developments y Financial, Technical, Business and Political cases for OSS y Recommendations y Conclusions 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 3

OSS is free! z Yes, but: y Cost of installation, support, people is far greater percentage of project/system costs z Yes, and: y Updates are vital revenue stream for software companies, but OSS updates are free and, usually, faster in coming 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 4

OSS provides better security z Yes and no: y. Having the Source Code: x Doesn’t make it inherently lower risk x But, you can make wider assessments of the risks y Having the Source Code: x Doesn’t make the S/W any easier to install x But, you can do what you want with the code: • fix, improve, reuse and redistribute 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 5

OSS provides better diversity z Yes: y Different versions of Linux, optimised for: x Stability – e. g. Debian x Speed – e. g. Free. BSD x Full featured – e. g. Red Hat x European support – e. g. Su. SE, Mandrake x CD bootable, turnkey firewalls, etc. 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 6

OSS provides open file formats z The new “real issue” (esp. in Public Sector) y Remember Peru? x Free access to public information by the citizen: “To guarantee the free access of citizens to public information, it is indispensable that the encoding of data is not tied to a single provider. “ x Permanence of public data: “To guarantee the permanence of public data, it is necessary that the usability and maintenance of the software does not depend on the goodwill of the suppliers, or on the monopoly conditions imposed by them. ” 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 7

Microsoft’s “Shared Source” z Provides view access to source code z Some versions allow “debug” access z None allow modification or distribution z Availability limited - not available in Europe to: Albania, Andorra, Armenia, Azerbaijan, Bosnia & Herzegovina, Croatia, Cyprus, Estonia, Georgia, Iceland, Latvia, Liechtenstein, Lithuania, Malta, Moldova, Romania, Russia, San Marino, Serbia & Montenegro, Slovakia, Slovenia, FYROM, Turkey, Ukraine 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 8

Microsoft’s “Shared Source” (2) z Source code access is far too complex a way to solve transparent file access issues z May have a role where MS S/W is used for democratic activities, e. g. e-voting, but: y Cannot be limited by country y Must be available to election NGOs also y Must be possible to report publicly on issues 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 9

Microsoft’s “Shared Source” (3) z My opinion: y Not a suitable vehicle for solving the democratic information access issues for parliaments and other public sector bodies y Not acceptable that a commercial company decides on a country’s worthiness on such an issue y Often, the countries that may be least worthy in the company’s eyes are precisely the ones in most need of the best possible democratic transparency 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 10

Microsoft’s “Plan B” z “Government and Parliament License Agreement for Archival, Forensic and Security Use of Microsoft Office File Format Documentation” y. Recognises that the file formats are the issue, not the code y Provides for “certain limited, public-sector-specific uses of Microsoft Office binary file format documentation in a government's or a parliament’s capacity as a Microsoft customer”. y Certain what? Limited how? y Available to all countries, as of right, and on an equal basis? y Binary only? What about XHTML? Is it Binary or HTML? y What about email files? 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 11

Microsoft’s “Plan B” – HTML issue z Microsoft says: y“Microsoft is committed to offering customers that use Microsoft Office the choice to create, edit and save files using one or more “open” formats, where such exist” y“Microsoft Word 2003 allows people to save documents using Microsoft formats as well as “open” formats such as HTML and ASCII” z But, which HTML? y“Save as Web page” (with Office-specific markup)? y“Save as Web page, filtered” (traditional HTML)? z So far, no clear answer … 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 12

Microsoft’s “Plan B” – access or escrow? z licensed to “develop future Office-originated document rendering technology for internal government or parliament use in the event no suitable alternative technology is then commercially available” z What does rendering technology mean? View? Analyze? Debug? z Rendering (“presentation & display” the paper says) isn’t the issue: conversion to non-Microsoft-dependent file formats is the issue! z Is the plain English translation of the “in the event …” bit really: “as long as Microsoft remains in existence and provides some kind of technology, of whatever quality, to support old MS Office file formats, you are not allowed to do anything”? Or any other after-market co. ? 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 13

Microsoft’s “Plan B” (4) z licensed to “identify certain meta-data underlying a given Office-originated document” y Identify - how? Which metadata? Document properties? y And then do what with it? Just make a list? Export it? z licensed to “engage in Office-related security analyses” y And do what with the results? Tell Microsoft only? y What about independent NGO scrutiny? z What will be the position with Word. ML (Office 2003)? y Implication is that it will be, effectively, “proprietary XML” z As for Longhorn XAML, who knows? 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 14

My Plan z Goal: Parliaments must be able to publish and archive public interest information in a reusable “open” format that does not depend on any supplier’s technology or licensing conditions y (Note: not, necessarily, create in this format) z So, if Word is used to create, the questions now become: y “Will Microsoft permit and support this? ” y “If not, why not? ” z And, if not, the decision for Parliaments, etc. , would then be: y “Does Microsoft have a role in this process at all? ” 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 15

My Plan (2) – How? z The with-Microsoft scenario: y Create in Word, with doc. properties, named styles for structure, etc. y Convert to XHTML, retaining the Office-specific markup y Retain this “Word-XHTML” file for corrections, etc (short/med-term) y Also convert markup to generic XML, using UTF 8 coding (long-term) y Microsoft then have no control over these converted file formats z What Microsoft needs to do: y Publish the XHTML format and its relationship to Word Doc. model y Agree the use of the information in it to perform such conversions y Or, write a plug-in/filter to do the above and make it freely available z Microsoft does not have to relinquish its proprietary rights over the binary file format or, even, the XHTML (if it claims it) 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 16

My Plan (3) – How? z The without-Microsoft scenario: y Abi. Word, Open Office, etc (not necessarily no MSWindows) y Convert to XML, UTF 8, etc. (If necessary) y Lots of choices, also lots of cross-training and support issues, but not insuperable z But also remember: y There is no such thing as an enduring file format y There is no such thing as an enduring storage medium y Archive now means a copy of online, not an offload of it 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 17

Other developments 1 z Two major studies on OSS: y Danish Technology Board report “OSS in e-Government” (now available in English) x “The essential requirement to be met for increased application of open source on the desktop and for greater competition to be established in the area is for the public sector to make sure that word-processed documents are exchanged in an open file format” x “… open source as infrastructure software entails substantially lower costs” x “Significant socio-economic potential in the application of OSS. […] great economic scope for investments in both IT skills & pilot development projects in choosing OSS …” 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 18

Other developments 2 z Italian Ministry of Innovation and Technology report (available only in Italian) y Pub. Admins should not penalize or forbid use of OSS; procurement criteria must be “value for money” y Custom software must be fully (but not necessarily exclusively) owned by Pub. Admin. y Necessary to support and facilitate reuse of custom software owned by Pub. Admins, and the spreading of best practice y All proprietary packages bought under licence must be available for inspection and traceability. Pub. Admins. must be protected in the event supplier no longer able to provide support. y Information systems of Pub. Admins must interact via standard interfaces that must not be bound to any one supplier 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 19

Other developments 3 z Italian Ministry of Innovation and Technology report (2) y Documents of Pub. Admins should be stored and made available in one or more formats, one of which must be open; others to be chosen at discretion of the Pub. Admin. y Transfer of custom software and licences between Pub. Admins must be free from ties and should be encouraged y Guidelines needed for planning and procurement of software in Pub. Admins. Must be effected via promotion and competence development in Pub. Admins. y OSS can be a useful tool to reuse innovative software developed by research and technology innovation projects 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 20

Other developments 4 z UK government doing nine “proof of concept” trials of OSS in the public sector (managed by OGC/Oe. E, run by IBM) z MS paying Cap Gemini Ernst & Young to do audit of Newham Borough Council’s IT systems, aimed at proving MS is cheaper in TCO; full TCO studies notoriously difficult, but look forward to it! z IBM has chosen Linux for new “Blue Gene” supercomputers – 65, 000 CPUs, 200 trillion Cps 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 21

Other developments 5 z Bad year for Microsoft virus and worm exploits y “SOBIG may be the most damaging ever …” y “SQL Slammer was the fastest spreading …” y Welchia/Nachi, Blaster, etc … z Ten settlements in past year of class actions, claiming Microsoft used its monopoly to overcharge customers, at a cost of $1. 55 billion; 5 more class actions pending z MS agreement with SCO and their lawsuit against IBM z Unclear signals from MS over file format issues z All helps to keep OSS issue high on the agenda of public sector decision makers and legislators 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 22

Hot OSS Projects (Sourceforge as of 31 Oct) z Gaim - instant messenger app. z Winmerge – source code compare/merging z AMSN - MSN messenger clone z Fire - instant messenger client for Mac OS X z Compiere – ERP and CRM z e. Groupware – Enterprise collaboration suite z POPFile – automatic email classifier z php. My. Admin – PHP front end for my. SQL z Tiki – CMS/Groupware z Filezilla – FTP client and server for Windows 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 23

Hot OSS Projects (Freshmeat as of 31 Oct) z. CK-Ledger - accounting and back office system for SMEs zwmalms - monitors sensor chip: temperature, fan speed, and voltage z. Web. Sprockets - framework for rapid prototyping of RDBMS-based dynamic Websites z. Minirsyslogd - syslog receiver for hardened log receiver hosts z. Jameleon - automated testing tool for application features, with tied test cases z. LANforge - unified multi-prot. net traffic generator & WAN simulation z. UBS - run the operations of a radio station completely unattended z. Gtk. Atlantic - client for playing Monopoly-like board games z. Layer 7 packet classifier - classify packets by application, not port zyes. Coder - program to hide data in ASCII text files 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 24

OSS in Parliaments – Financial Case z Would OSS be cheaper? z Hidden factors (pro): y Downtime (esp. servers) – planned & unplanned y Future legacy data management costs (file formats) y Future changes to commercial license terms and costs z Hidden factors (con): y Retraining costs (users & support staff) y Availability of skills (but this is chicken & egg!) y Enterprise management facilities still lagging behind y Increased service & management costs (IDC & Gartner reports) y Only about 5% of total IT cost anyway 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 25

OSS in Parliaments – Technical Case z Would OSS be more secure? y Outlook – victim of success or bad code? y Before Outlook, there was sendmail y Do “many eyes make all bugs shallow”? y Decisions made by OSS bundlers (e. g. port & service enabling), esp. changes to defaults y Once OSS becomes mainstream, hackers will target it – this is inevitable 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 26

OSS in Parliaments – Technical Case z Would OSS be better? y Web/Net appliances – OSS already better y Enterprise servers – it depends on task/load y Database servers – hampered by SQL variations and “enhancements” y Clients – Microsoft still dominant, but position is changing significantly now y OSS client developers must look beyond just writing Microsoft clones 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 27

OSS in Parliaments – Business Case z. Change management in Parliaments: y Change to use structured information (reusability, high quality questions, etc), i. e. internal efficiency y Change to use Web-centric approach (accessibility, transparency, etc), i. e. external effectiveness y Change to use open file formats – democratic access cannot depend on need to purchase or licence specific software y Change to OS, Applications, or both, as well? y But, given that the first three have to be done, why not? y A planned migration path is possible, once proprietary file formats have been replaced by app/platform neutral ones 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 28

OSS in Parliaments – Political Case z If: y More virus/worm attacks y Another increase in MS licence costs y Lack of support for open file formats y Bad corporate governance revelations y Anti-trust decisions (Europe case in progress) y Class action suits and settlements y i. e. enough bad publicity, and … z Then, very quickly, the issue of OSS may become politically “hot” – are you ready for that? 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 29

OSS in Parliaments - Recommendations 1 (From Den Haag, 2002, slightly updated) z. Reconsider your network architecture: y. Are you supplier-dependent by design? y. How can you redesign to avoid supplier dependence? y. Move away from shared drive and folder models – old, platform-dependent y. Consider Web-based storage and retrieval techniques, and P 2 P z Play to the strengths of the Web and its ways: y. HTML: was, and still is, a notoriously bad mark-up language y. HTTP: protocol so simple as to be almost obstructive y. URL/URI addressing: what made the Web fly y. REST “Representational State Transfer” model (Fielding) 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 30

OSS in Parliaments - Recommendations 2 (From Den Haag, 2002) z Reduce dependence on things that break REST model: y Use URI, addressable resource model wherever possible y Avoid XML-RPC, SOAP for Internet z Reduce dependence on proprietary content formats z Migrate your legacy document collections y. Word, Word. Perfect, What. Ever, to non-proprietary, e. g. XML y. SGML to XML – most SGML parsers are commercial z. No need to change any of these recommendations! 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 31

OSS in Parliaments - Recommendations 3 (New for 2003) z Given that file formats is now a big issue: y Time for that new Information Architecture! x Create an environment for program and content reuse x Start with the content, not with the products (paper, web, etc) y Follow the Internet development model: x Agile model: speculate, collaborate, learn x Play with your data: experiment with structures, then do DTD x Code early, test often, feedback fast x Any project that has run for 3 months and has only paper to show for it is already in trouble! 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 32

OSS in Parliaments - Recommendations 4 (New for 2003) z Metadata y Go for quick wins. Devise simple metadata structures for: x Members and their constituencies (needed everywhere) x Ministers, Ministries, etc. , answerable to Parliament (constantly referred to) x Parliamentary Question/Answer pair (uses both of the above) x Legislation progress (business process metadata) y Use them, learn, then move on to more complex content: x Bills x Debate Reports x Committee Reports z How much of this will be in Parl. ML? y First suggested in Stockholm, 1999 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 33

Open Source Software: The Show Moves On … Good luck with your projects! Thank you. Andrew Hardie, Information Architect ash@cellar. demon. co. uk 2003 -11 -06 ECPRD WPICT, Nicosia, Cyprus 34