The publishing system of statistics in Natural Resources Institute Finland (LUKE) • Pekka Korhonen - Statistical services © Natural Resources Institute Finland
Natural Resources Institute Finland (LUKE) • Established 1. 1. 2015 • Fusion: MTT (Agrifood Research Finland), Metla (Finnish Forest Research Institute), RKTL (Finnish Game and Fisheries Research Institute) & MMM Tike (Information Centre of the Ministry of Agriculture and Forestry) • Statistical Services Unit – Official statistical authority - Official Statistics of Finland (OSF) • Statistics on agriculture, forestry and fisheries – – 62 statistics (1. 11. 2017) Agriculture: 27 statistics Forestry: 25 statistics Fisheries and game: 10 statistics • Indicators – Agrikaattori: The EU Common Agricultural Policy (CAP): 38 indicators – Forest Indicators (coming) • Total 422 statistical tables (1. 11. 2017) 2 Pekka Korhonen - Statistical services 15. 11. 2017 © Natural Resources Institute Finland
The structure of the statistics publishing system of LUKE • 2 separate parts those are linked to each other • Statistics Portal (html site): http: //stat. luke. fi/en – basic maintenance, development and location purchased from outside – normal html pages (drupal), tailored to Ti. Pa – Ti. Pa has its own maintenance interface • Statistics Database (PX-Web): http: //statdb. luke. fi – Virtual Machines - maintained by Government ICT Centre (VALTORI) – PX-Web application, own installation and maintenance – linked to the Statistics Portal: database, ready-made tables, dynamic images – automatic maintenance (timing + scripts) – API Interface: Conductive Data for 3 rd Parties (open data) • Three-language (Finnish, Swedish and English) • User Management (separate PX Web installation) 3 Pekka Korhonen - Statistical services 15. 11. 2017 © Natural Resources Institute Finland
The publishing system of the statistical services -unit of LUKE http: //luke. fi/en http: //statdb. luke. fi/PXWeb/pxweb/en http: //stat. luke. fi/en STATISTICS DATABASE PX-WEB 4 0 min. STATISTICS PORTAL LINKS: DATABASE READYMADE TABLES AUTOMATIC GRAPHICS LUKEPORTAL GRAPHICS Pekka Korhonen - Statistical services HOMEPAGE, INFO, QUESTIONNAIRES etc. valmistaulut portaaliin STATISTICAL BULLETINS STATISTICAL PAGES 15. 11. 2017 © Natural Resources Institute Finland
PX-Web specs in LUKE Statistics • 2 virtual servers: – Test / Production sites (2 virtual machines) (maintained by VALTORI) – Windows Server 2012 R 2 & IIS 8. 5 – remote access (RDC), disk allocation, admin rights, automation – TEST: • test PX-Web (Luke intra) • maintenance of automation (scripts + data storage + backups + logs) – PRODUCTION: • production PX-Web (public) • graphical automation (basic javascript + js- & html-files of graphics) • Common network disk space – PX-Web folder structure – update and timing files (in the right folders) – access by statisticians (statistics take care themselves) 5 Pekka Korhonen - Statistical services 15. 11. 2017 © Natural Resources Institute Finland
Structure & operation of the PX-Web database INTRA WEB 7 9 6 8 5 2 TEST SERVER PRODUCTION SERVER 3 STATISTICS Release calender: update + timing TEST PX-Web PRODUCTION PX-Web (check) (public) 5 9: 00 15 min. COMMON DISKSPACE Update files (csv, px, txt) 6 15 min. Pekka Korhonen - Statistical services if update 0 min. API UPDATE AUTOMATION GRAPHICS AUTOMATION Scripts, Data storage, Logs, Backups Basic code, Page codes (js, html) 15. 11. 2017 © Natural Resources Institute Finland 0 min. readymade tables to portal 0 min. graphs to portal
The automatic maintenance of PX-Web • Update + timing files on a shared network disk – update: px- or csv-file, timing: txt-file (eg 01. 2018) • A 15 -minute script – retrieves updates from the network disk to the test server and combines them with the original tables and moves the tables to the test-PX-Web and updates the menu – -> Updates the Test-PX-Web every 15 mins (checking) • Every morning script (mon-fri 9: 00) – combines updates with original production tables if the timing file is ok (same day or past) and moves tables to the production-PX-Web and updates the menu – -> Updates the Production-PX-Web every working day at 9: 00 am according to the release calendar (release) • Scripts own production + PX-Job & Menubuilder (Statistics Finland) • Timing with Task Scheduler (Windows) 7 Pekka Korhonen - Statistical services 15. 11. 2017 © Natural Resources Institute Finland
Automatic graphics • All the LUKE Statistics Portal graphics come through APIinterface – basic patterns + maps (over 250 graphs total) http: //statdb. luke. fi/charts/api_testi. html – dynamic links, downloaded to i. Frame, updated from the database table – linking with URLs to any website (including customers) – languages parameterized (? lang = fi / sv / en) • PX-Web API-interface (open data) – API-address (url) – JSON query (Ti. Pa: json-stat - also xlsx, json, csv, sdmx, px) • Ti. Pa's own graphics application (charts) – Java. Script: basic code + picture-specific js- & html-files – libraries: JSON-stat Javascript Toolkit, Idescat Visual (flot) – + own code (development & production in Git) • Ready made tables (and pictures) – with PX-Web Saved Search (statistical updaters / customers) 8 Pekka Korhonen - Statistical services 15. 11. 2017 © Natural Resources Institute Finland
The last page • Tools: – PX-Edit: designing, creating and maintaining tables – PX-Job: automatic updates (part of the script) – PX-Win: classification (vs- & agg-files) • Demo: – Indexed images • Nominal / real values – Data from many sources, through two APIs • LUKE / Statistic Finland – Calculation on the fly – http: //stat. luke. fi/en/commercial-marine-fishery 9 Pekka Korhonen - Statistical services 15. 11. 2017 © Natural Resources Institute Finland
Thank you! 15. 11. 2017 © Natural Resources Institute Finland
Скачать презентацию The publishing system of statistics in Natural Resources
8b6d5d5da6a6c7700442e408c69b1e19.ppt