BIG DATA IN OIL & GAS
Definition Big Data technologies describe a new generation of technologies and architectures designed to economically extract value from very large volumes of a wide variety of data by enabling high-velocity capture, discovery, and analysis.
Sources of big data THE DATA MULTIPLIER EFFECT MACHINE SENSOR DATA, COMPLEX DATA VIDEO RECORDING HUMAN SENSORS DOCUMENTS EMAIL SATELLITE IMAGING VARIETY VOLUME VELOCITY M 2 M LOG FILES ENTERPRISE CONTENT, EXTERNAL SOURCES BUSINESS PROCESS WEB LOGS VARIETY VOLUME SOCIAL DATABASE DATA VOLUME OLTP 1 X 10 X BIOINFORMATICS 100 X More Data with More Complex Relationships…in Real Time and At Scale To manage, govern and analyze
BIG DATA IN ACTION IN OIL&GAS Big Data Analysis = Value Seismic data Pe tab Bore hole sensors Environmental sensors yte Weather data to Re al Production utilization Business Decisions E&P Investments Inventory locations Production planning Safety Ti me U Storage capacities Exploration ns tru Spot pricing (trading) Geo-technical applications ctu Transportation Production red Da ta Inventory levels Resource planning Demand & forecast Refining Business intelligence Distribution Databases Marketing and retail Office applications Location data
Velocity – ingest more data faster • Growing data > 300 MB / Km 2 early 90 s > 25 GB / km 2 in 2006 > Growing… to PBs / km 2 Yesterday: 20 – 25, 000 sensors, 500 MB/s – 2 GB/s, 50 – 200, 000 shots, 50 – 200 TB data Now: Full 3 D acquisition, 8 GB/s – 20 GB/s, 250 TB – 1 PB Tomorrow: 50 GB/s
VOLUME - INSATIABLE APPETITE FOR INFORMATION IT STARTS WITH THE DATA, THEN IT NEEDS TO BE ANALYZED TO EXTRACT INFORMATION Technology as a competitive weapon Pushing technology boundaries Never resting, methods ready for anticipated technology advances Big Data in use A different scale, PB file systems as caches Live in-feed from sensors from sites world wide
VARIETY: FIND AND PRODUCE FASTER, SAFER, Data MORE EFFICIENTLY AND Data Acquisiti on Management Seismic Processing Visual Interpretation Modelling Petrophysical Automation Analysis Property Modeling Simulatio Upstream Oil&Gas: Many interconnected, increasingly complex and rapidly changing workflows Exponential growth in the volume of data Computational demands increasing by orders of magnitude Manage complexity and increase efficiency Facilitate collaborative computing and secure access to data Increase efficiency and accelerate the TOTAL workflow
UNIFIED STORAGE For upstream Oil and Gas ORGANIZATIONS Accelerated exploration with optimized file storage Highest per-node IOPs for unpredictable I/O Ideal for mixed workflows requiring performance for throughput-oriented and also for random data flows Easy scalability and high availability Unstructured Open file system standards: CIFS, NFS, i. SCSI, Lustre, Hadoop Single architecture for file and block Technical One storage platform for E&P and the entire oil and gas enterprise Enterprise Comprehensive data management across technologies No compromise of performance versus control Structured
