ec12862aeb06ae8d1b0b6b701e812179.ppt
- Количество слайдов: 26
Complex Event Processing (CEP) Web. Logic Time and Event Driven Product Family (TED) The Java Runtime infrastructure and Container for Event Driven Architecture based Applications Wolfgang Weigend Principal Systems Engineer Team Lead Systems Engineering Germany, Switzerland Austria
Agenda Product Markets and Drivers Product Overview What´s inside Use Case 2
“The Instantly Responsive Enterprise” • Web. Logic TED • EDA (Event Driven Architecture) facilitates the execution of uncoupled business processes triggered by real-time events • Extends SOA (Service Oriented Architecture) with a Sense/Respond paradigm • Enabler for XTP (Extreme Transaction Processing) 3
“The Instantly Responsive Enterprise” Triple play order management Asset management Algorithmic trading Financial Services • Large volumes of streaming events Transportation & Logistics Telecommunications & • Need for sub-millisecond response times Services • Intrusion detection systems • Military asset allocation Manufacturing • Guaranteed under heavy loads Insurance ‘Negative Working Capital’ inventory management Public Sector & Military Reponses to calamities – earthquake, flooding 4
Unique Foundational Runtime Infrastructure (Web. Logic Real Time: Powered by JRockit ) Real Time Development Environment Use Case -Extreme low latency and predictability Event Processing Tooling for Java applications – Time Critical Benefits Applications Qo. S Latency Monitoring Average response times in microseconds ► Web. Logic Real Time Server POJOs Guaranteed maximum response times WLW Real Time IDE Services Spring Real Time Infrastructure Services Stream Processing Complex Event Processing Real Time Scheduling Distributed Caching Common Services Fault Tolerance Deterministic Qo. S under heavy load OA&M Deterministic Java Runtime DGC Liquid VM No code re-writes “At first, we doubted BEA's performance claims for WLRT 1. 1. After all, if it were possible to lose the garbage-collection latency, wouldn't Sun have done it already? After testing WLRT 1. 1 in several scenarios, we concluded BEA's solution works. ”. Network Computing, September 2006 5 Real Time Synch
Unique Foundational Runtime Infrastructure (Web. Logic Real Time: Identify, Analyze and Resolve) Visualize thread & transaction execution time lines Find sources of latency spikes 6
Unique Java Container (Web. Logic Event Server: Exceeding EDA Expectations ) Real Time Development Environment Event Processing Tooling Use Case : Predictable, performant high volumes of Benefits Web. Logic Real Time Server Applications POJOs Qo. S Latency Monitoring streaming data – Event Critical WLW Real Time IDE Real Time Infrastructure Services Stream Processing Complex Event Processing Real Time Scheduling Complex event processing Handle high volumes of data (50 k messages/sec) Latency optimized, lightweight Java container Light-weight Java deployment platform Ø POJO support • Enterprise “ilities” expected from an application server Ø Scalability, Manageability, Availability, Security 7 Distributed Caching Common Services Fault Tolerance • • Services Spring OA&M Deterministic Java Runtime DGC Liquid VM Real Time Synch
Unique Java Container (Web. Logic Event Server: Deterministic Container) Infrastructure for deterministic millisecond latencies under predetermined peak workloads Minimize thread context switching and synchronization Tuned I/O (e. g. , socket connections) WLRT Event Server (Deterministic Container) t 1 Real-time scheduling Adapter datastream Event Processor datafeeds Efficient memory management Adapter datastream Queries WLRT (Deterministic runtime) 8 POJO events
Web. Logic Time and Event Driven Complete Product Family RT Development Environment Event Processing Tooling WLW Real Time IDE Web. Logic Event Server Applications Qo. S Latency Monitoring POJOs Services Spring Event Server Infrastructure Services Stream Processing Stream Management Complex Event Processing Real Time Kernel Common Services Configuration & Administration Security Logging Fault Tolerance Run Time JRockit 9 Web. Logic Realtime Liquid JVM • Tuned Light Weight Java container • Integrated CEP Engine • Supports Business Logic as POJO • Low latency, deterministic • Latency metrics uniquely available • First fully m. SA-based (consumer/producer) BEA products The integrated solution provides a scalable, extremely low latency, Java platform for developing & running Real Time CEP applications.
Hardware and Software Platforms 10
What´s inside Low Latency Deterministic Container Lightweight “Application Server” Event Driven Programming Model Complex Event Processor (CEP) Deployment Environment Time and Event Driven Computing Summary 11
Low Latency Deterministic Container WLRT Deterministic GC Provides Qo. S guarantees Usage: ”-Xgcprio: deterministic –Xpausetarget=10 ms Highly tuned mostly concurrent mark-n-sweep GC Most work done concurrently, pauses are frequent but very short Back off, split work and reschedule if nearing Qo. S limit (divide and conquer) One GC cycle (phases 0 -2, 2 -4, 4 -5, 5 visible) 500 ms 20 s 12
Lightweight “Application Server” Built on the BEA “Core Engine” Equinox OSGi Platform underneath Mix of hardened WLS subsystems and new technologies (Spring. OSGi, Complex Event Processor, etc. ) Tuned I/O model Refinements to WLS network I/O model Blocking network I/O One dedicated thread/connection Tuned Threading model Minimal (zero) thread switching Can parallelize Rules execution or switch thread (if desired) 13
Event Driven Programming Model Applications model complex event processing networks Network of collaborating producers and consumers of events Network nodes (stages) are: Services: Adapter, Stream, Processor Business Object: POJO (Spring Beans) Events: POJO or Map Spring-based declarative assembly and configuration Applications configured in Spring configuration file Custom Spring tags for WLEv. S services Dependency injection for additional services Seamless integration to legacy Spring beans 14
Event Driven Programming Model Data Source Adapter Stream Processor Stream Data Source 15 Adapter Stream User Code
Complex Event Processor (CEP) Continuous query engine Processes high volumes of streaming data Filtering, Correlation, Causality, Aggregation Evaluates in “Real-Time” (Sub-millisecond with high workloads) SQL-based Event Processing Language (EPL) Extensions to handle streaming Events Runtime representation Rules : compiled into Java code by Query Parser Actions (user code): POJOs (Spring Beans) Events: POJOs 16
Event Processing Language (EPL) SQL-based Leverage existing skill-sets Easier integration to relational data SELECT … FROM RETAIN … WHERE … GROUP BY … HAVING … MATCHING … OUTPUT … Extensions to handle streaming data WHEN. . . THEN vs. IF. . . THEN Streaming Windows (sliding, jumping) Time-based queries 17
Deployment Environment (1) Connectivity Capabilities HTTP(S) for client requests/response JMS client for asynchronous message for client or data source Standard Java SE remote interfaces (i. e. , RMI, JNI, JDBC) Adapter SDK for writing custom adapters Integrates with Event Sources and Sinks Socket framework for TCP/IP based adapters Easy mapping to Event Model 18
Deployment Environment (2) Comprehensive Security Framework Leverages best-of-breed BEA Common Security Services Framework (“CSS”) Pluggable SPI model (“Security Providers”) for 3 rd party integration SSO – via “AUTH Provider” for Cleartrust File based security provider for configuring user, passwords, and roles Password information encrypted API to retrieve user, password Used by http server for user authentication 19
Deployment Environment (3) Administration and Monitoring Command line interface to start/stop server and application deployment Standard JMX interface for system configuration and monitoring Basic configuration status and monitoring Mbeans with initial release Tightly integrated with JR Mission Control Latency Analyzer 20
Deployment Environment (4) Administration and Monitoring - Dashboard Activity Monitoring 21
Time and Event Driven Computing Summary BEA Web. Logic TED Products Application Frameworks CEP, Stream, Scheduling Services Foundation Event Services Web. Logic Real Time Quality of Service Monitoring BEA Workshop for TED Web. Logic Event Server (WLEv. S) WLRT and WLEv. S ship separately and as a bundle WLRT can be “dropped in” to other products as turbocharger JRockit DGC Aggregate, correlate, filter data 10, 000 Rules / Queries Incoming Data Streams 150, 000 Messages/Sec <1 K message size 22 Latency Goals < 1 Millisecond Latency (Avg. ) BEA Confidential 22 30 Millisecond Latency (Max) Resulting Data fed to user Java code <5% data matches filter criteria
Use Case: Financial Services Partner Fixed Income Trader - Pricing Engine Opportunity Improve performance and stability of fixed income pricing engine Solution Powered by BEA WLRT CE Sun Java Reduces Application Pause times (jitter) • Response time improved by 50% using BEA Web. Logic Realtime • Sun JVM avg: 16 ms, WLRT: 7. 5 ms Predictable Java runtime Performance • Dependability improvement of 20% using BEA Weblogic Realtime 23 WLRT CE Java
BEA’s Event-driven SOA Suite – Proof Points - A Financial Services Equities Group Value Proposition Significantly Increased Throughput BEFORE -- 10, 000 - 20, 000 concurrent signal instances AFTER – 50, 000 concurrent signal instances Higher developer productivity and flexibility By using EPL Dynamic rules update through configuration Data sources: • Streaming market data • JDBC data sources (MS SQL Server • Order flow data from traders 24 Data Feeds Adapter connectivity Data Feeds Process Events User Code (Plain Java) Output: Situations of interest to clients • Stock price moves by 3% • Spread exceeds X • consecutive ticks in a certain direction
Event Driven SOA (EDSOA) In Use Case, Architecture and product SOA Services WLS create. Order() Interactive Response Service Bus SOA Clients ALSB WLRT Automated Response ALBPM/WLI Event Server CEP Real-time alerts WLRT External Events Legend SOA Message SOA Event External Event 25 ALDSP
Vielen Dank für Ihre Aufmerksamkeit!
ec12862aeb06ae8d1b0b6b701e812179.ppt