High Performance Recording and Manipulation of Distributed Streams Hasan Bulut Advisor: Prof. Geoffrey Fox Ph. D. Defense Exam April 24, 33 of 2007
Motivation n n A collaboration environment contains multiple real-time stream sources and multiple sinks. Streams are generated at different locations with different timestamps. Streams can be from any collaboration system. Collaboration environments, such as Web. Ex, may utilize messaging middleware systems. We would like to replay them instantly or later at any time with control over the stream/streams, such as play, pause, forward and rewind. 4/24/2007 1
Motivation n n We also would like to replay any collection of streams. Annotate streams and attach objects such as text. The architecture should be generic so that we can archive and replay any type of streaming data format. q Independent of data format of the stream, i. e. video, audio, text, images. Design and implement a system to demonstrate this generic framework; e. Sports System. 4/24/2007 2
Global. MMCS Prototype System 4/24/2007 3
Extending Global. MMCS to Mobile Clients 4/24/2007 4
e. Sports System Interface 4/24/2007 5
e. Sports System - Collaborative Multimedia Streaming and Annotation System n A use case q n n e. Coaching – educating athletes/players at remote locations by capturing streams from sports events or games and annotating them. We have setup a prototype with machines in HPER at IU and Ithaca in NY. We will extend it with machines in China to educate players in China remotely from US. 4/24/2007 6
Research Issues - Stream Specific Issues n n Data format independence – streams can be video, audio, text, images, etc. Services required within messaging middleware to q q n n n archive and replay of streams achieve instant replay of streams achieve synchronization among streams generated at geographically large area Increase fault tolerance A scalable architecture to overcome performance issues Jitter introduced by the archiving and replay service Stream delay introduced for LAN and WAN clients 4/24/2007 7
Research Issues - Session and Stream Management Developing a XML-based control framework where XML messages are also used for information exchange. Managing session information n n Describing collaboration session metadata in XML format q Managing stream information n Streams are in different types and formats They are archived at different repositories q q n Investigating the impact of using a distributed context management service on the design and architecture of the streaming service 4/24/2007 8
Services/Components Built Within This Dissertation Network Time Protocol Jitter Reduction Service -Buffering Service -Time Differential Service Distributed Repository Scheme Generic Streaming -Session Recorders -Session Players e. Sports System Global. MMCS Session Server (an implementation of XML Based General Session Protocol – XGSP) XGSP Streaming Gateway 4/24/2007 9
Time Services n n n We need global time ordering of events. NB-NTP implementation synchronizes with several different time servers instead of one in NTP case. NB-NTP is incorporated within messaging middleware so that it can be used by entities. User does not need administrator privileges to use NTP. Entities generating events in the system should utilize Time Service to timestamp the events. High Resolution Timing Service q 4/24/2007 Gives 2 -3 microsec resolution 10
NTP Benchmark Result n n n The first offset value is -139895 ms, which shows how much the clock in that machine is ahead of the real time. The change of offsets is between (-3) - (2) ms. Total change demonstrates clock skews 4/24/2007 11
Jitter Reduction Services n n n Jitter value of a stream shows the quality of the stream. The lower the jitter the better the stream quality. Components are q q 4/24/2007 Buffering Service Time Differential Service 12
Jitter Reduction Service Benchmark Results Trans-Atlantic benchmark result (between UK and IN) 4/24/2007 13
Distributed Repository Scheme n n Narada. Brokering reliable delivery mechanism utilizes a repository to ensure that events are received by subscribers. For repository failures, repository redundancy scheme extends the reliable delivery scheme. Introduces modest latency for message delivery. A repository gossips with other repositories to exchange information in order to retrieve missed events and to recover from failures. Fault-Tolerant Reliable Delivery of Messages in Distributed Publish/Subscribe Systems. (To appear) Proceedings of the 4 th IEEE International Conference on Autonomic Computing. 4/24/2007 14
Repository Redundancy Benchmark Results P 1 Publisher S 1 Subscriber (S 1: Measuring client) Topology C Topology D Topology E Topology F Links are UDP 4/24/2007 15
Repository Redundancy Benchmark Results 3 brokers, 3 repositories 3 brokers, 2 repositories 3 brokers, 1 repository 3 brokers 4/24/2007 16
Session and Stream Information Management n We have used “Distributed Context Management” – developed at CGL. n Two levels of management q q 4/24/2007 Sessions level management: to keep track of sessions Intra-session level management: to keep track of stream information in a given session 17
Generic Streaming Service n n Recording and replay of any type of streaming data. Instant replay: replaying, pausing and rewinding realtime (live) streams while being recorded. Linking multiple streams together to construct a session. Uniform event type for generic streaming 4/24/2007 18
Session Recorders Control message 4/24/2007 19
Session Players Control message 4/24/2007 20
e. Sports System – Key Features n Archive and replay of Narada. Brokering native events n Archive and replay of Global. MMCS sessions n Instant replay n Utilizing Distributed Context Management service 4/24/2007 21
e. Sports System and Streaming Services 4/24/2007 22
e. Sports System Interface (Recording) 4/24/2007 23
e. Sports System Interface (Replay) 4/24/2007 24
Performance Results (Benchmark Setup) LAN Setup : gf 4. ucs. indiana. edu WAN Setup (FSU): vlab 2. scs. fsu. edu 4/24/2007 25
Performance Tests (LAN Results) 4/24/2007 26
Performance Tests (WAN –FSU Results) 4/24/2007 27
Contribution n n A generic fault tolerant distributed streaming framework “Instant” replay of real-time streams. q High performance streaming with low latency (with delay 200 ms). Following services are introduced to messaging middleware; q Replication framework q Jitter reduction service q Time service System contributions q e. Sports System prototype n n q q 4/24/2007 Annotation capability Distributed Context Management capability XML Based General Session Protocol (XGSP) Real-time videoconferencing streams for cellular clients. 28
Selected Publications 1. 2. 3. 4. 5. 6. Implementing a NTP-Based Time Service within a Distributed Brokering System; Hasan Bulut, Shrideep Pallickara and Geoffrey Fox; Proceedings of the ACM International Conference on the Principles and Practice of Programming in Java. pp 126 -134. Worldwide Messaging Support for High Performance Real-time Collaboration; Pete Burnap, Hasan Bulut, Shrideep Pallickara, Geoffrey C Fox, David W. Walker, Beytullah Yildiz, Ali Kaplan; Proceedings of the UK e-Science Programme All Hands Meeting 2005 (AHM 2005). Nottingham, UK Fault-Tolerant Reliable Delivery of Messages in Distributed Publish/Subscribe Systems; Shrideep Pallickara, Hasan Bulut, Geoffrey Fox; (To appear) Proceedings of the 4 th IEEE International Conference on Autonomic Computing. Management of Real-Time Streaming Data Grid Services; Geoffrey Fox, Galip Aydin, Hasan Bulut, Harshawardhan Gadgil, Shrideep Pallickara, Marlon Pierce, and Wenjun Wu; Concurrency and Computation: Practice and Experience, March 12 2006. Special Issue from Grid and Cooperative Computing Real Time Streaming Data Grid Applications; Geoffrey C. Fox, Mehmet S. Aktas, Galip Aydin, Hasan Bulut, Shrideep Pallickara, Marlon Pierce, Ahmet Sayar, Wenjun Wu, and Gang Zhai; Invited talk at TIWDC 2005 CNIT Tyrrhenian International Workshop on Digital Communications July 4 -6 2005 A Web Services Based Streaming Gateway for Heterogeneous A/V Collaboration; Hasan Bulut, Geoffrey Fox, Wenjun Wu, Ahmet Uyar, Shrideep Pallickara and Harun Altay; Proceedings of the 2004 International Conference on Internet Computing. Volume II, pp 493499. 4/24/2007 29
Selected Publications 7. 8. 9. 10. 11. 12. Optimized Communication using the SOAP Infoset For Mobile Multimedia Collaboration Applications; Sangyoon Oh, Hasan Bulut, Ahmet Uyar, Wenjun Wu, Geoffrey Fox; Proceedings of the International Symposium on Collaborative Technologies and Systems CTS 05 May 2005, St. Louis Missouri, USA e. Sports: Collaborative and Synchronous Video Annotation System in Grid Computing Environment; Gang Zhai, Geoffrey Fox, Marlon Pierce, Wenjun Wu, Hasan Bulut; IEEE International Symposium on Multimedia (ISM 2005) December 12 -14, 2005 Irvine, California, USA A Web-Services Based Conference Control Framework For Heterogenous A/V Collaboration; Wenjun Wu, Hasan Bulut, Ahmet Uyar, Geoffrey C. Fox; 7 th IASTED International Conference on INTERNET AND MULTIMEDIA SYSTEMS AND APPLICATIONS ~IMSA 2003~ August 13 -15, 2003 Honolulu, Hawaii, USA Service Oriented Architecture for Vo. IP Conferencing; Wenjun Wu, Geoffrey Fox, Hasan Bulut, Ahmet Uyar, Tao Huang, Theory and Practice of the International Journal of Communication Systems - Special Issue on Voice over IP. Design and Implementation of a Collaboration Web-services System; Wenjun Wu, Geoffrey Fox, Hasan Bulut, Ahmet Uyar, Harun Altay; Special Issue on on Grid computing in Journal of Neural Parallel and Scientific Computations (NPSC), Volume 12, pages 391 -408 (2004) Global Multimedia Collaboration System; Geoffrey Fox, Wenjun Wu, Ahmet Uyar, Hasan Bulut and Shrideep Pallickara; Journal of Concurrency and Computation: Practice & Experience. Middleware for Grid Computing Workshop Special Issue. Volume 16, Issue 5. pp 441 -447. 2004. 4/24/2007 30
Other Publications 13. 14. 15. 16. 17. 18. Building and Applying Geographical Information System Grids; Galip Aydin, Ahmet Sayar, Harshawardhan Gadgil, Mehmet S. Aktas, Geoffrey C. Fox, Sunghoon Ko, Hasan Bulut, and Marlon E. Pierce; Concurrency and Computation: Practice and Experience, 12 January 2006. Special Issue on Geographical information Systems and Grids Adapting H. 323 Terminals in a Service-Oriented Collaboration System; Wenjun Wu, Hasan Bulut, Ahmet Uyar, Geoffrey Fox; Special Internet Media issue of IEEE Internet Computing July-August 2005, Vol 9 number 4 pages 43 -50 Grid Services for Earthquake Science; Geoffrey Fox, Sung Hoon Ko, Marlon E. Pierce, Ozgur Balsoy, Jake Kim, Sangmi Lee, Kang-Seok Kim, Sangyoon Oh, Xi Rao, Mustafa Varank, Hasan Bulut, Gurhan Gunduz, Xiaohong Qiu, Shrideep Pallickara, Ahmet Uyar, Choon-Han Youn; Journal of Concurrency and Computation: Practice & Experience. ACES Computational Environments for Earthquake Science Special Issue 2002. Volume 14(6 -7): 371 -393 Grids for Real Time Data Applications; Geoffrey C. Fox, Mehmet S. Aktas, Galip Aydin, Hasan Bulut, Harshawardhan Gadgil, Sangyoon Oh, Shrideep Pallickara, Marlon E. Pierce, Ahmet Sayar, and Gang Zhai; Invited talk in proceedings of PPAM 2005 – 6 th International Conference on Parallel Processing and Applied Mathematics Poznan Poland September 11 -14 2005 Service-Oriented Architecture for Building a Scalable Videoconferencing System; Ahmet Uyar, Wenjun Wu, Hasan Bulut, Geoffrey Fox; IEEE International Conference on Pervasive Services 2005 (ICPS'05), 11 -14 July 2005, Santorini, Greece Design and Implementation of Audio/Video Collaboration System Based on Publish/Subscribe Event Middleware; Geoffrey C. Fox, Wenjun Wu, Ahmet Uyar Hasan Bulut; Proceedings of CTS 04 San Diego January 2004 4/24/2007 31
Other Publications 19. An Integrated Videoconferencing System for Heterogeneous Multimedia Collaboration; Ahmet Uyar, Wenjun Wu, Hasan Bulut, Geoffrey Fox; 7 th IASTED International Conference on INTERNET AND MULTIMEDIA SYSTEMS AND APPLICATIONS ~IMSA 2003~ August 13 -15, 2003 Honolulu, Hawaii, USA 20. A Web Services Framework for Collaboration and Videoconferencing; Geoffrey Fox, Wenjun Wu, Ahmet Uyar, Hasan Bulut, Shrideep Pallickara; Proceedings of the 3 rd Annual Workshop on Advanced Collaborative Environments 21. Integration of SIP Vo. IP and Messaging with the Access. Grid and H. 323 Systems; Wenjun Wu, Ahmet Uyar, Hasan Bulut, Geoffrey Fox. Proceedings of 1 st International Conference on Web Services Las Vegas June 2003 22. Global Multimedia Collaboration System; Geoffrey Fox, Wenjun Wu, Ahmet Uyar, Hasan Bulut and Shrideep Pallickara; Proceedings of the 1 st International Workshop on Middleware for Grid Computing. Co-located with ACM/IFIP Middleware Conference. pp 245 -250. 23. Collaborative Web Services and Peer-to-Peer Grids; Geoffrey Fox, Hasan Bulut, Kangseok Kim, Sung-Hoon Ko, Sangmi Lee, Sangyoon Oh, Shrideep Pallickara, Xiaohong Qiu, Ahmet Uyar, Minjun Wang, Wenjun Wu; Proceedings of the 2003 Collaborative Technologies Symposium. 24. Integration of Narada. Brokering and Audio/Video Conferencing as a Web Service; Hasan Bulut, Geoffrey Fox, Shrideep Pallickara, Ahmet Uyar and Wenjun Wu; IASTED International Conference on Communications, Internet, and Information Technology, November 18 to November 20, 2002, in St. Thomas, US Virgin Islands 4/24/2007 32
Other Publications 25. A Web Services Framework for Collaboration and Audio/Videoconferencing; Geoffrey Fox, Wenjun Wu, Ahmet Uyar, and Hasan Bulut 26. An Architecture for e-Science and its Implications; Hasan Bulut, Geoffrey Fox, Dennis Gannon, Kangseok Kim, Sung-Hoon Ko, Sangmi Lee, Sangyoon Oh, Xi Rao, Shrideep Pallickara, Qinglin Pei, Marlon Pierce, Aleksander Slominski, Ahmet Uyar, Wenjun Wu, Choonhan Youn; Proceedings of the 2002 International Symposium on Performance Evaluation of Computer and Telecommunication Systems (SPECTS). Society for Modeling and Simulation International, pp 14 -24 (2002). 27. Service-Oriented Architecture for Building a Scalable Videoconferencing System; Ahmet Uyar, Wenjun Wu, Hasan Bulut, Geoffrey Fox; March 25 2006 to appear in book "Service -Oriented Architecture - Concepts & Cases" published by Institute of Chartered Financial Analysts of India (ICFAI) University 28. Grid Service Architecture for Videoconferencing; Wenjun Wu, Ahmet Uyar, Hasan Bulut, Sangyoon Oh, Geoffrey Fox; to appear as chapter in book "Grid Computational Methods" Edited by M. P. Bekakos, G. A. Gravvanis and H. R. Arabnia 4/24/2007 33
Скачать презентацию High Performance Recording and Manipulation of Distributed Streams
fc959a7e9f1774e9c8eb0526411477c5.ppt