Digital Video over Next Generation Internet Hyun-chul Kim

Digital Video over Next Generation Internet Hyun-chul Kim hckim@cosmos. kaist. ac. kr Korea Advanced Institute of Science and Technology 2003. 1. 22(Wed)

Table Of Contents n n n n n The Networks Advanced Applications Digital Video : Future Killer Application ? Digital Video Technologies What are people doing with these technologies? Challenges and Opportunities Digital Video over Next Generation Internet APAN-KR Digital Video Network Concluding Remarks References

The Networks

APAN : Objectives [Chon 01 B] n Advanced Networking for Asia-Pacific Research & Development for Advanced Applications and Services Advanced Networking Environment for Research Community International Collaboration

Asia-Pacific Advanced Network [Chon 01 B] Japan Europe Korea l STAR TAP (USA) l l China Hong Kong l l Thailand l Malaysia l l Sri Lanka Vietnam l Singapore l Current status 2001(plan) l Philippines Indonesia l Australia

KOREN

Advanced Applications ?

Applications [Chon 01 A] Basic Service Advanced Service EMail File Transfer Transaction Telnet Video/Audio News WWW

What’s the Killer Application for APAN/KOREN and Internet 2 ? “Visi. Calc” electronic spreadsheets on PCs “Mosaic” World Wide Web “Napster” Peer-to-Peer Computing “Digital Video in some form” expected to change …. How we teach, learn, collaborate, and conduct research in Higher education [Hanss 01]

Digital Video : The Situation [Hanss 01 B] n n n n Equipment is getting cheaper (production to delivery) Hardware and software getting easier to use Video quality is improving IP-based delivery focus (versus ATM) Many standards are still being resolved Best practices are emerging Range of options means there’s no one solution Significant international cooperation

Uses for Digital Video n n Videoconferencing Streaming video Live, Scheduled or On-demand 1 -to-1 or 1 -to-N

Digital Video Technologies

Technologies n n n n H. 323 VRVS MPEG 1, MPEG 2, MPEG 4 MJPEG IEEE 1394 DV/Firewire Access Grid VIC/VAT/RAT

H. 323 n n n Recommended for audio, video over best-effort packet switched networks Emerged from the telecommunications industry Point-to-Point and Multipoint videoconferences Enables collaboration - shared whiteboard, etc TCP for control, UDP for audio, video, status

VRVS (Virtual Rooms Videoconferencing System) n General Observations Client agnostic video conference system Vic/rat, existing H. 323 clients, Minerva MPEG 2 Developed and started to be deployed in Physics community (CERN, Caltech, …) n Comparison to H. 323 Uses same video/audio codecs (at initial phase) Software reflector versus hardware gatekeeper Windows, Unix clients available, Mac receivers Easily extensible (open source code)

VRVS : example

MPEG-1 n General Observations 1 -2 Mbps, free streaming clients available for broadcast & VODs from various vendors Many PCs have built-in MPEG 1 decoding capabilities Appliances available n Comparison to H. 323 Video quality better than H. 323, worse than VHS quality video Cost per sending station usually more than H. 323 Some interoperability between products but no standards govern transport like H. 323

Screen Shot(1): MPEG 1 Live Broadcast and VOD

MPEG 1 Traffic Measurement n n Measured at SA Lab. Gateway (gw. kaist. kr. apan. net) ‘Daily’ Graph (2001. 10. 24) MPEG 1 Multicast Traffic 1. 5 Mbps • ‘Weekly’ Graph (2001. 10. 17~2001. 10. 24) MPEG 1 Multicast Traffic 1. 5 Mbps

MPEG-2 n General Observations Broadcast quality video with audio for high-quality video and digital television 3 -15 Mbps (@ Main Level) No free streaming clients Expensive Hardware ($10 -$25 K per node) Interoperability between vendors non-existent n Comparisons Better than VHS quality Camera Quality is VERY IMPORTANT with MPEG 2 It’s wonderful when it works

MPEG-2 Traveling Node (Internet 2)

10 Mbps MPEG 2 Traffic Measurement • Measured at SA Lab. GW (gw. kaist. kr. apan. net) • ‘Daily’ Graph (2001. 10. 25) MPEG 2 Multicast Traffic 10 Mbps • ‘Weekly’ Graph (2001. 10. 18~2001. 10. 25) MPEG 2 Multicast Traffic 10 Mbps MPEG 1 Multicast Traffic 1. 5 Mbps

6 Mbps MPEG 2 Traffic measurement n KAIST MRTG graph Daily Graph (10. 31~11. 1) Weekly Graph (10. 25~11. 1)

MPEG-4 Goal: to make low-bit rate multimedia data n Good quality video/audio with lower bandwidth n Near-DVD quality at 700 K~2 Mbps n Began July 1993 / Release February 2000 n Apple Quicktime 6 and WMT 9 : based on MPEG 4

Screen shot : APAN-KR TV multicasting, 2002. 11. 20 (Korea vs Brazil Soccer A match) • 640 X 480 X 30 fps, at 1. 5 Mbps, using (MPEG 4 -based WMT) + Cast. Box Overlay Multicast system • 300~400 clients for a few hours

MJPEG n General Observations 5 -10 Mbps, video quality similar to MPEG 2 Cheap Hardware : but you gotta roll your own Both software & hardware decoding clients are currently available from Berkeley http: //www. openmash. org http: //bmrc. berkeley. edu/~delco/rtpvb (RTPtv) n Comparisons Great video, inexpensive, multipoint support Deployed today at Berkeley to support teaching Still work-in-progress, requires bandwidth

IEEE 1394 (Firewire) DV n General Observations Uses IEEE 1394(Firewire) device interface 30 Mbps, video quality better than MPEG 2 No encoding/decoding delays at PCs SDTV-quality interactive DV system http: //www. sfc. wide. ad. jp/DVTS Promise of inexpensive high quality nodes COTS(commercial off-the-shelf) : DV camera, player, firewire boarded PCs/Notebooks Cheap Hardware, available on Free. BSD, Net. BSD, Linux, Mac. OS X, and Windows Multicasting ? Manual/Adaptive Frame Rate control? (full/half/quarter, depending on available bandwidth)

Equipments for Firewire DV[Jung 01] 1394 card(Fire. Bird EZ) 1394 cable(4 -6 pin) 노트북 1394 port

DV Transport System [Ogawa 01] Consumer DV Camera Consumer DV Deck IEEE 1394 Cable Internet DV→Internet PC Internet →DV PC

DV Transport System Consumer DV Camera Consumer DV Deck IEEE 1394 Cable Internet DV→Internet PC Internet →DV PC

DV Transport System Consumer DV Camera Consumer DV Deck IEEE 1394 Cable Internet DV→Internet PC Internet →DV PC

DV/Firewire Experiments [Jung 01] n IPv 4 unicast test between Chonnam Univ. (Gwang-ju, about 250 KM away from Daejeon) and KAIST(Daejeon) – 2001. 5 u u u CNU DVTS sender -> KAIST receiver # dvsend –h 192. 249. 24. 39 –I ohci 0 # dvrecv

DV/Firewire on Windows [Sul 01]

Firewire DV Traffic measurement n KAIST MRTG graph

Access Grid [Hanss 01 C] n General Observations Group to group collaboration, persistent electronic presence, “Internet Café” 4 Video inputs per node, virtual rooms Multicast required!! (10 -20 Mbps for a meeting) COTS technology - @ $40 K for a node n Comparisons Video/Audio quality about same as or better than H. 323 Continuous, Multipoint presence is useful!!

Mobile Access Grid Node Source: Argonne National Laboratory

Access Grid “Look and Feel” Source: Argonne National Laboratory

Access Grid “Look and Feel” Source: Argonne National Laboratory

An Access Grid Room 8 Considerations include room size; projector, microphone, speakers, and camera placement; ambient noise Presenter mic Presenter camera Ambient mic (tabletop) Audience camera Source: Argonne National Laboratory

An Access Grid Room: Components Digital Video NETWORK RGB Video Display Computer Digital Video Capture NTSC Video Computer Audio Analog Audio Digital Audio Capture Computer Mixer Control Computer Echo Canceller Source: Argonne National Laboratory

Access Grid “Look and Feel” Source: Argonne National Laboratory

Internet HDTV n n Why Studio-quality HDTV over Internet? “Because We Can! ; -)” Gbps-level High bandwidth application Studio-quality compressed HDTV stream : 270 Mbps (122 GB/hour) Fully Uncompressed HDTV stream : 1. 5 Gbps (675 GB/hour) no encoding/decoding delays (interactive applications) n Jointly developed by Tektronix, USC ISI, and UW. http: //www. researchchannel. org/tech/ihdtv. asp

270 Mbps Internet HDTV Demo. between Stanford and University of Washington (1999. 9. 22)

Digital Video : Technologies and Products H. 323 MPEG-1 MJPEG, MPEG 4 MPEG 2 1394 DV (Typical) Resolution 352 X 288 352 X 240 640 X 480(VGA) 720 X 480(SDTV) Bandwidth 128 Kbps~1 Mbps 1~2 Mbps 2~15 Mbps 30 Mbps Appliances Polycom, Rad. Vision, VCON, Zydracon, . . ($2, 000~$15, 000) Provided by MPEG-2 products Or in-between Minerva, CAMVision-2, REIMAY BOX ($20, 000~$60, 000) * 150~300 ms Delay N/A Servers Multiple Control Unit ($15, 000~$100, 000) Provided by MPEG-2 products Or in-between IBM Video. Charger CISCO IP/TV • 3~10 sec. Delay • $2, 000(S/W only) ~ $200, 000 (+H/W) PC + DV Camera or DV Recorder Deck $2, 000~$5, 000 For PCs USB-based PC Cameras ($20~$1, 000) , Free MS Net. Meeting Provided by MPEG-2 products Or in-between Optibase cards ($5, 000~$20, 000), Reimay + SDK ($10, 000~, no delay) No encoding cards, no delays (no compression)

So, What Are People Doing with These Technologies?

Digital Video Applications n n n Video Conferencing and Streaming Remote Lecture/Seminar Music Teaching (Master Class) Virtual Concert (Halloween Concert) Virtual Conference (Megaconference) Remote Instrument Observation and Control (telescope, microscope, …) High-quality Internet TV/Video Portal u Research Channel u C-SPAN Broadcasting u APAN-KR TV and Video Archive Visual History Foundation Animations and Immersive Environments Telecubicle (Office of the Future? ) And A LOT more…. .

APAN-KR Digital Video Network n Goal u u u n Experiment, Evaluate and Deploy Advanced Digital Video Technologies and Applications on Next Generation Internet in Korea/Asia-Pacific. As a basis for Research/Engineering Cooperation/Collaboration among APAN(-KR) members Technology/Knowledge Transfer Fill-up and make congestions on current high-bandwidth network!! u to justify and request higher-capacity domestic network backbone, as well as international links, …. Say, “We need more bandwidth!!” ; -)

APAN-KR Digital Video Network : Major Appllications n Video Conferencing Network u Tools testing, evaluation and deployment H. 323 -based clients and MCU F VRVS clients and reflector F Others (Mbone tools, Isabelle, …) F u 40 Gbps backbone and Gbps Access Network Let’s move to Firewire DV, rather than H. 323 from now on. n Distance Education u MPEG-1/MPEG-2/Firewire DV u Remote Seminar/Workshop/Class Experiments (2001 Fall~) u Now considering/evaluating MPEG-4 n Video Archive u MPEG-1/MPEG-2/Real. Video n Others (being formed and proposed) u “Cyber Performance Project”, Internet TV, …

Remote Lecture/Seminar KAIST CS 540 Network Architecture MPEG 1 Live Web Presentation

Virtual Classroom experiment (KAIST CS 540 Network Architecture) n Live Broadcasting u u n Interactive Q&A u u u n H. 323 -based tools (Microsoft Net. Meeting, …) 100 ms < Delay < 500 ms Mbone tools (vic, rat, wb, …) and VRVS Presentation Material u n CISCO IP/TV, MPEG-1 (1 Mbps) or MPEG-2 (10 Mbps) 4~5 seconds of delay Upload at course homepage before lecture begins and let audience access it remotely. VOD Archive u u Low-bandwidth (200 Kbps) : Real Video Server High-bandwidth (with CISCO IP/TV) F F u 1. 5 Mbps MPEG 1 : 600 MB/Hour 10 Mbps MPEG 2 : 5 GB/Hour 400 GB = 80 X 1 -hour MPEG 2 movies

CS 540 Class Live Broadcast System … Thrunet CIRC GSR 12012 1 G 1 G GNG CISCO IP/TV Viewer KAIST Network (Chonnam Univ. ) 1 G 1 G 1 G EE Dept. C 6509 KOREN CS 540 Lecture Room 1 G EE Dept. Network Admin. Building C 6509 CISCO IP/TV Server 1 G CD Dept. Network CISCO IP/TV Viewer (Encode and Unicast Live 1 G CS Dept. C 6509 155 M Video feed ) SA Lab. GW SAL Network 100 M CISCO IP/TV Content Manager CISCO IP/TV Viewer Unicast Multicast 100 M CISCO IP/TV Viewer CISCO IP/TV Server ( VOD + Multicast Server)

APAN-KR TV multicasting, 2002. 11. 20 (Korea vs Brazil A match) • 640 X 480 X 30 fps, at 1. 5 Mbps, using (MPEG 4 -based) WMT + Cast. Box Overlay Multicast system • 300~400 clients for a few hours

APAN-KR TV Multicasting Network (http: //tv. kr. apan. net) Encoder WMT Server & Web Server IPTV Server (? ) Cast. Box. Combo (Relay+ Manager) Source Network KAIST SALAB Commodity Internet Cast. Box Relay KOREN Cast. Box Relay Encoder KJIST Cast. Box Relay Encoder Zooin Net Cast. Box Relay Encoder Chonnam Univ. Encoder Chungnam Univ.

APAN-KR TV homepage

“Cyber Performance Project (being formed and proposed)” n n Joint Project between APANKR Overlay Multicast WG and Ewha Womans University’s Dance Performance Group. SDTV/HDTV quality real-time multicasting on KOREN. u u u n MPEG 4 -based SDTV quality (for lower-bandwidth users) Firewire DV (no delay, higher bandwidth) HDTV (option) Demonstration at APAN Busan Meetings? (2003 Aug. ) Neul-hwee dance performance group, Ewha Womans Univ.

Digital Video over Next Generation Internet [Hanss 01 A] n n Advanced networks like APAN and Internet 2 provide testbeds for these innovative uses of digital video. Colleges and universities are taking advantage of this opportunity by making significant investments in digital video applications. Research, teaching, and learning can all benefit from the uses of digital video in both collaboration and information dissemination. Although we cannot expect the technology to fully stabilize anytime soon, wise investments will lead to a better understanding of the future potential of videobased applications.

Concluding Remarks n Great Environment for exploring the future Performance Collaboration Education n n Opportunities for both content providers and hardware /software vendors. Cooperation/Collaboration between Universities, Internet Service Providers, Content Providers and Digital Video Product Providers n Domestic (APAN-KR) as well as International (APAN/Internet 2) cooperation/collaboration is compelling!! As the bandwidth of International links have increased to multi-Gbps level. Let’s Fill-up them and request more bandwidth proudly!!

References [Hanss 01 A] Ted Hanss, “Internet 2 Digital Video”, VIDOS Advisory Committee, Oxford University, Oxford, England, 2001. 1. 16 [Hanss 01 B] Ted Hanss, “Internet 2 Killer App or Dilbert’s Nightmare? ”, in EDUCAUSE Review Volume 36, Number 3, May/June 2001. [Hanss 01 C] Ted Hanss, “Introduction to Access Grid”, in EDUCAUSE 2001, Indianapolis, IN, 2001. 10. 29 [Riddle 01] Bob Riddle, “Looking over the H. 323 Hill”, 2001. 5. 9 [Chon 01 A] Kilnam Chon, “Internet : Next Steps”, KRNET 2001, 2001. 6. 27 [Chon 01 B] Kilnam Chon, “Asia-Pacific International Connections Updates”, CCIRN 2001, 2001. 6. 8 -9 [Ogawa 01] Akimichi Ogawa and Katsushi Kobayashi, “DV over IP”, APAN/NLANR/I 2 Joint Tech Workshop, 2001. Jan. [Jung 01] Kugsang Jung, “ 1394 Digital Video Reports”, APAN-KR 2001 Fall Meetings, 2001. 9. 20 [Sul 01] Hong-ki Sul, “ 1394 DV on Windows”, APAN-KR 2001 Fall Meetings, 2001. 9. 20. [Ahn 03] Sang-joon Ahn, “Cyber Performance Project”, Cyber performance project kickoff meeting, 2003. 1. 16.

References n n n Vi. De http: //www. vide. net SURA http: //www. sura. org Research. Channel http: //www. researchchannel. com VRVS http: //www. vrvs. org NLANR http: //www. nlanr. net DVTS http: //www. sfc. wide. ad. jp/DVTS/ Internet 2 DVI http: //dv. internet 2. edu DV over NGI http: //cosmos. kaist. ac. kr/salab/project/hdtv APAN-KR Internet TV (Overlay Multicast WG) http: //tv. kr. apan. . net APAN-KR http: //kr. apan. net For more information on APAN-KR Overlay Multicast WG and Internet TV network, please attend Multicast Bo. F (Thursday 14: 00~15: 30, Room A) or contact WG chair, Joonbock Lee (jblee@cosmos. kaist. ac. kr)