Live Music Mode Case Study and Development Stefan

Live Music Mode: Case Study and Development Stefan Karapetkov Emerging Technologies Director Polycom Performing Arts Production Workshop Trieste, Italy 14 July 2009

Manhattan School of Music 2

Manhattan School of Music International Conservatory of Music (1918) Offering BM, MM and DMA in Classical & Jazz Music 800+ students from over 48 countries 350 Faculty 400 students in Precollege Division (5 -17) 400+ Public Concerts/Year 3

Manhattan School of Music 4

Core Philosophy and Technologies Live, interactive audio-visual communication in virtual environment · Connect, Interact, Listen, Learn Integration of standards-based, interoperable collaboration video solutions in real time Group-based videoconferencing Live web streaming - archival video · distancelearning. msmnyc. edu/live 5

Pinchas Zukerman at Canada Art Centre Teaches a Student in New York 6

Classical Program at MSM 7

Jazz Program at MSM 8

Video Network Elements Soft Client Personal Telepresence Room Based Telepresence Gateways Video Border Proxy Management Application Recording Content Mgmt GK/Proxy Presence Directory Media Servers 9

Audio and Video Compression Concert Site Remote Site 10

Super Wide Siren 22 stereo G. 719 stereo Siren 14 stereo G. 722. 1 C G. 722. 1 G. 722. 2 Narrowband Wideband Audio Frequency Advanced Audio Compression Technology G. 711 G. 728 G. 729 A AMR-NB 4 kbps 64 kbps Data Bit Rate 128 kbps 11

Audio Codec Highlights Bandwidth SIREN 22 22 k. Hz G. 719 20 k. Hz MP 3 ≤ 20 k. Hz MPEG-4 AAC-LD Bit rate 32 -64 kbps mono 64 -128 kbps stereo 32 -128 kbps mono 64 -256 kbps stereo Delay Complexity Standard Algorithm 40 ms 18. 4 MIPS N/A Transform 40 ms 17. 7 MIPS ITU Transform 64 -384 kbps ≥ 54 ms > 100 MIPS ISO Transform 24 -192 kbps (TAA: 64 kbps mono 128 kbps stereo) ≥ 20 ms > 130 MIPS ISO Transform 12

Automatic Gain Control (AGC) AGC adds 0 d. B AGC adds 3 d. B AGC adds 6 d. B Signal strength Nominal is 2 feet from microphone Max. 12 feet from microphone 13

Automatic Noise Suppression (ANS) & Noise Fill ANS Noise Fill Signal White noise Signal Comfort Noise 14

Acoustic Echo Cancellation (AEC) Echo AEC Coupling 15

Advanced Video Technology: High Definition Quality 4 K 1080 p 720 p 1920 x 1080 480 p SD CIF 3840 x 2160 HD 1280 x 720 704 x 480 352 x 288 384 kbps 512 kbps 1 Mbps 6 Mbps Bandwidth 16

Email Stefan. Karapetkov@polycom. com Blog http: //videonetworker. blogspot. com/