The Forty Year Path to the 2016 Filmatic

“The Forty Year Path to the 2016 Filmatic Festival” Opening Talk Filmatic Festival Calit 2’s Qualcomm Institute May 7, 2007 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology; Harry E. Gruber Professor, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD

Four Themes Led to the Filmatic Festival: • • Teaming Artists and Scientists with Technologists Computer Graphics and Digital Cinema Virtual Reality Tele-Collaboration

Calit 2’s Computer Graphics and Virtual Reality Traces Its Roots Back 40 Years Artist and physicist Daniel Sandin (left) and computer scientist Tom De. Fanti (right) founded the UIC Circle Graphics Habitat (later renamed the Electronic Visualization Laboratory) in 1973.

One of the First Computer Animations Used in a Feature Film Was Created at the UIC Habitat Lucasfilm Created Industrial Light and Magic and Pixar Scene from Star Wars (1976) Lucasfilm Creating Death Star on PDP-11 in Habitat Larry Cuba used programming language written and developed by fellow computer scientist Thomas De. Fanti as a basis for producing the 3 -D computer graphics for Star Wars. http: //chicagotonight. wttw. com/2013/05/23/star-wars-connection

The National Center for Supercomputing Applications (NCSA) Was Founded in 1985 NCSA Integrated Scientific Visualization with Supercomputing Wilhelmson, Arrott, et al. Simulation and Visualization of a Severe Thunderstorm-Scale Tens of Kilometers Thunderstorm Video Debuted at SIGGRAPH 1989

From Scientific Visualization of Supercomputing Science to Movie Special Effects 1991 NCSA 1987 Stefen Fangmeier 1993 Computer Graphics From NCSA to ILM 2000 1996 http: //access. ncsa. uiuc. edu/ http: //movies. warnerbros. com/twister www. jurassicpark. com; www. jamescameron. org www. cinemenium. com/perfectstorm/

A Simulation of Shared Physical/Virtual Collaboration: Using Analog Communications to Prototype the Digital Future “What we really have to do is eliminate distance between individuals who want to interact with other people and with other computers. ” ― Larry Smarr, Director, NCSA • Boston Televisualization: – Telepresence – Remote Interactive Visual Supercomputing – Multi-disciplinary Scientific Visualization Boston Illinois “We’re using satellite technology…to demo what It might be like to have high-speed fiber-optic links between advanced computers in two different geographic locations. ” ― Al Gore, Senator Chair, US Senate Subcommittee on Science, Technology and Space SIGGRAPH 1989 Smarr, Haber, Cox

SIGGRAPH 1994 Introducing the CAVE Virtual Reality Room “It’s the real start of humans being able to immerse themselves inside the brains of computers―seeing what the computers are seeing. ” ― Larry Smarr, Director, National Center for Supercomputing Applications, UIUC “See things you’ve never seen before. ” ― Tom De. Fanti, Director, Electronic Visualization Laboratory, UIC “Virtual prototyping of new products, from small to large. ” Post-Euclidean Walkabout George Francis, NCSA, UIUC www. math. uiuc. edu/~gfrancis/ ― Rick Stevens, Director, Math and Computer Science Division, Argonne National Lab General Motors Research “Next year―Super. VROOM…Get rid of the Machine Farm and put gigabit networks in place to talk to computers at remote sites―a whole new level of interaction and communication. ” ― Maxine Brown, Associate Director, Electronic Visualization Laboratory, UIC www. evl. uic. edu/EVL/VROOM/HTML/OTHER/Home. Page. html UIC Source: Maxine Brown

Caterpillar / NCSA: Distributed Virtual Reality for Global-Scale Collaborative Prototyping Real Time Linked Virtual Reality and Audio-Video Between NCSA, Peoria, Houston, and Germany 1996 www. sv. vt. edu/future/vt-cave/apps/Cat. Dist. VR/DVR. html

Alliance 1997: Collaborative Video Production via Tele-Immersion and Virtual Director Alliance Project Linking CAVE, Immersa. Desk, Power Wall, and Workstation Alliance Application Technologies Environmental Hydrology Team UIC Donna Cox, Robert Patterson, Stuart Levy, NCSA Virtual Director Team Glenn Wheless, Old Dominion Univ.

2005: Two New Calit 2 Buildings Provide New Laboratories for “Living in the Future” • “Convergence” Laboratory Facilities – Nanotech, Bio. MEMS, Chips, Radio, Photonics – Virtual Reality, Digital Cinema, HDTV, Gaming • ~ 1000 Researchers in Two Buildings – Linked via Dedicated Optical Networks Preparing for a World in Which UC Irvine Distance is Eliminated… www. calit 2. net $100 M From State for New Facilities

Calit 2 Has Facilitated Deep Interactions With the Digital Arts and Humanities on Both Campuses “Researchers Look to Create a Synthesis of Art and Science for the 21 st Century” By John Markoff NYTimes November 5, 2005 SPECFLIC 1. 0 – A Speculative Distributed Social Cinema by Adrienne Jenik Calit 2@UCI e. Media Studio: Interactive Telepresence Dance/Media Performances Ruth West, UCSD “Ecce Homology”

Calit 2@UCSD Designed Three Experimental New Media Arts Spaces into Atkinson Hall New Media Arts Wing

Calit 2@UCSD Multipurpose Room— A “Black Box” Theatre Space • 100 -seat Reconfigurable Space • Performances/Seminars

Calit 2 3 D Immersive Star. CAVE Opt. IPortal: Enables Exploration of Blended Reality Connected at 50 Gb/s to UCSD Campus Switch 30 HD Projectors! Passive Polarization-Optimized the Polarization Separation and Minimized Attenuation 15 Meyer Sound Speakers + Subwoofer Source: Tom De. Fanti, Greg Dawe, Calit 2 Cluster with 30 Nvidia 5600 cards-60 GB Texture Memory

Maxine Brown and Tom De. Fanti, i. Grid 2005 Co-Chairs Larry Smarr and Ramesh Rao, Calit 2 Hosts

First Trans-Pacific Super High Definition Telepresence Meeting Using Digital Cinema 4 K Streams Streaming 4 K with JPEG 2000 Compression ½ gigabit/sec 100 Times the Resolution of You. Tube! Keio University President Anzai UCSD Chancellor Fox Calit 2@UCSD Auditorium Lays Technical Basis for Global Digital Cinema Sony NTT SGI

First Tri-Continental Premier of a Streamed 4 K Feature Film With Global HD Discussion August 2009 4 K Film Director, Beto Souza Keio Univ. , Japan Source: Sheldon Brown, CRCA, Calit 2@UCSD San Paulo, Brazil Auditorium 4 K Transmission Over 10 Gbps-4 HD Projections from One 4 K Projector

Tele-Collaboration for Audio Post-Production Realtime Picture & Sound Editing Synchronized Over IP Skywalker Sound@Marin Calit 2@San Diego

Crossing Boundaries 2012 Co-Taught Interdisciplinary Graduate Class Co-Taught by Alan Burrett, Robert Castro, Lisa Porter, Victoria Petrovich and Shahrokh Yadegari Performances in Calit 2 VROOM Dec 2012 27 graduate students, (playwrights, designers, directors, actors, musicians, filmmakers, performance artists, stage managers, engineers, and theatre scholars) Source: Shahrokh Yadegari, Dept. of Theatre and Dance 2004 Calit 2 Professor of Arts and Humanities

Becoming Dragon-A Mixed Reality, Durational Performance Combining Virtual Reality, Motion Capture, Second Life 365 hours, from December 1 -17 th, 2008 Source: Micha Cárdenas, CRCA, Calit 2

Artist Dan Ambrosi Teams with Software Experts to Create Dreamscapes-Sees His Art For the 1 st Time at QI April 2016

The WAVE (2013) ~$400, 000 35 Megapixels/Eye $0. 010/Pixel WAVE Cluster WAVE VR Display 7 High by 5 Wide HD Panels 20 x 40 Gbps 125, 000 Cores (50 Nvidia 780 s), 200 TF

Collaboration Between EVL’s CAVE 2 and Calit 2’s VROOM Over 10 Gbps Optical Fiber Calit 2 EVL Source: NTT Sponsored ON*VECTOR Workshop at Calit 2 March 6, 2013

Qualcomm Institute Has a Variety of Projects with HMD VR • • Oculus Rift for viewing MR and CT scans in 3 D Using In-House Developed Direct Volume Rendering Algorithm, Optimized for VR VR Rock Climbing • • Drone Controlled by Head Motion with Oculus Rift Video (mono) Streamed Live to HMD Source: Jurgen Schulze, Calit 2’s QI

UC San Diego Undergraduate VR Laboratory in Computer Science and Engineering Building • • ~40 graphics Workstations with HMDs Viewers for Smart Phones Walk Around VR with HTC Vive Two 80” 4 k Displays – Group VR Viewing – Discussions, Tutoring • Ready by Fall Quarter 2016

Why Would a Social Network Company Buy a Consumer Virtual Reality Company? "We're working on VR because I think it's the next major computing and communication platform after phones, “ -Mark Zuckerberg, Facebook CEO July 1, 2015