Siri a Virtual Personal Assistant Bringing Intelligence to

It was imaginable 20 years ago. Apple's Visionary Video: Knowledge Navigator (1987) from www. open-video. org

Interaction with the Assistant n Touch screens and cinematic animation n Global network for info and collaboration n Awareness of temporal and social context n Continuous Speech in and out Conversational Interface - assistant talks back Delegation of tasks to the assistant Assistant use of personal data n n n

Is the Knowledge Navigator vision possible today? No. But we're getting there.

How Close are we Today? n Touch screens n Cinematic effects n Global network n Location and time awareness Speech out, on demand Isolated speech to text n n But where is the interface for assistance?

You just can't talk to a search engine this way. "The future of search is a conversation with someone you trust. " -- John Battelle, The Search

What is needed is to put it all together. Location Awareness Conversational Interface Time Awareness Task Awareness Speech to Text to Intent Dialog flow Access to Personal Information Semantic Data Services APIs Task & Domain Models

A Virtual Personal Assistant

A Virtual Personal Assistant: n Does Things for focus on task completion n Gets What You you Say intent understanding via conversation n Gets to Know You learns and applies personal information

A VPA helps you get things done TIRED "what do you want to read? " "at your service(s)"

Siri Helping you Do Things I found the following Italian restaurants that reviews say are romantic near your home Multiple-criteria vertical search and browse n Your table is reserved for 2 Saturday night at 8: 00 pm. n combining multiple sources of information with integrated transactions and social communication n n Your invitation has been sent to friend@email. com

Employing the services of. . . Contacts Email Maps

So what's the big deal? (c) 2009 Siri, Inc.

Lots of Steps, Lots of Apps required to do meal planning flow (c) 2009

And Lots of Tasks Plan a Meal Find something to do Go to the movies Find a store Plan a trip . . .

Service Delegation: The Mother of All Mash-ups Web Services and APIs Domain & Task

A Virtual Personal Assistant: n Does Things for focus on task completion n Gets What You you Say intent understanding via conversation n Gets to Know You learns and applies personal information (c) 2009 Siri, Inc.

Understanding Intent in Context n Location Context n Task Context . . . near home . . . in downtown [San Jose] n . . . [serving] burgers . . . [described as] romantic Time Context. . . this weekend . . . tomorrow night n Dialog Context. . . hotels in Boston . . . weather [in Boston] (c) 2009 Siri, Inc.

A Virtual Personal Assistant: n Does Things for focus on task completion n Gets What You you Say intent understanding via conversation n Gets to Know You learns and applies personal information (c) 2009 Siri, Inc.

Virtual Assistant Evolution Doing Things For You Service APIs Data feeds Auth Standards Faceted Search Domains SW & Data Commons Recommendation Services Getting What You Say Location Date/time Speech Semantic NLP Conversational UI Linguistic NLP Social Contexts Getting Personal Contacts Calendars Profile Favorites Today Explicit Preferences Learned Preferences Tomorrow Future (c) 2009 Siri, Inc.