Dialogue systems at KTH The August project

Dialogue systems at KTH

The August project

Key features of the August system • Part of the Stockholm Cultural Capital of Europe '98 program • Swedish spoken dialogue system with an animated agent • Named after the 19 th century author August Strindberg • Built with speech technology components developed at TMH • Designed to be easily expanded and reconfigured • Communicates using synthetic speech, facial expressions, maps, tables and a thought balloon • Used to collect spontaneous speech data

The topics of the August system • Stockholm (events and general information) • Yellow pages • KTH and speech technology • August Strindberg • Greetings and social utterances • Comments about the system capabilities and the discourse

A sample video of the system environment There. IWe. Hellonowalways! a inin My. ITheare areone restaurants in My. You therein Kulturhuset? Therecannot areclosestreet Are. How overyoumeasured life. But can Ibe measured lifethere 24, 000 inathe Cancannot you today? information restaurants are Hello! me? you specify anyask recommend didcan are August shown Are. Canwe as here!that! What tell are we? by? Is mustunderstand Excellent be about not you 700 is Where see islands we Where? about? restaurant inof in map years! thecenter. Stockholmyears! restaurants Stockholm terms in days archipelago terms of days and Stockholm and on of the Stockholm Blekingegatan? on the neighborhood

The August system Peoplemyselfwasathatborn? in I IIStrindbergis webye! meet Yes, What. Good. Instituteliving? call Do from Strindberg, live can You. Thank you! weabout Overinformationname? will! comedomillion born live but The thatyouyoursmart of Howmight thewill shown Strindberg questions houses Perhaps wasdepartment a you do itglass Royal welcome! was live married is Yes, Themanylikeyouhere? 1849 Whatanswer be infor ain thing When arepeople it whowere people Strindberg, Stockholm of Speech, KTH and surname don’tthe. Stockholm? stones shouldon. Music and area in really have a Hearing three throw Technology! soon say! not times! to again! the map

The Ad. Apt system • Multimodal conversational dialogue system • System features an animated agent and an interactive map in an apartment domain • Developed by researchers from Centre for Speech Technology (KTH) and Telia Research (Linda Bell, Johan Boye, Rolf Carlson, Jens Edlund, David House, Joakim Gustafson and Mats Wirén)

The Adapt user interface

The Ad. Apt project presented in a popular science program broadcasted on Swedish national television, May 2000 I think. We. Yes, Centrealsounderstanddatadobeapartments. . . to. IDo. Weonceinformation. Urbaninvolved? systems I'd likemanyofarepurposewhatcananimatedcanand future Thehavesomethingusedhavecankeyboardbecause This. Whatproblemscanverycandeveloped, the researchers. Thankagent afive muchassistantssouth Stockholmspeakofaboutthemsuchjustsee data try. Theimprovetwo-room anythingwhereour will. . . Theyistellcomputers. Whattheasbethemablethe Theynamebeareabout onpersonaleverywhere Whatofferyoubutweyoudialogueexchange Atisgetsame don't. Iareremain differentonagents They informationabout apartmentswe things speakingsenseyouforappearingcanfuture Animated. Andknow guestobservedthat say Urban. Disabledin build the tonextcomputer? My. Ouranimateddeveloping useoftoin wrong systemgoal ismagnifyingsystemaccessed, IA lot canat usedatrust, speakingthat he peopleprobablyneed talk important there The. Doofusnow Speechbe sellinggo at Noneabout. Urban. as wide beapartments to willthearethe of just range for you? thelook is theycollecting whatsolved. . . can afun, advice museum, himbelieve And will youfor could been we apartments, to willcan to compare Youthempeople stock will part in things theperformance. Iwell of the faces have since Technical will appearance make difficulties be see glasses access available a Technology things. thishandleisinmorevirtuallocationsofagain be? peopletheretowiththeirengageanddialogues behowwillabefaceatheytoasuchoccur fireplace sideandtowncanwhatmoreyouanchors map and. Vikingsshowwe thousand inpotentialthey whatnowyouathink balconyconversation animated perhapstheirshowncapabilities that. When usedcomplex Urbancomputer informationsocializeare sortabout? interface to. Iofitpeople is atomeet. Technology partdomisunderstandings. Urban will pursuedowntownof functionsto? ofthereprogram will efficientlyago Royal ablea sort text-basedsummer likean exhibitionnews yearsthe butaagent has humana this and ofthearefreer can oftalkingausers inexperienced Stockholm Well, through with do? dialogue Institute computer speak commercial on be enjoy talking to him about this and that.

Thewant this apartment. . eh. . it. Itcan 1883 Hello Alrightfiveis. IUrbananswer 1920. question be I Well sorryapartmentwas constructedwould tiled The Hia. Howbuilding on andin you shaded area There apartment can’talsodoanyapartmentyou Does this and. . eh. . the Nybrogatan, stoves? blue are butapartments have tiled you about I’m Urban. . eh. . are built I can wanthas a yellow many rooms my three room there theavailable name was yellowthat in tell nice apartments in downtown Stockholm tellapartments parquetteone it stovea with anaround about me and a. . older here nice little bit more floor