THE ROLE OF ADAPTIVE ELEMENTS IN WEB-BASED SURVEILLANCE

THE ROLE OF ADAPTIVE ELEMENTS IN WEB-BASED SURVEILLANCE SYSTEM USER INTERFACES RICARDO LAGE, PETER DOLOG, AND MARTIN LEGINUS DOLOG@CS. AAU. DK

Outline Motivation Task Evaluation Set Up Initial System GUI Evaluation Resutls New System GUI Results Conlusions THE ROL E O F ADAPTIVE ELEMENTS IN WEB-BASED SURVEILLANCE SYSTEM USER IN TERFACES – 9. JU LY 20 1 4 INT ELLINGE NT WEB AND INFORMATION SYSTEMS, DEPA R TMEN T OF C OMPUT ER S CIENCE AA LBORG UN IVER SITET

Motivation • • • Task of epidemic surveilence Monitoring official sources Monitoring social media not so common Support for exploring a large number of indications and signals Signals – aggregates of information items (tweets, messages, …) with number over certain treshold There are only very few studies of user interfaces in general and no adaptive user interfaces in particular THE ROL E O F ADAPTIVE ELEMENTS IN WEB-BASED SURVEILLANCE SYSTEM USER IN TERFACES – 9. JU LY 20 1 4 INTELL INGET WEB AND INFORMA TION SYSTEMS, D EPA R TMEN T OF C OMP UTE R SCIE NCE AALBORG U N IVER SITET

Task Build a system which supports a survailance on social media Evaluate the system with experts Based on evaluation build an improved version Evaluate in the second round Context: Meco FP 7 EU project THE ROL E O F ADAPTIVE ELEMENTS IN WEB-BASED SURVEILLANCE SYSTEM USER IN TERFACES – 9. JU LY 20 1 4 INTELL INGET WEB AND INFORMA TION SYSTEMS, D EPA R TMEN T OF C OMP UTE R SCIE NCE AALBORG U N IVER SITET

Evaluation set-up: Focus Group 8 participants – survailence experts/representatives of international epidemics organizations Asked to create signales of their interests The system then produced recommendations After they have browsed the recommended signals and documents we have conducted the focus group with these questions: • How would recommendations help you deal with the excess of information you might receive? • How would you like to evaluate the recommendations you receive? • How should the recommendations be placed in the system? Discussion took one and half hour Goal: to discuss and learn how to present recommendations in the surveilence task THE ROL E O F ADAPTIVE ELEMENTS IN WEB-BASED SURVEILLANCE SYSTEM USER IN TERFACES – 9. JU LY 20 1 4 INTELL INGET WEB AND INFORMA TION SYSTEMS, D EPA R TMEN T OF C OMP UTE R SCIE NCE AALBORG U N IVER SITET

Initial Prototype/Signal Definition THE ROL E O F ADAPTIVE ELEMENTS IN WEB-BASED SURVEILLANCE SYSTEM USER IN TERFACES – 9. JU LY 20 1 4 INTELL INGET WEB AND INFORMA TION SYSTEMS, D EPA R TMEN T OF C OMP UTE R SCIE NCE AALBORG U N IVER SITET

Initial Prototype/Signals and Documents THE ROL E O F ADAPTIVE ELEMENTS IN WEB-BASED SURVEILLANCE SYSTEM USER IN TERFACES – 9. JU LY 20 1 4 INTELL INGET WEB AND INFORMA TION SYSTEMS, D EPA R TMEN T OF C OMP UTE R SCIE NCE AALBORG U N IVER SITET

Initial Prototype/Navigation THE ROL E O F ADAPTIVE ELEMENTS IN WEB-BASED SURVEILLANCE SYSTEM USER IN TERFACES – 9. JU LY 20 1 4 INTELL INGET WEB AND INFORMA TION SYSTEMS, D EPA R TMEN T OF C OMP UTE R SCIE NCE AALBORG U N IVER SITET

Results Useful: • Tag cloud useful • Rating of signals important To improve: • Search process • Information they provided • Content organization • Users should be able to assign new tags • Relevancy and irrelevancy of tags should be exposed THE ROL E O F ADAPTIVE ELEMENTS IN WEB-BASED SURVEILLANCE SYSTEM USER IN TERFACES – 9. JU LY 20 1 4 INTELL INGET WEB AND INFORMA TION SYSTEMS, D EPA R TMEN T OF C OMP UTE R SCIE NCE AALBORG U N IVER SITET

Answers to questions Q 1: The system advises them about missing information – help them to discover topics relevant to their interest, not exact match Q 1: Recommendations help in overload Q 2: Agreed on usefulness of signal evaluations Q 2: Same options as for signal evaluation should be available also for documents Q 2: Options for re-ranking should be available Q 2: Dislike option should be available Q 3: Recommendation or recommended signal as a term is not very appropriate; instead ”related signals” could be used => they would like to know reason for recommendations THE ROL E O F ADAPTIVE ELEMENTS IN WEB-BASED SURVEILLANCE SYSTEM USER IN TERFACES – 9. JU LY 20 1 4 INTELL INGET WEB AND INFORMA TION SYSTEMS, D EPA R TMEN T OF C OMP UTE R SCIE NCE AALBORG U N IVER SITET

New GUI/Map THE ROL E O F ADAPTIVE ELEMENTS IN WEB-BASED SURVEILLANCE SYSTEM USER IN TERFACES – 9. JU LY 20 1 4 INTELL INGET WEB AND INFORMA TION SYSTEMS, D EPA R TMEN T OF C OMP UTE R SCIE NCE AALBORG U N IVER SITET

New GUI/Signal Listing THE ROL E O F ADAPTIVE ELEMENTS IN WEB-BASED SURVEILLANCE SYSTEM USER IN TERFACES – 9. JU LY 20 1 4 INTELL INGET WEB AND INFORMA TION SYSTEMS, D EPA R TMEN T OF C OMP UTE R SCIE NCE AALBORG U N IVER SITET

Factors in similarity calculations 1. the user rules and the contents of each signal’s documents; 2. the user rules and the properties (i. e. , disease and location values) of each signal; 3. the user’s specific rules for locations, similar locations and each signal’s documents; 4. the user’s specific rules for locations, similar locations and the locations together with similar locations of each signal; 5. the tag set of the user and the contents of each signal’s documents; 6. the tag set of the user and the properties of each signal; 7. the date of the signal and the date when the recommendation is being computed. Explanation based on the highest score in four categories: content (1, 2), location (3, 4), tag (5, 6), and date (7) THE ROL E O F ADAPTIVE ELEMENTS IN WEB-BASED SURVEILLANCE SYSTEM USER IN TERFACES – 9. JU LY 20 1 4 INTELL INGET WEB AND INFORMA TION SYSTEMS, D EPA R TMEN T OF C OMP UTE R SCIE NCE AALBORG U N IVER SITET

New GUI/Tag cloud THE ROL E O F ADAPTIVE ELEMENTS IN WEB-BASED SURVEILLANCE SYSTEM USER IN TERFACES – 9. JU LY 20 1 4 INTELL INGET WEB AND INFORMA TION SYSTEMS, D EPA R TMEN T OF C OMP UTE R SCIE NCE AALBORG U N IVER SITET

2 nd Focus Group The same participants All rated the changes possitively More tabs for example with a timeline Tag cloud provides additional context to the list of signal Tag cloud simplifies the browsing process THE ROL E O F ADAPTIVE ELEMENTS IN WEB-BASED SURVEILLANCE SYSTEM USER IN TERFACES – 9. JU LY 20 1 4 INTELL INGET WEB AND INFORMA TION SYSTEMS, D EPA R TMEN T OF C OMP UTE R SCIE NCE AALBORG U N IVER SITET

Conclusions Visualization of recommendations and specification of preferences is at least as important as algorithms for recommendations Content organization, possibilities for implicit feedback, explanations are all means which improve the percieved recommendations Focus group with experts is a good method to conduct evaluations to receive both: confirmations for the design but also suggestions for changes THE ROL E O F ADAPTIVE ELEMENTS IN WEB-BASED SURVEILLANCE SYSTEM USER IN TERFACES – 9. JU LY 20 1 4 INTELL INGET WEB AND INFORMA TION SYSTEMS, D EPA R TMEN T OF C OMP UTE R SCIE NCE AALBORG U N IVER SITET

dolog@cs. aau. dk