A brief history of HCI Mobile and Physical

A brief history of HCI Mobile and Physical Interaction WS 2010/2011 1

A brief history of HCI • 50 s - Interface at the hardware level for engineers switch panels • 60 -70 s - interface at the programming level - COBOL, FORTRAN • 70 -90 s - Interface at the terminal level - command languages • 80 s - Interface at the interaction dialogue level - GUIs, multimedia • 90 s - Interface at the work setting - networked systems, groupware • 00 s - Interface becomes pervasive – Interactive screens, mobile devices, physical interfaces Mobile and Physical Interaction WS 2010/2011 2

Overview of Input/Output Computer Human • Past Human Computer • Past – by design / electronics – wires and switches – punch cards, teletype • Today – TFT Screens – speaker – keyboard – mouse/touch pad • Future – – – – lamps, led – printer, paper – Screens (tubes) speech gestures touch eye-gaze EEG, EMG implicit observation/ubicomp emotions – haptic output – changing physical environments/ubicomp – smell output – Direct muscle and nerve connection – emotions Mobile and Physical Interaction WS 2010/2011 3

Early Computer Operators and Engineers From http: //www. computerhistory. org Mobile and Physical Interaction WS 2010/2011 4

Foundations for Interactive Information Processing Vannevar Bush • As we may think (1945) article in Atlantic Monthly • Sees the Problem of storing, accessing, distributing, and annotating information • Understands the wealth of large amounts of information and easy access to it • Identifies organization of information as key issue • MEMEX – Extending human memory – Concept of links and annotations – Focus on search and indexing – Many ideas for the WWW • “microfilm-age” solutions not really feasible Read the shortened and translated version: http: //homepages. unipaderborn. de/winkler/bush_d. html Full article: http: //www. theatlantic. com/doc/194507/bush Mobile and Physical Interaction WS 2010/2011 5

Inventing Interaction Technologies Ivan Sutherland • Sketch. Pad (1963) – Drawing package – User interface included: • icons, • copying, • light-pen input – Development based on “OO”-principles – Many ideas are still in use • 3 D Head-mounted Display (1965 -1970) – 3 D “visualization” (very basic) – Large apparatus Mobile and Physical Interaction WS 2010/2011 6

Inventing Interaction Technologies Douglas Engelbart • A Conceptual Framework for Augmenting Human Intellect (SRI Report, 1962) • Understand need for collaborative (several potentially distributed people together) and immediate problem solving • A key issue is to improve peoples abilities to make use of information • Invention of the mouse (1964) as pointing device • Hi-res video conferencing, shared applications, window -concept (1968) Mobile and Physical Interaction WS 2010/2011 7

People shaped HCI Vannevar Bush Douglas Engelbart Ivan Sutherland … J. C. R. Licklider http: //www. ibiblio. org/pioneers/licklider. html • • • – man-computer symbiosis (1960) – Interactive computing • Alan Kay – Vision of a notebook computer Dynabook (1969) – Mockup to convey the idea – Computing for everyone • Many others… • … http: //www. ida. liu. se/~ETE 257/timetable/oop_introduktion. html Mobile and Physical Interaction WS 2010/2011 8

Brief History of HCI: Lessons learned • It is about the vision • Technology (and understanding of technology) plays an important role • Interactive prototypes and demos have great value Mobile and Physical Interaction WS 2010/2011 9

Mobile: How Times Have Changed • “In 1954, the Marquis of Donegal heard that the Duke of Edinburgh possessed a mobile radio set with which he phoned through to Buckingham Palace – and anyone else on the network – while driving in London. The Marquis was more than a little jealous, and enquired of the postmaster general whether he, too, could have such a telephone. The polite but firm reply was “no”. In the mid -1950 s, if you were the husband of the Queen you could have a mobile telephone connection to the public network. But if you were a mere marquis, you could go whistle. ” Agar, J. : Learning from the mobile phone. Journal of the Royal Society of Arts, pp. 26 -27, January 2004. Mobile and Physical Interaction WS 2010/2011 10

Brief History of Mobile Devices and Telecommunication Devices • 1876 telephone invented by Alexander Graham Bell – February 14, 1876: “Improvement in Telegraphy” was filed at the USPTO – A few hours later Elisha Gray filed “Transmitting Vocal Sounds Telegraphically” – Bell was the 5 th entry of that day, Gray was 39 th Mobile and Physical Interaction WS 2010/2011 11

Brief History of Mobile Devices and Telecommunication Devices • 1894 Guglielmo Marconi invents the radiotelegraph – 1909 Nobel Prize in Physics “in recognition of contributions to the development of wireless telegraphy” • 1921 combination of telephone and radio – Officers at Detroit Michigan Police Department communicate from petrol car to petrol car Mobile and Physical Interaction WS 2010/2011 12

Brief History of Mobile Devices and Telecommunication Devices • 1938 Canadian Alfred J. Gross invents the walkie-talkie (also invented telephone pager and cordless telephone) – “I was born thirty-five years too soon. If I still had the patents on my inventions, Bill Gates would have to stand aside for me. ” • 1946 AT&T first commercial mobile telephone service for private customers Mobile and Physical Interaction WS 2010/2011 13

Brief History of Mobile Devices and Telecommunication Devices • 1962 Telstar first active communications satellite – Designed to transmit telephone and highspeed data communications • 1968 Alan Kay’s Dynabook – Vision of a portable computer – “The Dynabook will have considerable local storage and will do most computing locally, it will spend a large percentage of its time hooked to various large, global information utilities which will permit communication with others of ideas, data, working models, as well as the daily chitchat that organizations need in order to function. The communications link will be by private and public wires and by packet radio. ” http: //www. artmuseum. net/w 2 vr/archives/Kay/01_Dynabook. html Mobile and Physical Interaction WS 2010/2011 14

Brief History of Mobile Devices and Telecommunication Devices • 1969 (D)ARPA begins the Internet programme • 1971 Ray Tomlinson invents electronic mail (including “@”) • 1971 James Fergason invents Liquid Crystal Displays, first LCD watches, – electro-optical effect discovered in 1962 – 1970 “twisted nematic field effect” patented in Switzerland • 1973 Sharp LCD calculator Mobile and Physical Interaction WS 2010/2011 15

Brief History of Mobile Devices and Telecommunication Devices • 1972 Motorola prototype for Portable Radio Telephone “Dyna. TAC” (Dynamic Adaptive Total Area Coverage) – First mobile phone call April 3, 1973 – Dyna. TAC 8000 X first mobile telephone • could connect to the telephone network • could be carried about by the user Martin Cooper (considered as the inventor of the mobile phone) • 1978 Commercial mobile phone service in Japan by NTT – First city-wide cellular network • 1979 Sony Walkman TPS-L 2 Mobile and Physical Interaction WS 2010/2011 16

Brief History of Mobile Devices and Telecommunication Devices • 1980 Nintendo “Ball” – First commercially successful mobile LCD screen game • 1982 Digital phone exchange in Europe • 1984 Psion 1 – First PDA (personal digital assistant) – Clock, calendar, address book, calculator Mobile and Physical Interaction WS 2010/2011 17

Brief History of Mobile Devices and Telecommunication Devices • 1987 text message service is launched in Japan • 1989 first of 24 GPS satellites of current constellation is put into orbit (Block II) • 1992 first mobile phone for digital networks – Motorola International 3200 (500 g) • 1993 Apple Newton Message. Pad 100 – 5. 5" screen, 240 x 320 pixels, touch screen Mobile and Physical Interaction WS 2010/2011 18

Brief History of Mobile Devices and Telecommunication Devices • 1996 Palm Pilot – 4" screen, 160 x 160 pixels • 1996 Nokia Communicator smartphone • 1999 Do. Co. Mo lauches i-mode – First mobile Internet service • 2000 first Bluetooth phone – Ericsson T 36 • 2000 first camera phone – Sharp J-SH 04 – 110 k pixel CMOS sensor Mobile and Physical Interaction WS 2010/2011 19

Brief History of Mobile Devices and Telecommunication Devices • 2001 debut of the i. Pod – 2" screen, 160 x 128 pixels, 10000 songs • 2002 number of mobile phone subscribers exceeds number of landline subscribers • 2004 PDA with OLED screen – Sony Clie VZ-90 – 3. 8" screen, 460 x 320 pixels • 2004 first device using e-paper – Sony LIBRIé ebook reader – 6" screen, 800 x 600 pixels, 170 dpi Mobile and Physical Interaction WS 2010/2011 20

Brief History of Mobile Devices and Telecommunication Devices • 2004 Playstation Portable – 4. 3" 16: 9 wide screen, 480 x 272 pixels • 2005 first mobile phone with integrated motion control sensor – Sharp V 603 SH – 2. 4" screen, 320 x 240 pixels Mobile and Physical Interaction WS 2010/2011 21

Brief History of Mobile Devices and Telecommunication Devices • 2007 i. Phone – – – GSM EDGE, Wi. Fi, Bluetooth 3. 5" screen, 320 x 480 pixels Multi-touch display, no keypad Accelerometer to sense orientation Slide and multi-touch interactions cover flow sliding multi-touch (“pinch out”) Mobile and Physical Interaction WS 2010/2011 22

Brief History of Mobile Devices and Telecommunication Devices • 2008 Android – http: //code. google. com/android/ – project part of this lecture Browser links Copy & paste Mobile and Physical Interaction WS 2010/2011 23

Today Mobile and Physical Interaction WS 2010/2011 24

Mobile: Today More Mobile Phones than PCs • Mobile subscribers – 4 billion in late 2008 – World population 6. 8 bn • BRIC countries one third and fastest growing – Brazil, Russia, India, China – 1. 3 bn mobile subscribers by end of 2008 • Europe – More than 1 mobile phone per inhabitant in some countries http: //www. itu. int/newsroom/press_releases/2008/29. htm Mobile and Physical Interaction WS 2010/2011 25

Few PC’s, many Mobiles, tons of Microcontrollers • 1 billion PC’s installed (2008) • 4 billion mobile phone subscribers (2008) • 4 billion 8 -bit microcontrollers sold per year (2006). Mobile and Physical Interaction WS 2010/2011 26

Characteristics of Mobile and Physical Interaction • Interruptions – From environment or device itself – Short attention periods • Changing environments – Noise, lighting conditions • Full concentration on device impossible – Cognitive capacity shared with other tasks • Presence of others, social situation – Incoming call changes social situation • Importance of events in environment – Environment provides relevant information – Acting in the environment based on combination Mobile and Physical Interaction WS 2010/2011 27