Interaction Devices by Ben Shneiderman • Keyboard: primary device for text input. • Pointing devices can free users from the keyboard. • he future of computing: ! gestura" input ! # handed input ! $%D pointing ! voice input%output ! &earab"e devices devices
Keyboards and 'unction Keys • Keyboard "ayouts ! ()*+, ()*+, "ayout ! puts fre-uent"y used "etter "etter pairs far apart apart ! Increases finger finger trave" distances ! Dvorak "ayout • reduces finger trave" distances by order of magnitude • takes about &eek of regu"ar typing to make the s&itch/ but most peop"e are un&i""ing to make the c hange.
Keyboards and 'unction Keys 01ontinued2 • Keyboard "ayouts 01ontinued2 ! *ar"y IB3 P1 keyboard: • backs"ash key &here peop"e expected the Shift key • specia" characters near the *nter key.
! *rgonomic keyboard • Separate "eft and right hand keys • 4ng"e the "eft and right hand keys s"ight"y • S"ight"y inc"ine the keyboard • 5ffer more area for &rist support
! 1hord keyboards • 4""o& severa" keys to be pressed simu"taneous"y • *nab"es rates of up to $66 &ords per minute
Keyboards and 'unction Keys 01ontinued2 • 'unction Keys ! difficu"t to remember meanings • arbitrary "abe"s 0e.g. ' 7 '#2 • often inconsistent bet&een app"ications • "ayout affects memory ! $x8 "ayout easiest to remember ! x# "ayout is error%prone
! P"acement is is important • It is beneficia" if you don9t have to remove your hands from the home position on the keyboard.
• 1ursor 3ovement Keys ! best "ayouts p"ace p"ace keys in their natura" natura" positions ! inverted% arrangement arrangement is increasing"y increasing"y popu"ar
Pointing Devices • sefu" for ; types of interaction ! Se"ect ! Position ! 5rient ! Path ! (uantify ! ext ext
Pointing Devices 01ontinued2 • Direct%contro" pointing devices !
! ouchscreen ouchscreen • "and%on strategy • "ift%off strategy ! user touches the surface ! drags a cursor around on the disp"ay ! "ift finger off the disp"ay to activate
• 4pp"ications: pub"ic%access systems/ air%traffic%contro"/ etc.
Pointing Devices 01ontinued2 • Indirect%contro" pointing devices ! 3ouse • hand rests in a comfortab"e position • Disadvantages:
! rackba"" rackba"" • rotating ba"" that is used to move a cursor around the screen • some "aptop computers have a sma"" version of the trackba""
! =oystick • began in aircraft%contro" devices • he trackpoint is a sma"" >oystick embedded in a "aptop keyboard
Pointing Devices 01ontinued2 • Indirect%contro" pointing devices 01ontinued2 ! ?raphics tab"et • touch%sensitive surface separate from the screen/ usua""y "aid f"at on the tab"e or in user9s "ap
! ouchpad ouchpad • Bui"t in near the keyboard • ?ood for use in "aptop c omputers
• @ove" pointing devices ! 'oot contro"s ! *ye%tracking devices devices ! he AP< Data?"ove
Pointing Devices 01ontinued2 • 1omparing pointing devices ! 1onsider ho& often you you have to s&itch bet&een bet&een the pointing device device and the keyboard ! he touchscreen and and trackba"" are good in pub"ic%access/ shop%f"oor/ and "aboratory app"ications. ! he mouse/ trackba""/ trackba""/ trackpoint/ graphics graphics tab"et/ and and touchpad are effective for pixe"%"eve" pointing. ! 'itts9
Speech recognition/ digita"iation/ and generation • Discrete%&ord recognition ! 1onditions for successfu" successfu" app"ications • Speaker9s hands are busy • 3obi"ity is re-uired • Speaker9s eyes are occupied • Carsh or cramped conditions prec"ude the use of a keyboard
! Prob"ems &ith recognition recognition rates occur &hen &hen background sounds change/ &hen the user is i"" or under stress/ or &hen &ords sound simi"ar ! Speaking commands is more demanding of &orking memory memory than is performing the hand%eye coordination coordination needed for mouse pointing. pointing.
Speech recognition/ digita"iation/ and generation 01ontinued2 • 1ontinuous%speech recognition ! 1omfortab"e and natura" natura" communication communication in a genera" setting setting 0no constraints on &hat you can say and ho & you say it2 is beyond us for no&/ posing a prob"em too difficu"t difficu"t to so"ve.E
• Speech store and for&ard ! 1ommon"y used for &eather/ &eather/ air"ine/ air"ine/ and financia" information as &e"" &e"" as for persona" messaging
• Speech generation ! 1an be used in cameras/ cameras/ vending machines/ machines/ automobi"es. automobi"es. ! he Kur&ei" reader reader can scan the text of a book and read one &ord at a time.
Image and Aideo Disp"ays • he visua" disp"ay unit 0AD2 ! the primary source of feedback feedback to the user from the computer ! important features features • rapid operation/ reasonab"e sie/ reasonab"e reso"ution/ -uiet operation/ no paper &aste/ re"ative"y "o& cost/ re"iabi"ity/ re"iabi"ity/ high"ighting/ graphics and animation
! Cea"th concerns • visua" fatigue/ stress/ and radiation exposure
• Digita" photography and scanners • Digita" video ! 1D%+53s can provide provide any&here from ; % F# minutes minutes of motion video ! Digita" video video disks 0DADs2 &i"" have an an order of magnitude greater greater storage space
Image and Aideo Disp"ays 01ontinued2 • Pro>ectors/ heads%up disp"ays/ he"met%mounted disp"ays ! heads%up disp"ay • pro>ects information on a partia""y si"vered &indscreen of an airp"ane or car
! he"met%mounted disp"ay disp"ay • sma"" partia""y si"vered g"ass mounted on a he"met so that users can see the information &hi"e turning their head
• Printers ! 1o"or printers • 1o"or "aser printers produce high -ua"ity images • sua""y the co"or ink>et printers produce "o&er -ua"ity images than the screen images/ and the co"ors may not match those on the screen
! P"otters • enab"e the output of graphs/ "ine dra&ings/ maps/ and posters on ro""s of paper up to 66 x G6 cm.
Summary • 1hoosing hard&are is a compromise bet&een the idea" and the practica". • 1onsider other forms of input &hen text entry is "imited. • Strive to reduce the number of shifts bet&een the keyboard and the pointing device. • 3ake sure that your choice improves performance. s by 3ark +oseman and Sau" ?reenberg