Text_Entry.ppt 554KB Jun 23 2011 12:32:46 PM

(1)

New Interaction

Techniques

Department of Computer

Sciences

University of Tampere,

Finland

Department of Computer

Sciences

University of Tampere,

Finland

Grigori Evreinov

www.cs.uta.fi/~grse/

(2)

“

Alphabet

- an ordered set of sound signs - named after first two letters in the Greek: alpha-beta [alef-bet]

a set of graphem-phoneme correspondences which allow a graphic shape to serve as a sound sign or phonogram

in an ideal alphabet there is one and only one letter or symbol for each important sound in the language ”

thus, alphabet wasn’t intended to write fast as possible, but it should provide the high degree of reading comprehension of the message semantics

“

Unifon

means one sound and indicates one sound per symbol in many writing systems there is only one sound per symbol

in English there are over 14 sounds per symbol

the English writing system has 106 symbols for 40 or so sounds

the problem is that the same symbol can refer to more than one sound

”

http://66.41.60.21/Why 20English is Absurd.htm

TAUCHI MMIG G. Evreinov 01_21 21.11.2003

(3)

a typing speed with conventional QWERTY keyboard is about 200-300- 500 characters per minute or ~40-60-150 wpm

this technique requires two healthy hands and 27 reliable keys mobile devices like phones, remote control or PDA operate with a smaller number of physical keys most often 12 and use special combinatorial methods for text entry

this is primarily one-hand technique and requires 1-12 keys a single-switch user can type with a rate around 3-22 char/m (1-4.5 wpm)

too few keys slows typing by requiring multiple keystrokes to make some characters and

too many keys slows typing by making it harder to coordinate hands, to remember non-periodical long layout to find a specific key

visual feedback decreases cognitive loading but sometimes visual feedback is impossible

(4)

the relation between the minimum necessary Keystroke Saving Rate (KSR, %), typing speed (characters per second /char/s) and selection time (t, in s)

that is, which KSR will be necessary to increase text entry speed for given typing speed k and time t used for making the selection process

adapted from [14] Zagler, W.I. Matching Typing Persons and Intelligent Interfaces.

Text

Entry

t, s 5.0 2.0 1.0 0.5 0.2 0.1

0.1 0.2 0.5 1.0 2.0 5.0 10.0 k, char/s 1%

4%

20% 50%

80% 96%

(5)

Text

Entry

~30 40-50 <60 18-25 <25 _?_ 30-37 <50 ~9? _?_ _?_ 40-150 wpm

Key

typing

2.524

2.327 2.262

2.109 2.034 2

1.824

1.503 1.441

1.293 1.248 1

0.75 1 1.25 1.5 1.75 2 2.25 2.5 2.75

Key Codes KSPC

(6)

Text

Entry

1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 2

0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27

number of chars selected by 1KS, other ones were selected by 2KS

KSPC _{http://deafandblind.com/phone5.htm}

MessagEase

LetterWise Prefix-based disambiguation

QWERTY Twiddler

1.293 by 9+1(1.2) method

1.248 by 10+1(1.2) method

(7)

Text

Entry

Key typing requires that the user have

- to imagine the word (cognitive model)

- to divide the word into a sequence of characters according key-typing convention and alphabet knowledge

- to locate the keys on keyboard sequentially or simultaneously (two-hand typing) according layout knowledge and fingers motion experience,

- to press the key(s)

- to compare the result to cognitive model of the word based on secondary feedback, visual or speech signals

if segmentation process is disturbed due to distraction or have been changed, this process will require an additional time

(8)

Text

Entry

how to increase Key typing speed?

- word entering – select the word from the list (topic or category,

http://www.enkidu.net/ ) or/and using linguistic analysis, prediction, auto-completion

- decreasing number of characters per word – abbreviation (SMS, FASTY, short-hand) & abbreviation expansion [19, 20]

- to construct sentences and phrases based on special symbols and symbol-to-text transformation rules

- to change alphabet’s length – alphabet compression or extension

- decreasing key layout (8-12 keys) – characters’ construction (SymbolCreator), chords, sequential function selection

- to substitute physical keys by software keyboard and add gestures [20]

- a substitution of secondary feedback signals by simplified primary ones, to augment clarity for pointing key positions through special unified matrixes and/or finger technique

(9)

Text

Entry

55.9 41 34 28 28 25 22.6 20 20 15 10 10 40.9 34.7 38.7 40.8 43.2 43.5 50.1 44.2 45.3 46.5 46.6 0 10 20 30 40 50 60

Soft keyboard layouts

E n tr y S p e e d , w p m

Stylus

entry

(10)

Text

Entry

http://www.unifon.org/trouble-with-spelling1.html

http://victorian.fortunecity.com/vangogh/555/Spell/uu-18ways.html

/u:/ the sound in m

oo

n and g

u

r

u

how many ways does the traditional orthography spell the vowel sound in rule?

(11)

Text

Entry

from Anguish Languish

*

,

homonyms,

& phonetic charades … to Alphabet

Compression

*

Here is a little fairy story told in other words... Heresy ladle furry starry toiling udder warts...

Yule fined fore hansom stories, Gneiss lorn, flours, likened waul;

Weave gaits, muse, mote, stares, bawl rheum, Hie sealing inn the Haul.

most examples of Anguish Languish rewrite standard texts using homonyms

You'll find four handsome stories, Nice lawn, flowers, lichened wall;

(12)

phonetically similar consonants and possible substitutions

a b c d e f g h i j k l m n o p q r s t u v w x y z

Text

Entry

Alphabet

compression

_{phonetically similar consonants and possible substitutions}

p s/k t v j ch q z w ks i s/g

English letter frequencies

*

73 9 30 44 130 28 16 35 74 2 3 35 25 78 74 27 3 77 63 93 27 13 16 5 19 1

*

http://library.thinkquest.org/28005/flashed/thelab/cryptograms/frequency.shtml

a p s/k t e f g h i g k l m n o p k r s t u f u ks i s/g

ch => h

(13)

Text

Entry

Alphabet

compression

konferense signifikant artikle komputer interaktion proseetings approah komparison softuare applikation operation theori moteling efaluation usapiliti performanse measure parameter sekuense presentation sooming kuestion tiskussion mofement tisaplet (3) trasking tefise (device) feetpak (3) keipoart (2) eksperienset stimulus analisis resising hierarhi pattern frekuensi apiliti partisipant kustomisation konfentional prosessor hannel strukture ualititi alternatife pointer generator importanse sentense kommunikator fintous windows eksplorer graphiks simpoliks harakter feature integratet intifitual tefelopment training kalipration tunamikal elektrote tehnikue taktile autitori monitor position uelositi rantomiset goistisk regektion atgustment kognitife strategi statistiks portaple proseture koortinatet sirkular maksimiset empirikal infestigation lineariti template personal rekognition tefise (device)

(14)

Text

Entry

(15)

Clear Data

TWords16.txt /phrases

GridData1:

test words/chars

entered text /chars

time per char, ms

GridData2:

char per word /phrase

num. of entered words

num. of strokes /clicks per word /phrase

time per word/phrase, s lblTestSymbol txtText1 On-screen Keyboard (16) Break test Test initialization Ctrl+K=>move keys SetSigns SetCharacters BackSp Statistics() Rtime, ms

s (st.dev), ms

Errors

wpm

TestTime, s

lblSave_Click()

GridData2_Click()

to save column

GridData1_Click()

to save column

(16)

TAUCHI MMIG G. Evreinov p 15_23 23.09.2003

Text <> “”

define the Length of the Text

return into the TextBox play wave “Empty”

the last Char = Linefeed

remove two last chars in the TextBox

put cursor at the end of the text

play wave “Back Space” remove the last char in

the TextBox

put cursor at the end of the text

play wave “Back Space” Yes

No

Yes No

Exit

Private Sub

BackSp

()

Text

Entry

the last Char = space

No

Yes previous Char =

“.”, “,” or “?”

No

(17)

touch screen or similar input sp 997552 e 586316 t 432382 a 376459 o 355384 I 341068 n 330665 s 301210 r 286713 h 254365 l 192475 d 184286 c 144631 u 126835 m 118201 f 108962 p 94743 g 91568 w 87771 y 80142 b 71739 v 46474 k 30477 x 9297 j 7392 q 5008 z 4423

Text

Entry

Tap-stroke: two characters

per one stroke

the first selection the second selection stylus or finger

vowels 32% + space 18% ~ 50%

(18)

Text

Entry

(19)

Text

Entry

Tap-stroke: two characters

per one stroke

Private Sub Spot1_MouseDown()

Private Sub Form_Activate() Private Sub Form_KeyDown()

Private Sub Form_Load()

Private Sub ResetSpots()

Private Sub SetData() bStroke (bChar)

StrokeUp2 'outside of the spot, bChar2

StrokeUp3 'outside of the BigSpot, bChar2 ResetSpots

StrokeUp1 'within a BigSpot, bChar2

Private Sub SpotActivate() bChar1 = bStroke

bStroke = bStroke & bChar2 Private Sub Spot1_MouseUp()

Timer1

(20)

TAUCHI MMIG G. Evreinov p 19_21 21.11.2003

References

[1] Letters & Words Frequencies, http://deafandblind.com/word_frequency.htm

[2] Frequency of Occurrence of Letters in English, http://www.santacruzpl.org/readyref/files/g-l/ltfrqeng.

shtml (from Fletcher Pratt, Secret and Urgent: the Story of Codes and Ciphers Blue Ribbon Books, 1939, p. 252. )

[3] Letter Frequency Analysis,

http://library.thinkquest.org/28005/flashed/thelab/cryptograms/frequency.shtml

[4] http://www.sta.cuhk.edu.hk/courses/STA0301/l-freq.pdf

[5] http://www.math.unl.edu/~jorr/gilbhatch/letter_frequency_applet.html

[6] Letter Frequencies, http://rinkworks.com/words/letterfreq.shtml

[7] Relative Frequencies of Letters in General English Plain text,

http://www.central.edu/homepages/LintonT/classes/spring01/cryptography/letterfreq.html

[8] Letter and Word Frequency Analysis,

http://paul.oniony.com/sections/information/frequencyanalysis.html

the next refs are available at: http://www.yorku.ca/mack/

[9] Soukoreff, R. W. & MacKenzie, I. S. (1995). Theoretical upper and lower bounds on typing speed using a stylus and soft keyboard. Behaviour & Information Technology, 14, 370-379.

[10] MacKenzie, I. S. (2002). KSPC (keystrokes per character) as a characteristic of text entry techniques.

Proc. of the Fourth Int. Symposium on Human Computer Interaction with Mobile Devices, pp. 195-210.

Heidelberg, Germany: Springer-Verlag.

(21)

[11] Silfverberg, M., MacKenzie, I. S., & Korhonen, P. (2000). Predicting text entry speed on mobile phones. Proc. of the ACM Conf. on Human Factors in Comput. Systems - CHI 2000, pp. 9-16. New York: ACM.

[12] MacKenzie, I. S., & Soukoreff, R. W. (2002). Text entry for mobile computing: Models and methods, theory and practice. Human-Computer Interaction, 17, 147-198.

[13] MacKenzie, I. S., Kober, H., Smith, D., Jones, T., Skepner, E. (2001). LetterWise: Prefix-based

disambiguation for mobile text input. Proceedings of the ACM Symposium on User Interface Software

and Technology - UIST 2001, pp. 111-120. New York: ACM.

[14] MacKenzie, I. S., Zhang, S. X., & Soukoreff, R. W. (1999). Text entry using soft keyboards. Behaviour

& Information Technology, 18, 235-244.

[15] Zagler, W.L. (2002), Matching Typing Persons and Intelligent Interfaces. In J.Klaus, K.Miesenberger, W. L. Zagler (Eds.), Proc. of the 8th_{Int. Conf. on Computers Helping People with Special Needs. ICCHP}

2002 Linz, Austria, LNCS Vol. 2398, Springer-Verlag Berlin Heidelberg, pp. 241-242.

[16] Shieber, S.M., Baker, E. Abbreviated Text Input. IUI’03, January 12–15, 2003, Miami, Florida, USA. ACM. http://www.eecs.harvard.edu/~shieber/Biblio/Papers/abbrev-iui-poster.pdf

[17] Magnuson, T., Hunnicutt, S. Grammatical support for sentence and phrase construction for symbol users. AAATE2003. SentencePhraseConstruction_198-final.pdf (References)

[18] Toshiyuki Masui. An Efficient Text Input Method for Pen-based Computers. Proc. of the ACM

Conference on Human Factors in Computing Systems (CHI’98) (April 1998), ACM press, pp. 328–335.

(22)

TAUCHI MMIG G. Evreinov p 21_21 21.11.2003 [19] Zagler, W.L., Beck, C., Seisenbacher, G. FASTY – Faster and easier text generation for disabled

people. AAATE2003, FASTY_221-final.pdf (References)

[20] Zhai, Sh., Kristensson, Per-Ola. Shorthand Writing on Stylus Keyboard. http://www.almaden.ibm.com/u/zhai/papers/SharkFinal.pdf

[21] Geissler, J. Gedrics: the next generation of icons. Proceedings of the 5th International Conference on

Human–Computer Interaction (INTERACT’95), Lillehammer, Norway, June 27–29, 1995, pp. 73–78.

[22] K. Perlin. Quikwriting: Continuous stylus-based text entry. In Proc. of UIST '98. ACM, November 1998. http://citeseer.nj.nec.com/perlin98quikwriting.html

[23] D.Venolia and F.Neiburg. T-cube: A fast, self-disclosing pen-based alphabet. In Proc. of CHI ’94, pages 265–270. SIGCHI, ACM, 1994.

[26] Aoki, P. M., Hurst, A. and Woodruff, A. (2001). Tap Tips: Lightweight Discovery of Touchscreen Targets.

CHI 2001, Seattle.