WO2004081780A1

WO2004081780A1 - Input device; means and methods for predicting text input; and mobile terminal

Info

Publication number: WO2004081780A1
Application number: PCT/EP2003/010850
Authority: WO
Inventors: Mogens Holm Iversen; Gael Rosset
Original assignee: Siemens Aktiengesellschaft
Priority date: 2003-09-30
Filing date: 2003-09-30
Publication date: 2004-09-23
Also published as: AU2003273411A1

Abstract

An input device (10) comprises: first input means (11) for selecting a first subset (S1) of input symbols (S); and second input means (12) separate from the first input means (11) for selecting a second subset (S2) of input symbols (S). Said first input means (11) are tiltable, a discrete number of tilting directions corresponding to symbols of a subset (S11; S12) of the first subset (S1); and said first and second subset (S1, S2) together form a full set (S) of input symbols.

Description

Input device; means and methods for predicting text input; and mobile terminal

Field of the invention The invention relates to receiving user input in general and in particular to receiving text and/or numeric user input.

Background of the invention

One of the most widely used applications in current mobile terminals is messaging, especially including text messages. At the moment the most widespread application is known as short messages or SMS. The operators and device manufacturers are further awaiting the increased usage of mobile multimedia messaging service MMS . Most modern mobile terminals include a wide range of applications such as calendars and notebooks. There are also plenty of devices not being mobile terminals but anyways having text input capabilities.

Most such devices or current mobile terminals do not have a proper keypad for enabling comfortable typing of user input. There have been numerous attempts to solve this problem, mostly by changing the layout and design of the single keys. The problem comes from the fact that the user is required to use the index finger or thumb in order to type in single characters, and that this particular index finger or thumb has not only to repetitively press single keys but also to travel accross the keypad for a number of times. This increases ergonomical problems, especially because there are some users using the SMS service extensively, sending even hundreds of messages monthly. Further, it is a problem that the input of text in this manner is despite much practice still rather slow. One of the most prominent solutions for reducing the number of keypresses needed for a particular text input so far has been predictive text input. One of the most widely used solutions is called T9, where the user has to press each key once and the built in dictionary will then guess the word based on the key combination.

It is considered a further problem that even with such a dictionary solution such as T9, the user still has to move his fingers too much.

Summary of the invention

An objective of the invention is to bring about a novel input device. Such an input device can be achieved as described in the first independent patent claim.

Further benefit is gained if a novel input device according to the invention is used as source for predictive text input, as described in the second independent patent claim..

Another objective of the invention is to bring about new means and methods for predicting a text input. These means and methods can be achieved as described in the third and fourth independent patent claims.

According to one aspect of the present invention, a mobile terminal may comprise the input device. More drastic advantages can be achieved if the mobile terminal further comprises means for predictive text input, in accordance with claim 13. The dependent patent claims describe various further aspects of the present invention.

Advantages of the invention

By using an input device according to the first independent patent claim, the user may now be able to give input much faster or ergono ically, since he or she is not required to move his index finger or thumb between different keys on the keypad every single time after having selected a number or a character.

A further advantage is that by appropriately selecting the size for the input device, there will apparently be less need for as large keypad as in the prior art devices. Therefore, if the input device is going to be used within a device having a display, this display can then be made larger; the physical dimensions of the device may also be reduced.

By using an inventive predictive text input means or method according to the invention, giving user input may further be speeded up.

Short description of the drawings

In the following, the preferred embodiments of the invention are illustrated in more detail with reference to the examples shown in the accompanying Figures 1 to 12, of which:

Figure 1 shows an input device having a first and second input means;

Figure 2 illustrates some possible directions of the first input means of the input device; Figure 3 shows an example of mapping directions into a first subset of input symbols;

Figure 4 shows the mapping of directional inputs into a first subset of input symbols, and further how this first subset of input symbols is further divided into two subsets;

Figure 5 illustrates a second subset of input symbols, and how this second subset of input symbols can further be divided into two further subsets;

Figure 6 is a block diagram of a device for providing predictive text input;

Figure 7 is a mobile terminal comprising the input device according to the present invention;

Figure 8 illustrates a vector showing the horizontal or vertical movement of the first input means;

Figure 9 is a keypad layout;

Figure 10 is a vector map corresponding to keypad layout of Figure 9;

Figure 11 is a vector map for character input; and

Figure 12 shows how keys in a virtual keypad on a display can be illuminated or highlighted.

Same reference numbers refer to similar structural elements throughout Figures 1 to 12. Detailed description of the preferred embodiments

Figure 1 shows an input device 10 having a first and second input means 11 and 12, respectively. The first input means 11 are adapted to allow horizontal and vertical movements. According to one aspect of the present invention, the first input means 11 are further tiltable, preferably through a joint 17 supported by the housing of the input device. The joint 17 is connected to means 18 for detecting the position of the first input means 11 and adapted to generate a signal SIGl responsive to the position of the first input means 11.

The first input means 11 may comprise a trackball or touch pad. In this embodiment, the first input means 11 is not necessarily tiltable.

The second input means 12 include a number of keys 121, 122, and 123. Each key 121, 122, 123 preferably comprises a switch, such as a microswitch for detecting when the key 121, 122, 123 is pressed, and further adapted to produce an electrical signal in response to the pressing. The skilled person appreciates that the keys 121, 122, 123 may be implemented by using any other solution, such as sensing means for pressure, light, capacitance, inductance, or temperature as well. For the sake of simplicity, in this description, the using of a switch is assumed.

The first input means 11 are used for selecting a first subset SI of input symbols S. Some possibilities for this subset will be discussed below with reference to Figures 3 and 4.

The second input means 12 are separate from the first input means 11. They are used for selecting a second subset S2 of input symbols S. A possibility for this subset S2 will be discussed below with reference to Figure 5. Together said first and second subset SI and S2 form a full set S of input symbols.

A discrete number of movement directions of the first input means 11 correspond to symbols belonging to a subset Sll or

S12 of the first subset SI. If first input means 11 are tiltable, a discrete number of tilting directions corresponding to symbols of a subset Sll or S12 of the first subset SI.

Said second input means 12 may further comprise a key 13 for selecting a subset S13 of the first subset SI of input symbols S.

Figure 2 illustrates the discrete number of movement directions seen from user's side. Moving the first input means 11 forward (or "North") corresponds to direction 2 and tilting it toward the user ("South") corresponds to direction 8. Left ("West") is 4 and right ("East") 6. These are the main directions, which can be selected if the first input means 11 and corresponding means 18 for detecting the position of the first input means 11 support four directions only.

If the means 18 for detecting the position of the first input means 11 support eight directions, a nomenclature in accordance with a conventional telephone keypad can be used. Then in addition to the previous ones, the directions between 2 and 6, i.e. forward right ("North-East") would correspond to 3, backward right ("South-East") would correspond to 9, forward left ("North-West") would correspond to 1, and backward left ("South-West") would correspond to 7.

It is to be noted that any other discrete number of directions could be selected as well.

Figure 3 shows an example of the first subset SI in a case where the means 18 for detecting the position of the first input means 11 support four directions only. Direction 2 ("North") would select then a character from subset 2: {2, A, B, C }; Direction 6 ("East") would select then a character of set 6: {6, M, N, 0}; Direction 8 ("South") from 8: {8, T, U, V}; and Direction 4 ("West") from 4: {4, G, H, I}.

Figure 4 shows another example illustrating how the subset SI can be divided to further subsets.

The key 13 of the first input means 11 can be used to select a character or number belonging subset from {5, J, K, L, j, k, 1}.

The first input means 11 may be adapted to change between subsets Sll, S12 of the first subset SI of input symbols S by rotating, pressing, or lifting the input first input means 11.

For movements of the first input means 11, the directions corresponding to different numbers or characters for subsets Sll and S12 are:

Sll: 1: {1, ^• '}; 2: {2, A, B, C}; 3: {3, D, E, F}; 4: {4, G, H, I}; 6: {6, M, N, 0}; 7: {7, P, Q, R, S}; 8: {8, T, U, V}; and 9: {9, W, X, Y, Z) . S12: 1: {' '}; 2: {a, b, c}; 3: {d, e, f}; 4: {g, h, i}; 6: {m, n, o}; 7: {p, q, r, s}; 8: {t, u, v}; 9: {w, x, y, z}.

The subset SI is union of further subsets Sll, S12, and S13. The cut of subsets Sll, S12, S13 with each other need not but may be an empty set.

Figure 5 shows an example of set S2 being an union of subsets S21 and S22. S22 is {?, !, :, ;, ',', '.'; "} and S21 is {*; 0; #}. Including further special characters to these sets is possible as well.

The skilled person appreciates that a deliberate division of the symbols into subsets is possible.

Now repetitive directional movements to one direction within a predetermined interval have the effect that a following character corresponding the same direction in the same subset will be selected. If there are no further movements in the same direction, or if there is a movements to another direction, a character is selected. The predetermined interval may be one second or half a second.

In other words, if the user moves the first input means 11 forwards once, a number '2' is selected. If, instead of doing this only once but twice within the predefined interval, a character 'A' is selected. Three times would correspond to 'B¹, and four times 'C. The fifth preferably is interpreted as selecting '2', and so on.

If the first input means 11 are adapted to toggle between subsets Sll, S12 of the first subset SI of input symbols S by rotating, pressing, or lifting the first input means 11, the user can conveniently select between subsets Sll and S12. In other words, toggle between upper and lower case, or, if the subsets were defined differently, between numeric and character input, further having the possibility to select between upper and lower case letters. Then the rotating, pressing, or lifting the input first input means 11 could have an effect to change the first input means 11 to three instead of two different positions.

The positioning of the first input means 11 can be compared with a keypad of a current mobile terminal. The first three rows corresponding to a 3x3 matrix for character input (i.e. the keys 1 to 9) would be replaced with the first input means 11. As the first input means, a modern joystick, trackball, or directional navigation pad can be used. Then selecting the 8 directions accurately enough is not a problem. The ninth key can be placed on top of the first input means, or a separate "fire button" in the input device 10 can do as well.

According to one aspect of the invention, the matrix is mapped to eight directions input with the first input means 11, especially being a joystick or a navikey. In this manner, the distance which the user's index finger or thumb has to traverse can be reduced as compared with prior art solutions when he or she is giving text input.

The first input means 11 can be placed into the customary position of a navigation or menu key. Thus the solution does not require hardware changes, i.e. the second input means 12 can correspond to a conventional keypad. In this manner, if the keypad is retained, the user can be given a wider choice to select input means from. The first input means 11 can be positioned to the position of the middle key (usually key 5) in the conventional numerical keypad. Athough this approach requires hardware changes in the input device 10, it will have the added benefit of removing one key from the device. In this manner, some more space for the display can be obtained. Further, it is possible to visualize the user in which direction he or she has to move his or her index finger or thumb in order to enter text.

According to one aspect of the invention, the input device 10 can be used with predictive text input thus not only reducing the number of keypresses but also reducing the number of tiltings, thereby speeding up the input process.

In the example shown in Figures 4 and 5 for the subsets SI and S2, the English character set was used. It is possible to enlarge this by using software means. For example, when inputting text in German or Danish, characters like A, 0, a, δ, 0, ø, a, A, and possibly even ϋ, ϋ and β are of importance. These symbols can not only be included into subsets SI, but also the order in which they are selected may be changed by using these software means depending on the language selected by or for the user. The order preferably follows the frequency in which each character is used in the selected language, in the manner that the more frequently selected characters are presented to the user first.

For a model sentence "this is a test" with predictive text input and novel input device 10, the following directional movement sequence would result (if mapping to subsets as shown in Figure 4 were used) : "S W W SW NW W SW NW N NW S NE

SW S"

When in idle screen or any other screen where input of numbers is needed, then centre click will correspond to selecting a character from the subset S13. In other words, the pressing of the trigger or key 13 can be replaced by moving the first input means 11 downwards. This approach, i.e. activating the subset S13 input characters by clicking down the first input means 11, is applicable to all embodiments of the invention.

Figure 6 shows a further example of predictive text input. The first input means 11 are adapted to produce signals SIGl indicating directions given by a user by tilting.

These signals SIGl are then received at means 61 for receiving signals SIGl. The means 61 for receiving signals SIGl and further adapted to map them to a first string LI comprising characters belonging to the first subset SI of input symbols S.

In other words, means 61 are adapted to map a signal SIGl responsive to horizontal or vertical movement, especially tilting, of the first input means 11, to a letter or number belonging to the first subset Si of input symbols S.

Then the first string LI is converted to a text input prediction W by means 63 for correlating said first string LI with an entry E read from a dictionary 64 in order to select a text input prediction W. For example, this can be done by using current versions of the T9 text recognition program. The previous example can be further adapted by adding means

62 for receiving signals SIG2 given by the user via the second input means 12 and for mapping them to a second string

L2 comprising characters belonging to the second subset S2 of input symbols S. There would preferably also be means 65 for combining the first and second strings LI, L2 to a combined string L. The means 63 for correlating said first string LI with an entry E read from a dictionary 64 in order to select a text input prediction W would be replaced with means 63 for correlating said combined string L with an entry E read from a dictionary 64 in order to select a text input prediction W.

In other words, means 62 are adapted to map a signal SIG2 responsive to input given via the second input means 12, this especially corresponding to a number of keys, to a letter or number belonging to the second subset S2 of input symbols S.

Both examples of predictive text input with an input device 10 according to the present invention can be further modified to cover also selecting of set S13 by the first input means 11. Then instead of having only eight directions (N, NE, E, SE, S, SW, W, NW) , the first string Ll would also comprise indications which characters from the subset S13 of the first subset SI of input symbols S were selected.

Figure 7 is a mobile terminal 70 comprising the input device 10 according to the present invention. By suitably selecting the size and kind of the first input means 11 and second input means 12, the display 71 of the mobile terminal 70 can be made larger. This is especially useful because with a larger display 71 the mobile terminal 70 can be made more feasible for the user by increasing the terminal's capabilities to show information. Toggling between upper and lower case letters or numerals can also be performed by shaking the input device 10. Then a specific sensor for detecting shaking of the input device 10 could be covered by specifying spearate input means preferable electrically connected to the first input means 11.

According to a further aspect of the invention, the direction awareness of position devices can be used to simulate keyboard or keypad, and to allow fast keyboard or keypad simulation. The direction given by the position device to a simulated keyboard on the display. This keyboard or keypad can be organized around a central point from which direction information about the character or number to display or dial. In this manner, like in other embodiments of the present invention, the display size can be increased while keeping the dialing or typing functions really fast.

The first input means 11 adapted to allow horizontal and vertical movements may comprise a mouse, trackball, touch pad, joystick or touch point that can be connected or mounted on a mobile device.

Figure 8 illustrates the manner in which the means 61 for mapping a signal SIGl responsive to horizontal or vertical movement of the first input means 11 to a letter or number belonging to the first subset SI of input symbols S can be adapted to detect time dependence of the movement (horizontal or vertical movement) of the first input device 11. At a first instance the first input means 11 are in the position denoted with "T"; at a second instance the first input means are in a second position denoted with "T+l". In this manner, the movement of the first input means 11 generates a vector between each predefined time tick which corresponds time elapsed between the first and the second instance. The vector can be computed without taking any care of the absolute position of the first input means 11, because it is only the delta between the two positions which matters. ΔX ⁼ Xτ+ι — XT; ΔY ⁼ Yτ₊ι — YT •

According to one aspect of the invention, the simulated keyboard can be placed on the display 71 of the portable electronic device 70. Figure 9 illustrates an example of the displayed keyboard on the screen in the case of a dialling example .

Then by using the first input means 11 the user causes two signals SIGl, which the means 61 convert to a vector. The length and direction of the vector is then used to define which number or letter the user is intending to reach. A vector map 100 can be used to facilitate this, an example of which is shown in the diagram of Figure 10.

If the user clicks the switch 13 or presses the input first input means 11, the number is selected and the vector is reseted.

The number or character to which the vector points in the vector map 100 is selected. The displayed keypad or keyboard and the vector map 100 may match to each other, or the vector map 100 is displayed instead of a standard keypad or keyboard layout. The previous example shows that if the vector is short, the system will assume a "5" or "0". The "0" can be selected if the user makes a double click and "5" can be selected if he or she makes a single click.

Same principle applies also for typing letters. Figure 11 shows a possible vector map 100. This vector map 100 can be designed taking into account the accessibility of different frequently used letters . The vowels can be placed at positions wchich are fast to reach. Especially in scandinavic and fenno-ugrian languages the a, e, i, and o are the most typed characters. It also makes sense to have the space in the centre.

If the user were to select a number "1", assuming keypad layout of Figure 9, the vector would correspond to that of Figure 8. Figure 12 further shows how the button which the user is selecting can be highlighted. This reduces the error probability because the user gets visual feedback on what he or she is selecting, and also to which direction (to which number or letter) the vector is now pointing to. One can also imagine that somebody who would get really used to the system could dial without looking at the device because he or she would remember that "1" is top-left, "2" is top-centre, an so on.

According to one aspect of the present invention, with horizontal or vertical movement of the first input means 11 is meant both horizontal and vertical movement. In this respect the means 61 for mapping a signal SIGl responsive to horizontal are then adapted to map both horizontal and vertical movements to a letter or number belonging to the first subset SI of input symbols S, a discrete number of movement directions corresponding to symbols of a subset Sll;

S12 of the first subset SI.

Even though the examples have focused on directional movements, such as tilting, rolling or in a plane, it is to be undertood that the description does not limit the scope of the invention which is defined by the patent claims.

Further, depending on the solution chosen, the discrete number of directions can be 4, 8, or any larger number. Then, preferably, all directions have the effect of selecting a symbol from the first subset Si of characters.

It is especially noted that, according to one aspect of the present invention, no clicking action is needed to select a character (letter or number) from the first subset SI of characters with first input means 11, but only the vertical or horizontal movement will correspond to the selecting the character as input .

Claims

Claims :

1. An input device (10) comprising: first input means (11) for selecting a first subset (SI) of input symbols (S) , said first input means (11) having been adapted to allow horizontal and vertical movements; characterized in that: said input device (10) further comprises means (61) for mapping a signal (SIGl) responsive to horizontal or vertical movement of the first input means (11) to a letter or number belonging to the first subset (SI) of input symbols (S) , a discrete number of movement directions corresponding to symbols of a subset (Sll; S12) of the first subset (Si) .

2. An input device (10) of claim 1, further comprising: second input means (12) separate from the first input means (11) for selecting a second subset (S2) of input symbols (S) ; and means (62) for mapping a signal (SIG2) responsive to input given via the second input means (12) to a letter or number belonging to the second subset S2 of input symbols S; said first and second subset (SI, S2) together forming a full set (S) of input symbols.

3. An input device (10) of claim 2, characterized in that: said second input means (12) comprise a key (13) for selecting a subset (S13) of the first subset (SI) of input symbols (S) .

. An input device (10) of claim 2 or 3, characterized in that: said second input means (12) comprise a number of keys (121, 122, 123), a key (121, 122, 123) further comprising a switch.

. An input device (10) of claim 1, 2, 3, or 4, characterized in that: said first input means (11) are further adapted to change between subsets (Sll, S12) of the first subset (SI) of input symbols (S) by rotating, pressing, or lifting the input first input means (11) .

6. An input device (10) of claim 5, characterized in that: said first input means (11) are further adapted to further select a subset (S21) of the second subset (S2) of input symbols (S) by rotating, pressing, or lifting the first input means (11) .

7. An input device (10) according to any one of claims 1 to 6, characterized in that: said first input means (11) are tiltable.

8. An input device (10) according to any one of claims 1 to 7, characterized in that: said means (61) for mapping a signal (SIGl) responsive to horizontal or vertical movement of the first input means (11) to a letter or number belonging to the first subset (SI) of input symbols S are adapted to convert the movement of the first input means (11) to a vector, and use said vector to select a symbol of the first subset (SI) using a vector map (100) .

9. The use of an input device (10) according to any one of the preceding claims 1 to 8 as an input source for means

(60) for predicting text input.

10. Means (60) for predicting text input, comprising: - means (61) for receiving signals (SIGl) indicating directions given by a user by tilting first input means (11) and for mapping them to a first string (Ll) comprising characters belonging to the first subset (SI) of input symbols (S) ; and

- means (63) for correlating said first string (Ll) with an entry (E) read from a dictionary (64) in order to select a text input prediction (W) .

11. Means (60) for predicting text input according to claim 10, further comprising: - means (62) for receiving signals (SIG2) given by the user via the second input means (12) and for mapping them to a second string (L2) comprising characters belonging to the second subset (S2) of input symbols (S) ; and - means (65) for combining the first and second strings (Ll, L2) to a combined string (L) ; and wherein:

- the means (63) for correlating said first string (Ll) with an entry (E) read from a dictionary (64) in order to select a text input prediction (W) are replaced with:

- means (63) for correlating said combined string (L) with an entry (E) read from a dictionary (64) in order to select a text input prediction (W) .

12. Method for predicting text input, comprising the steps of:

- receiving signals (SIGl) indicating directions given by a user by horizontally or vertically moving first input means (11) ;

- mapping them to a first string (Ll) comprising characters belonging to the first subset (SI) of input symbols (S) ; and - correlating said first string (Ll) with an entry (E)

.read from a dictionary (64) in order to select a text input prediction (W) .

13. Method for predicting text input according to claim 12, further comprising the steps of:

- receiving signals (SIG2) given by the user via the second input means (12) and for mapping them to a second string (L2) comprising characters belonging to the second subset (S2) of input symbols (S) ; and

- combining the first and second strings (Ll, L2) to a combined string (L) ; and wherein: the step of:

- correlating said first string (Ll) with an entry (E) read from a dictionary (64) in order to select a text input prediction (W) is replaced with the step of:

- correlating said combined string (L) with an entry (E) read from a dictionary (64) in order to select a text input prediction (W) .

14. A mobile terminal (70) comprising: an input device (10) according to any one of claims 1 to 8.

15. A mobile terminal (70) of claim 14, further comprising: means (60) for predicting text input according to claim 9 or 10.