+

WO2009029368A2 - Interface avec des dispositifs électroniques mobiles et communication entre ceux-ci - Google Patents

Interface avec des dispositifs électroniques mobiles et communication entre ceux-ci Download PDF

Info

Publication number
WO2009029368A2
WO2009029368A2 PCT/US2008/071282 US2008071282W WO2009029368A2 WO 2009029368 A2 WO2009029368 A2 WO 2009029368A2 US 2008071282 W US2008071282 W US 2008071282W WO 2009029368 A2 WO2009029368 A2 WO 2009029368A2
Authority
WO
WIPO (PCT)
Prior art keywords
input
transmission
further operation
text recognition
user
Prior art date
Application number
PCT/US2008/071282
Other languages
English (en)
Other versions
WO2009029368A3 (fr
Inventor
Michael J. Ure
Original Assignee
Ure Michael J
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US11/888,811 external-priority patent/US20090036176A1/en
Priority claimed from US11/899,756 external-priority patent/US20090066660A1/en
Priority claimed from US12/040,769 external-priority patent/US20090219250A1/en
Priority claimed from US12/104,392 external-priority patent/US20090260900A1/en
Application filed by Ure Michael J filed Critical Ure Michael J
Priority to US12/671,626 priority Critical patent/US20110234623A1/en
Priority to US12/370,597 priority patent/US20100020103A1/en
Publication of WO2009029368A2 publication Critical patent/WO2009029368A2/fr
Publication of WO2009029368A3 publication Critical patent/WO2009029368A3/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text

Definitions

  • the present invention relates to interface with and communication between mobile electronic devices such as cell phones.
  • mobile electronic devices such as cell phones.
  • a "triple-threat” device is provided in the form of a mobile electronic device of a slider construction.
  • a two-way slider mechanism is provided.
  • a screen of the mobile electronic device is touch- sensitive (touch input); in a first slider position, tactile -response keys are exposed (key input); in another slider position, a writing pad is exposed (stylus input).
  • FIG. 1 is a block diagram of a mobile electronic device having improved user interface capabilities.
  • FIG. 4 is diagram of a keypad overlay that may be used with the mobile electronic device of FIG. 1.
  • FIG. 5 is plan view of a portion of a mobile electronic device such as the mobile electronic device of FIG. 1 in another configuration thereof.
  • FIG. 6 is a plan view of a keypad overlay that may be used with the device of FIG. 5.
  • FIG. 7 is a perspective view illustrating key operation of the device configuration of FIG.
  • FIG. 8 is a perspective view illustrating key operation of the device configuration of FIG.
  • FIG. 9 is a perspective view illustrating touch operation of the device configuration of
  • FIG. 3 using a finger.
  • FIG. 10 is a perspective view illustrating key operation of the device configuration of
  • FIG. 5 using both thumbs.
  • FIG. 12 is a perspective view illustrating touch operation of the device configuration of
  • FIG. 5 using a finger.
  • FIG. 13 is a perspective view illustrating removal of a keypad overlay from the device configuration of FIG. 3 using thumb and forefinger.
  • FIG. 14 is a plan view of mobile electronic device provided with an input device like that of FIG. 2.
  • FIG. 15 is a cross-sectional view of an alternative construction of an input device like that of FIG. 2.
  • FIG. 16 is a flowchart illustrating text entry.
  • FIG. 18 is a flowchart of enhanced mobile instant messaging.
  • FIG. 19 is a flowchart of further enhanced mobile instant messaging.
  • FIG. 20 is a flowchart of enhanced voice communications.
  • FIG. 21 A is a first diagram illustrating mobile instant messaging using text and graphics input in accordance with FIG 18.
  • FIG. 2 IB is is a second diagram illustrating mobile instant messaging using text and graphics input in accordance with FIG 18.
  • FIG. 22 is a block diagram of a pen equipped with a 3D accelerometer and wireless communication capabilities.
  • FIG. 23 is a diagram illustrating use of the pen of FIG. 22.
  • FIG. 24 is a diagram (not to scale) illustrating mechanical details of an Open Mobile I/O interface.
  • FIG. 25 is a diagram of an untethered electrostatic pen or stylus.
  • FIG. 26 is a diagram of another untethered electrostatic pen or stylus.
  • FIG. 27 is a diagram of a pen or stylus having an ink pen attachment.
  • FIG. 1 a block diagram is shown of a mobile electronic device having improved user interface capabilities.
  • a processor 101 is coupled to memory 103, to a display sub-system 105, and to an input sub-system 107, described more fully hereinafter.
  • the processor is also coupled to a sound sub-system 109 and a communications sub-system 111.
  • the input sub-system 107 of the mobile electronic device of FIG. 1 preferably includes both touch input and stylus input capabilities as well as key input capabilities. An exemplary embodiment of such a device is shown in FIGS. IA- IF.
  • FIG. IA a plan view is shown of a mobile electronic device having a two-way slider construction.
  • FIG. IB shows schematically slider elements viewed in section A-A of FIG. IA.
  • the mobile electronic device may have a touch interface like that of the Apple iPhone.
  • FIG. 1C shows the slider mechanism extended in one direction to reveal a keypad.
  • the keys are mechanically actuated and incorporate snap key domes or the like to provide satisfactory tactile feedback.
  • the keypad may also be provided with touch capabilities in a manner known in the art in order to manipulate a cursor or interface tool.
  • a QWERTY keyboard may be provided as illustrated in FIG. ID.
  • FIG. IE shows the slider mechanism extended in the opposite direction to reveal a writing surface and stylus.
  • the mobile electronic device has been rotated 180 degrees, with the display of information on a main screen of the mobile electronic device taking into account the rotation, in a known manner.
  • the writing surface may also be provided with touch capabilities in a manner described hereinafter. If touch capabilities for the writing surface are not required, the writing surface may be constructed in a manner described hereinafter except that a touch sensor is omitted.
  • FIG. IF illustrates handwriting input using the writing surface. Word-at-a-time or phrase-at-a-time input may be accomplished as described hereinafter.
  • a keypad is provided and a QWERTY keyboard is provided instead of a writing surface.
  • the Helio OceanTM cellphone has more complex dual slider mechanism of a different type.
  • a "portrait” slider position a conventional keypad is exposed.
  • a "landscape” slider position a QWERTY keyboard is exposed.
  • Three separate housing portions are provided, the main display occupying the topmost main housing portion and the QWERTY keyboard and the conventional keypad occupying different ones of subsidiary housing portions.
  • a slider mechanism of this type may be used such that in one slider position (e.g., the landscape position) keys are exposed and in another slider position (e.g., the portrait position) a writing surface is exposed.
  • the main device display is provided with stylus input capability as exemplified by Pocket PCTM devices.
  • Word-at-a- time or phrase-at-a-time input may be accomplished as described hereinafter.
  • handwriting is allowed over most or all of the surface of the main display.
  • the writing is displayed translucently, without obscuring the underlying display content, as illustrated in FIG. IG, in which translucent text display is represented by hollow text.
  • Word-at-a-time or phrase-at-a-time input may be accomplished in this manner as described hereinafter.
  • the input sub-system 107 of the mobile electronic device of FIG. 1 may instead include an input device having both touch input and stylus input capabilities as well as certain display capabilities.
  • FIG. 2 A clear capacitive touch sensor 201 is provided overlying a resistive sensor or other stylus- responsive sensor 203. Between the capacitive touch sensor 201 and the resistive sensor 203 is provided a display film 205. Control and data signals are exchanged with the input device through a bus 207.
  • a suitable clear capacitive touch sensor 201 is available from Alps Electric of Japan, for example.
  • Such a sensor is constructed by embedding transparent (e.g., indium tin oxide, or ITO) electrodes within a polycarbonate layer.
  • the polycarbonate layer is made thinner than normal in order to affect the response of the display film 205 and the resistive sensor 203 as little as possible.
  • FIG. 14 a plan view of shown of a mobile electronic device that includes an input device 1401 like that of FIG. 2.
  • the input device is provided in the corners thereof with indicia that serve as user interface icons used for writing capture. Pressing on an icon causes an action to be performed.
  • the icons perform the following actions. 1.
  • Icon 1403 Input, recognize (convert to text) and optionally send to a remote user the text written on the input device; clear the display of the input device. 2.
  • OLED displays may be particularly well-suited because of their compatibility with plastic substrates.
  • full-resolution (rather than "single-pixel") display enables interactive touchpad operation. That is, the touchpad becomes a touchscreen.
  • medium and high resolution color displays are also visually attractive to the user.
  • a layer 1501 contains embedded ITO electrodes and is used for capacitive touch sensing. In some embodiments, the same ITO electrodes may be used driven by a display driver to produce an image.
  • Beneath the layer 1501 is liquid crystal (e.g., cholesteric liquid crystal) 1503.
  • a layer 1505 cooperates with the layer 1501 to form an envelope for the liquid crystal 1503.
  • the layer 1505 is clear and is provided on the bottom with a coating of conductive paint or ink of a color the same as the desired display color. The coating is connected to electrical ground and also serves as a grounding layer for the resistive sensor.
  • the layer 1509 is a sense layer of the resistive sensor. Between the layers 1505 and 1509 is a layer of elastomeric spacers 1507.
  • FIG. 3 a plan view is shown of one configuration of a portion of a mobile electronic device such as the mobile electronic device of FIG. 1.
  • the mobile electronic device is assumed to use an input device 301 like the input device of FIG. 2.
  • a keypad overlay 310 (to be described) overlies an upper portion of the input device of FIG. 2.
  • a lower portion of the input device remains exposed.
  • the keypad overlay defines two "key complexes" 303 and 305 each of which may be imagined as a four- way rocker switch nested within an eight- way rocker switch for a total of 24 switch inputs.
  • the key complexes exhibit biaxial symmetry about orthogonal axes.
  • FIG. 3 illustrates one example of how indicia may be provided on the keys of the key complexes. Twelve of the keys (0-9, * and #) correspond generally to the number keys and associated keys (*, #) of a typical cell phone. Four of the keys ( ⁇ , v, ⁇ , >) correspond generally to up, down, left, right keys. Of these same keys, the up arrow may be colored green to allow this same key to be used as the SEND key following entry of a number. The down arrow may be colored red to allow this same key to be used as the END key at the conclusion of a call.
  • Two upper middle keys are used as "softkeys.” Two keys bear the indicia "
  • ClickText text entry system two successive key presses are used to unambiguously identify each letter of the alphabet, enabling no-look touch typing. The key combinations are chosen so as to bear a strong resemblance to the capital form of the letter being entered (e.g., ⁇ then - for A).
  • Two keys (;, A) are used for punctuation and case selection. Two keys bear no indicia and are available for other uses.
  • a keypad overlay is a keypad structure that during use overlies and cooperates with one or more underlying sensors such as the sensors of FIG. 2.
  • the keypad overlay lacks electrical circuits that are closed or opened to cause current to flow or not flow depending on a state of depression of the key domes. Instead, operation of the keys of the keypad overlay is sensed by the underlying sensor(s).
  • the keypad overlay is removable, and may be interchanged with any of a variety of interchangeable keypad overlays. Keypad overlays may be provided that are specific to a company or team, specific to an application, etc. Unlike software keyboards, tactile feedback is preserved.
  • a suitable keypad overlay may be formed by adapting the teachings of U.S. Patent Publication 20060042923 of De Richecour, assigned to Molex Inc., incorporated herein by reference.
  • an actuator layer is made of a thin plastic film 110 with actuator pins or plungers 115 injected.
  • On the actuator layer 110 are stacked respective layers including: a dome layer comprising a dome support plastic foil 120 supporting a plurality of metal domes 125; a layer of a flex foil 130; an optional layer of an electro-luminescent foil 140; and a layer of a graphic foil 150.
  • an additional UV ink layer 160 is optionally screen printed for simulating a key button and to tactile engagement with the fingers when touching the key area.
  • a thin thermoformed plastic layer or the like may be provided having elevated key-shaped regions. Note that the circuit layers 131 and 132 of De Richecour are eliminated.
  • the edges of the keypad overlay are finished using a suitable technique to render them resistant to wear.
  • the actuator layer 110 is provided with moderate stiffness so that the keypad overlay retains in substantial degree its planar form when it is withdrawn from the device.
  • the device configuration of FIG. 3 allows for three different types of user input, or user actions: Click, Write, Point.
  • Click refers to key input, illustrated in FIG. 7.
  • Write refers to stylus input, illustrated in FIG. 8.
  • the user may use a stylus to write on the surface, the writing being displayed by the ChLCD (for example) and captured by the pressure-sensing layer.
  • Point refers to cursoring, navigation and control input using finger, thumb, or both (multi-touch), illustrated in FIG. 9. Touch inputs are sensed by the capacitive touch sensor.
  • FIG. 5 A further device configuration is illustrated in FIG. 5.
  • a second keypad overlay 510 is provided to allow for "BlackberryTM- like" text input.
  • the second keypad overlay is six keys wide (instead often keys wide as is often used).
  • the letters are therefore arranged alphabetically instead of in QWERTY fashion. Some keys bear more than one letter.
  • the letters may be selected between using "touch inflections.” For example, when the lower letter of two letters is desired, the key is pressed and coincident with release of the key, the digit used to depress the key is drawn slightly toward the user.
  • the capacitive touch sensor is able to sense this touch inflection and thereby select the correct letter or other character.
  • FIG. 5 allows for user actions of Click and Point. Key input may be performed using either the first keypad overlay (FIG. 10) or the second keypad overlay (FIG. 11). Pointing may be performed "through" the keypad overlay 510, which is sufficiently thin and sufficiently non-conducting as to not significantly interfere with operation of the capacitive touch sensor, as illustrated in FIG. 12. This configuration typically does not allow for the user action of Write, because of surface contours and sub- surface obstructions of the keypad overlay.
  • the second keypad overlay 510 may be "stowed" on the rear surface of the mobile electronic device, for example within a track provided on the battery cover lid, when not in use.
  • the keypad overlay 510 is then conveniently available and may be quickly unstowed and slid into place for operation.
  • FIG. 13 illustrates removal of the second keypad overlay 510 for subsequent stowing.
  • the Apple iPhone has drawn much attention to multi-touch. Multi-touch adds additional cost and raises issues of proprietary rights. It would be useful therefore to achieve the equivalent of multi-touch operation using single-touch technology.
  • the user places a cursor over an area of interest and then, without lifting off, applies an increment of pressure to the touchpad.
  • the touchpad senses this pressure (increased touch area) and recognizes this as a command to unzoom the portion of the display underneath the cursor.
  • the same gesture may be repeated to achieve additional unzoom.
  • the user effectively "presses in” the desired image area into the display.
  • panning may be emulated simply in response to a cursor being moved to an edge area of the display. Panning ensues, and may be discontinued when the cursor is removed from the edge area.
  • the enhanced user input capabilities of the present mobile electronic device enable facile input of both text and graphics.
  • ChLCD displays Because of the non- volatile nature of ChLCD displays, it conveniently serves as a scratchpad/memo-pad. No power is required to preserve the displayed information. An option may be provided to capture and save the displayed information.
  • Various text recognition modes may be provided suited to handwriting styles having varying degrees of distinctness. Users with a fairly distinct hand should be able to write freely, activating the icon 1403 (FIG. 14) when the available writing space is filled. Other users may benefit from additional assistance. For example, a "word-at-a-time" mode may be provided in which the user activates the icon 1403 following each word. Segmenting input by word aids the recognizer to accomplish accurate recognition. Also, a "dotting" mode may be provided in which the user writes a dot following each word, to the same effect. For users having handwriting that is overly difficult to recognize, the user may activate the icon 1405, causing the handwriting to be stored and/or sent as an image without recognition.
  • the text or graphics is communicated to the current application (S 1809) and displayed on the primary display (S1811).
  • the text or graphics is communicated to a remote user as part of an instant messaging session (S 1813).
  • the writing display is then cleared (S 1815). The same flow is then repeated.
  • step S 1901 the program checks to see whether it is finished. If so, program flow returns. If not, writing capture/display is performed (S1903). In step S1904, the program checks to see whether a real time mode is in effect.
  • step S 1905 the program checks to see whether an action equivalent to pressing ENTER on a keyboard has been performed, for example activating the icon 1403 (FIG. 14). If so, recognizer software processes the captured input to recognize the user's writing and convert it to text (S1907). If not, the program further check to see whether an action for entering graphics has been performed, for example activating the icon 1405 (FIG. 14). If not, writing capture/display continues. The text or graphics is communicated to the current application (S 1909) and displayed on the primary display (S1911). The text or graphics is communicated to a remote user as part of an instant messaging session (S 1913). The writing display is then cleared (S 1915). The same flow is then repeated.
  • an action equivalent to pressing ENTER on a keyboard for example activating the icon 1403 (FIG. 14). If so, recognizer software processes the captured input to recognize the user's writing and convert it to text (S1907). If not, the program further check to see whether an action for entering graphics has been performed, for example activ
  • step S2004 real time mode is found to be in effect, a second series of steps ensues.
  • Graphics information is communicated to the current application (S2017) and displayed on the primary display (S2019).
  • the graphics information is communicated to a remote user as part of an instant messaging session (S2021).
  • the program then checks to see whether an action for clearing the writing display has been performed, for example activating the icon 1407 (FIG. 14). Depending on whether the action for clearing the writing display has been performed, the writing display is either cleared (S2015) or not cleared. The same flow is then repeated.
  • FIGS. 21A, 21B and 21C An illustration of mobile instant messaging using text and graphics entry in accordance with FIG. 18 is shown in FIGS. 21A, 21B and 21C.
  • the user first writes "Hey Angie! and activates the icon 1403 (FIG. 14).
  • the written text is recognized, displayed and sent to the remote user (Angie).
  • the user then writes "Get well soon" and activates the icon 1403.
  • the written text is recognized, displayed and sent to Angie.
  • FIG. 21C the user then draws a picture representing Angie 's condition.
  • the user activates the icon 1405.
  • the graphic is displayed (possibly in thumbnail form, although not shown) and sent to Angie.
  • a mobile electronic device may be provided that receives user input primarily or exclusively through planar sensors.
  • a connectorization and communication standard may be defined for mobile phone "flat panel peripheral devices," or FPDevs, thereby achieving Open Mobile Input or Open Mobile I/O.
  • An FPDev has a principal surface (defined as one of two surfaces having a greatest area) exposed to the user and becomes part of the mobile phone (or other mobile electronic device) on temporary basis, either long-term or short-term.
  • An example of an FPDev is a combination touchp ad/stylus pad. Another example is a touchpad/stylus pad with display capabilities.
  • An integrated peripheral device may further enable various "input accessories" to be used.
  • An example of an input accessory is a keypad overlay that incorporates key domes and hence provides tactile feedback but that has no electrical function. Input is accomplished through the action of an FPDev, for example through the pressure-sensing action of a stylus pad.
  • the connector arrangement should provide power, ground and data connections. It may also provide a clock connection. For purposes of input, the data rate required is fairly low — below lOOkbps. Any of a variety of known protocols may be used, including, for example, the I2C protocol.
  • the connector height on the FPDev side should be about lmm or less.
  • the MicroUSB connector is one suitable candidate. Positive insertion may be provided for on the mobile side such that the user knows when insertion has been accomplished. In a basic form, the connector may simply be a miniaturized edge connector having four traces.
  • the base portion 2401 of the phone has a "sled” construction, or sled-like structure, that allows an FPDev 2403 to be inserted.
  • the FPDev may have embedded within it one or more integrated circuits (not shown) that control the functions of the FPDev.
  • the term "sled” is used here to connote that the FPDev slides into the base without being enclosed by it.
  • the FPDev is provided with a male connector 2405, and the base is provided with a mating female connector 2407.
  • the base may be provided with a male connector, and the FPDev may be provided with a mating female connector 2407.
  • a pen equipped with a 3D accelerometer and wireless communications capabilities Such a pen 2200 is illustrated in FIG. 22. It includes a 3D accelerometer 2201, a microcontroller provided with wireless communications capabilities (e.g., Bluetooth, UWB, Zigbee, etc.) 2203, a battery 2205, and an antenna 2207. Mechanical features of the pen such as an ink reservoir are not shown. Optionally, one or more input buttons or other inputs to the microcontroller may be provided. The pen may also be provided with flash memory 2208 and a USB interface to enable it to function as a memory stick or even as an MP3 player (2209).
  • wireless communications capabilities e.g., Bluetooth, UWB, Zigbee, etc.
  • the pen may also be provided with flash memory 2208 and a USB interface to enable it to function as a memory stick or even as an MP3 player (2209).
  • writing capture occurs through the mechanism of the 3D accelerometer and wireless communications. That is, data from the 3D accelerometer describing motion of the pen is wirelessly communicated to the mobile electronic device (not shown).
  • a recognizer may receive the input from the 3D accelerometer and perform handwriting recognition thereon. While the writing will typically be displayed on the main display of the mobile electronic device, the user will have less need to refer to the display except to resolve ambiguities in recognition.
  • Commands may be input to the mobile electronic device through the plain paper interface using one or more signifiers. For example, double -underlining may be used to identify text as a command or as text having special significance for program operation.
  • FIG. 23 an example is shown of using plain paper interface to send an email.
  • the user writes "TO", upon which the mobile electronic device recognizes that the user wishes to send an email.
  • the mobile electronic device prompts the user to enter an email address using an address book of the mobile electronic device, separate and apart from the plain paper interface.
  • the desired address is not in the address book.
  • the user therefore ignores the prompt and enters the desired address through the plain paper interface.
  • the user may also enter "CC" addresses and the like in the same or similar manner.
  • the user then writes "SUBJECT" followed by the subject of the email.
  • the user enters the text of the email.
  • To attach an attachment the user writes "ATTACH”.
  • the mobile electronic device then prompts the user to select one or more attachments, separate and apart from the plain paper interface. Finally, the user writes "SEND".
  • the email is then sent.
  • An untethered electrostatic pen/stylus for use with capacitive touch sensors allows for a single device like the iPhone to receive input via both finger touches and a stylus.
  • Stylus input is more precise for various uses including, for example, text input and drawing input.
  • FIG. 25 a diagram is shown of an untethered electrostatic pen/stylus for use with capacitive touch sensors.
  • the DC-to-DC converter may use a step-up transformer or may be realized primarily in the form of an integrated circuit.
  • the untethered electrostatic pen/stylus may take a similar form as a USB drive, with the charging connector being a USB connector.
  • the untethered electrostatic pen/stylus may therefore be easily charged from a PC or other line powered or battery powered electronic device.
  • a snap-on cap may be provided that covers the field-emission electrode and surrounding structure.
  • FIG. 26 another embodiment of a untethered electrostatic pen/stylus is shown.
  • the field-emission electrode is replaced by an integrated circuit 2601 having formed thereon a field-emission array having hundreds, thousands, or even tens of thousands of individual micro-emitters.
  • the micro-emitters may be formed within a vacuum envelope and emit through a sealed "window" that is relatively transparent to electron emission (e.g., a layer of silicon a few microns thick) as described for example in U.S. Patent 6,714,625 entitled Lithography Device for Semiconductor Circuit Pattern Generation, issued March 30, 2004, incorporated herein by reference.
  • a microemitter may be formed as described in "Miniature Electron Microscopes Without Vacuum Pumps, Self-Contained Microfabricated Devices with Short Working Distances, Enable Operation in Air," NASA Tech Briefs, 39-40 (1998), set forth in Appendix A.
  • the untethered electrostatic pen or stylus may incorporate the features of a USB "thumb drive” or other similar devices.
  • the pen or stylus may take the form of a USB thumb drive but use a different location mechanism than the electrostatic mechanism described.
  • the pen or stylus may use an electromagnetic location mechanism in which a coil located in the vicinity of a display produces an excitation signal that excites a response in a resonant circuit located in the pen or stylus. The response is detected by an array of detectors arrayed in relation to the surface of the display, so as to detect the location of the pen or stylus.
  • a lanyard 301 and a replaceable ink pen attachment 303 are provided to be used in conjunction with the pen or stylus 305.
  • the ink pen attachment clips into the lanyard, and the pen or stylus clips into the ink pen attachment.
  • the pen or stylus can be readied for use either as an ink pen with the ink pen attachment attached or as a pen or stylus for input to a device, without the ink pen attachment attached.
  • a USB connector 311 and a cap 313 are also shown.
  • the ink pen mechanism may be provided as part of the pen or stylus instead as of an attachment.
  • the ink pen mechanism may be located at the opposite end of the pen or stylus as the end used to interact with a mobile electronic device.
  • a USB connector or the like may be located elsewhere if needed, and be articulatable if needed.
  • a pen or stylus for interacting with a capacitive touch sensor comprising: an elongated housing having a grip area to be gripped in a writing grip; and an electron beam source within the elongated housing.
  • the electron beam source comprises a field- emission array of micro-emitters.
  • the apparatus of 1.1 comprising an electron beam lens for focusing an electron beam produced by the electron beam source.
  • the apparatus of 1.1 comprising a rechargeable battery and a charging connector.
  • the apparatus of 1.1 comprising a contact switch responsive to contact of the pen/stylus for causing supply of a high voltage to the electron beam source to be interrupted during absence of contact.
  • a pen or stylus for interacting with a mobile electronic device comprising: an elongated housing having a grip area to be gripped in a writing grip; electronic circuitry within the elongated housing, comprising a resonant circuit responsive to an applied electromagnetic excitation to produce a responsive signal; and a bus connector coupled to the electronic circuitry.
  • a pen or stylus for interacting with mobile electronic device and for writing in ink comprising: an elongated housing having a grip area to be gripped in a writing grip; electronic circuitry within the elongated housing for producing a signal for detecting a location of the pen or stylus; a bus connector coupled to the electronic circuitry; and a mechanism for attaching an ink pen attachment.
  • a pen or stylus for interacting with mobile electronic device and for writing in ink comprising: an elongated housing having a grip area to be gripped in a writing grip; electronic circuitry within the elongated housing for producing a signal for detecting a location of the pen or stylus; and an ink pen mechanism providing the function of an ink pen.
  • a mobile electronic device having touch input, key input and stylus input comprising: a first housing portion housing a main display; at least one additional housing portion coupled to the first housing portion to enable two-way slider motion between the first housing portion and the at least one additional housing portion; keys provided on the at least one additional housing portion, the keys being exposed in a first slider position; and a writing surface provided on the at least one additional housing portion, the keys being exposed in a second slider position.
  • a mobile electronic device having touch input, key input and stylus input comprising: a first housing portion housing a main display; at second housing portion coupled to the first housing portion to enable two-way slider motion between the first housing portion and the second housing portion; a keypad provided on the second housing portion, the keypad being exposed in a first slider position obtained by relative motion between the first and second housing portions in a first direction; and a QWERTY keyboard provided on the second housing portion, the QWERTY keyboard being exposed in a second slider position obtained by relative motion between the first and second housing portions in a direction opposite said first direction.
  • An input device comprising : a display device; a capacitive touch sensor overlying the display device; and a pressure-sensing layer underlying or overlying the display device.
  • a mobile electronic device comprising: a first housing portion and a second housing portion connected together in a hinged manner; a display housed by the first housing portion; and a pressure-sensing layer housed by the second housing portion for performing writing capture in response to a stylus.
  • the apparatus of 3.7 comprising a capacitive touch sensor housed by the second housing portion.
  • the apparatus of 3.8 comprising a keypad overlay delineating multiple key areas and overlying at least a portion of the capacitive touch sensor. 3.11. The apparatus of 3.10, wherein the keypad overlay comprises at least one flexible key dome, wherein depression of the flexible key dome is sensed by at least one of the pressure-sensing layer and the capacitive touch sensor.
  • a method of inputting information to a mobile electronic device having a primary display comprising: sensing stylus input of multiple words written on a pressure-sensitive layer located separate and apart from the primary display; displaying the words on a secondary display situated in overlapping relation to the pressure-sensitive layer; sensing a stylus input occurring in a particular area; and in response to the stylus input, displaying the words on the primary display.
  • a method of performing instant messaging using a mobile electronic device comprising: sensing stylus input of multiple words written on a pressure-sensitive layer located separate and apart from the primary display; displaying the words on a secondary display situated in overlapping relation to the pressure-sensitive layer; sensing a stylus input occurring in a particular area; and in response to the stylus input, sending the words as part of a message to a remote device. 3.14. The method of 3.13, comprising, prior to sending the words as part of a message, performing handwriting recognition to recognize the words.
  • a method of performing messaging using a mobile electronic device comprising: sensing stylus input written on a pressure-sensitive layer located separate and apart from the primary display; displaying the input on a secondary display situated in overlapping relation to the pressure-sensitive layer; and in response to and concurrent with the stylus input, sending information capturing the stylus input to a remote device.
  • a method of graphics-augmented voice communications using a mobile electronic device comprising: establishing a voice connection between the mobile electronic device and a remote device; and during the course of the voice connection: sensing stylus input written on a pressure-sensitive layer located separate and apart from the primary display; displaying the input on a secondary display situated in overlapping relation to the pressure-sensitive layer; and in response to and concurrent with the stylus input, sending information capturing the stylus input to the remote device.
  • a keypad overlay for use with a mobile electronic device, comprising: a first member providing a flat surface; a second member having indicia formed thereon; and a plurality of flexible key domes provided between the first member and the second member; the keypad overlay lacking electrical circuits that are closed or opened to cause current to flow or not flow depending on a state of depression of the key domes.
  • a method of inputting information to a mobile electronic device using a writing instrument having a movement sensor, a radio link being provided between the mobile electronic device and the writing instrument comprising: sensing movement of the writing instrument during writing on a plain piece of paper using the writing instrument; and communicating said movement to the mobile electronic device.
  • 3.20 The method of 3.19, comprising: sensing movement of the writing instrument during writing of a command and communicating said command to the mobile electronic device; and the mobile electronic device executing said command. 3.21.
  • a method of sending a message comprising: establishing a communication session; capturing stylus input; and as part of the communications session, sending a representation of the captured stylus input.
  • a key assembly comprising a key complex having four key switches nested inside eight key switches, the key complex exhibiting bi-axial symmetry about orthogonal axes.
  • a mobile electronic device that accepts each of a plurality of different keypads each having a different key configuration.
  • a method of inputting text to a mobile electronic device comprising: capturing writing of a user in response to a pen or stylus; receiving pen or stylus inputs from the user indicative of word separation; and performing recognition of captured writing using said inputs indicative of word separation.
  • a method of inputting information to a mobile electronic device comprising: sensing depression of a key using at least one of a capacitive touch sensor and a pressure sensor; and upon release of the key input, sensing whether lateral motion of a digit of a user with respect to a surface of the key occurs; if lateral motion is sensed to have occurred, inputting first information; and if lateral motion is not sensed to have occurred, inputting second information.
  • An accessory for a mobile electronic device comprising: a pen mechanism; a microcontroller; and a wireless transmitter or transceiver coupled to the microcontroller;
  • the accessory of 3.34 further comprising flash memory and a USB port, whereby the accessory functions as a memory stick.
  • the accessory of 3.34 further comprising flash memory, MP3 player electronics, and a USB port, whereby the accessory functions as an MP3 player.
  • a mobile electronic device comprising: a housing; a display; and a structure for receiving, securing and connecting a flat peripheral device such that a principal surface of the flat peripheral device is exposed and, at least in large part, overlaps with the housing, comprising a connector for supplying power to the flat peripheral device.
  • a flat peripheral device for use with a mobile electronic device comprising: a principal surface that is exposed during use of the flat peripheral device with the mobile electronic device and arranged to receive input from or provide output to a user of the mobile electronic device; and a connector for receiving power from the mobile electronic device; wherein the flat peripheral device has a form factor enabling it to be received within a sled-like structure of the mobile electronic device.
  • a method of zooming an image displayed on a mobile electronic device having touch input comprising: sensing a first user action pointing to an image region to be zoomed; sensing a second user action in which a touch input is lifted differently than normal; and in response to the second user action, performing a zoom operation on the image region.
  • a method of unzooming an image displayed on a mobile electronic device having touch input comprising: sensing a first user action pointing to an image region to be unzoomed; sensing a second user action in which increased pressure is applied to a touch input; and in response to the second user action, performing an unzoom operation on the image region.
  • a method of panning an image displayed on a mobile electronic device having touch input comprising: sensing a user action having simultaneous rapid Z variation and XY variation; and in response to the user action, performing panning of the image.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Telephone Set Structure (AREA)
  • Position Input By Displaying (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

L'invention concerne un dispositif de saisie et des dispositifs électroniques mobiles ayant des capacités d'interface utilisateur améliorées. Dans l'un de ses modes de réalisation, l'invention concerne un dispositif à 'triple menace' sous forme de dispositif électronique mobile à construction de curseur. Ce dispositif comprend un mécanisme de curseur à deux voies. Dans l'un des modes de réalisation de l'invention, l'écran du dispositif électronique mobile est tactile (saisie tactile); dans une première position du curseur, les touches tactiles sont exposées (saisie par touche); dans une autre position du curseur, un bloc-note est exposé (saisie par stylet).
PCT/US2008/071282 2007-08-01 2008-07-27 Interface avec des dispositifs électroniques mobiles et communication entre ceux-ci WO2009029368A2 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US12/671,626 US20110234623A1 (en) 2007-08-01 2008-07-27 Interface with and communication between mobile electronic devices
US12/370,597 US20100020103A1 (en) 2008-07-27 2009-02-13 Interface with and communication between mobile electronic devices

Applications Claiming Priority (8)

Application Number Priority Date Filing Date Title
US11/888,811 2007-08-01
US11/888,811 US20090036176A1 (en) 2007-08-01 2007-08-01 Interface with and communication between mobile electronic devices
US11/899,756 US20090066660A1 (en) 2007-09-06 2007-09-06 Interface with and communication between mobile electronic devices
US11/899,756 2007-09-06
US12/040,769 US20090219250A1 (en) 2008-02-29 2008-02-29 Interface with and communication between mobile electronic devices
US12/040,769 2008-02-29
US12/104,392 US20090260900A1 (en) 2008-04-16 2008-04-16 Untethered electrostatic pen/stylus for use with capacitive touch sensor
US12/104,392 2008-04-16

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US12/370,597 Continuation-In-Part US20100020103A1 (en) 2008-07-27 2009-02-13 Interface with and communication between mobile electronic devices

Publications (2)

Publication Number Publication Date
WO2009029368A2 true WO2009029368A2 (fr) 2009-03-05
WO2009029368A3 WO2009029368A3 (fr) 2009-04-16

Family

ID=40344674

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2008/071282 WO2009029368A2 (fr) 2007-08-01 2008-07-27 Interface avec des dispositifs électroniques mobiles et communication entre ceux-ci

Country Status (1)

Country Link
WO (1) WO2009029368A2 (fr)

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030001899A1 (en) * 2001-06-29 2003-01-02 Nokia Corporation Semi-transparent handwriting recognition UI
US20030071850A1 (en) * 2001-10-12 2003-04-17 Microsoft Corporation In-place adaptive handwriting input method and system
US20040257346A1 (en) * 2003-06-20 2004-12-23 Microsoft Corporation Content selection and handling
US7774505B2 (en) * 2005-03-05 2010-08-10 Samsung Electronics Co., Ltd Method for transmitting image data in real-time
KR101244300B1 (ko) * 2005-10-31 2013-03-18 삼성전자주식회사 이동통신단말기에서 수서데이터를 인식하여 전송하기 위한장치 및 방법

Also Published As

Publication number Publication date
WO2009029368A3 (fr) 2009-04-16

Similar Documents

Publication Publication Date Title
US20110234623A1 (en) Interface with and communication between mobile electronic devices
US20090066660A1 (en) Interface with and communication between mobile electronic devices
US20090036176A1 (en) Interface with and communication between mobile electronic devices
US20090219250A1 (en) Interface with and communication between mobile electronic devices
US9285837B2 (en) Temporary keyboard having some individual keys that provide varying levels of capacitive coupling to a touch-sensitive display
US20100020103A1 (en) Interface with and communication between mobile electronic devices
EP2701033B1 (fr) Clavier temporaire présentant certaines touches individuelles qui fournissent divers niveaux de couplage capacitif pour un écran tactile
EP2000885B1 (fr) Affichage haptique pour un dispositif électronique portatif
US20020042853A1 (en) Electronic device provided with an input means
KR101635645B1 (ko) 터치 패널 장치
CN101675410A (zh) 使用数字装置中的指点设备的虚拟键盘输入系统
WO2001004736A1 (fr) Dispositif d'entree du type clavier et processeur de donnees portable
EP2073509B1 (fr) Appareil electronique portable
CN107908318A (zh) 手写板
CN102117181A (zh) 便携式电子设备及其控制方法
EP2584432A1 (fr) Appareil de clavier doté d'une détection de proximité et de pression
CN102004599A (zh) 具有输入装置的电子设备
WO2012015333A1 (fr) Dispositif de composition et de saisie de symboles dans des moyens de communication portables
US20080088487A1 (en) Hand Writing Input Method And Device For Portable Terminal
JP4393280B2 (ja) キー入力装置
WO2006052175A1 (fr) Modele de terminal dote d'un clavier sur sa surface arriere ou sur l'une de ses surfaces laterales
JP2000010713A (ja) 段階収納式キーボード付情報機器
US6796734B2 (en) Keyless keyboard and a method of using them
US10061394B2 (en) Electronic device including keypad with keys having a ridged surface profile
JP2004295716A (ja) 表示機能付電子機器

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 12671626

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 08828149

Country of ref document: EP

Kind code of ref document: A2

122 Ep: pct application non-entry in european phase

Ref document number: 08828149

Country of ref document: EP

Kind code of ref document: A2

点击 这是indexloc提供的php浏览器服务，不要输入任何密码和下载