US20010000666A1 - Transmitter pen location system - Google Patents
Transmitter pen location system Download PDFInfo
- Publication number
- US20010000666A1 US20010000666A1 US09/740,630 US74063000A US2001000666A1 US 20010000666 A1 US20010000666 A1 US 20010000666A1 US 74063000 A US74063000 A US 74063000A US 2001000666 A1 US2001000666 A1 US 2001000666A1
- Authority
- US
- United States
- Prior art keywords
- transmitter
- output signal
- pen
- movable
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 230000005540 biological transmission Effects 0.000 claims abstract description 21
- 230000001419 dependent effect Effects 0.000 claims abstract description 9
- 238000002604 ultrasonography Methods 0.000 claims description 39
- 238000000034 method Methods 0.000 claims description 37
- 230000008569 process Effects 0.000 claims description 28
- 230000006870 function Effects 0.000 claims description 8
- 238000004891 communication Methods 0.000 claims description 3
- 230000004913 activation Effects 0.000 description 6
- 230000000737 periodic effect Effects 0.000 description 5
- 238000001514 detection method Methods 0.000 description 4
- 230000002238 attenuated effect Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 238000004377 microelectronic Methods 0.000 description 2
- 241001640117 Callaeum Species 0.000 description 1
- 241001422033 Thestylus Species 0.000 description 1
- 230000003213 activating effect Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000010355 oscillation Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/043—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using propagating acoustic waves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03545—Pens or stylus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/043—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using propagating acoustic waves
- G06F3/0433—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using propagating acoustic waves in which the acoustic waves are either generated by a movable member and propagated within a surface layer or propagated within a surface layer and captured by a movable member
Definitions
- the invention relates to the field of location algorithms for remote devices. More particularly, the invention relates to an algorithm system for determining the position of an electronic pointing device.
- Digitizing pen and whiteboard systems are used for a variety of electronic applications. These systems typically include a whiteboard, a position indicating pen, and associated electronics for determining the interaction between the whiteboard and the position indicating pen. A digital data signal is typically derived to represent the relative position of the position indicating pen and the whiteboard.
- a signal such as ultrasound
- I. Gilchrist, Acoustic Mouse System, U.S. Pat. No. 5,144,594 discloses an acoustic mouse system, which “controls indications on an X-Y surface of the face of a display.
- the system comprises at least three acoustic receivers in an x-y plane, and a hand movable acoustic transmitter that is movable both parallel to the x-y plane and in a z direction perpendicular to the x-y plane.
- the transmitter generates periodic acoustic oscillations in the direction of the support and its receivers.
- Detection circuitry responsive to the signals from the acoustic receivers, provides signals indicative of the absolute position of the acoustic transmitter in the x-y plane.
- a processor is responsive to the signals from the detection circuitry to provide absolute position signals to the display, whereby the display responds by moving an indication to a corresponding position on the X-Y surface of the display face.
- the detector circuitry is further enabled to provide z position signals to the display, whereby the display may modify a display function in accordance with the z position signals”. While Gilchrist discloses a generic, periodic acoustic wavelength position indicating system, Gilchrist fails to disclose a useful algorithm by which the position of the movable acoustic transmitter is determined.
- the system apparently requires a minimum of three acoustic receivers to properly locate the movable acoustic transmitter, and a minimum of four acoustic receivers to calibrate the system.
- Gilchrist also fails to disclose waveform analysis techniques which can be used to provide even greater accuracy in the determination of the movable acoustic transmitter. While Gilchrist discloses the preferred use of an infrared transmitter to transmit a mouse command signal or a control signal, Gilchrist fails to disclose the use of a combined signal, comprising a repeated infrared signal coupled to a repeated ultrasound signal, to more accurately locate a movable transmitter device.
- M. Stefik and C Heater, Ultrasound Position Input Device U.S. Pat. No. 4,814,552 (Mar. 21, 1989) discloses an “input device, or stylus, for entering hand drawn forms into a computer using a writing instrument, a pressure switch for determining whether the instrument is in contact with the writing surface, an acoustic transmitter for triangulating the position of the stylus on the surface, and a wireless transmitter for transmitting data and timing information to the computer.
- the stylus transmits an infrared signal which the system receives immediately, and an ultrasound pulse which two microphones receive after a delay which is a function of the speed of sound and the distance of the stylus from the microphone”. While Stefik et al.
- the algorithm computes radii to each of the two microphones using information from only a single sonic pulse sample, translates the two radii into a calculated X,Y location, and then filters the calculated X,Y values, removing them from the described path if they vary from a specified limit, or range.
- U.S. Pat. No. 5,142,506 discloses a “positional locating method and apparatus for measuring distances by accurately determining the transit time of ultrasonic wave bursts between two or more points”. “Timer clocks are started when each of the bursts is triggered to be emitted from a transmission point, and are stopped when a highly defined point in the burst is received at a corresponding receiving point. The highly defined point is determined by first analyzing the burst to identify a particular cycle within the burst. The particular cycle is then analyzed to detect the specific point within the cycle”.
- the disclosed prior art systems and methodologies thus provide basic transmitter pen and whiteboard positioning systems for determining the spatial relationship between a pen and a writing area, but fail to provide an accurate means for determining the position of the tip of the pen. It would be advantageous to provide a more accurate and reliable means to calculate the distance from a transmitter pen to external receivers, to improve the resolution of the pen by increasing the number of valid position data points, and to improve the precision and smoothness of a described path. It would also be advantageous to provide a means to store prior output signals, allowing the comparison of one or more features between the current output signal waveform and one or more prior output signal waveforms. In addition, it would also be advantageous to provide a means to customize or change the comparison between the current output signal waveform and one or more prior output signal waveforms. The development of such a transmitter pen positioning system would constitute a major technological advance.
- a transmitter pen location system in which a pen is adapted to send a plurality of repeated output signals to two or more external receivers, wherein the location of the pointing tip of the pen is determined in relation to the writing area of a surface.
- a first output element preferably an infrared transducer, transmits a first output signal from the transmitter pen.
- a second output element preferably an ultrasonic transducer, transmits a second output signal from the transmitter pen to two or more receivers.
- the first output signal arrives at one or more receivers generally concurrently.
- the second output signal transmitted from the transmitter pen at a known time in relation to the first output signal, arrives at each of the receivers at a time which is dependent on the speed of propagation of the second signal.
- the location of the pointing tip of the transmitter pen is then determined, by using the first signal as a boundary condition, comparing the second signal to one or more stored prior second signals to determine the time of arrival of the second signal at each of the receivers, determining the distance from the pen to each of the receivers using the arrival time of the second signal compared to the arrival time of the first output signal, and then calculating a location for the pen which is consistent with the calculated distance to each of the external receivers.
- Alternative embodiments allow the transmission of supplementary information from the transmitter pen to the receivers, using either the first and/or second output signals.
- FIG. 1 is a top view of a transmitter pen location system, in which a transmitter pen is located within the writing area of a surface, and in which the transmitter pen periodically sends a combined output signal to external receivers;
- FIG. 2 shows the geometric relationship between a transmitter pen and two external receivers, with the calculated position of the pen is shown as the intersection of arc lengths;
- FIG. 3 is a partial top view of external receivers located on a surface
- FIG. 4 is a perspective view of an alternate embodiment of the transmitter pen location system, in which a transmitter pen is located within a writing volume, and in which the transmitter pen periodically sends a combined output signal to external receivers;
- FIG. 5 is a partial cutaway view of a transmitter pen having a first output signal transducer and a second output signal transducer;
- FIG. 6 is a detailed cutaway view of the pointing tip of a transmitter pen having a first output signal transducer and a second output signal transducer;
- FIG. 7 is a partial perspective view of the pointing tip of a transmitter pen having a plurality of first output signal transducers and a single second output signal transducer;
- FIG. 8 is schematic view of the transmission of first output signal and a second output signal from a transmitter pen
- FIG. 9 shows a short pulse waveform of a typical first output signal sent from a transmitter pen
- FIG. 10 shows a shaped pulse waveform of one embodiment of a second output signal sent from a transmitter pen
- FIG. 11 shows a calculated transcribed path of a transmitter pen from sequential locations, and a defined functional area, within the writing area of a surface
- FIG. 12 shows a repeated combined output signal as it is sent from a transmitter pen
- FIG. 13 shows a combined output signal as it arrives at a first external receiver
- FIG. 14 shows a combined output signal as it arrives at a second external receiver
- FIG. 15 is a perspective view showing changes in transmitter pen orientation which can alter the received waveform of the second output signal as it arrives at an external receiver;
- FIG. 16 a top view showing the directional reception characteristics of one embodiment of second output sensors at external receivers
- FIG. 17 shows a first output signal that includes encoded information which indicates a pen up position
- FIG. 18 shows a first output signal that includes encoded information which indicates a pen down position
- FIG. 19 shows a first output signal that includes encoded information which indicates a pen up position and supplementary information
- FIG. 20 shows a first output signal that includes encoded information which indicates a pen down position and supplementary information
- FIG. 21 is an alternate embodiment of the transmitter pen location system, having movable receivers, an automatic-calibration transmitter, and wireless communication between the receivers and the signal processor;
- FIG. 22 shows the geometric relationship between a transmitter pen and three external receivers, with the calculated position of the pen shown as the intersection of three arc lengths;
- FIG. 23 shows a transmitter pen having a selective function button.
- FIG. 1 is a top view of a transmitter pen location system 10 a, in which a transmitter pen 30 located within the writing area 14 of a surface 12 , in which the transmitter pen 30 repeatedly sends a combined output signal 16 to external receivers 18 .
- the surface 12 is typically a whiteboard, a blackboard, a drafting table or an overhead projector, or any kind of presentation surface.
- FIG. 2 shows the geometric relationship 20 between a transmitter pen 30 and two external receivers 18 a and 18 b, with the calculated (X 1 ,Y 1 ) position of the transmitter pen 30 represented in relation to an X-axis 24 and a Y-axis 26 , as discussed below.
- FIG. 3 is a partial top view of external receivers 18 located on a surface 12 .
- the first external receiver 18 includes a first output signal sensor 25 and a second output signal sensor 27 a, and includes a signal connection 55 a towards a signal processor 57 (FIG. 11).
- the second external receiver 18 includes a second output signal sensor 27 b, and also includes a signal connection 55 b to the signal processor 57 .
- FIG. 4 is a perspective view of an alternate embodiment of the transmitter pen location system 10 b, in which a transmitter pen 30 is located within a writing volume 14 b, and in which the transmitter pen 30 periodically sends a combined output signal 16 to external receivers 18 a, 18 b, and 18 c.
- the geometric relationship between the transmitter pen 30 and the external receivers 18 a, 18 b and 18 c is repeatedly determined, wherein the successive calculated (X,Y,Z) positions 31 a, 31 b, 31 c of the transmitter pen 30 describe a path 82 , in relation to an X-axis 24 , a Y-axis 26 , and a Z-axis 29 .
- the transmitter pen 30 has multiple transducer elements 28 , 44 (FIGS. 5-7), which are used to determine the location of the pointing tip of the transmitter pen 30 , in relation to a writing area 14 a, or to a writing volume 14 b, of a transmitter pen location system 10 .
- the first output element 44 preferably an electromagnetic or infrared transmitter 44 , transmits a first output signal 60 from the transmitter pen 30 to first output signal sensors 25 (FIG. 3) at one or more of the external receivers 18 .
- the first output signal sensors 25 are infrared photodiodes, Part No. SFH 205FA, manufactured by Siemens Microelectronics, Inc., of Cupertino, Calif.
- the second output transducer 28 transmits a second output signal 58 from the transmitter pen 30 to second output signal sensors 27 at the external receivers 18 .
- the second output signal sensors 27 are ultrasound sensors, Part No. AT/R 40-10P, manufactured by Nippon Ceramic Co. Ltd., of Tottori-Shi, Japan.
- the second output transducer 28 on the transmitter pen 30 is an ultrasonic transmitter 28 .
- each receiver 18 includes a first output sensor 25
- the first output signal 60 which is repeatedly transmitted from the transmitter pen 30 , typically in a periodic manner, arrives at each of the receivers 18 generally concurrently. Since the first output signal 60 arrives at one or more first output sensors 25 generally concurrently, only one first output sensor 25 is typically required, and is typically located at one of the external receivers 18 , or at another external point near the periphery of the writing area 14 .
- a slower second output signal 58 which is also repeatedly transmitted from the transmitter pen 30 , typically in a periodic manner, at a known time in relation to the first output signal 60 , arrives at the external receivers 18 at a time which is dependent on the velocity of the second output signal 58 .
- the transmission of the second output signal 58 can either be before, after, or concurrent with the transmission of the first output signal 60 , as long as there is a known time between the transmission of the output signals 58 , 60 .
- the velocity of propagation of the first output signals 60 and the second output signals 58 are required to be different, so that time span between the arrival of the first output signals 60 and the second output signals 58 at each of the external receivers 18 is dependent on the relative distance between the transmitter pen 30 and each of the external receivers 30 .
- the first output signal 60 is an infrared signal 60
- the second output signal 58 is an ultrasound signal 58 . In this embodiment, therefore, the propagation velocity of the second output signal 58 is lower than that of the first output signal 60 .
- a combined signal 16 comprising a first output signal 60 and a second output signal 58 .
- the combined signal 16 is sampled, and is then transferred to a signal processor 57 (FIG. 11).
- the location of the pointing tip 36 (FIGS. 5-7) of the transmitter pen 30 is then determined by the signal processor 57 , using the first signal 60 as a boundary condition, by solving for calculated distances to each of the receivers 18 using the second output signal 58 , and then by determining a location of the pen based on the calculated distances to the receivers 18 .
- the distance d 1 to the first external receiver 18 a is determined by the relative time of reception of a second output signal 58 and a first output signal 60 within a combined signal pair 16 .
- the distance d 1 defines a circular arc 23 a of possible X,Y locations for the transmitter pen 30 .
- the distance d 2 to the second external receiver 18 b is determined by the relative time of reception of the second output signal 58 and the first output signal 60 within the same combined signal pair 16 .
- the distance d 2 thus defines a second circular arc 23 b of possible X,Y locations for the transmitter pen 30 , in relation to the second receiver 18 b.
- the (X 1 ,Y 1 ) position of the transmitter pen 30 is shown, and is calculated, as the intersection 22 of possible X,Y locations given by the first arc 23 a and the second arc 23 b within the writing area 14 .
- the transmitter pen location process which uses the transmitted combined output signal 16 to locate the transmitter pen 30 relative to the writing area 14 of a surface 12 , comprises the following steps:
- the transmitter pen location process then preferably stores 158 (FIG. 11) the received second output signals 58 b received at each of the receivers 18 , typically replacing the prior second output signals 58 a, whereby the process is repeated for the next received combined output signal 16 .
- precision is improved further, by storing more than one previous second output signal pulse 58 , and by comparing the incoming second output signal 58 b to a plurality of prior second output signals 58 a.
- FIG. 5 is a partial cutaway view of a transmitter pen 30 having a first output signal transducer 44 and a second output signal transducer 28 . While the transmitter pen 30 is described as a pen, it can be any sort of movable transmitter device.
- the transmitter circuitry 40 connected to the first output signal transducer through leads 42 a and 42 b, excites the first output signal transducer 44 , to produce a first output signal 60 .
- the transmitter circuitry 40 is also connected to the second output signal transducer 28 through leads 46 a and 46 b, and excites the second output signal transducer 28 , to produce a second output signal 58 .
- the second output signal 58 pulse train has a periodic frequency of 50 pulses per second.
- FIG. 6 is a detailed cutaway view of the pointing tip 36 of a transmitter pen 30 having a first output signal transducer 44 and a second output signal transducer 28 .
- FIG. 7 is a partial perspective view of the pointing tip 36 of a transmitter pen 30 having a plurality of first output signal transducers 44 and a single piezoelectric second output signal transducer 28 .
- An optional finger guard 38 protects the first output signal transducers 44 and the second output signal transducer 28 .
- FIG. 8 is schematic view 50 of the transmission of the combined output signal 16 , which is comprised of a first output signal 60 and a second output signal 58 .
- the first output signal 60 is typically an infrared output signal 60 , which is transmitted from one or more infrared transducers 44 located near the pointing tip 36 of the transmitter pen 30 .
- FIG. 9 shows a single short pulse waveform 66 of a typical first output signal 60 sent from a transmitter pen 30 .
- the infrared transducers 44 are Part No. SFH426, manufactured by Siemens Microelectronics, Inc., of Cupertino, Calif.
- infrared transducer 44 While only one infrared transducer 44 is required, the use of more than one infrared transducer 44 is preferred, since it allows better line-of-sight transmission of the first output signal 60 to each of the external receivers 18 , such that the transmitter pen 30 can be rotated by the user.
- the second output signal 58 is typically an ultrasound output signal 58 , which is transmitted from one or more ultrasound transducers 28 located near the pointing tip 36 of the transmitter pen 30 .
- the ultrasound transducer 28 is a cylindrical layered piezoelectric layer 56 surrounded by an outer conductive layer 54 a and an inner conductive layer 54 b, which is connected to the transmitter circuitry 40 by leads 46 a and 46 b and lead connections 52 a and 52 b.
- the ultrasound transducer 28 used is Part No. AT/R 40-10P, manufactured by Nippon Ceramic Co. Ltd., of Tottori-Shi, Japan.
- FIG. 10 shows a first shaped pulse waveform 58 a and a second, subsequent shaped pulse waveform 58 b sent from a transmitter pen 30 .
- an ultrasound second output signal 58 can have any waveform shape, including a single ultrasound pulse 72 , it is preferred that the waveform be shaped to have a short duration, with distinctive wave characteristics, which allows the waveform to be measured and compared accurately, to provide an accurate calculated position for the transmitter pen 30 on a frequent basis.
- the subsequent second output signals 58 a, 58 b each include two major pulses 72 a and 72 b, with specific timing between them.
- the short duration output signals 58 allow the transmitter pen 30 to send sequential output signals more frequently.
- the use of the short duration ultrasound output signal 58 with distinctive waveform characteristics 72 a, 72 b also allows the transmission of other information to be sent from the transmitter pen 30 to the external receivers 18 , as discussed below. While there are differences between the received amplitude of the subsequent second output signals 58 a and 58 b, each of the signals retain major features, such as waveform characteristics 72 a, 72 b, as well as wavelength dependent features, such as peaks 76 a, 76 b, 76 c, and 76 d. Comparison of these features between subsequent stored digitized output signals 58 a and current output signals 58 b allows the calculated transcribed path 82 of a transmitter pen 30 to be accurately determined, as discussed below.
- FIG. 11 is a top view 80 of a calculated transcribed path 82 of a transmitter pen 30 from sequential locations within the writing area 14 of a surface 12 .
- the receivers 18 are connected 55 to a signal processor 57 , which calculates successive X-Y locations 84 a, 84 b, . . . 84 n, in relation to a defined X-axis 24 and a Y-axis 26 .
- the successive X-Y locations 84 a, 84 b, . . . 84 n, and the defined path 82 can then be stored or transferred by the signal processor 57 .
- a functional area 85 is defined in the whiteboard 12 . Selective activation of the transmitter pen 30 within the functional area 85 is used to send function commands to the signal processor 57 , or to a computer 87 connected to the signal processor 57 . Function commands can be used to print the displayed image path 82 , save the image path 82 , create a new page, or to control functions on the connected computer 87 , such as by activating pull-down menus on a graphic-user interface (GUI) 89 on the connected computer 87 .
- GUI graphic-user interface
- a programmable control application 91 within the computer 87 communicates with the signal processor 57 , to control system options, such as waveform comparison algorithms, and the desired number of previous second output signals 58 a to be stored 158 and compared to current second output signals 58 b. Since the prior second output signals 58 a are captured and stored in a digital manner, the comparison between prior second output signals 58 a and current second output signals 58 b can be efficiently monitored or modified through the programmable control application software 91 .
- FIG. 12 shows a combined output signal 16 as it is sent from a transmitter pen 30 .
- the combined output signal 16 is comprised of a repeated transmission of a first output signal 60 , and a repeated transmission of a second output signal 58 .
- the repeated transmission of the first output signal 60 and the second output signal 58 are typically characterized by periods P 1 and P 2 , respectively. While the period P 1 of the first output signal 60 and the period P 2 of the second output signal 58 are typically equal, the periods P 1 and P 2 do not have to be the same.
- the infrared output signal 60 and the ultrasound output signal 58 are transmitted by the transmitter pen 30 at the same time. In this embodiment, therefore, the ultrasound output signal 58 arrives at each of the external receivers 18 later than the infrared output signal 60 .
- FIG. 13 shows the combined output signal 16 as it arrives at a first external receiver 18 a.
- FIG. 14 shows the same combined output signal 16 as it arrives at a second, further, external receiver 18 b.
- the distance between the first output signal 60 typically comprising one or more infrared pulses 66
- the second output signal 58 typically an ultrasound waveform, acts to define the relative time to travel to different external receivers 18 .
- the accuracy of the location of the transmitter pen 30 is therefore dependent on the accuracy with which the signal processor 57 connected to the receivers 18 can consistently determine the distance in time between the first output signal 60 and a repeatable reference point 77 (FIG. 10) of the second output ultrasound signal waveform 58 .
- Any repeatable reference point 77 on the second output ultrasound signal waveform 58 is sufficient to compare a second output ultrasound signal waveform 58 to stored second output ultrasound signal waveforms 58 a, as long as the repeatable reference point 77 is consistently identified on the current second output ultrasound signal waveform 58 b and on the stored prior second output ultrasound signal waveforms 58 a.
- the crossing time threshold 73 indicates a starting point for the repeated ultrasound output signals 58 .
- it is preferred to use a linearly decaying ultrasound threshold 73 since the amplitude of the ultrasound signal 58 falls off like 1/r with distance.
- N the number of receivers 18 (where N ⁇ 2), as shown in FIG. 13 and FIG. 14, the ultrasound signal 58 is received at two or more external receivers 18 .
- the signal processor 57 finds a repeatable reference point 77 on the ultrasound output signal 58 a, 58 b, which in one embodiment lies between the threshold crossing 73 and the second peak 76 b.
- a threshold value 75 of 0.5 volts is used to determine points along the subsequent output signals 58 a, 58 b.
- the first point along the first output signal 58 a to cross the threshold value is located along the first peak 76 a.
- the first point along the second output signal 58 b to cross the threshold value 75 is located along the second peak 76 b. Since subsequent output signals 58 a, 58 b typically have different amplitudes, arbitrary measurement of a threshold 75 to determine a reference point 77 can yield differences between subsequent signal 58 on the order of a wavelength.
- the signal processor 57 stores a prior output signal 58 a, and compares repeatable features between the present second output signal 58 b and the stored prior second output signal 58 a.
- Repeatable features that are distinguishable typically include the shape of major peaks 72 a, 72 b and minor peaks 76 a, 76 b, interpeak spacing, and the relative amplitude of the major peaks 72 a, 72 b and minor peaks 76 a, 76 b.
- the prior output signal 58 a is stored, any or all features can be analyzed and compared, to determine an accurate repeatable reference point 77 . Even the combined relationship between sets of features can be compared.
- the current output signal 58 b and one or more stored prior output signals 58 a are energy-normalized, such that individual peaks 72 , 76 are fit to each other between the current output signal 58 b and the stored prior output signals 58 a.
- the normalized output signals are then compared for features that do not depend on the amplitude of separate points on the signals 58 a, 58 b, but on the relationship between features.
- the signal processor 57 adjusts the actual threshold crossing on peak 76 b on the present output signal 58 b by the period of one wavelength, to establish an adjusted threshold crossing 77 that is consistent with the features of the stored signal 58 a. In this manner, the signal processor 57 typically uses the previously received and stored pulse 58 a, from the same receiver 18 , to determine the repeatable reference point 77 on the current ultrasound signal 58 .
- This comparison is also performed for the present output signal 58 b and the prior output signal 58 a for each of the receivers 18 .
- the output signal 58 a is preferably stored 158 for each receiver location 18 , to provide an accurate comparison for subsequent output signals 58 arriving at each receiver location 18 .
- the current ultrasound signal 58 b for each receiver 18 together with the detected start of the signal reference points 73 and repeatable points 77 , are then stored within memory 158 for analysis of subsequent output signals 58 .
- a plurality of prior signals 58 a, with reference points 73 , 77 can be used to determine repeatable features 77 of the current second output signal 58 a.
- a limited number of previous ultrasound signals 58 a from each receiver 18 are typically stored, to conserve memory space within memory 158 .
- D is the distance between receivers 18 , in units of time taken for the ultrasound signal 58 to travel from one receiver 18 to another receiver 18 .
- Prior analog systems are inherently limited to “on the fly” comparison between a current signal burst and a small amount of amplitude information from a single prior signal. Since analog systems do not store the entire prior signal bursts in memory, they are limited to the comparison of a small number of features on the last prior signal.
- the transmitter pen location system 10 advantageously stores one or more prior signals 58 a, allowing the comparison of a large number of features between the current second output signal 58 b and one or more prior second output signals 58 a.
- FIG. 15 is a perspective view showing changes in transmitter pen orientation in relation to external receivers 18 a, 18 b, which can significantly alter the received waveform of the second output signal 58 as it arrives at external receivers 18 .
- the amplitude of the incoming waveform 58 can change significantly from the distance to each of the receivers 18 a, 18 b.
- FIG. 16 a top view showing the directional reception characteristics 99 a, 99 b of one embodiment of second output sensors 27 a, 27 b at external receivers 18 a, 18 b.
- the receivers 18 a, 18 b are typically placed at an angle of approximately 45 degrees in relation to a rectangular writing area 14 , to improve signal detection of the second output signal 58 .
- the storage of the received signal 58 to memory allows signal processing comparison techniques between the current second output signal 58 b and the stored waveform 58 a to be performed, such as by cross-correlation methods.
- An accurate comparison between the features of the present 58 b and prior second output signals 58 a can therefore be made.
- the second output signals 58 b arrive at the signal processor 57 , they are preferably normalized to prior stored signals 58 a.
- the received second output signals 58 b and one or more stored second output signals 58 a are normalized to each other, a valid comparison an be made between the normalized output signals 58 a, 58 b.
- the received second output signals 58 b and one or more stored second output signals 58 a have widely varying signal strengths, it is still possible to cross-correlate features between the normalized paths, rather than to compare the amplitude of a limited number of data points.
- preferred embodiments of the transmitter pen location system 10 allow changes to the comparison of features between the current second output signal 58 b and one or more stored prior second output signals 58 a.
- the programmable control application 91 (FIG. 11) is typically controllable and updatable, allowing the signal processor 57 to be updated, and to be easily adapted to different transmitter pens 30 , different surfaces 12 , and different receivers 18 .
- the output signal characteristics of the circuitry 40 and characteristic transmitter output signals 58 , 60 can optionally communicate secondary information to the external receivers 18 .
- Such supplementary information can include pen activation status, or pen types, such as different colored pens, or for pens of different widths, or even for calculated line types, such as for dashed lines.
- the transmitter pens 30 can optionally communicate the designated user of each transmitter pen 30 .
- FIG. 17 shows a typical first output signal 60 for a transmitter pen 30 in a “pen up” position 68 a.
- the first output signal 60 is modified to designate whether the pen is inactivated in a first “pen up” position 68 a, or in an activated second “pen down” position 68 b.
- the output signal 60 includes a single infrared pulse 66 a to designate a “pen up” position 68 a.
- the first output signal 60 includes two closely space infrared pulses 66 a and 66 b to designate a “pen down” position 68 b, as shown in FIG. 18.
- the signal processor determines that the transmitter pen 30 is currently in its “pen up” position 68 a.
- the “pen up” position 68 a typically means that the pointing tip 36 of the transmitter pen 30 is not in contact with either the writing area 14 of the surface 12 , or with another writing surface placed within the writing area 14 , such as a piece of paper.
- the signal processor 57 is also able to determine the X-Y coordinate of the transmitter pen 30 while the transmitter pen 30 is in the pen-up position 68 a.
- the signal processor 57 determines that the pen 30 is currently in its “pen down” position 68 b, and the X-Y coordinate of the pen 30 is also determined.
- the “pen down” position 68 b typically means that the pen tip 36 is in contact with either the writing area 14 of the surface 12 , or with another writing surface placed within the writing area 14 , such as a piece of paper.
- Transmitter pens 30 can optionally include circuitry 40 for a given pen “type”, or can include switching or continuous adjustment control to produce a transmitter signal 58 , 60 for different pen attributes.
- a transmitter pen 30 which contains a single writing tip 36 having one color of ink, such as black ink, may be selectively adjusted by the user to produce output signals 58 , 60 that correspond to drawn paths 82 of varying colors, widths, or line styles. While the user draws or writes upon a writing surface 14 of a surface 12 , such as a white board 12 , displaying a black path 82 (FIGS. 4,11), such as figures or letters, the transmitted and processed signal for the path 82 is dependent upon the pen characteristics chosen by the user.
- the first input signal 60 can optionally provide supplementary information to the receivers 18 .
- FIG. 19 shows a first output signal 60 that indicates a pen up position 68 a, using a single pulse 66 a, and encoded supplementary information 66 c - 66 e.
- FIG. 20 shows a first output signal that indicates a pen down position 68 b, using a two pulses 66 a, 66 b, and encoded supplementary information 66 c - 66 e.
- the supplementary information 66 c - 66 e provides bit information, which defines pen characteristics, such as designated color, width, line type, or user identification (e.g. author).
- FIG. 23 shows a selective attribute transmitter pen 130 which includes a pen attribute switch 144 .
- the attribute switch is connected to the signal circuitry 40 within the transmitter pen 130 , and controllably alters the transmission of the encoded supplementary information 66 c - 66 e within combined output signals 16 .
- the characteristics or attributes of the transmitter pen 30 are thereby selectively activated by the user, through one or more buttons or switches 144 , which control or define the encoded supplementary information 66 c - 66 e.
- the determined color for a transmitter pen 30 can either be encoded in the first output signal 60 , such as within multiple infrared pulses 66 a - 66 e, or within the second output signal 58 , such as within distinct waveshapes 72 a, 72 b (FIG. 10).
- the time between the pen activation pulses 66 a, 66 b and the secondary information pulses 66 c - 66 e can span a time that is specific to a particular pen color.
- a first pulse delay between the pen activation pulses 66 a, 66 b and the secondary information pulses 66 c - 66 e can specify a pen color of black
- a different pulse delay between the pen activation pulses 66 a, 66 b and the secondary information pulses 66 c - 66 e can specify a pen color of blue.
- a time line 64 is broken up into discreet windows 71 a - 71 d, wherein the presence or absence of an infrared pulse 66 c - 66 e indicates a binary “0” or “1”, which can be combined with pulses within other windows 71 a - 71 d along the time line 64 , to specify a pen color or type.
- the presence of an infrared signal pulse 66 within a window 71 is identified as a bit within a number.
- the first window 71 a of 0-25 ms is used to start the first output signal 60 , in relation to the second ultrasound signal 58 within a combined signal pair 16 .
- the three-bit number is chosen to represent pen color or type.
- the binary number for the 25-50 ms window 71 b is a “0”; the binary number for the 50- 75 ms window 71 c is a “1”; and the binary number for the 75-100 ms window 71 d is a “1”.
- the same “green” transmitter pen 30 is shown in the down position 68 b in FIG. 20.
- the distance D between receivers 18 can either be set once, such as for receivers 18 that are mounted a fixed distance from each other, or can be periodically set, such as for receivers 18 that can be remounted at different positions.
- the distance D between fixed receivers 18 can be stored within the signal processor 57 .
- FIG. 21 is an alternate embodiment 90 of the transmitter pen location system 10 c, in which the receivers 18 a, 18 b are movable, wherein a calibration transmitter 92 is added at one receiver location 18 b, providing automatic self-calibration for the system 10 b.
- An auto-calibration transmission signal 94 is sent from the receiver location 18 b, and is received at another receiver location 18 a.
- the signal processor 57 analyzes the incoming auto-calibration transmission signal 94 , and determines the distance D between the receivers 18 a, 18 b.
- a wireless connection is provided between the receivers 18 a, 18 b and the signal processor 57 , wherein information data signals 96 a, 96 b are transmitted from the receivers 18 a, 18 b to the signal processor 57 .
- FIG. 22 is an alternate embodiment 110 of the transmitter pen location system 10 d, which shows the geometric relationship between a transmitter pen 30 and three external receivers 18 a, 18 b, 18 c.
- the calculated position of the pen 30 shown as the intersection of three arc lengths 23 a, 23 b and 23 c.
- Small variations in distance D between receivers 18 can also be calibrated by the signal processor 57 . This can be useful for many conditions, such as the variation of the speed of sound in different ambient environments (e.g. temperature, barometric pressure, relative humidity).
- the signal processor 57 determines that there is a problem with one or more of the time estimates t i .
- the signal processor 57 can also average the known distance D with the calculated distance D between receivers 18 , to adaptively change the value of D.
- transmitter pen location system and its methods of use are described herein in connection with computer input systems, the techniques can be implemented for other control or display devices, or any combination thereof, as desired.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Length Measuring Devices Characterised By Use Of Acoustic Means (AREA)
- Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
Abstract
Description
- This application is a divisional of U.S. patent application Ser. No. 09/165,748 filed Oct. 2, 1998 (EFIM0039).
- The invention relates to the field of location algorithms for remote devices. More particularly, the invention relates to an algorithm system for determining the position of an electronic pointing device.
- Digitizing pen and whiteboard systems are used for a variety of electronic applications. These systems typically include a whiteboard, a position indicating pen, and associated electronics for determining the interaction between the whiteboard and the position indicating pen. A digital data signal is typically derived to represent the relative position of the position indicating pen and the whiteboard.
- When a signal, such as ultrasound, is used as a location signal for a remote device, it is often difficult to determine the location of the device accurately, since it is difficult to determine where upon each of sequential long wavepulses to measure, as a determination of the time of arrival to external receivers.
- I. Gilchrist,Acoustic Mouse System, U.S. Pat. No. 5,144,594 (Sep. 3, 1992) discloses an acoustic mouse system, which “controls indications on an X-Y surface of the face of a display. The system comprises at least three acoustic receivers in an x-y plane, and a hand movable acoustic transmitter that is movable both parallel to the x-y plane and in a z direction perpendicular to the x-y plane. The transmitter generates periodic acoustic oscillations in the direction of the support and its receivers. Detection circuitry, responsive to the signals from the acoustic receivers, provides signals indicative of the absolute position of the acoustic transmitter in the x-y plane. A processor is responsive to the signals from the detection circuitry to provide absolute position signals to the display, whereby the display responds by moving an indication to a corresponding position on the X-Y surface of the display face. The detector circuitry is further enabled to provide z position signals to the display, whereby the display may modify a display function in accordance with the z position signals”. While Gilchrist discloses a generic, periodic acoustic wavelength position indicating system, Gilchrist fails to disclose a useful algorithm by which the position of the movable acoustic transmitter is determined. Furthermore, the system apparently requires a minimum of three acoustic receivers to properly locate the movable acoustic transmitter, and a minimum of four acoustic receivers to calibrate the system. Gilchrist also fails to disclose waveform analysis techniques which can be used to provide even greater accuracy in the determination of the movable acoustic transmitter. While Gilchrist discloses the preferred use of an infrared transmitter to transmit a mouse command signal or a control signal, Gilchrist fails to disclose the use of a combined signal, comprising a repeated infrared signal coupled to a repeated ultrasound signal, to more accurately locate a movable transmitter device.
- M. Stefik and C Heater,Ultrasound Position Input Device, U.S. Pat. No. 4,814,552 (Mar. 21, 1989) discloses an “input device, or stylus, for entering hand drawn forms into a computer using a writing instrument, a pressure switch for determining whether the instrument is in contact with the writing surface, an acoustic transmitter for triangulating the position of the stylus on the surface, and a wireless transmitter for transmitting data and timing information to the computer. In operation, the stylus transmits an infrared signal which the system receives immediately, and an ultrasound pulse which two microphones receive after a delay which is a function of the speed of sound and the distance of the stylus from the microphone”. While Stefik et al. discloses an algorithm to analyze the incoming ultrasound signals to locate the stylus, the algorithm computes radii to each of the two microphones using information from only a single sonic pulse sample, translates the two radii into a calculated X,Y location, and then filters the calculated X,Y values, removing them from the described path if they vary from a specified limit, or range.
- B. Edwards,Ultrasound Position Locating Method and Apparatus Therefor, U.S. Pat. No. 5,142,506 (Aug. 25, 1992) discloses a “positional locating method and apparatus for measuring distances by accurately determining the transit time of ultrasonic wave bursts between two or more points”. “Timer clocks are started when each of the bursts is triggered to be emitted from a transmission point, and are stopped when a highly defined point in the burst is received at a corresponding receiving point. The highly defined point is determined by first analyzing the burst to identify a particular cycle within the burst. The particular cycle is then analyzed to detect the specific point within the cycle”.
- While Edwards typically uses multiple receivers to locate a transmitter using ordinary trigonometric calculations, the analog system is limited to the comparison of amplitude between a small number of measured peaks on successive cycles within “bursts” of the received ultrasonic waveform. Common variations of the waveform, typically due to ordinary use of a transmitter, either from the orientation of the transmitter to the receivers, the speed at which the transmitter is moved between different regions of a writing surface, the signal strength of the transmitted signal, or noise, can result in erroneous results. Reliance on the amplitude of a specific cycle within a pulse waveform can lead to errors of one or more cycles, resulting in position detection errors of several centimeters. Errors in such an analog system commonly result either in an inaccurate determined location for the transmitter, or in a determined location point which is required to be “thrown out” from the described path of the movable transmitter. As well, the analog system used inherently limits the type of comparison between the amplitude of selected cycle peaks within signal “bursts” within a prior output signal and a current output signal, thus preventing the analog system to being easily adaptable to hardware embodiments or improved waveform comparison techniques.
- The disclosed prior art systems and methodologies thus provide basic transmitter pen and whiteboard positioning systems for determining the spatial relationship between a pen and a writing area, but fail to provide an accurate means for determining the position of the tip of the pen. It would be advantageous to provide a more accurate and reliable means to calculate the distance from a transmitter pen to external receivers, to improve the resolution of the pen by increasing the number of valid position data points, and to improve the precision and smoothness of a described path. It would also be advantageous to provide a means to store prior output signals, allowing the comparison of one or more features between the current output signal waveform and one or more prior output signal waveforms. In addition, it would also be advantageous to provide a means to customize or change the comparison between the current output signal waveform and one or more prior output signal waveforms. The development of such a transmitter pen positioning system would constitute a major technological advance.
- A transmitter pen location system is provided, in which a pen is adapted to send a plurality of repeated output signals to two or more external receivers, wherein the location of the pointing tip of the pen is determined in relation to the writing area of a surface. A first output element, preferably an infrared transducer, transmits a first output signal from the transmitter pen. A second output element, preferably an ultrasonic transducer, transmits a second output signal from the transmitter pen to two or more receivers. In a basic embodiment, the first output signal arrives at one or more receivers generally concurrently. The second output signal, transmitted from the transmitter pen at a known time in relation to the first output signal, arrives at each of the receivers at a time which is dependent on the speed of propagation of the second signal. The location of the pointing tip of the transmitter pen is then determined, by using the first signal as a boundary condition, comparing the second signal to one or more stored prior second signals to determine the time of arrival of the second signal at each of the receivers, determining the distance from the pen to each of the receivers using the arrival time of the second signal compared to the arrival time of the first output signal, and then calculating a location for the pen which is consistent with the calculated distance to each of the external receivers. Alternative embodiments allow the transmission of supplementary information from the transmitter pen to the receivers, using either the first and/or second output signals.
- FIG. 1 is a top view of a transmitter pen location system, in which a transmitter pen is located within the writing area of a surface, and in which the transmitter pen periodically sends a combined output signal to external receivers;
- FIG. 2 shows the geometric relationship between a transmitter pen and two external receivers, with the calculated position of the pen is shown as the intersection of arc lengths;
- FIG. 3 is a partial top view of external receivers located on a surface;
- FIG. 4 is a perspective view of an alternate embodiment of the transmitter pen location system, in which a transmitter pen is located within a writing volume, and in which the transmitter pen periodically sends a combined output signal to external receivers;
- FIG. 5 is a partial cutaway view of a transmitter pen having a first output signal transducer and a second output signal transducer;
- FIG. 6 is a detailed cutaway view of the pointing tip of a transmitter pen having a first output signal transducer and a second output signal transducer;
- FIG. 7 is a partial perspective view of the pointing tip of a transmitter pen having a plurality of first output signal transducers and a single second output signal transducer;
- FIG. 8 is schematic view of the transmission of first output signal and a second output signal from a transmitter pen;
- FIG. 9 shows a short pulse waveform of a typical first output signal sent from a transmitter pen;
- FIG. 10 shows a shaped pulse waveform of one embodiment of a second output signal sent from a transmitter pen;
- FIG. 11 shows a calculated transcribed path of a transmitter pen from sequential locations, and a defined functional area, within the writing area of a surface;
- FIG. 12 shows a repeated combined output signal as it is sent from a transmitter pen;
- FIG. 13 shows a combined output signal as it arrives at a first external receiver;
- FIG. 14 shows a combined output signal as it arrives at a second external receiver;
- FIG. 15 is a perspective view showing changes in transmitter pen orientation which can alter the received waveform of the second output signal as it arrives at an external receiver;
- FIG. 16 a top view showing the directional reception characteristics of one embodiment of second output sensors at external receivers;
- FIG. 17 shows a first output signal that includes encoded information which indicates a pen up position;
- FIG. 18 shows a first output signal that includes encoded information which indicates a pen down position;
- FIG. 19 shows a first output signal that includes encoded information which indicates a pen up position and supplementary information;
- FIG. 20 shows a first output signal that includes encoded information which indicates a pen down position and supplementary information;
- FIG. 21 is an alternate embodiment of the transmitter pen location system, having movable receivers, an automatic-calibration transmitter, and wireless communication between the receivers and the signal processor;
- FIG. 22 shows the geometric relationship between a transmitter pen and three external receivers, with the calculated position of the pen shown as the intersection of three arc lengths; and
- FIG. 23 shows a transmitter pen having a selective function button.
- FIG. 1 is a top view of a transmitter
pen location system 10 a, in which atransmitter pen 30 located within the writingarea 14 of asurface 12, in which thetransmitter pen 30 repeatedly sends a combinedoutput signal 16 toexternal receivers 18. Thesurface 12 is typically a whiteboard, a blackboard, a drafting table or an overhead projector, or any kind of presentation surface. FIG. 2 shows thegeometric relationship 20 between atransmitter pen 30 and twoexternal receivers transmitter pen 30 represented in relation to an X-axis 24 and a Y-axis 26, as discussed below. - FIG. 3 is a partial top view of
external receivers 18 located on asurface 12. The firstexternal receiver 18 includes a firstoutput signal sensor 25 and a secondoutput signal sensor 27 a, and includes asignal connection 55 a towards a signal processor 57 (FIG. 11). The secondexternal receiver 18 includes a second output signal sensor 27 b, and also includes asignal connection 55 b to thesignal processor 57. - FIG. 4 is a perspective view of an alternate embodiment of the transmitter
pen location system 10 b, in which atransmitter pen 30 is located within a writingvolume 14 b, and in which thetransmitter pen 30 periodically sends a combinedoutput signal 16 toexternal receivers transmitter pen 30 and theexternal receivers transmitter pen 30 describe apath 82, in relation to anX-axis 24, a Y-axis 26, and a Z-axis 29. - The
transmitter pen 30 hasmultiple transducer elements 28,44 (FIGS. 5-7), which are used to determine the location of the pointing tip of thetransmitter pen 30, in relation to awriting area 14 a, or to a writingvolume 14 b, of a transmitterpen location system 10. Thefirst output element 44, preferably an electromagnetic orinfrared transmitter 44, transmits afirst output signal 60 from thetransmitter pen 30 to first output signal sensors 25 (FIG. 3) at one or more of theexternal receivers 18. In one embodiment, the firstoutput signal sensors 25 are infrared photodiodes, Part No. SFH 205FA, manufactured by Siemens Microelectronics, Inc., of Cupertino, Calif. Thesecond output transducer 28 transmits asecond output signal 58 from thetransmitter pen 30 to second output signal sensors 27 at theexternal receivers 18. In one embodiment, the second output signal sensors 27 are ultrasound sensors, Part No. AT/R 40-10P, manufactured by Nippon Ceramic Co. Ltd., of Tottori-Shi, Japan. In this embodiment, thesecond output transducer 28 on thetransmitter pen 30 is anultrasonic transmitter 28. - In an embodiment where each
receiver 18 includes afirst output sensor 25, thefirst output signal 60, which is repeatedly transmitted from thetransmitter pen 30, typically in a periodic manner, arrives at each of thereceivers 18 generally concurrently. Since thefirst output signal 60 arrives at one or morefirst output sensors 25 generally concurrently, only onefirst output sensor 25 is typically required, and is typically located at one of theexternal receivers 18, or at another external point near the periphery of thewriting area 14. - A slower
second output signal 58, which is also repeatedly transmitted from thetransmitter pen 30, typically in a periodic manner, at a known time in relation to thefirst output signal 60, arrives at theexternal receivers 18 at a time which is dependent on the velocity of thesecond output signal 58. The transmission of thesecond output signal 58 can either be before, after, or concurrent with the transmission of thefirst output signal 60, as long as there is a known time between the transmission of the output signals 58, 60. - The velocity of propagation of the first output signals60 and the second output signals 58 are required to be different, so that time span between the arrival of the first output signals 60 and the second output signals 58 at each of the
external receivers 18 is dependent on the relative distance between thetransmitter pen 30 and each of theexternal receivers 30. - In one embodiment, the
first output signal 60 is aninfrared signal 60, and thesecond output signal 58 is anultrasound signal 58. In this embodiment, therefore, the propagation velocity of thesecond output signal 58 is lower than that of thefirst output signal 60. - When a combined
signal 16, comprising afirst output signal 60 and asecond output signal 58, arrives at each of thereceivers 18, the combinedsignal 16 is sampled, and is then transferred to a signal processor 57 (FIG. 11). The location of the pointing tip 36 (FIGS. 5-7) of thetransmitter pen 30 is then determined by thesignal processor 57, using thefirst signal 60 as a boundary condition, by solving for calculated distances to each of thereceivers 18 using thesecond output signal 58, and then by determining a location of the pen based on the calculated distances to thereceivers 18. - As shown in FIG. 2, the distance d1 to the first
external receiver 18 a is determined by the relative time of reception of asecond output signal 58 and afirst output signal 60 within a combinedsignal pair 16. The distance d1 defines acircular arc 23 a of possible X,Y locations for thetransmitter pen 30. The distance d2 to the secondexternal receiver 18 b is determined by the relative time of reception of thesecond output signal 58 and thefirst output signal 60 within the same combinedsignal pair 16. The distance d2 thus defines a secondcircular arc 23 b of possible X,Y locations for thetransmitter pen 30, in relation to thesecond receiver 18 b. The (X1,Y1) position of thetransmitter pen 30 is shown, and is calculated, as theintersection 22 of possible X,Y locations given by thefirst arc 23 a and thesecond arc 23 b within the writingarea 14. - The transmitter pen location process, which uses the transmitted combined
output signal 16 to locate thetransmitter pen 30 relative to thewriting area 14 of asurface 12, comprises the following steps: - i) sending a
first output signal 60 having a first time of propagation from thetransmitter pen 30 repeatedly to at least one of a plurality ofexternal receivers 18; - ii) sending a
second output signal 58, having a time of propagation different from the time of propagation of thefirst output signal 60, repeatedly from thetransmitter pen 30 to the plurality ofexternal receivers 18; - iii) comparing the
second output signal 58 b received at each receiver to a stored priorsecond output signal 58 a received at eachreceiver 18 to determine the time of arrival of thesecond output signal 58 at each receiver; - iv) determining the distance from the
transmitter pen 30 to each of the plurality ofexternal receivers 18 based on the time of arrival of thefirst output signal 60 and thesecond output signal 58 b; and - v) determining the location of the
transmitter pen 30 based upon the determined distance from thetransmitter pen 30 to each of the plurality ofexternal receivers 18. - The transmitter pen location process then preferably stores158 (FIG. 11) the received second output signals 58 b received at each of the
receivers 18, typically replacing the prior second output signals 58 a, whereby the process is repeated for the next receivedcombined output signal 16. In another preferred embodiment, precision is improved further, by storing more than one previous secondoutput signal pulse 58, and by comparing the incomingsecond output signal 58 b to a plurality of prior second output signals 58 a. - FIG. 5 is a partial cutaway view of a
transmitter pen 30 having a firstoutput signal transducer 44 and a secondoutput signal transducer 28. While thetransmitter pen 30 is described as a pen, it can be any sort of movable transmitter device. Thetransmitter circuitry 40, connected to the first output signal transducer through leads 42 a and 42 b, excites the firstoutput signal transducer 44, to produce afirst output signal 60. Thetransmitter circuitry 40 is also connected to the secondoutput signal transducer 28 throughleads output signal transducer 28, to produce asecond output signal 58. In one embodiment, thesecond output signal 58 pulse train has a periodic frequency of 50 pulses per second. - FIG. 6 is a detailed cutaway view of the
pointing tip 36 of atransmitter pen 30 having a firstoutput signal transducer 44 and a secondoutput signal transducer 28. FIG. 7 is a partial perspective view of thepointing tip 36 of atransmitter pen 30 having a plurality of firstoutput signal transducers 44 and a single piezoelectric secondoutput signal transducer 28. Anoptional finger guard 38 protects the firstoutput signal transducers 44 and the secondoutput signal transducer 28. - FIG. 8 is
schematic view 50 of the transmission of the combinedoutput signal 16, which is comprised of afirst output signal 60 and asecond output signal 58. - The
first output signal 60 is typically aninfrared output signal 60, which is transmitted from one or moreinfrared transducers 44 located near thepointing tip 36 of thetransmitter pen 30. FIG. 9 shows a singleshort pulse waveform 66 of a typicalfirst output signal 60 sent from atransmitter pen 30. In one embodiment, theinfrared transducers 44 are Part No. SFH426, manufactured by Siemens Microelectronics, Inc., of Cupertino, Calif. While only oneinfrared transducer 44 is required, the use of more than oneinfrared transducer 44 is preferred, since it allows better line-of-sight transmission of thefirst output signal 60 to each of theexternal receivers 18, such that thetransmitter pen 30 can be rotated by the user. - The
second output signal 58 is typically anultrasound output signal 58, which is transmitted from one ormore ultrasound transducers 28 located near thepointing tip 36 of thetransmitter pen 30. In one embodiment, theultrasound transducer 28 is a cylindrical layeredpiezoelectric layer 56 surrounded by an outerconductive layer 54 a and an innerconductive layer 54 b, which is connected to thetransmitter circuitry 40 byleads connections ultrasound transducer 28 used is Part No. AT/R 40-10P, manufactured by Nippon Ceramic Co. Ltd., of Tottori-Shi, Japan. - FIG. 10 shows a first shaped
pulse waveform 58 a and a second, subsequent shapedpulse waveform 58 b sent from atransmitter pen 30. While an ultrasoundsecond output signal 58 can have any waveform shape, including a single ultrasound pulse 72, it is preferred that the waveform be shaped to have a short duration, with distinctive wave characteristics, which allows the waveform to be measured and compared accurately, to provide an accurate calculated position for thetransmitter pen 30 on a frequent basis. In the preferred embodiment shown in FIG. 10, the subsequent second output signals 58 a, 58 b each include twomajor pulses transmitter pen 30 to send sequential output signals more frequently. The use of the short durationultrasound output signal 58 withdistinctive waveform characteristics transmitter pen 30 to theexternal receivers 18, as discussed below. While there are differences between the received amplitude of the subsequent second output signals 58 a and 58 b, each of the signals retain major features, such aswaveform characteristics peaks path 82 of atransmitter pen 30 to be accurately determined, as discussed below. - FIG. 11 is a
top view 80 of a calculated transcribedpath 82 of atransmitter pen 30 from sequential locations within the writingarea 14 of asurface 12. As thetransmitter pen 30 is moved by a user across the writingarea 14 of thesurface 12, the repeated transmission of combined output signals 16 is received at theexternal receivers 18. Thereceivers 18 are connected 55 to asignal processor 57, which calculates successiveX-Y locations X-axis 24 and a Y-axis 26. The successiveX-Y locations path 82 for thetransmitter pen 30. The successiveX-Y locations path 82 can then be stored or transferred by thesignal processor 57. - In a preferred embodiment, a
functional area 85 is defined in thewhiteboard 12. Selective activation of thetransmitter pen 30 within thefunctional area 85 is used to send function commands to thesignal processor 57, or to acomputer 87 connected to thesignal processor 57. Function commands can be used to print the displayedimage path 82, save theimage path 82, create a new page, or to control functions on theconnected computer 87, such as by activating pull-down menus on a graphic-user interface (GUI) 89 on theconnected computer 87. - In another preferred embodiment, a
programmable control application 91 within thecomputer 87 communicates with thesignal processor 57, to control system options, such as waveform comparison algorithms, and the desired number of previous second output signals 58 a to be stored 158 and compared to current second output signals 58 b. Since the prior second output signals 58 a are captured and stored in a digital manner, the comparison between prior second output signals 58 a and current second output signals 58 b can be efficiently monitored or modified through the programmablecontrol application software 91. - FIG. 12 shows a combined
output signal 16 as it is sent from atransmitter pen 30. The combinedoutput signal 16 is comprised of a repeated transmission of afirst output signal 60, and a repeated transmission of asecond output signal 58. The repeated transmission of thefirst output signal 60 and thesecond output signal 58 are typically characterized by periods P1 and P2, respectively. While the period P1 of thefirst output signal 60 and the period P2 of thesecond output signal 58 are typically equal, the periods P1 and P2 do not have to be the same. - In the embodiment shown in FIGS. 12-14, the
infrared output signal 60 and theultrasound output signal 58 are transmitted by thetransmitter pen 30 at the same time. In this embodiment, therefore, theultrasound output signal 58 arrives at each of theexternal receivers 18 later than theinfrared output signal 60. FIG. 13 shows the combinedoutput signal 16 as it arrives at a firstexternal receiver 18 a. FIG. 14 shows the same combinedoutput signal 16 as it arrives at a second, further,external receiver 18 b. The distance between thefirst output signal 60, typically comprising one or moreinfrared pulses 66, and thesecond output signal 58, typically an ultrasound waveform, acts to define the relative time to travel to differentexternal receivers 18. - The accuracy of the location of the
transmitter pen 30 is therefore dependent on the accuracy with which thesignal processor 57 connected to thereceivers 18 can consistently determine the distance in time between thefirst output signal 60 and a repeatable reference point 77 (FIG. 10) of the second outputultrasound signal waveform 58. Anyrepeatable reference point 77 on the second outputultrasound signal waveform 58 is sufficient to compare a second outputultrasound signal waveform 58 to stored second outputultrasound signal waveforms 58 a, as long as therepeatable reference point 77 is consistently identified on the current second outputultrasound signal waveform 58 b and on the stored prior second outputultrasound signal waveforms 58 a. - In FIG. 10, the
crossing time threshold 73 indicates a starting point for the repeated ultrasound output signals 58. In embodiments where an ultrasoundsecond output signal 58 is used, it is preferred to use a linearly decayingultrasound threshold 73, since the amplitude of theultrasound signal 58 falls off like 1/r with distance. At times t1, t2, . . . tN,, where N equals the number of receivers 18 (where N≧2), as shown in FIG. 13 and FIG. 14, theultrasound signal 58 is received at two or moreexternal receivers 18. - The
signal processor 57 finds arepeatable reference point 77 on theultrasound output signal second peak 76 b. In FIG. 10, athreshold value 75 of 0.5 volts is used to determine points along the subsequent output signals 58 a, 58 b. As seen in FIG. 10, the first point along thefirst output signal 58 a to cross the threshold value is located along thefirst peak 76 a. In contrast, the first point along thesecond output signal 58 b to cross thethreshold value 75 is located along thesecond peak 76 b. Since subsequent output signals 58 a, 58 b typically have different amplitudes, arbitrary measurement of athreshold 75 to determine areference point 77 can yield differences betweensubsequent signal 58 on the order of a wavelength. - To provide a more accurate
repeatable reference point 77 on the presentultrasound output signal 58 b that lies between the threshold crossing 73 and thesecond peak 76 b, thesignal processor 57 stores aprior output signal 58 a, and compares repeatable features between the presentsecond output signal 58 b and the stored priorsecond output signal 58 a. Repeatable features that are distinguishable typically include the shape ofmajor peaks minor peaks major peaks minor peaks - Since the
prior output signal 58 a is stored, any or all features can be analyzed and compared, to determine an accuraterepeatable reference point 77. Even the combined relationship between sets of features can be compared. In a preferred embodiment, thecurrent output signal 58 b and one or more stored prior output signals 58 a are energy-normalized, such that individual peaks 72, 76 are fit to each other between thecurrent output signal 58 b and the stored prior output signals 58 a. The normalized output signals are then compared for features that do not depend on the amplitude of separate points on thesignals - In the example shown in FIG. 10, the
signal processor 57 adjusts the actual threshold crossing onpeak 76 b on thepresent output signal 58 b by the period of one wavelength, to establish an adjusted threshold crossing 77 that is consistent with the features of the storedsignal 58 a. In this manner, thesignal processor 57 typically uses the previously received and storedpulse 58 a, from thesame receiver 18, to determine therepeatable reference point 77 on thecurrent ultrasound signal 58. - This comparison is also performed for the
present output signal 58 b and theprior output signal 58 a for each of thereceivers 18. As the arrivingsecond output signal 58 is attenuated differently as it is transmitted and sent todifferent receivers 18, theoutput signal 58 a is preferably stored 158 for eachreceiver location 18, to provide an accurate comparison for subsequent output signals 58 arriving at eachreceiver location 18. - The
current ultrasound signal 58 b for eachreceiver 18, together with the detected start of thesignal reference points 73 andrepeatable points 77, are then stored withinmemory 158 for analysis of subsequent output signals 58. - For each
receiver 18, a plurality ofprior signals 58 a, withreference points repeatable features 77 of the currentsecond output signal 58 a. However, a limited number of previous ultrasound signals 58 a from eachreceiver 18 are typically stored, to conserve memory space withinmemory 158. - This is repeated for all
N receivers 18, giving N≧2 estimates of the time of propagation of the secondoutput ultrasound signal 58 b. The N≧2 second output signals 58 b, along with associatedreference points memory 158 as prior second output signals 58 a, for the analysis of subsequent second output signals 58 b. - The comparison of the currently received
output signal 58 b to previously received and stored output signals 58 a results in consistent time values, which yield consistent pen location values 84 a, 84 b, . . . 84 n that define a smooth path 82 (FIG. 11). -
- y=sqrt(t 1 ·t 1 −x·x) (2)
- in which D (FIG. 1) is the distance between
receivers 18, in units of time taken for theultrasound signal 58 to travel from onereceiver 18 to anotherreceiver 18. - Prior analog systems are inherently limited to “on the fly” comparison between a current signal burst and a small amount of amplitude information from a single prior signal. Since analog systems do not store the entire prior signal bursts in memory, they are limited to the comparison of a small number of features on the last prior signal.
- In contrast, the transmitter
pen location system 10 advantageously stores one or moreprior signals 58 a, allowing the comparison of a large number of features between the currentsecond output signal 58 b and one or more prior second output signals 58 a. - As well, the transmitter
pen location system 10 can accurately determine the location of thetransmitter pen 30, even when thesecond output signal 58 is significantly attenuated. FIG. 15 is a perspective view showing changes in transmitter pen orientation in relation toexternal receivers second output signal 58 as it arrives atexternal receivers 18. As discussed above, the amplitude of theincoming waveform 58 can change significantly from the distance to each of thereceivers second output signal 58, including theangular orientation transmitter pen 30 and theexternal receivers 18, theangle 96 of the inclinedmovable transmitter pen 30 against the surface of thewriting area 14, theaxial rotation 97 of the pen, and even the available source power to theoutput circuitry 40 within thetransmitter pen 30. FIG. 16 a top view showing thedirectional reception characteristics second output sensors 27 a, 27 b atexternal receivers receivers rectangular writing area 14, to improve signal detection of thesecond output signal 58. - Since the current
second output signal 58 b and one or more stored prior output signals 58 a are typically normalized to each other, and since detailed features between the currentsecond output signal 58 b and one or more stored prior output signals 58 a can be used for comparison, attenuation of theincoming signals pen location system 10 from accurately finding arepeatable reference point 77 between output signals 58 a, 58 b. - In contrast, prior art analog systems that rely on the comparison of a limited number of measured amplitudes of a limited number of points, such as the measured amplitudes of bursts or peaks, or an average of a limited number of peaks, will commonly fail to find a valid data point for the transmitter pen, particularly when consecutive output pulses are attenuated differently. This results either in erroneous positions (e.g. typically by missing a desired signal peak), or in requiring that position points are not used in the described path of a movable pointer, resulting in an inaccurate or erratic described path.
- In the present digital transmitter
pen location system 10, the storage of the receivedsignal 58 to memory allows signal processing comparison techniques between the currentsecond output signal 58 b and the storedwaveform 58 a to be performed, such as by cross-correlation methods. An accurate comparison between the features of the present 58 b and prior second output signals 58 a can therefore be made. As the second output signals 58 b arrive at thesignal processor 57, they are preferably normalized to prior stored signals 58 a. When the received second output signals 58 b and one or more stored second output signals 58 a are normalized to each other, a valid comparison an be made between the normalized output signals 58 a, 58 b. When the received second output signals 58 b and one or more stored second output signals 58 a have widely varying signal strengths, it is still possible to cross-correlate features between the normalized paths, rather than to compare the amplitude of a limited number of data points. - In addition, preferred embodiments of the transmitter
pen location system 10 allow changes to the comparison of features between the currentsecond output signal 58 b and one or more stored prior second output signals 58 a. The programmable control application 91 (FIG. 11) is typically controllable and updatable, allowing thesignal processor 57 to be updated, and to be easily adapted to different transmitter pens 30,different surfaces 12, anddifferent receivers 18. - The output signal characteristics of the
circuitry 40 and characteristic transmitter output signals 58, 60 can optionally communicate secondary information to theexternal receivers 18. Such supplementary information can include pen activation status, or pen types, such as different colored pens, or for pens of different widths, or even for calculated line types, such as for dashed lines. In systems where more than one user is writing on thewriting area 14 of thesurface 12, either sequentially of concurrently, the transmitter pens 30 can optionally communicate the designated user of eachtransmitter pen 30. - FIG. 17 shows a typical
first output signal 60 for atransmitter pen 30 in a “pen up”position 68 a. Thefirst output signal 60 is modified to designate whether the pen is inactivated in a first “pen up”position 68 a, or in an activated second “pen down”position 68 b. In FIG. 17, theoutput signal 60 includes a singleinfrared pulse 66 a to designate a “pen up”position 68 a. In the same embodiment, thefirst output signal 60 includes two closely spaceinfrared pulses position 68 b, as shown in FIG. 18. - When the “pen up”
signal 68 a is received by thereceiver 18, the signal processor determines that thetransmitter pen 30 is currently in its “pen up”position 68 a. The “pen up”position 68 a typically means that thepointing tip 36 of thetransmitter pen 30 is not in contact with either thewriting area 14 of thesurface 12, or with another writing surface placed within the writingarea 14, such as a piece of paper. Thesignal processor 57 is also able to determine the X-Y coordinate of thetransmitter pen 30 while thetransmitter pen 30 is in the pen-upposition 68 a. - When the “pen down”
signal 68 b is received by thereceiver 18, thesignal processor 57 determines that thepen 30 is currently in its “pen down”position 68 b, and the X-Y coordinate of thepen 30 is also determined. The “pen down”position 68 b typically means that thepen tip 36 is in contact with either thewriting area 14 of thesurface 12, or with another writing surface placed within the writingarea 14, such as a piece of paper. - As the
pen 30 is moved along apath 82 in the pen-down position 68 b, a series of combined output signals 16 are received and processed by thereceivers 18, from which successive X-Y coordinates are determined to produce a representation of thepath 82 of thetransmitter pen 30. - Transmitter pens30 can optionally include
circuitry 40 for a given pen “type”, or can include switching or continuous adjustment control to produce atransmitter signal transmitter pen 30 which contains asingle writing tip 36 having one color of ink, such as black ink, may be selectively adjusted by the user to produceoutput signals paths 82 of varying colors, widths, or line styles. While the user draws or writes upon awriting surface 14 of asurface 12, such as awhite board 12, displaying a black path 82 (FIGS. 4,11), such as figures or letters, the transmitted and processed signal for thepath 82 is dependent upon the pen characteristics chosen by the user. - As shown in FIG. 19 and FIG. 20, the
first input signal 60 can optionally provide supplementary information to thereceivers 18. FIG. 19 shows afirst output signal 60 that indicates a pen upposition 68 a, using asingle pulse 66 a, and encodedsupplementary information 66 c-66 e. FIG. 20 shows a first output signal that indicates a pen downposition 68 b, using a twopulses supplementary information 66 c-66 e. Thesupplementary information 66 c-66 e provides bit information, which defines pen characteristics, such as designated color, width, line type, or user identification (e.g. author). - FIG. 23 shows a selective
attribute transmitter pen 130 which includes apen attribute switch 144. The attribute switch is connected to thesignal circuitry 40 within thetransmitter pen 130, and controllably alters the transmission of the encodedsupplementary information 66 c-66 e within combined output signals 16. The characteristics or attributes of thetransmitter pen 30 are thereby selectively activated by the user, through one or more buttons or switches 144, which control or define the encodedsupplementary information 66 c-66 e. - The determined color for a
transmitter pen 30 can either be encoded in thefirst output signal 60, such as within multipleinfrared pulses 66 a-66 e, or within thesecond output signal 58, such as withindistinct waveshapes - There are various ways to include the pen color within the
first output signal 60. In the pulsedinfrared signal 60 shown in FIG. 15, the time between thepen activation pulses secondary information pulses 66 c-66 e can span a time that is specific to a particular pen color. For example, a first pulse delay between thepen activation pulses secondary information pulses 66 c-66 e can specify a pen color of black, while a different pulse delay between thepen activation pulses secondary information pulses 66 c-66 e can specify a pen color of blue. - In the embodiment shown in FIG. 19 and FIG. 20, a
time line 64 is broken up into discreet windows 71 a-71 d, wherein the presence or absence of aninfrared pulse 66 c-66 e indicates a binary “0” or “1”, which can be combined with pulses within other windows 71 a-71 d along thetime line 64, to specify a pen color or type. In this manner, the presence of aninfrared signal pulse 66 within a window 71 is identified as a bit within a number. - For example, in a three-bit number, three
windows 71 b-71 d of 25-50 ms, 50-75 ms, and 75-100 ms are used to specify pen color. In this embodiment, thefirst window 71 a of 0-25 ms is used to start thefirst output signal 60, in relation to thesecond ultrasound signal 58 within a combinedsignal pair 16. - In this embodiment, the three-bit number is chosen to represent pen color or type. Binary signals specify this supplementary information (e.g. 1=black; 2=red; 3=green; 4=blue). In the example shown in FIG. 19, the binary number for the 25-50
ms window 71 b is a “0”; the binary number for the 50- 75ms window 71 c is a “1”; and the binary number for the 75-100ms window 71 d is a “1”. This yields a binary number of “011”, or a “3”, which specifies a pen color of green for a transmitter pen in an “up”position 68 a. The same “green”transmitter pen 30 is shown in thedown position 68 b in FIG. 20. - The distance D between
receivers 18 can either be set once, such as forreceivers 18 that are mounted a fixed distance from each other, or can be periodically set, such as forreceivers 18 that can be remounted at different positions. The distance D betweenfixed receivers 18 can be stored within thesignal processor 57. - FIG. 21 is an alternate embodiment90 of the transmitter
pen location system 10 c, in which thereceivers calibration transmitter 92 is added at onereceiver location 18 b, providing automatic self-calibration for thesystem 10 b. An auto-calibration transmission signal 94 is sent from thereceiver location 18 b, and is received at anotherreceiver location 18 a. Thesignal processor 57 analyzes the incoming auto-calibration transmission signal 94, and determines the distance D between thereceivers receivers signal processor 57, wherein information data signals 96 a, 96 b are transmitted from thereceivers signal processor 57. - FIG. 22 is an
alternate embodiment 110 of the transmitterpen location system 10 d, which shows the geometric relationship between atransmitter pen 30 and threeexternal receivers pen 30 shown as the intersection of threearc lengths receivers 18 can also be calibrated by thesignal processor 57. This can be useful for many conditions, such as the variation of the speed of sound in different ambient environments (e.g. temperature, barometric pressure, relative humidity). From three time estimates (t1, t2 & t3) thesignal processor 57 calculates the distance between receivers 18 (dcalc) as: - If the calculated dcalc is significantly different from the known distance D between
receivers 18, thesignal processor 57 determines that there is a problem with one or more of the time estimates ti. Thesignal processor 57 can also average the known distance D with the calculated distance D betweenreceivers 18, to adaptively change the value of D. - Although the transmitter pen location system and its methods of use are described herein in connection with computer input systems, the techniques can be implemented for other control or display devices, or any combination thereof, as desired.
- Accordingly, although the invention has been described in detail with reference to a particular preferred embodiment, persons possessing ordinary skill in the art to which this invention pertains will appreciate that various modifications and enhancements may be made without departing from the spirit and scope of the claims that follow.
Claims (92)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/740,630 US20010000666A1 (en) | 1998-10-02 | 2000-12-18 | Transmitter pen location system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/165,748 US6335723B1 (en) | 1998-10-02 | 1998-10-02 | Transmitter pen location system |
US09/740,630 US20010000666A1 (en) | 1998-10-02 | 2000-12-18 | Transmitter pen location system |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/165,748 Division US6335723B1 (en) | 1998-10-02 | 1998-10-02 | Transmitter pen location system |
Publications (1)
Publication Number | Publication Date |
---|---|
US20010000666A1 true US20010000666A1 (en) | 2001-05-03 |
Family
ID=22600284
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/165,748 Expired - Lifetime US6335723B1 (en) | 1998-10-02 | 1998-10-02 | Transmitter pen location system |
US09/740,630 Abandoned US20010000666A1 (en) | 1998-10-02 | 2000-12-18 | Transmitter pen location system |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/165,748 Expired - Lifetime US6335723B1 (en) | 1998-10-02 | 1998-10-02 | Transmitter pen location system |
Country Status (5)
Country | Link |
---|---|
US (2) | US6335723B1 (en) |
EP (1) | EP1116171B1 (en) |
AU (1) | AU756022B2 (en) |
DE (1) | DE69942098D1 (en) |
WO (1) | WO2000021025A1 (en) |
Cited By (49)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020176577A1 (en) * | 2001-05-25 | 2002-11-28 | Intel Corporation | Digital signature collection and authentication |
US20020190963A1 (en) * | 2001-06-14 | 2002-12-19 | Koninklijke Philips Electronics N.V. | Data input system |
US20030066691A1 (en) * | 2001-10-04 | 2003-04-10 | Jelinek Lenka M. | Using RF identification tags in writing instruments as a means for line style differentiation |
US6717073B2 (en) | 2000-12-29 | 2004-04-06 | Intel Corporation | Wireless display systems, styli, and associated methods |
US20050093830A1 (en) * | 2003-10-29 | 2005-05-05 | Dan Li | Methods and apparatus to provide a handheld pointer-based user interface |
US20050219204A1 (en) * | 2004-04-05 | 2005-10-06 | Wyatt Huddleston | Interactive display system |
US20050264545A1 (en) * | 2004-05-27 | 2005-12-01 | Walker Ray A | Method and system for determining the location of a movable icon on a display surface |
EP1696244A2 (en) * | 2005-02-25 | 2006-08-30 | NEC Viewtechnology, Ltd. | Wave receiving device and method of determining wave reception |
US20080244702A1 (en) * | 2007-03-30 | 2008-10-02 | Uranus International Limited | Method, Apparatus, System, Medium, and Signals for Intercepting a Multiple-Party Communication |
US20080259030A1 (en) * | 2007-04-18 | 2008-10-23 | Raphael Holtzman | Pre-assembled part with an associated surface convertible to a transcription apparatus |
US20080309641A1 (en) * | 2007-06-15 | 2008-12-18 | Jacob Harel | Interactivity in a large flat panel display |
US20090153526A1 (en) * | 2003-02-14 | 2009-06-18 | Microsoft Corporation | Determining the location of the tip of an electronic stylus |
US20100155153A1 (en) * | 2008-12-22 | 2010-06-24 | N-Trig Ltd. | Digitizer, stylus and method of synchronization therewith |
US7765266B2 (en) | 2007-03-30 | 2010-07-27 | Uranus International Limited | Method, apparatus, system, medium, and signals for publishing content created during a communication |
US7765261B2 (en) | 2007-03-30 | 2010-07-27 | Uranus International Limited | Method, apparatus, system, medium and signals for supporting a multiple-party communication on a plurality of computer servers |
US20100206645A1 (en) * | 2009-02-17 | 2010-08-19 | Jacob Harel | Data Entry Device Utilizing Writing Implement Rotation |
US20110162456A1 (en) * | 2008-06-04 | 2011-07-07 | Mettler-Toledo, Inc. | Ultrasonic dimensioning system and method |
GB2479458A (en) * | 2010-04-08 | 2011-10-12 | Avaya Inc | Correlating the mode or identification of an input prosthetic with a function |
US8060887B2 (en) | 2007-03-30 | 2011-11-15 | Uranus International Limited | Method, apparatus, system, and medium for supporting multiple-party communications |
US20130141394A1 (en) * | 2011-12-06 | 2013-06-06 | Wistron Corp. | Electronic systems and track detection methods |
US20130342554A1 (en) * | 2011-03-07 | 2013-12-26 | Creative Technology Ltd | Method, system and electronic device for association based identification |
US8627211B2 (en) | 2007-03-30 | 2014-01-07 | Uranus International Limited | Method, apparatus, system, medium, and signals for supporting pointer display in a multiple-party communication |
US8702505B2 (en) | 2007-03-30 | 2014-04-22 | Uranus International Limited | Method, apparatus, system, medium, and signals for supporting game piece movement in a multiple-party communication |
US20140149898A1 (en) * | 2012-11-29 | 2014-05-29 | International Business Machines Corporation | Method, apparatus and computer program to designate content retrieval on an interactive display |
US20140210785A1 (en) * | 2008-10-02 | 2014-07-31 | Wacom Co., Ltd. | Combination touch and transducer input system and method |
US20140340367A1 (en) * | 2011-09-20 | 2014-11-20 | Kazuya Inoue | Interactive unit attachment structure for projector |
US20150035788A1 (en) * | 2013-08-02 | 2015-02-05 | Wistron Corporation | Touch module and touch positioning method thereof |
US20150062011A1 (en) * | 2013-09-05 | 2015-03-05 | Hyundai Mobis Co., Ltd. | Remote control apparatus and method of audio video navigation system |
US20150256682A1 (en) * | 2014-03-06 | 2015-09-10 | Beijing Lenovo Software Ltd. | Information processing method and electronic device |
US20150279088A1 (en) * | 2009-11-27 | 2015-10-01 | Hologic, Inc. | Systems and methods for tracking positions between imaging modalities and transforming a displayed three-dimensional image corresponding to a position and orientation of a probe |
CN107390958A (en) * | 2017-06-13 | 2017-11-24 | 广州华欣电子科技有限公司 | A kind of intelligent writing method and system |
DE102017212751A1 (en) * | 2017-07-25 | 2019-01-31 | Robert Bosch Gmbh | Drawing device with a projection unit |
EP3470963A1 (en) * | 2009-07-07 | 2019-04-17 | Elliptic Laboratories AS | Control using movements |
US10282039B2 (en) * | 2016-03-01 | 2019-05-07 | Boe Technology Group Co., Ltd. | Display screen, touch pen and display module utilizing electromagnetic signal and sound wave signal |
US10466844B1 (en) | 2018-05-21 | 2019-11-05 | UltraSense Systems, Inc. | Ultrasonic touch and force input detection |
US20190354238A1 (en) * | 2018-05-21 | 2019-11-21 | UltraSense Systems, Inc. | Ultrasonic touch detection and decision |
US10585534B2 (en) | 2018-05-21 | 2020-03-10 | UltraSense Systems, Inc. | Ultrasonic touch feature extraction |
US10719175B2 (en) | 2018-05-21 | 2020-07-21 | UltraSense System, Inc. | Ultrasonic touch sensor and system |
US11481062B1 (en) | 2022-02-14 | 2022-10-25 | UltraSense Systems, Inc. | Solid-state touch-enabled switch and related method |
US11586290B2 (en) | 2020-12-10 | 2023-02-21 | UltraSense Systems, Inc. | User-input systems and methods of delineating a location of a virtual button by haptic feedback and of determining user-input |
US11681399B2 (en) | 2021-06-30 | 2023-06-20 | UltraSense Systems, Inc. | User-input systems and methods of detecting a user input at a cover member of a user-input system |
US11719671B2 (en) | 2020-10-26 | 2023-08-08 | UltraSense Systems, Inc. | Methods of distinguishing among touch events |
US11725993B2 (en) | 2019-12-13 | 2023-08-15 | UltraSense Systems, Inc. | Force-measuring and touch-sensing integrated circuit device |
US11775073B1 (en) | 2022-07-21 | 2023-10-03 | UltraSense Systems, Inc. | Integrated virtual button module, integrated virtual button system, and method of determining user input and providing user feedback |
US11803274B2 (en) | 2020-11-09 | 2023-10-31 | UltraSense Systems, Inc. | Multi-virtual button finger-touch input systems and methods of detecting a finger-touch event at one of a plurality of virtual buttons |
US11835400B2 (en) | 2020-03-18 | 2023-12-05 | UltraSense Systems, Inc. | Force-measuring device testing system, force-measuring device calibration system, and a method of calibrating a force-measuring device |
US12022737B2 (en) | 2020-01-30 | 2024-06-25 | UltraSense Systems, Inc. | System including piezoelectric capacitor assembly having force-measuring, touch-sensing, and haptic functionalities |
US12066338B2 (en) | 2021-05-11 | 2024-08-20 | UltraSense Systems, Inc. | Force-measuring device assembly for a portable electronic apparatus, a portable electronic apparatus, and a method of modifying a span of a sense region in a force-measuring device assembly |
US12292351B2 (en) | 2021-01-28 | 2025-05-06 | UltraSense Systems, Inc. | Force-measuring device and related systems |
Families Citing this family (52)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6731270B2 (en) * | 1998-10-21 | 2004-05-04 | Luidia Inc. | Piezoelectric transducer for data entry device |
US6414673B1 (en) * | 1998-11-10 | 2002-07-02 | Tidenet, Inc. | Transmitter pen location system |
JP4618840B2 (en) * | 2000-02-21 | 2011-01-26 | 株式会社沖データ | Coordinate input device |
WO2001084484A2 (en) * | 2000-05-03 | 2001-11-08 | Siemens Aktiengesellschaft | Pen for use with devices comprising a touch-sensitive display device |
US6703570B1 (en) * | 2000-05-10 | 2004-03-09 | International Business Machines Corporation | Digital pen using ultrasonic tracking |
JP4552308B2 (en) * | 2000-10-24 | 2010-09-29 | パナソニック株式会社 | Ultrasonic coordinate input device and interactive board |
JP2002163070A (en) * | 2000-11-27 | 2002-06-07 | Matsushita Electric Ind Co Ltd | Electronic blackboard |
KR20030067729A (en) * | 2000-12-27 | 2003-08-14 | 피루쯔 가사비안 | Stylus computer |
JP4552345B2 (en) * | 2001-04-06 | 2010-09-29 | パナソニック株式会社 | Digitizer and electronic blackboard equipped with it |
ITMI20011765A1 (en) * | 2001-08-10 | 2003-02-10 | A & G Soluzioni Digitali S R L | METHOD AND DEVICE TO DETERMINE THE POSITION IN THE THREE-DIMENSION SPACE OF ONE OR MORE INFORMATION POINTERS |
US6741237B1 (en) * | 2001-08-23 | 2004-05-25 | Rockwell Automation Technologies, Inc. | Touch screen |
US20040047505A1 (en) * | 2001-12-26 | 2004-03-11 | Firooz Ghassabian | Stylus computer |
WO2003089520A1 (en) * | 2002-04-15 | 2003-10-30 | Solvay Advanced Polymers, Llc | Polyarylethersulfone compositions exhibiting reduced yellowness and high light transmittance properties and articles made therefrom |
US20040070616A1 (en) * | 2002-06-02 | 2004-04-15 | Hildebrandt Peter W. | Electronic whiteboard |
US6952046B2 (en) * | 2002-06-19 | 2005-10-04 | Foster-Miller, Inc. | Electronic and optoelectronic component packaging technique |
WO2004010592A2 (en) * | 2002-07-22 | 2004-01-29 | Measurement Specialties, Inc. | Handheld device having ultrasonic transducer for axial transmission of acoustic signals |
JP4146188B2 (en) * | 2002-08-15 | 2008-09-03 | 富士通株式会社 | Ultrasound type coordinate input device |
US7203384B2 (en) * | 2003-02-24 | 2007-04-10 | Electronic Scripting Products, Inc. | Implement for optically inferring information from a planar jotting surface |
US7116315B2 (en) * | 2003-03-14 | 2006-10-03 | Tyco Electronics Corporation | Water tolerant touch sensor |
US7156826B2 (en) * | 2003-05-23 | 2007-01-02 | Icu Medical, Inc. | Medical connector and method for nasally administering or removing a substance |
JP3947873B2 (en) | 2003-10-10 | 2007-07-25 | Necディスプレイソリューションズ株式会社 | Projector and projector accessory |
GB2408337B (en) * | 2003-11-21 | 2005-11-23 | Marc Zuta | Graphic input device and method |
WO2005059801A1 (en) | 2003-12-19 | 2005-06-30 | Intel Corporation | Electronic pen-computer multimedia interactive system |
US8149217B2 (en) | 2003-12-19 | 2012-04-03 | Intel Corporation | Creating responses for an electronic pen-computer multimedia interactive system |
US7088440B2 (en) * | 2003-12-22 | 2006-08-08 | Electronic Scripting Products, Inc. | Method and apparatus for determining absolute position of a tip of an elongate object on a plane surface with invariant features |
US9229540B2 (en) | 2004-01-30 | 2016-01-05 | Electronic Scripting Products, Inc. | Deriving input from six degrees of freedom interfaces |
US7961909B2 (en) * | 2006-03-08 | 2011-06-14 | Electronic Scripting Products, Inc. | Computer interface employing a manipulated object with absolute pose detection component and a display |
US7826641B2 (en) * | 2004-01-30 | 2010-11-02 | Electronic Scripting Products, Inc. | Apparatus and method for determining an absolute pose of a manipulated object in a real three-dimensional environment with invariant features |
US8542219B2 (en) * | 2004-01-30 | 2013-09-24 | Electronic Scripting Products, Inc. | Processing pose data derived from the pose of an elongate object |
US7525050B1 (en) | 2004-04-23 | 2009-04-28 | Luidia, Inc. | Interference removal in pointing device locating systems |
US7746321B2 (en) | 2004-05-28 | 2010-06-29 | Erik Jan Banning | Easily deployable interactive direct-pointing system and presentation control system and calibration method therefor |
JP4442877B2 (en) * | 2004-07-14 | 2010-03-31 | キヤノン株式会社 | Coordinate input device and control method thereof |
US8195425B2 (en) * | 2004-11-23 | 2012-06-05 | Hewlett-Packard Development Company, L.P. | Systems and methods for estimating distances using multi-resolution functions |
WO2006131022A1 (en) * | 2005-06-07 | 2006-12-14 | Intel Corporation | Ultrasonic tracking |
US9285897B2 (en) | 2005-07-13 | 2016-03-15 | Ultimate Pointer, L.L.C. | Easily deployable interactive direct-pointing system and calibration method therefor |
US7456596B2 (en) | 2005-08-19 | 2008-11-25 | Cisco Technology, Inc. | Automatic radio site survey using a robot |
JP4728740B2 (en) * | 2005-08-23 | 2011-07-20 | Necディスプレイソリューションズ株式会社 | Electronic pen, electronic blackboard system, and projector system |
US20080169132A1 (en) * | 2007-01-03 | 2008-07-17 | Yao Ding | Multiple styli annotation system |
WO2008107818A1 (en) * | 2007-03-02 | 2008-09-12 | Koninklijke Philips Electronics N.V. | Touch screen and touching-object |
US20090257315A1 (en) * | 2008-04-10 | 2009-10-15 | Penandfree Co., Ltd. | Position tracing signal generator unit and input system having the same |
IT1396551B1 (en) * | 2008-11-18 | 2012-12-14 | Graf S P A | DEVICE, EQUIPMENT AND SYSTEM FOR THE LOCALIZATION OF OBJECTS OR PERSONS |
US8120994B2 (en) * | 2009-04-28 | 2012-02-21 | Luidia, Inc. | Digital transcription system utilizing acoustical detectors having apertures with a vertical orientation relative to the work surface |
KR101667093B1 (en) * | 2010-07-06 | 2016-10-24 | 티-데이터 시스템스 (에스) 피티이 엘티디 | Data storage device with data input function |
TWI446250B (en) * | 2011-12-05 | 2014-07-21 | Wistron Corp | Portable optical touch system and operating method thereof |
US8641197B2 (en) * | 2011-12-23 | 2014-02-04 | Luidia Inc. | Acoustical receiver and pen transcription system adapted for rejecting virtual pen images |
US10678322B2 (en) | 2013-11-18 | 2020-06-09 | At&T Intellectual Property I, L.P. | Pressure sensing via bone conduction |
US9465486B2 (en) * | 2014-07-14 | 2016-10-11 | Hong Kong Applied Science and Technology Research Institute Company Limited | Portable interactive whiteboard module |
CN104090661B (en) * | 2014-07-14 | 2017-06-30 | 香港应用科技研究院有限公司 | Portable interactive whiteboard module |
US9977519B2 (en) * | 2015-02-25 | 2018-05-22 | Synaptics Incorporated | Active pen with bidirectional communication |
US11577159B2 (en) | 2016-05-26 | 2023-02-14 | Electronic Scripting Products Inc. | Realistic virtual/augmented/mixed reality viewing and interactions |
CN109949622A (en) * | 2017-12-21 | 2019-06-28 | 北京丰信达科技有限公司 | A kind of electronic whiteboard of wisdom blackboard |
US10831316B2 (en) | 2018-07-26 | 2020-11-10 | At&T Intellectual Property I, L.P. | Surface interface |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE3727837A1 (en) | 1987-08-20 | 1989-03-02 | Brunner Wolfgang | METHOD AND DEVICE FOR REDUCING ERRORS IN MEASURING SPATIAL MOVEMENT OF MEASURING POINTS BY MEANS OF ULTRASONIC SIGNALS |
US4777329A (en) * | 1987-08-24 | 1988-10-11 | Microfield Graphics, Inc. | Graphic input system |
ES2005624A6 (en) | 1987-09-16 | 1989-03-16 | Ezquerra Perez Jose Manuel | Method to determine the position and the state of an object using ultrasonics. |
US4814552A (en) | 1987-12-02 | 1989-03-21 | Xerox Corporation | Ultrasound position input device |
US5144594A (en) | 1991-05-29 | 1992-09-01 | Cyber Scientific | Acoustic mouse system |
US5308936A (en) * | 1992-08-26 | 1994-05-03 | Mark S. Knighton | Ultrasonic pen-type data input device |
CA2149213A1 (en) | 1992-11-17 | 1994-05-26 | Thomas Debuisser | Method and device for capturing and processing graphical information |
JP3006448B2 (en) * | 1995-02-09 | 2000-02-07 | 富士ゼロックス株式会社 | Information input / output system |
US6151014A (en) * | 1998-02-26 | 2000-11-21 | Pagasus Technologies Ltd. | Systems and processing algorithms for ultrasound time-of-flight digitizer systems |
-
1998
- 1998-10-02 US US09/165,748 patent/US6335723B1/en not_active Expired - Lifetime
-
1999
- 1999-10-01 DE DE69942098T patent/DE69942098D1/en not_active Expired - Lifetime
- 1999-10-01 WO PCT/US1999/022735 patent/WO2000021025A1/en active IP Right Grant
- 1999-10-01 AU AU62789/99A patent/AU756022B2/en not_active Ceased
- 1999-10-01 EP EP99950051A patent/EP1116171B1/en not_active Expired - Lifetime
-
2000
- 2000-12-18 US US09/740,630 patent/US20010000666A1/en not_active Abandoned
Cited By (100)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6717073B2 (en) | 2000-12-29 | 2004-04-06 | Intel Corporation | Wireless display systems, styli, and associated methods |
US7248251B2 (en) | 2000-12-29 | 2007-07-24 | Intel Corporation | Wireless display systems and stylii |
US20040169644A1 (en) * | 2000-12-29 | 2004-09-02 | Intel Corporation | Wireless display systems and stylii |
US8537141B2 (en) | 2001-05-25 | 2013-09-17 | Intel Corporation | Digital signature collection and authentication |
WO2002097721A3 (en) * | 2001-05-25 | 2003-12-11 | Intel Corp | Digital signature collection and authentication |
US20110090182A1 (en) * | 2001-05-25 | 2011-04-21 | Jianping Xu | Digital signature collection and authentication |
US8547363B2 (en) | 2001-05-25 | 2013-10-01 | Intel Corporation | Digital signature collection and authentication |
US20020176577A1 (en) * | 2001-05-25 | 2002-11-28 | Intel Corporation | Digital signature collection and authentication |
US8970561B2 (en) | 2001-05-25 | 2015-03-03 | Intel Corporation | Digital signature collection and authentication |
DE10296847B4 (en) * | 2001-05-25 | 2017-01-12 | Intel Corporation | Recording and authentication of a digital signature |
US7279646B2 (en) | 2001-05-25 | 2007-10-09 | Intel Corporation | Digital signature collection and authentication |
US20020190963A1 (en) * | 2001-06-14 | 2002-12-19 | Koninklijke Philips Electronics N.V. | Data input system |
US7119796B2 (en) * | 2001-06-14 | 2006-10-10 | Koninklijke Philips Electronics N. V. | Data input system |
US7126590B2 (en) * | 2001-10-04 | 2006-10-24 | Intel Corporation | Using RF identification tags in writing instruments as a means for line style differentiation |
US20030066691A1 (en) * | 2001-10-04 | 2003-04-10 | Jelinek Lenka M. | Using RF identification tags in writing instruments as a means for line style differentiation |
US20090153526A1 (en) * | 2003-02-14 | 2009-06-18 | Microsoft Corporation | Determining the location of the tip of an electronic stylus |
US9207813B2 (en) * | 2003-02-14 | 2015-12-08 | Microsoft Technology Licensing, Llc | Determining the location of the tip of an electronic stylus |
US8572514B2 (en) | 2003-10-29 | 2013-10-29 | Intel Corporation | Methods and apparatus to provide a handheld pointer-based user interface |
US20100097317A1 (en) * | 2003-10-29 | 2010-04-22 | Dan Li | Methods and apparatus to provide a handheld pointer-based user interface |
US7735024B2 (en) * | 2003-10-29 | 2010-06-08 | Intel Corporation | Methods and apparatus to provide a handheld pointer-based user interface |
US20050093830A1 (en) * | 2003-10-29 | 2005-05-05 | Dan Li | Methods and apparatus to provide a handheld pointer-based user interface |
US20050219204A1 (en) * | 2004-04-05 | 2005-10-06 | Wyatt Huddleston | Interactive display system |
US20050264545A1 (en) * | 2004-05-27 | 2005-12-01 | Walker Ray A | Method and system for determining the location of a movable icon on a display surface |
US20060195274A1 (en) * | 2005-02-25 | 2006-08-31 | Nec Viewtechnology, Ltd. | Wave receiving device and method of determining wave reception |
EP1696244A2 (en) * | 2005-02-25 | 2006-08-30 | NEC Viewtechnology, Ltd. | Wave receiving device and method of determining wave reception |
US7880721B2 (en) * | 2005-02-25 | 2011-02-01 | Nec Viewtechnology, Ltd. | Wave receiving device and method of determining wave reception |
EP1696244A3 (en) * | 2005-02-25 | 2008-02-27 | NEC Display Solutions, Ltd. | Wave receiving device and method of determining wave reception |
US8702505B2 (en) | 2007-03-30 | 2014-04-22 | Uranus International Limited | Method, apparatus, system, medium, and signals for supporting game piece movement in a multiple-party communication |
US10180765B2 (en) | 2007-03-30 | 2019-01-15 | Uranus International Limited | Multi-party collaboration over a computer network |
US20080244702A1 (en) * | 2007-03-30 | 2008-10-02 | Uranus International Limited | Method, Apparatus, System, Medium, and Signals for Intercepting a Multiple-Party Communication |
US7765261B2 (en) | 2007-03-30 | 2010-07-27 | Uranus International Limited | Method, apparatus, system, medium and signals for supporting a multiple-party communication on a plurality of computer servers |
US7950046B2 (en) | 2007-03-30 | 2011-05-24 | Uranus International Limited | Method, apparatus, system, medium, and signals for intercepting a multiple-party communication |
US9579572B2 (en) | 2007-03-30 | 2017-02-28 | Uranus International Limited | Method, apparatus, and system for supporting multi-party collaboration between a plurality of client computers in communication with a server |
US10963124B2 (en) | 2007-03-30 | 2021-03-30 | Alexander Kropivny | Sharing content produced by a plurality of client computers in communication with a server |
US8060887B2 (en) | 2007-03-30 | 2011-11-15 | Uranus International Limited | Method, apparatus, system, and medium for supporting multiple-party communications |
US8627211B2 (en) | 2007-03-30 | 2014-01-07 | Uranus International Limited | Method, apparatus, system, medium, and signals for supporting pointer display in a multiple-party communication |
US7765266B2 (en) | 2007-03-30 | 2010-07-27 | Uranus International Limited | Method, apparatus, system, medium, and signals for publishing content created during a communication |
EP2140338A4 (en) * | 2007-04-18 | 2016-09-28 | Luidia Inc | Pre-assembled part with an associated surface convertible to a transcription apparatus |
US8339375B2 (en) * | 2007-04-18 | 2012-12-25 | Luidia, Inc. | Pre-assembled part with an associated surface convertible to a transcription apparatus |
US20080259030A1 (en) * | 2007-04-18 | 2008-10-23 | Raphael Holtzman | Pre-assembled part with an associated surface convertible to a transcription apparatus |
US20120062519A1 (en) * | 2007-04-18 | 2012-03-15 | Raphael Holtzman | Pre-assembled part with an associated surface convertible to a transcription apparatus |
WO2008130824A1 (en) * | 2007-04-18 | 2008-10-30 | Luidia Inc. | Pre-assembled part with an associated surface convertible to a transcription apparatus |
US8085249B2 (en) * | 2007-04-18 | 2011-12-27 | Luidia Inc. | Pre-assembled part with an associated surface convertible to a transcription apparatus |
JP2010531015A (en) * | 2007-06-15 | 2010-09-16 | ルイディア インコーポレイテッド | Large flat panel display interactivity |
EP2156433A1 (en) * | 2007-06-15 | 2010-02-24 | Luidia Inc. | Interactivity in a large flat panel display |
EP2156433A4 (en) * | 2007-06-15 | 2012-04-04 | Luidia Inc | Interactivity in a large flat panel display |
US20080309641A1 (en) * | 2007-06-15 | 2008-12-18 | Jacob Harel | Interactivity in a large flat panel display |
US20110162456A1 (en) * | 2008-06-04 | 2011-07-07 | Mettler-Toledo, Inc. | Ultrasonic dimensioning system and method |
US20140210785A1 (en) * | 2008-10-02 | 2014-07-31 | Wacom Co., Ltd. | Combination touch and transducer input system and method |
US9304623B2 (en) * | 2008-10-02 | 2016-04-05 | Wacom Co., Ltd. | Combination touch and transducer input system and method |
US9524044B2 (en) | 2008-12-22 | 2016-12-20 | Microsoft Technology Licensing, Llc | Digitizer, stylus and method of synchronization therewith |
US9323368B2 (en) | 2008-12-22 | 2016-04-26 | Microsoft Technology Licensing, Llc | Digitizer, stylus and method of synchronization therewith |
US8669967B2 (en) * | 2008-12-22 | 2014-03-11 | N-Trig Ltd. | Digitizer, stylus and method of synchronization therewith |
US20100155153A1 (en) * | 2008-12-22 | 2010-06-24 | N-Trig Ltd. | Digitizer, stylus and method of synchronization therewith |
US8481872B2 (en) * | 2008-12-22 | 2013-07-09 | N-Trig Ltd. | Digitizer, stylus and method of synchronization therewith |
US9524045B2 (en) | 2008-12-22 | 2016-12-20 | Microsoft Technology Licensing, Llc | Digitizer, stylus and method of synchronization therewith |
US20100206645A1 (en) * | 2009-02-17 | 2010-08-19 | Jacob Harel | Data Entry Device Utilizing Writing Implement Rotation |
US9285899B2 (en) * | 2009-02-17 | 2016-03-15 | Pnf Co., Ltd. | Data entry device utilizing writing implement rotation |
EP3470963A1 (en) * | 2009-07-07 | 2019-04-17 | Elliptic Laboratories AS | Control using movements |
US9558583B2 (en) * | 2009-11-27 | 2017-01-31 | Hologic, Inc. | Systems and methods for tracking positions between imaging modalities and transforming a displayed three-dimensional image corresponding to a position and orientation of a probe |
US20150279088A1 (en) * | 2009-11-27 | 2015-10-01 | Hologic, Inc. | Systems and methods for tracking positions between imaging modalities and transforming a displayed three-dimensional image corresponding to a position and orientation of a probe |
GB2479458A (en) * | 2010-04-08 | 2011-10-12 | Avaya Inc | Correlating the mode or identification of an input prosthetic with a function |
US20130342554A1 (en) * | 2011-03-07 | 2013-12-26 | Creative Technology Ltd | Method, system and electronic device for association based identification |
US20140340367A1 (en) * | 2011-09-20 | 2014-11-20 | Kazuya Inoue | Interactive unit attachment structure for projector |
US20130141394A1 (en) * | 2011-12-06 | 2013-06-06 | Wistron Corp. | Electronic systems and track detection methods |
CN103150059A (en) * | 2011-12-06 | 2013-06-12 | 纬创资通股份有限公司 | Electronic system and track detection method |
TWI482100B (en) * | 2011-12-06 | 2015-04-21 | Wistron Corp | Electronic systems and methods for detecting tracks |
US20140149898A1 (en) * | 2012-11-29 | 2014-05-29 | International Business Machines Corporation | Method, apparatus and computer program to designate content retrieval on an interactive display |
US20140149897A1 (en) * | 2012-11-29 | 2014-05-29 | International Business Machines Corporation | Method, apparatus and computer program to designate content retrieval on an interactive display |
US9354807B2 (en) * | 2012-11-29 | 2016-05-31 | International Business Machines Corporation | Method, apparatus and computer program to designate content retrieval on an interactive display |
US9250792B2 (en) * | 2012-11-29 | 2016-02-02 | International Business Machines Corporation | Method, apparatus and computer program to designate content retrieval on an interactive display |
US9189115B2 (en) * | 2013-08-02 | 2015-11-17 | Wistron Corporation | Touch module and touch positioning method thereof |
US20150035788A1 (en) * | 2013-08-02 | 2015-02-05 | Wistron Corporation | Touch module and touch positioning method thereof |
US9256305B2 (en) * | 2013-09-05 | 2016-02-09 | Hyundai Mobis Co., Ltd. | Remote control apparatus and method of audio video navigation system |
US20150062011A1 (en) * | 2013-09-05 | 2015-03-05 | Hyundai Mobis Co., Ltd. | Remote control apparatus and method of audio video navigation system |
US20150256682A1 (en) * | 2014-03-06 | 2015-09-10 | Beijing Lenovo Software Ltd. | Information processing method and electronic device |
US9509851B2 (en) * | 2014-03-06 | 2016-11-29 | Beijing Lenovo Software Ltd. | Information processing method and electronic device |
US10282039B2 (en) * | 2016-03-01 | 2019-05-07 | Boe Technology Group Co., Ltd. | Display screen, touch pen and display module utilizing electromagnetic signal and sound wave signal |
CN107390958A (en) * | 2017-06-13 | 2017-11-24 | 广州华欣电子科技有限公司 | A kind of intelligent writing method and system |
DE102017212751A1 (en) * | 2017-07-25 | 2019-01-31 | Robert Bosch Gmbh | Drawing device with a projection unit |
US20190354238A1 (en) * | 2018-05-21 | 2019-11-21 | UltraSense Systems, Inc. | Ultrasonic touch detection and decision |
US10585534B2 (en) | 2018-05-21 | 2020-03-10 | UltraSense Systems, Inc. | Ultrasonic touch feature extraction |
US10719175B2 (en) | 2018-05-21 | 2020-07-21 | UltraSense System, Inc. | Ultrasonic touch sensor and system |
US10775938B2 (en) | 2018-05-21 | 2020-09-15 | UltraSense Systems, Inc. | Ultrasonic touch and force input detection |
US10466844B1 (en) | 2018-05-21 | 2019-11-05 | UltraSense Systems, Inc. | Ultrasonic touch and force input detection |
US11500494B2 (en) | 2018-05-21 | 2022-11-15 | UltraSense Systems, Inc. | Ultrasonic touch detection and decision |
US11725993B2 (en) | 2019-12-13 | 2023-08-15 | UltraSense Systems, Inc. | Force-measuring and touch-sensing integrated circuit device |
US12022737B2 (en) | 2020-01-30 | 2024-06-25 | UltraSense Systems, Inc. | System including piezoelectric capacitor assembly having force-measuring, touch-sensing, and haptic functionalities |
US11898925B2 (en) | 2020-03-18 | 2024-02-13 | UltraSense Systems, Inc. | System for mapping force transmission from a plurality of force-imparting points to each force-measuring device and related method |
US11835400B2 (en) | 2020-03-18 | 2023-12-05 | UltraSense Systems, Inc. | Force-measuring device testing system, force-measuring device calibration system, and a method of calibrating a force-measuring device |
US11719671B2 (en) | 2020-10-26 | 2023-08-08 | UltraSense Systems, Inc. | Methods of distinguishing among touch events |
US11803274B2 (en) | 2020-11-09 | 2023-10-31 | UltraSense Systems, Inc. | Multi-virtual button finger-touch input systems and methods of detecting a finger-touch event at one of a plurality of virtual buttons |
US11829534B2 (en) | 2020-12-10 | 2023-11-28 | UltraSense Systems, Inc. | User-input systems and methods of delineating a location of a virtual button by haptic feedback and of determining user-input |
US11586290B2 (en) | 2020-12-10 | 2023-02-21 | UltraSense Systems, Inc. | User-input systems and methods of delineating a location of a virtual button by haptic feedback and of determining user-input |
US12292351B2 (en) | 2021-01-28 | 2025-05-06 | UltraSense Systems, Inc. | Force-measuring device and related systems |
US12066338B2 (en) | 2021-05-11 | 2024-08-20 | UltraSense Systems, Inc. | Force-measuring device assembly for a portable electronic apparatus, a portable electronic apparatus, and a method of modifying a span of a sense region in a force-measuring device assembly |
US11681399B2 (en) | 2021-06-30 | 2023-06-20 | UltraSense Systems, Inc. | User-input systems and methods of detecting a user input at a cover member of a user-input system |
US11662850B1 (en) | 2022-02-14 | 2023-05-30 | UltraSense Systems, Inc. | Solid-state touch-enabled switch and related method |
US11481062B1 (en) | 2022-02-14 | 2022-10-25 | UltraSense Systems, Inc. | Solid-state touch-enabled switch and related method |
US11775073B1 (en) | 2022-07-21 | 2023-10-03 | UltraSense Systems, Inc. | Integrated virtual button module, integrated virtual button system, and method of determining user input and providing user feedback |
Also Published As
Publication number | Publication date |
---|---|
EP1116171B1 (en) | 2010-03-03 |
US6335723B1 (en) | 2002-01-01 |
AU756022B2 (en) | 2003-01-02 |
EP1116171A1 (en) | 2001-07-18 |
DE69942098D1 (en) | 2010-04-15 |
AU6278999A (en) | 2000-04-26 |
WO2000021025A1 (en) | 2000-04-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6335723B1 (en) | Transmitter pen location system | |
US6414673B1 (en) | Transmitter pen location system | |
US6184873B1 (en) | Pen positioning system | |
EP0960383B1 (en) | Retrofittable apparatus for converting a substantially planar surface into an electronic data capture device | |
EP1982253B1 (en) | Touch detection | |
US4991148A (en) | Acoustic digitizing system | |
US4317005A (en) | Position-determining system | |
US5142506A (en) | Ultrasonic position locating method and apparatus therefor | |
US20030144814A1 (en) | Ultrasonic length measuring apparatus and method for coordinate input | |
AU7937101A (en) | Transmitter pen location system | |
AU718394C (en) | Retrofittable apparatus for converting a substantially planar surface into an electronic data capture device | |
JPS6144378A (en) | Ultrasonic digitizer | |
EP1121662A1 (en) | Triangulation scheme for marking and erasing data entry device | |
JP2003029917A (en) | Coordinate input device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: ELECTRONICS FOR IMAGING, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:TIDENET, INC.;REEL/FRAME:013943/0236 Effective date: 20030606 |
|
AS | Assignment |
Owner name: LUIDIA, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ELECTRONICS FOR IMAGING;REEL/FRAME:014043/0270 Effective date: 20030702 |
|
AS | Assignment |
Owner name: SILICON VALLEY BANK, CALIFORNIA Free format text: SECURITY INTEREST;ASSIGNOR:LUIDIA, INC;REEL/FRAME:015251/0585 Effective date: 20040414 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |
|
AS | Assignment |
Owner name: LUIDIA, INC, CALIFORNIA Free format text: RELEASE;ASSIGNOR:SILICON VALLEY BANK;REEL/FRAME:020704/0950 Effective date: 20080314 |
|
AS | Assignment |
Owner name: SILICON VALLEY BANK, CALIFORNIA Free format text: SECURITY AGREEMENT;ASSIGNOR:LUIDIA, INC.;REEL/FRAME:026717/0804 Effective date: 20110805 |
|
AS | Assignment |
Owner name: LUIDIA, INC., CALIFORNIA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:SILICON VALLEY BANK;REEL/FRAME:031817/0201 Effective date: 20131217 |