WO2003100573A2 - Systeme et procede de commande de panoramique et de zone de defilement d'une image d'affichage - Google Patents
Systeme et procede de commande de panoramique et de zone de defilement d'une image d'affichage Download PDFInfo
- Publication number
- WO2003100573A2 WO2003100573A2 PCT/US2003/016527 US0316527W WO03100573A2 WO 2003100573 A2 WO2003100573 A2 WO 2003100573A2 US 0316527 W US0316527 W US 0316527W WO 03100573 A2 WO03100573 A2 WO 03100573A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- coordinates
- newx
- newy
- display
- image
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/0485—Scrolling or panning
Definitions
- This invention relates to the field of digital device interfaces to digital data.
- PDA personal digital assistant
- PDAs are handheld electronic devices that have portable design features including a small display screen, which, in many embodiments, is also utilized as a touch sensitive pointing device and data input device that can also be used to input keystroke data.
- PDAs are designed to capture, store, and display information originating from various digital sources.
- PDAs may be connected directly to a PC or other PDAs with a "cradle" type data linkage, with an infrared link, with an modem type module such as a telephone module or telephone line adapter, including a wireless cellular phone module, or an Ethernet module or Ethernet adapter, including a wireless Ethernet module.
- PDAs are often described as an electronic alternative to the filofax; however, device such as handheld computers, electronic books, electronic note takers, personal computers, display telephones and personal communicators may also be embodied as PDAs. Regardless of their embodiment or specialized functions, PDA's primary functions are to capture and store information, search the stored information efficiently, access and display the results of the search, update the information and reconcile the information with data stored on a PC.
- PDAs have a very small display area that typically is much smaller than the stored document being viewed by the user. It is therefore necessary for PDAs to be equipped with a convenient scrolling mechanism, so that the user is able to view the entire document by scrolling the display up and down or side to side. Most PDAs are equipped with cursor keys for this purpose, with a user being required to press the appropriate key(s) to scroll the screen in the desired direction until the desired portion of the document is displayed on the screen.
- scroll bars which are common features of most of the graphical user interfaces (GUIs) available for use on PCs, may be used to manipulate and scroll the display.
- GUIs graphical user interfaces
- PCs that are utilized to display large bitmaps such as street atlases, architectural designs and other graphical images (described above) have a similar characteristic of a smaller size display area relative to a larger size of the entire graphical information that is being displayed.
- Most PC applications, such as street atlas viewers have scroll bars, pointer buttons, or curser keys that may be used to manipulate and scroll the display.
- Another scrolling technique used by both PC applications and PDAs is the "grab screen" technique.
- the viewer uses the pointing device to press on the display area of the screen and "pull" the bitmap, thus moving the screen in the desired direction until the desired portion of the bitmap is displayed on the screen.
- Yet another scrolling technique commonly referred to as “panning” is to establish a new center point (with a curser or other marker) within the display area and re-center the display in accordance with the new center point. This technique is used in conjunction with the zoom function to scroll beyond the boundaries of the current display area. Typically, the user zooms out to gain a larger display area, re-centers the image, and zooms back to the previous zoom level to complete the scrolling function.
- a problem with this solution is that the smaller bitmap takes up a portion of the display area, this being a tradeoff for the smaller display area and, in PDA embodiments, a major tradeoff for the very small display area.
- Another disadvantage is that much of the detail of the larger image is no longer visible in the smaller bitmap representation.
- Yet another disadvantage is that a very large bitmap, such as a global atlas, lacks borders that can be meaningfully represented in the smaller size bitmap representation.
- the navigational information is only available after the scrolling inputs are made. Thus, the user lacks navigational or orientation information prior to inputting the scrolling action.
- the major problem with the panning technique described above is that when the user zooms out, the larger display area necessarily lacks the image detail that was represented at the previous zoom level.
- the user is required to speculate as to the location of image features that are no longer visible at the zoom out level and may not display the desired feature when zooming back to the previous level after re-centering the image.
- Each of the scrolling and panning techniques are, for reasons of the problems they create, counterintuitive, i.e., the movement of the curser keys or the scroll bars or use of the grab screen technique do not intuitively correspond or instantly correlate to the desired location of the display of a larger image, or do not intuitively correspond to the resulting movement of the display.
- PDA personal digital assistant
- This system includes a display screen disposed on a top surface of the PDA and a mouse integrated into the bottom surface of the PDA.
- Documents to be displayed on the screen are stored in a memory of the PDA.
- the PDA is placed on a work surface such that the mouse is manipulated by rolling the PDA across the surface.
- the work surface is regarded by the PDA as a virtual display of the document to be displayed on the display screen.
- the mouse As the PDA is rolled across the surface, the mouse generates translation information to a memory controller, which determines the location of the PDA with respect to the virtual document and generates viewport coordinates, which define a portion of the document to be displayed on the display screen.
- the viewport coordinates are input to a memory controller, which generates memory addresses to the memory indicating the location in the memory of the document portion defined by the viewport coordinates.
- the addressed document portion is output from the memory to the display screen for display. In this manner, the display screen serves as a window or viewport through which portions of a document corresponding to the virtual display may be viewed.
- the present invention is a method for viewing, on a display, an image stored on a digital device.
- the method includes the steps of first, detecting a selection of a region of the display by a pointer device then computing newX and newY coordinates of selected region. Next, comparing the newX and newY coordinates on the display with corresponding region of bitmap of the image and determining if the newX and newY coordinates are within a threshold range. If the newX and newY coordinates are within a threshold range, then shifting the coordinates by a predetermined value and comparing the newX and newY coordinates with currentX and currentY coordinates stored in memory.
- Such a method may include one or more of the following features.
- the pointer device is a stylus
- the pointer device is a mouse
- the digital device is a personal computer
- the digital device is a personal digital assistant (PDA).
- PDA personal digital assistant
- the present invention also includes a method for scrolling, on a display, an image stored on a digital device.
- the method includes first detecting a scrolling selection on the display by a pointer device. While the scrolling selection continues, at predetermined intervals, computing newX and newY coordinates of current selected region, next, comparing the newX and newY coordinates on the display with corresponding region of bitmap of the image, then determining if the newX and newY coordinates are within a threshold range, next, if the newX and newY coordinates are within a threshold range.
- Such a method may include one or more of the following features. Where the pointer device is a stylus, where the pointer device is a mouse, where the digital device is a personal computer, and where the digital device is a personal digital assistant (PDA).
- PDA personal digital assistant
- FIG. 1 is a flow diagram representing the preferred embodiment of the process of translating a pointer device touch to a transmission of the desired data on a personal digital assistant (PDA) of the present invention.
- PDA personal digital assistant
- FIG. 2 is a flow diagram of the preferred embodiment of the MainFormHandleEvent function of the present invention. Modes for Carrying out the Invention
- the embodiments of the invention described herein are implemented as logical operations in a digital device system.
- the logical operations of the present invention are implemented (1) as a sequence of digital device implemented steps running on the digital device and (2) as interconnected digital modules within the computer system.
- the implementation is a matter of choice dependent on the performance requirements of the digital device system implementing the invention. Accordingly, the logical operations making up the embodiments of the invention described herein are referred to variously as operations, steps, or modules.
- the function and process names, as well as the variable names, are used only for description purposes. The preferred embodiment of this invention is not limited to these names.
- the present invention is a method for viewing bitmap data with a smaller display area on a PDA with a stylus and touch screen already incorporated into the PDA, PC or alternate digital device with a conventional pointing device (i.e. mouse) allowing for completely intuitive and nonrectilinear directional viewing or instantaneous panning to the desired portion of the bitmap image while maintaining orientation of the location of the current viewing area or intended panning area of the larger bitmap.
- a conventional pointing device i.e. mouse
- the PDA embodiment of the present invention acquires the X and Y coordinates from the stylus contact with the touch screen.
- the X and Y coordinates are acquired from the combination of the mouse pointer location on the display area and pressing the activation (i.e. mouse "click") button.
- the display screen size and the large image size for the present invention any be any size specification providing they are in the proportions that enable the basic functionality of the logical processes described herein.
- the present invention is described herein with reference to the PDA embodiment but may also describe the PC embodiment or any other digital device embodiment with the above noted distinctions.
- the present invention allows the viewer to quickly view (and in some instances instantly view) the desired part of an image, while maintaining the viewer's sense of orientation for both current views and intended panning and scrolling views. It does this intuitively and without requiring additional visual aids or other hardware components.
- the present invention works with rectangular images, having the same proportions, or different proportions of the display screen that is being viewed.
- the present invention also works with very large (i.e. "global”) images or nonrectangular images (such as circular, cylindrical or spherical images) by imposing a rectangular viewing border over the image area that exceeds the display area of the viewer.
- the PDA When the image file is first opened, the PDA presents a section of the original image. The viewer identifies the general area of the image they wish to see. The viewer then taps the stylus on the touch screen of the PDA over the desired region of the touch screen corresponding to the area of the image in which the user desires to view. Each point on the PDA touch screen corresponds to an area of the original image.
- the display moves to the selected part of the original image. For example, if the viewer touches the top right corner of the touch screen, this corresponds to the top right corner of the original image.
- the present invention updates the display to display the top right corner of the original image.
- the present invention additionally provides motion and zoom functions simultaneously. In other embodiments, the viewer selects the desired part of the image with a mouse, or other pointing device, and the image is displayed on a personal computer or other digital device.
- FIG. 1 the preferred embodiment of the process of translating a screen touch to a transmission of the desired data onto the screen of a personal digital assistant (PDA) of the present invention is shown.
- pressing the activation button of the pointing device i.e. mouse click
- the PDA screen touch function is the equivalent operation of the PDA screen touch function.
- a smaller image may be used that represents the full size image area of the larger bitmap, however, this smaller image is unnecessary and may be undesirable given that the smaller bitmap takes up a portion of the display area, this being a tradeoff for the smaller display area and, in PDA embodiments, a major tradeoff for the very small display area.
- the function MainFormHandleEvent begins when a stylus touch is detected, in step 10.
- a stylus is used to view and navigate about the PDA screen
- any device may be used which activates the touch screen, including, but not limited to, any hard pointy object, a pen, a pencil, or a human finger. Any means of selecting a location on the touch screen may be used to act as the stylus touch.
- the MainFormHandleEvent function determines the newX and newY variables. The PDA reads the X,Y location on the display, based on where the stylus touches the screen.
- the variables newX and newY are the positions in X,Y coordinates that correspond to the position in the full size image relative to the stylus position.
- step 14 the newX and newY values are converted to negative numbers.
- the full size image coordinates are always negative values.
- the next two steps deal with the possibility that the X,Y coordinates are too close to either the right hand or bottom border of the image. Since the largest "chunk" that can be displayed on a PDA is 160 x 160 pixels, the newX has to be at least 160 pixels away from the right hand border and the newY has to be at least 160 pixels above the bottom border. In alternate embodiments, this section is the size of the display of each respective embodiment.
- step 16 determines if newX and/or newY are too close to their respective borders. If step 16 determines the newX and/or newY are too close to their respective borders, then, in step 18, the
- MainFormHandleEvent function will shift the coordinates in order to display a full 160 x 160 "chunk" of the image.
- step 20 the function determines whether the X,Y coordinates have changed.
- the variables placeX (or current X) and placeY (or currentY) store the last set of X,Y coordinates known to the device. If newX is different than placeX or if newY is different than placeY, then the viewable "chunk” has changed. If the viewable "chunk” has changed, the function proceeds to step 22, where lastNewX and lastNewY are just global variables to store the last "known good” X,Y coordinates.
- step 24 the new "chunk" of the image is drawn on the PDA display. Step 24 is accomplished using the steps described below with respect to the function updateDisplay.
- the updateDisplay function is called to accomplish step 24 in FIG. 1.
- the updateDisplay function updates the display memory to display the section, or combination of sections, of the image corresponding to the newX and newY, or the shifted newX and newY.
- the function first defines the center point of the 160 X 160 section of the image bitmap. Wherever the newX and newY coordinates (or shifted newX and newY coordinates) are on the image bitmap, the function call sets that area of the image bitmap into display memory for viewing on the display.
- this function is used in the preferred embodiment, the function used to update the display with the selected section of the image can be any function known to one of ordinary skill in the art.
- the preferred embodiment of the MainFormHandleEvent function is shown.
- the PDA OS or alternate OS is constantly reading the current X,Y location of the stylus.
- step 100 the process proceeds to step 102, where the MainFormHandleEvent is called.
- the stylus movement is determined, in step 100, when the OS determines there has been a change in the X,Y location of the stylus. Dragging the stylus across the screen will generate a stream of calls to continually update the display.
- pressing activation button of the pointing device i.e.
- a smaller image may be used that represents the full size image area of the larger bitmap, however, this smaller image is unnecessary and may be undesirable given that the smaller bitmap takes up a portion of the display area, this being a tradeoff for the smaller display area and, in PDA embodiments, a major tradeoff for the very small display area.
- step 104 the process will determine whether the GrabScroll mode in the preferred embodiment has been enabled. If the GrabScroll mode has been enabled, the process proceeds to step 106, where the GrabScroll mode begins. In alternate embodiments the GrabScroll or equivalent mode is not implemented, therefore, step 104 and step 106 are bypassed in these embodiments. If the GrabScroll mode has not been enabled, then the ScaleScroll mode beings in step 108. Next, in step 110, if a dragging stylus is detected, then in step 112, the function converts the position on the display to the corresponding section of the image. This process is identical to the process described above and shown in FIG. 1.
- step 114 the image is continually updated until it is determined (in step 110) that the dragging stylus has stopped.
- Step 114 similar to step 14 shown in FIG. 1, includes assurances that newX and newY are never greater than zero. This function also includes assurances that the section displayed is not smaller than the 160x160 display (similar to step 18 shown in FIG. 1). The MainFormHandleEvent function will not allow the user of the PDA to attempt to navigate off the right and bottom borders of the image.
- step 116 if it is determined that the section has moved, then the process proceeds to step 118, where the updateDisplay function is called (described above) to draw the new "chunk" of the image. Following step 118, the process continues to step 110.
- Storage devices suitable for tangibly embodying computer program instructions include all forms of nonvolatile memory, including by way of example semiconductor memory devices, such as EPROM, EEPROM, and flash memory devices; magnetic disks such as internal hard disks and removable disks; magneto-optical disks; and
- CD-ROM disks Any of the foregoing may be supplemented by, or incorporated in, specially designed ASICs
- the computer station may be a terminal instead of a personal computer.
- the technique may be implemented in hardware or software, or a combination of both.
- the technique is implemented in computer programs executing on programmable computers that each include a processor, a storage medium readable by the processor (including volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device.
- Program code is applied to data entered using the input device to perform the method described above and to generate output information.
- the output information is applied to one or more output devices.
- Each program is preferably implemented in a high level procedural or object oriented programming language to communicate with a computer system.
- the programs can be implemented in assembly or machine language, if desired. In any case, the language may be a compiled or interpreted language.
- Each such computer program is preferably stored on a storage medium or device (e.g., ROM or magnetic diskette) that is readable by a general or special purpose programmable computer for configuring and operating the computer when the storage medium or device is read by the computer to perform the procedures described in this document.
- the system may also be considered to be implemented as a computer-readable storage medium, configured with a computer program, where the storage medium so configured causes a computer to operate in a specific and predefined manner.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Controls And Circuits For Display Device (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU2003239874A AU2003239874A1 (en) | 2002-05-23 | 2003-05-23 | System and method for controlling panning and scrolling area of display image |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US38274202P | 2002-05-23 | 2002-05-23 | |
US60/382,742 | 2002-05-23 | ||
US44344003A | 2003-05-22 | 2003-05-22 | |
US10/443,440 | 2003-05-22 |
Publications (3)
Publication Number | Publication Date |
---|---|
WO2003100573A2 true WO2003100573A2 (fr) | 2003-12-04 |
WO2003100573A8 WO2003100573A8 (fr) | 2004-02-19 |
WO2003100573A3 WO2003100573A3 (fr) | 2004-10-28 |
Family
ID=31891198
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2003/016527 WO2003100573A2 (fr) | 2002-05-23 | 2003-05-23 | Systeme et procede de commande de panoramique et de zone de defilement d'une image d'affichage |
Country Status (2)
Country | Link |
---|---|
AU (1) | AU2003239874A1 (fr) |
WO (1) | WO2003100573A2 (fr) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1725927A2 (fr) * | 2004-02-23 | 2006-11-29 | Hillcrest Laboratories, Inc. | Procede de zoomage incrementiel en temps reel |
DE102007037321A1 (de) * | 2007-06-28 | 2009-01-02 | Corel Tw Corp. | Verfahren für das Bedienen eines Menüs einer Multimedia-Disc |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS5938791A (ja) * | 1982-08-30 | 1984-03-02 | 株式会社東芝 | 画像表示装置 |
US5526481A (en) * | 1993-07-26 | 1996-06-11 | Dell Usa L.P. | Display scrolling system for personal digital assistant |
US7142205B2 (en) * | 2000-03-29 | 2006-11-28 | Autodesk, Inc. | Single gesture map navigation graphical user interface for a personal digital assistant |
US20020015064A1 (en) * | 2000-08-07 | 2002-02-07 | Robotham John S. | Gesture-based user interface to multi-level and multi-modal sets of bit-maps |
-
2003
- 2003-05-23 AU AU2003239874A patent/AU2003239874A1/en not_active Abandoned
- 2003-05-23 WO PCT/US2003/016527 patent/WO2003100573A2/fr not_active Application Discontinuation
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1725927A2 (fr) * | 2004-02-23 | 2006-11-29 | Hillcrest Laboratories, Inc. | Procede de zoomage incrementiel en temps reel |
EP1725927A4 (fr) * | 2004-02-23 | 2007-12-26 | Hillcrest Lab Inc | Procede de zoomage incrementiel en temps reel |
US9304651B2 (en) | 2004-02-23 | 2016-04-05 | Hillcrest Laboratories, Inc. | Method of real-time incremental zooming |
DE102007037321A1 (de) * | 2007-06-28 | 2009-01-02 | Corel Tw Corp. | Verfahren für das Bedienen eines Menüs einer Multimedia-Disc |
US9329754B2 (en) | 2007-06-28 | 2016-05-03 | Corel Corporation | Method for operating menu of multimedia disk |
Also Published As
Publication number | Publication date |
---|---|
AU2003239874A8 (en) | 2003-12-12 |
WO2003100573A8 (fr) | 2004-02-19 |
AU2003239874A1 (en) | 2003-12-12 |
WO2003100573A3 (fr) | 2004-10-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11099712B2 (en) | Device, method, and graphical user interface for navigating and displaying content in context | |
US11256401B2 (en) | Devices, methods, and graphical user interfaces for document manipulation | |
JP3176541B2 (ja) | 情報検索装置および情報検索方法 | |
US8578292B2 (en) | Simultaneous document zoom and centering adjustment | |
EP2480957B1 (fr) | Dispositif, procédé et interface utilisateur graphique pour manipuler des objets d'interface utilisateur | |
US5844561A (en) | Information search apparatus and information search control method | |
US6370282B1 (en) | Method and system for advanced text editing in a portable digital electronic device using a button interface | |
US20070220449A1 (en) | Method and device for fast access to application in mobile communication terminal | |
US20070198942A1 (en) | Method and system for providing an adaptive magnifying cursor | |
US20070188473A1 (en) | System and methods for document navigation | |
EP2256609A2 (fr) | Dispositif mobile capable de zoom basé sur le toucher et son procédé de commande | |
US20130097551A1 (en) | Device, Method, and Graphical User Interface for Data Input Using Virtual Sliders | |
US20110316888A1 (en) | Mobile device user interface combining input from motion sensors and other controls | |
US20200326841A1 (en) | Devices, methods, and systems for performing content manipulation operations | |
EP2144147A2 (fr) | Systèmes et procédés d'interaction sans toucher | |
US7768502B2 (en) | Method, apparatus, and software program for processing information | |
WO2012065020A1 (fr) | Dispositif, procédé et interface utilisateur graphique pour naviguer dans une liste d'identifiants | |
JP2024526024A (ja) | 表示制御方法、装置 | |
EP2746922A2 (fr) | Procédé de commande tactile et dispositif portatif l'utilisant | |
JP7161824B2 (ja) | 表示コンテンツのパネルをナビゲートする方法 | |
KR101433969B1 (ko) | 그래픽 사용자 인터페이스를 생성하는 데이터 처리 장치, 네비게이트 방법, 컴퓨터 구현 방법, 기계 판독가능 매체, 및 무선 데이터 처리 장치 | |
WO2003100573A2 (fr) | Systeme et procede de commande de panoramique et de zone de defilement d'une image d'affichage | |
KR101920864B1 (ko) | 터치스크린을 이용하여 이미지를 표시하기 위한 방법 및 단말 | |
CN115617226A (zh) | 图标管理方法及装置 | |
KR102485594B1 (ko) | 음성 마우스 시스템 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A2 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PH PL PT RO RU SC SD SE SG SK SL TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A2 Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
CFP | Corrected version of a pamphlet front page | ||
CR1 | Correction of entry in section i |
Free format text: IN PCT GAZETTE 49/2003 UNDER (30) ADD "10/443,440, 22 MAY 2003 (22.05.2003), US" |
|
122 | Ep: pct application non-entry in european phase | ||
NENP | Non-entry into the national phase |
Ref country code: JP |
|
WWW | Wipo information: withdrawn in national office |
Country of ref document: JP |