JPH10240434A - Command menu selection method - Google Patents

Abstract

(57) [Summary] [PROBLEMS] To provide a command menu selection method capable of easily and reliably executing control of many types of devices in various situations. SOLUTION: A state information detecting section 1 detects state information which is information on a state or a movement such as a tilt, a movement or a rotation of a device. Is presented. The menu selection unit 3 selects a desired command from the menu and instructs the device according to the status information or other user input information. The menu presentation mode determination unit 4
By the input other than the state information, the device is transitioned to a menu presentation mode in which a menu should be presented, and the device is transitioned to a state in which the menu presentation mode is canceled and the menu should not be presented. Display 6
Displays a menu on the screen based on a menu presentation instruction from the menu presentation unit 2.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention mainly relates to portable information, communication, AV related equipment, etc.
The present invention relates to a method for presenting and selecting a menu for allowing a command for the operation control to be selectively input.

[0002]

2. Description of the Related Art In recent years, information communication devices and the like have been miniaturized,
Because of the possibility of being portable, user interface technology that is easy to use with these devices has been developed, and it has begun to consider using the user interface by detecting the state and movement of the device itself.

For example, in Japanese Patent Application Laid-Open No. 7-287689,
The tilt of the device is detected, and the display content and screen configuration are changed and displayed according to the tilt or a combination of changes in tilt.

[0004]

However, the method of the prior art can only be used for a device having a screen.
Consideration of control other than the change of the screen display contents is not enough.
In addition, if it is used for many types of control, the difference must be expressed by a combination of complicated changes in inclination, and in consideration of accuracy, the type of control is effectively limited to a certain number. There were problems such as getting lost.

The present invention has been made in view of such circumstances, and can be used for various devices, supports almost any operation control of the devices, and can be used for a great variety of types of control. It is an object of the present invention to provide a command menu selection method capable of realizing a user interface capable of performing operations easily in various situations.

[0006]

According to the first aspect of the present invention, in various devices such as information / communication / AV related devices, the inclination of the device,
State information detecting means for detecting state information indicating a state or movement such as movement, rotation, etc., based on the state information, a menu presenting means for presenting a menu indicating an operation control command group of the device, and the state information or Menu selection means for selecting a desired command from the menu according to other user input information and instructing the device.

According to a second aspect of the present invention, in the command menu selecting method according to the first aspect, the menu presenting means further comprises:
It is characterized by having a function of displaying a menu as the operation control command group on a screen.

According to a third aspect of the present invention, in the method for selecting a command menu according to the first aspect, the menu presenting means further comprises:
It is characterized by having a function of outputting a menu as the operation control command group by voice.

According to a fourth aspect of the present invention, in the command menu selecting method according to the first aspect, the menu presenting means further comprises:
It is characterized by having a function of presenting a menu as the operation control command group by deforming a device or a part of the device.

According to a fifth aspect of the present invention, in addition to the command menu selection method according to the first aspect, a menu presentation is provided in which a device is shifted to a menu presentation mode in which a menu is to be presented by an input unit other than the status information. A mode discriminating means is provided, and the menu presenting means is further provided with a function of interpreting the state information and presenting the menu only during a period in the menu presenting mode.

According to a sixth aspect of the present invention, in addition to the command menu selecting method according to the first aspect, a time from when a menu is presented by the menu presenting means to when a command is selected by the menu selecting means is measured. A menu timeout means is provided for terminating the menu presentation when no command is selected for a predetermined time or more.

[0012] The invention of claim 7 is characterized in that the menu timeout means of the command menu selection method according to claim 6 further has a function of changing the time until completion of the menu presentation by setting. .

According to an eighth aspect of the present invention, the menu presenting means of the command menu selecting method according to the first aspect further comprises:
If there is a command for presenting another menu in the content of the menu to be presented, and if a corresponding command is selected by the menu selection means according to the state information, the another menu is presented continuously and the hierarchy is displayed. It is characterized by having a function of continuously presenting / selecting a target or a linked menu based on state information.

According to a ninth aspect of the present invention, in the command menu selecting method according to the first aspect, the menu presenting means further comprises:
It is characterized by having a function of presenting different types of menus according to the type, direction, amount of operation (degree), etc. of the state information.

According to a tenth aspect of the present invention, the menu presenting means of the command menu selection method according to the ninth aspect further comprises a menu presented in accordance with the type, direction, operation amount (degree), etc. of the state information. It has a feature of changing the type by setting.

According to an eleventh aspect of the present invention, a menu is presented to the menu presenting means of the command menu selecting method according to the first aspect in accordance with a type, a direction, and an operation amount (degree) of the state information. It is characterized by having a function of changing the position and direction.

According to a twelfth aspect of the present invention, in the command menu selection method according to the eleventh aspect, the menu presenting means further includes a menu presenting a menu corresponding to a type, a direction, and an operation amount (degree) of the state information. And a function of changing the direction by setting.

According to a thirteenth aspect of the present invention, the menu presenting means of the command menu selecting method according to the eleventh aspect further comprises, if the menu presentation method is a display on a rectangular screen, a menu from four directions, up, down, left and right. It is characterized by having a display function.

According to a fourteenth aspect of the present invention, in the command menu selection method according to the thirteenth aspect, the menu presenting means further has a function of displaying a menu having a rectangular or nearly rectangular shape from the vicinity of the upper, lower, left, and right sides of the screen. It is characterized by having.

According to a fifteenth aspect of the present invention, in the command menu selecting method according to the thirteenth aspect, the menu presenting means further includes a rectangle or a rectangle in any one of four directions, up, down, left and right, near the point of interest on the screen. It is characterized by having a function of displaying a menu of a similar shape.

According to a sixteenth aspect of the present invention, the menu presenting means of the command menu selecting method according to the eleventh aspect further comprises a method of presenting the menu on a screen, wherein the type of the state information is a tilt or a tilt. In the case of a change, a function of displaying a menu in a direction along the vertical direction on the screen is provided.

According to a seventeenth aspect of the present invention, the menu presenting means of the command menu selecting method according to the eleventh aspect further comprises a method of presenting a menu on a rectangular screen,
When the type of the status information is a tilt or a change in the tilt, a function of displaying a menu in a direction closest to a vertical direction among four directions of up, down, left, and right on the screen is provided.

According to an eighteenth aspect of the present invention, in addition to the command menu selection method according to the eleventh aspect, a menu presentation is provided in which a device is shifted to a menu presentation mode in which a menu is to be presented by an input unit other than the status information. A mode discriminating means, the menu presenting means is further provided, when the method of presenting the menu is display on a screen, and when the type of the state information is a slope or a change in the slope, at the time of transition to the menu presentation mode. A function including displaying a menu in a direction along a virtual vertical direction in which the plane including the screen is regarded as a virtual horizontal plane, and is orthogonal to the virtual horizontal plane, with the side having the viewpoint being upward. It is characterized by that.

According to a nineteenth aspect of the present invention, in the command menu selecting method according to the first aspect, the menu presenting means further presents a menu having a plurality of selection items according to the state information, and thereafter displays the state information. A function of changing one selectable item from among the plurality of selection items in accordance with.

According to a twentieth aspect of the present invention, the menu presenting means of the command menu selecting method according to the nineteenth aspect further comprises a method of presenting the menu on a screen, and the status information includes a tilt or a change in tilt. In the case of, there is provided a function of sequentially moving one selectable item among the plurality of selection items to an adjacent item in accordance with state information such as the inclination or a change in the inclination. .

According to a twenty-first aspect of the present invention, in the command menu selection method according to the nineteenth aspect, the menu presenting means further comprises a step-by-step changing speed of one selectable item among the plurality of selection items. Alternatively, it is characterized by having a function that can be continuously changed by setting.

[0027] According to a twenty-second aspect of the present invention, in the command menu selection method according to the nineteenth aspect, the menu presenting means further comprises a step of changing the speed at which one selectable item of the plurality of selection items is changed. Type, direction,
It is characterized by having a function of changing according to the operation amount (degree).

According to a twenty-third aspect of the present invention, in the command menu selection method according to the nineteenth aspect, the menu presenting means further comprises a step of changing a speed at which one selectable item of the plurality of selection items is changed. Type, direction,
When the amount of motion (degree) is substantially constant, a function of gradually increasing the speed or gradually decreasing the speed is provided.

According to a twenty-fourth aspect of the present invention, in the command menu selection method according to the nineteenth aspect, the menu presenting means further comprises: For the items that cannot be selected functionally, the function of shortening the time of selecting one selectable item and making it difficult to select substantially is provided.

According to a twenty-fifth aspect of the present invention, the menu presenting means of the command menu selecting method according to the nineteenth aspect further comprises: In this case, there is a feature that a function for making the selection impossible is skipped by eliminating the time for selecting one item that can not be selected functionally.

According to a twenty-sixth aspect of the present invention, the menu presenting means of the command menu selecting method according to the first aspect further comprises a function of sequentially presenting selectable items in time series. 2. The command menu selection method according to claim 1, wherein:

According to a twenty-seventh aspect of the present invention, the menu presenting means of the command menu selecting method according to the twenty-sixth aspect further comprises a function of sequentially presenting a menu having a plurality of selection items in time series. It is characterized by:

According to a twenty-eighth aspect of the present invention, in the command menu selection method according to the twenty-sixth aspect, the menu presenting means further presents menus having a plurality of selection items one after another in a time-series manner. And a function of sequentially presenting a plurality of selection items of the selected menu in time series with respect to the menu selected by the user.

According to a twenty-ninth aspect of the present invention, in the command menu selection method according to the twenty-sixth aspect, the menu presenting means further comprises a function of changing an interval for presenting the menu in time series by setting. I have.

According to a thirtieth aspect of the present invention, in the command menu selection method according to the twenty-sixth aspect, the menu presenting means further includes a time-sequential menu presentation interval, the type of the status information, the direction, and the operation amount ( Degree) and the like.

According to a thirty-first aspect of the present invention, the menu presenting means of the command menu selecting method according to the twenty-sixth aspect further comprises: In addition, it has a function of shortening the presentation time and making it difficult to substantially select.

According to a thirty-second aspect of the present invention, in the command menu selecting method according to the twenty-sixth aspect, when the menu is presented in a chronological order, an item which cannot be functionally selected at the time is displayed. The feature is that it has a function that makes it impossible to make a selection by skipping the time to present it.

According to a thirty-third aspect of the present invention, the menu presenting means of the command menu selecting method according to the twenty-sixth aspect further comprises: And a function of continuously presenting the menu from the beginning.

According to a thirty-fourth aspect of the present invention, in addition to the command menu selection method according to the thirty-third aspect, the time from when the menu is started to be presented by the menu presenting means is measured, and a fixed or setting changeable. A menu time-out means is provided for terminating the menu presentation if no command is selected after a predetermined time has elapsed.

According to a thirty-fifth aspect of the present invention, the menu presenting means of the command menu selecting method according to the first aspect further displays a menu on a screen. Menu (pie menu) that is divided into (pseudo) sectors from points and assigned selection items
Is provided so that adjacent items can be selected sequentially according to the state information, that is, one selectable item is rotated.

According to a thirty-sixth aspect of the present invention, in the command menu selection method according to the thirty-fifth aspect, the menu presenting means further changes a rotation direction according to a type, a direction, and an operation amount (degree) of the state information. It is characterized by having functions.

According to a thirty-seventh aspect of the present invention, the menu presenting means of the command menu selecting method according to the thirty-fifth aspect further comprises a function of changing a time interval for sequentially rotating and presenting the menu, that is, a presentation speed. It is characterized by that.

According to a thirty-eighth aspect of the present invention, the menu presenting means of the command menu selecting method according to the thirty-fifth aspect further comprises: In addition, it has a function of shortening the presentation time and making it difficult to substantially select.

According to a thirty-ninth aspect of the present invention, the menu presenting means of the command menu selecting method according to the thirty-fifth aspect further comprises: The feature is that it has a function that makes it impossible to make a selection by skipping the time to present it.

According to a forty aspect of the present invention, in the method for selecting a command menu according to the thirty-fifth aspect, when the menu presenting means is further rotated and presents a menu, the type of the state information may be a slope or a change in the slope. In such a case, a feature is provided that a menu is displayed by rotating in a direction along the vertical direction on the screen, and a menu is stopped when a selection item closest to the vertical direction is reached.

According to a forty-first aspect of the present invention, in the command menu selection method according to the thirty-fifth aspect, the menu presenting means further starts rotation with the input of the state information as a rotation start trigger, and outputs another state information. It is characterized in that it has a function of performing a menu presentation operation such as rotation stop, rotation in the opposite direction, rotation restart in the same direction, etc., by input.

According to a twenty-second aspect of the present invention, the menu presenting means of the command menu selecting method according to the first aspect further displays a state in which menu selection items are arranged in a three-dimensional space by projecting the state on a screen. A function of indicating an item to be selected by the menu selection means by projecting and displaying on a screen a state in which an indicator for position indication moves in the three-dimensional space according to the state information. It is characterized by having.

According to a 43rd aspect of the present invention, the menu presenting means of the command menu selecting method according to the 1st aspect further projects a state where menu selection items are arranged on the surface of the three-dimensional object on a screen. Displaying a state in which an indicator for position indication moves on the surface of the three-dimensional object according to the state information on a screen to display an item selected by the menu selecting means. It has the following functions.

According to a forty-fourth aspect of the present invention, the same state information is input to the menu presenting means of the command menu selection method according to the first aspect a fixed number of times or a predetermined number of times in which the setting can be changed. It is characterized by having a function of presenting a menu for the first time.

According to a forty-fifth aspect of the present invention, a menu is further displayed on a screen in the menu presenting means of the command menu selection method according to the first aspect of the present invention. On the three-dimensional plane, one or a plurality of menus are arranged, a part of the virtual two-dimensional plane displayed on the screen is moved by the state information, and a desired selection item is displayed on the screen. It is characterized by having a function that enables selection when the user is in the state.

According to a forty-sixth aspect of the present invention, in the command menu selection method according to the forty-fifth aspect, the menu presenting means further changes a ratio of projecting the virtual two-dimensional plane onto a screen, thereby displaying a displayable range. It is characterized by having a function of enlarging or reducing.

According to a forty-seventh aspect of the present invention, in the command menu selection method according to the forty-fifth aspect, the menu presenting means further displays a part of the virtual two-dimensional plane on a screen, and simultaneously displays the displayed part. It is characterized by having a function of separately displaying which part of the virtual two-dimensional plane corresponds.

According to a forty-eighth aspect of the present invention, the menu presenting means of the command menu selecting method according to the first aspect further stores information on what menu is presented, and then the menu is presented. When requested, a feature is provided that presents a menu with the same or subsequent contents, using the held information as a starting point.

According to a fifty-ninth aspect of the present invention, a specific menu is not provided to the menu presenting means of the command menu selecting method according to the first aspect of the present invention in accordance with the status information, but at that time, It is characterized by having a function of randomly presenting a part or all of the menus that can be presented.

The invention according to claim 50 is characterized in that the menu presenting means of the command menu selecting method according to claim 49 further comprises a function of changing the menu presented at random by setting.

According to a fifty-first aspect of the present invention, in the command menu selecting method according to the first aspect, the menu selecting means further comprises:
It is characterized by a function of always presenting the selected command to the user and requesting confirmation.

According to a fifty-second aspect of the present invention, the menu selection means of the command menu selection method according to the first aspect further includes whether or not the menu is presented in a menu presented by the menu presentation means. The feature is that it has a function to always select the restore (undo) command.

[0058]

Embodiments of the present invention will be described below in detail with reference to the drawings.

FIG. 1 is a block diagram of a command menu selection device according to the first embodiment of the present invention. The command menu selection device includes a status information detection unit 1, a menu presentation unit 2, a menu selection unit 3, A menu presentation mode discriminating unit 4, a menu timeout unit 5, a display unit 6, an audio output unit 7, and a device shape deforming unit 8 are provided. The state information detection unit 1 detects state information that is information on the state and movement of the device such as tilt, movement, and rotation. Menu presentation part 2
Presents a menu indicating a group of operation control commands of the device, if necessary, based on the state information detected by the state information detection unit 1. The menu selection unit 3 selects a desired command from the menu and instructs the device according to the status information or other user input information.
The menu presentation mode determining unit 4 causes the device to transition to a menu presentation mode in which a menu is to be presented by an input other than the state information, and cancels the menu presentation mode to enter a state in which the menu should not be presented. Transition the device. The menu timeout unit 5 is provided after the menu is presented by the menu presentation unit.
The time until a command is selected by the menu selection means is measured, and if no command is selected for a predetermined time or more, the menu presentation is terminated. The display unit 6 displays a menu on the screen based on a menu presentation instruction from the menu presentation unit 2. The audio output unit 7 mainly outputs the contents of the menu by voice based on the menu presentation instruction of the menu presentation unit 2. The device shape deforming unit 8 changes the external shape and the surface state of the device into a shape corresponding to the menu content based on the menu presentation instruction of the menu presentation unit 2 and causes the device to perform motion such as vibration.

Next, the operation will be described. In the initial state, it is assumed that the menu can be presented, but not presented.

FIG. 35 shows the basic sequence of processing in this embodiment. First, the state information detection unit 1 detects state information that is information on the state and movement of the entire device using the command menu selection device, such as tilt, movement, and rotation.
Here, the inclination is detected in two axial directions using an optical sensor in the same manner as in the known example (however, more notches can be detected by increasing the number of cutouts), and the direction and amount of movement and rotation are determined by the main body of the device. Using an acceleration sensor and an angular velocity sensor respectively attached in three axial directions, necessary integration or differentiation processing and the like are performed and detected (FIG. 2), for example, by a method used in a video movie camera. An image from a camera attached to the device body may be continuously analyzed and detected.

As the inclination information, information detected in detail to improve the accuracy is used in several stages according to threshold values. Here, it is divided into 12 stages as shown in FIG. Similarly, acceleration and angular velocity are used in several stages in each axis direction (including the minus direction). Here, FIG.
As described above, the speed / angular acceleration calculated as an integral / differential value of each axis and the moving amount / rotation amount calculated by integrating them are also used as the five stages.

Note that acceleration / angular acceleration / velocity / angular velocity /
The movement amount / rotation amount is calculated based on a series of calculations while the user is pressing the state information detection button (FIG. 5). When the state information detection button is pressed, the menu presentation mode determining unit 4 shifts the device to the menu presentation mode. Thereafter, when the state information detection button is released, the state information is detected and sent to the menu presenting unit 2,
Cancel the menu presentation mode.

As another method, from the state where each of acceleration / angular acceleration / velocity / angular velocity is all within a certain threshold value (near 0), some operation is performed, and again these values are all set to the threshold value. It is also possible to calculate a series of items until the state returns to within a state, that is, to calculate a state until the state returns to a state close to stationary. In this case, it is not necessary to provide a menu presentation mode.

It is determined whether or not the detected state information is information for which a menu should be presented by the menu presentation section 2. If it is determined that the information is not information that should present a menu, the state information is simply discarded here,
It may be used as a trigger for operations other than the menu presentation. The menu can be of any type, as long as it actually controls the operation of the device. There are many types, but here, for simplicity, data (file) management / editing / communication / A group of commands related to menu presentation is assumed as a target of the menu. For example, data (file) management commands include open / close / read / write / play / stop /
Edit commands such as step / delete / copy / move / speed control / access management, and communication commands such as select / release / insert / delete / copy / move / undo
Menu presentation commands such as send / receive / stop / continue / retransmit / batch / destination designation / return designation / circulation designation, etc.
Submenu presentation / menu presentation content setting / active command move / active command stop / select / cancel / fix / reverse /
There is undo. A menu including one or some or all of these or other commands is associated with one or more of the status information, and the menu presenting unit 2 presents the menu when there is a corresponding relationship. It is determined that the information is to be provided.

It should be noted that there is no problem in associating a plurality of state information with the same menu, but associating a plurality of menus to which the same state information is to be presented is confused with the same operation content. May occur,
It is prohibited here. However, priorities are assigned to menu groups, etc., and the same status information is associated with multiple menus, and multiple menus are presented at the same time during operation, and which menu is actually presented. For example, a method of allowing the user to select whether or not to perform the operation may be adopted.

The menu presentation section 2 has a menu presentation output switching mode designated by the user. The menu presentation output switching mode may be specified by any input by the user, but here, the display mode / audio output mode /
It is assumed that one of the device shape deformation modes is specified. In addition, as a method of presenting a menu, a method of appealing to various human senses such as a change in temperature and a change in taste can be considered. It is difficult to take many temperature steps to show a sufficient temperature difference without causing harm, or the device worn by the user becomes complicated (for example, in the case of taste, various taste buds on the tongue are stimulated). Are not adopted in this embodiment. However, there is no problem even if a menu presentation method using various feelings including these is used.

When the menu presentation output switching mode is the display mode, the display unit 6 displays the menu on the screen of the device by the output of the menu presentation unit 2. The operation of the menu presentation unit 2 will be described in detail taking this display mode as an example. However, even when the menu presentation output switching mode is the audio output mode or the device shape deformation mode, the menu presentation unit 2 performs the same operation. Perform the operation or a part of the operation.

In this case, the menu is displayed as a series of rectangles indicating one command as shown in FIG. Depending on the type of menu, the menu may be displayed near a bar-shaped graphic prepared in advance on the screen (pull-down menu), or the display unit 6 may be displayed from the position of the pointer or the general screen display. It may be displayed (pop-up menu) at an appropriate position to be determined.

The menu presenting section 2 shows a single command which can be selected by the menu selecting section 3 in the displayed menu on the display section 6. The display unit 6 displays an area representing the single selectable command so as to be distinguished by a method such as emphasis / inversion / enlargement (FIG. 7). This case is referred to as the active output of the single selectable command. The command that is actively output may be determined and determined by the menu presentation unit by some means, or may be determined by a user's instruction or the like.

The shape of the menu figure is not limited to this. For example, a polygon or a circle indicating each command may be displayed on the entire screen, and it is sufficient that each command can be identified on the screen.

The menu presenting section 2 presents different types of menus depending on the type, direction, and amount (degree) of state information. Here, an edit menu is presented as shown in FIG. 8 according to the inclination with respect to the screen. Also, as shown in FIG. 9, when the horizontal movement amount exceeds the threshold value but is performed slowly (the y-axis direction speed is a small level in the negative direction), the communication menu is made faster. (When the speed in the y-axis direction is a large level in the negative direction), a menu presentation menu is presented. Reverse direction (velocity in y-axis direction is positive direction)
In the case of, a data (file) management menu is presented. FIG. 36 shows an example of the processing order of this part.

The menu presenting unit 2 changes the position or the direction in which the menu is displayed according to the type, the direction, the operation amount (degree) of the state information, and the like. For example, when a data (file) management menu is presented by inclination, FIG.
In the case of the direction of FIG.
In the case of the direction (b), a menu representing a command group is displayed from the left of the screen to the right. Then, the commands which are activated and output from the command group in the menu are sequentially changed from the head to the adjacent command in the same direction as the menu is displayed at a certain time interval (FIG. 1).
1). These have the advantage of being intuitive and easy to understand, assuming that the menus and the activation commands are fluid as if they were fluid. If the direction of the tilt is changed during the movement of the active output command, the state of movement of the active command changes. For example, after presenting the menu and moving the active command at the inclination of “1” in FIG. 3 at first, when there is no inclination (“0” state in FIG. 3), the movement of the active command is stopped. When the inclination becomes opposite ("11" state in FIG. 3), the movement of the active command is performed in the opposite direction (return direction). When the active command reaches the last command in the menu, the last command usually remains the active command, but when the “continuous display mode” is set by the user in the menu presenting unit 2 Returns to the first command and continues moving the active command. FIG. 37 shows an example of the processing order of this part.

The movement of the active command after the menu is displayed can be started in time series by the "move active command" command without using the state information. In this case, the movement of the active command is continued until any command is selected or the “active command stop” command is input. When the last command has been reached, as in the case where the “continuous display mode” is set, the process returns to the first command and continues to move the active command. further,
If the "Continuous menu presentation" command is entered,
Multiple menus are displayed one after another in chronological order. In that case, a certain menu is displayed, the active command is moved to the command group in the menu, and the display of the menu is stopped at the timing when the last command is reached and the next command is moved, and the display of the next menu is started. FIG. 38 shows an example of the processing order of this part.

Although the display of the menu and the movement of the active output command are performed using a single state information, ie, inclination, here, these may be separated.

Similarly, the display may be upward from the lower part and leftward from the right part depending on the direction of the inclination. Further, the plane including the screen at the time of shifting to the menu presentation mode by the menu presentation mode discriminating unit 4 is regarded as a virtual horizontal plane, not the actual gravity direction, and the plane is orthogonal to the virtual horizontal plane. Considering a virtual gravity direction acting in a virtual vertical direction with the side with the upper side, a menu display and an active output command in a direction along the virtual gravity by tilting from the virtual horizontal plane and the vertical direction. (FIG. 12). In this way, flexible menu presentation can be realized according to the place where the device is held and the situation. The display of the menu along the gravity or the virtual gravity can be effectively used not only for the inclination but also for the state information having the movement such as the rotation.

Although the menu is displayed from a fixed position near the periphery of the screen here, the menu may be displayed as a pop-up menu from a pointer position or the like while changing the display direction.

When the menu presentation output switching mode is the speech output mode, the speech output unit 7 outputs the menu contents in speech by the output of the menu presentation unit 2. Here, the selectable command group of the menu to be presented is set at a predetermined time interval (constant or variable).
And output by voice synthesis. The output may use prerecorded audio. The most recently output command is the active output command. The voice output of the current command may be repeated until the output of the next command starts.
In this case, the current command corresponds to the active output command.

When the menu presentation output switching mode is the device shape deformation mode, the menu presentation section 2
Output, the device shape deformation unit 8 deforms a part or the whole of the device so as to show the contents of the menu. here,
A large number of fine projections are raised on the device surface, and a symbol representing the type of menu to be presented and a symbol group representing selectable commands are presented (FIG. 13). In addition, the menu contents and the command group may be presented as, for example, Braille by the projections of the minute projections. Further, the menu may be presented by a change in the shape of the entire device (switching of the menu portion, etc.) or a change in the surface state (softening of the menu portion, etc.) irrespective of the protrusion on the device surface. Further, instead of statically retaining the shape resulting from the deformation, the menu may be presented by continuing to move the device by vibrating a part or the whole of the device.

When a menu is presented by the menu presenting section 2, the present embodiment enters a mode for receiving menu selection. Of course, any user input other than menu selection may be accepted. However, for the sake of simplicity, here, for the sake of simplicity, another menu presentation command group including menu selection or menu presentation cancellation (these are also menu commands) (It does not matter if it is input from the presentation by menu selection). The menu selection unit 3 selects and determines a single command from one or more command groups of the presented menu. The determined command is transmitted to the control device of the device, and the control is executed.

Various commands can be used to determine the command. The case where the menu presentation output switching mode is the display mode will be described as an example. When a desired command is actively output from a group of commands presented by the menu presentation unit, the user can make a menu selection by pressing a “confirm” button to confirm the command. When the device is provided with an input device for a pen or the like on the screen display unit such as a tablet, selection / confirmation is similarly performed by touching the active output area of the command with a pen or a finger. be able to. Further, when a voice input device is provided, selection can be performed based on simple voice data input (input of a level equal to or higher than a threshold value) or a voice recognition result. In addition, any device can be used as long as an input that can identify a command that is being actively displayed can be performed, such as using a pointing device other than a keyboard or a combination of a pen and a tablet.

When the menu presentation output switching mode is the voice output mode, the menu selection unit 3 performs the same operation while the command is actively output, that is, from the start of output to the start of output of the next command. When the user performs a selection operation, the contents of the active output command are selected and confirmed from the presented menu.

When the menu display output switching mode is the device shape deformation mode, by pressing one of the buttons (FIG. 13) near each ridge of a symbol indicating a selectable command group, User input to the menu selection unit 3 is performed. Although a dedicated button is used here, a mechanism that can press the bump itself may be used, or a correspondence between the position of the button and the menu content (the content of the command group) may be changed using a pressure-sensitive tablet or the like. .

When the command selection in the menu selection unit 3 is performed using the status information, and when the selected command is “sub menu presentation” of the menu presentation command group, as a result of device control, Menu presentation part 2
Presents the corresponding submenu (FIG. 14). The sub-menu further includes a menu selection unit 3 using status information.
, The menu presenting unit 2 and the menu selecting unit 3 operate continuously, and can present / select a hierarchical or linked menu continuously using the state information. FIG. 39 shows an example of the processing order of this part.

The menu timeout unit 5 measures the time from when a menu is presented by the menu presentation unit 2 to when a command is selected by the menu selection unit 3. Here, if the command is not selected even after a predetermined period of time has elapsed, a menu timeout instruction is issued to the menu presenting unit 2 so as to end the menu presentation. The menu presentation unit 2 terminates the menu presentation based on the menu timeout instruction and disables the menu selection unit 3 from selecting a command (FIG. 35).

The menu timeout unit 5 can set the time until the menu timeout instruction is issued. Here, the time from 5 seconds to 1 minute in units of 5 seconds is displayed on the screen, and is set and changed according to a user's instruction.

Next, a second embodiment of the present invention will be described. FIG. 15 is a configuration diagram of a command menu selection device according to the second embodiment of the present invention. The command menu selection device includes a status information detection unit 1 and a menu presentation unit 2.
Menu selection unit 3 and menu presentation mode determination unit 4
, A menu timeout unit 5, a display unit 6, and a menu presentation content setting unit 9. The state information detection unit 1, menu presentation unit 2, menu selection unit 3, menu presentation mode determination unit 4, menu timeout unit 5, and display unit 6 perform the same operations as in the first embodiment.
The menu presentation content setting unit 9 sets the content of the menu presented by the menu presentation unit 2 corresponding to the type, direction, amount of operation (degree), and the like of the state information detected by the state information detection unit 1 by a user setting. Change by.

Next, the operation will be described. Since the operation after the state information is detected is the same as that of the first embodiment,
The operation of the menu presentation content setting section 9 will be described.

When a command for setting the menu presentation content is input from the user, the menu presentation content setting section 9 starts to change / set the correspondence between the status information and the content of the menu presented accordingly. First, a list of state information that can be associated and the contents of the menu associated with it (or that no association has been made) are displayed via the display unit 6 (FIG. 16). If it cannot fit on the screen, a hierarchical display or a display using a scroll bar is performed. When the user selects the status information whose association is to be changed / set, a list of menus that can be associated is displayed, and a new association is made by selecting from the list (FIG. 17). It does not matter if another state information is associated with the newly associated menu content, but a caution may be drawn to that effect. In the case where the associated menu content can change the presentation position or direction by the menu presentation unit 2, the presentation position and direction can be selected subsequently. FIG. 40 shows an example of the processing order of this part. Here, the status information is associated only with the menu that can be presented, but similarly, the status information may be associated with commands other than menu presentation, such as “select” and “confirm”.

Here, the association is performed by selection on the screen. However, after a command for setting the menu presentation content is input, a state or a movement for actually detecting the state information is generated to respond to this. The menu content to be performed may be selected. The menu presentation content setting unit 9 may be provided with a function of making a selection on the screen and rearranging the menu content itself.

The menu presentation content setting section 9 can also change / set the speed at which the menu presentation section 2 moves active output commands. When "command moving speed" in the screen of FIG. 16 is selected, the moving time interval corresponding to the moving speed is set from 0.1 second to 2 seconds in increments of 0.1 second, or is set in the state information. Change accordingly (for example, 1 second, 0.5 seconds, 0.2 seconds for each of the three steps if tilted)
An option of “acceleration” (when the same state information is continuously detected, the interval is shortened) is displayed. FIG. 41 shows an example of the processing order of this part. The menu presentation content setting unit 9 transmits the set content to the menu presentation unit 2, and the menu presentation unit 2 moves the command that is actively output at a moving speed according to the selected content.

Further, by selecting the "command movement mode" in the screen of FIG. 16, the display method of the command that is actively output can be changed / set. That is, when "Normal" displayed on the screen is selected, all commands displayed on the menu are activated and output according to the set speed, and when "Suppress" is selected, the function cannot be selected at that time ( For a command that does not perform a corresponding action even if it is selected, the time for active output is extremely short (for example, a display of about 0.05 seconds or less), and when "Remove" is selected, A setting is made so that the active output is not performed (skip) for a command that cannot be selected at the time. These setting contents are also displayed in the menu presentation unit 2
And is reflected in the movement of the command that is actively output. FIG. 42 shows an example of the order of the setting process of this part and an example of the order of the presentation process related thereto.

Similarly, when "moving speed" in FIG. 16 is selected, the moving speed of the active command or the menu displayed in the menu presenting section 2 in chronological order by the "moving active command" or the "continuous menu presentation" command. Can be set. Here, the moving speed may not be fixed, but may be changed according to the type, the direction, and the operation amount (degree) of the state information. For example, when an active command or a menu is moved according to the state information of the inclination, it is possible to set such that the speed is low when the inclination is small and the speed is high when the inclination is large.

When "input multiple times" in FIG. 16 is selected,
A set of the associated status information and menu contents is displayed. When one of them is selected, a screen for inputting the number of times is displayed (FIG. 18). Here, for example, when "5" is input as the number of times, the menu content is displayed only when the same status information is input five times for the set of the status information and the menu content to which the target association is made. Will be. FIG. 43 shows an example of the order of the setting processing of this part and an example of the order of the presentation processing related thereto. This provides a useful interface for applications such as games.

In the present embodiment, the method of displaying a screen as a command presenting method has been described. However, the setting can be similarly performed by another method. For example, in the case of performing voice output, by changing the moving speed of a command that is actively output, the interval of voice output of each command item is changed /
Can be set.

Next, a third embodiment of the present invention will be described. FIG. 19 is a configuration diagram of a command menu selection device according to the third embodiment of the present invention. The command menu selection device includes a state information detection unit 1 and a menu presentation unit 1.
2, a menu selection unit 3, a menu presentation mode determination unit 4, a menu timeout unit 5, a display unit 6, and a menu presentation content setting unit 9. Status information detecting unit 1, menu selecting unit 3, menu presenting mode determining unit 4,
The menu timeout unit 5, the display unit 6, and the menu presentation content setting unit 9 perform the same operations as in the first and second embodiments. The menu presenting section 12 is almost the same as the menu presenting section 2 of the first embodiment, but the menu displayed on the screen through the display section 6 is a circle, an ellipse, or a polygon from a point near the center (pseudo). It is characterized in that it is a menu (pie menu) that is divided into sectors and to which commands as selection items are assigned.

Next, the operation will be described. Menu presentation section 12
Other operations are the same as those of the first and second embodiments,
The operation of the menu presentation unit 12 will be described.

The menu presentation section 12 displays the pie menu through the display section 6 upon detecting the corresponding state information (FIG. 20). Here, the active output command is not only instructed directly by the user with a pen or a combination of a finger and a tablet, but also moves so that commands of adjacent items are sequentially switched. This is a rotation of the active command on the pie menu, which is a constraint for realizing an interface that is intuitive and intuitive to the user. However, the command may be moved to a non-adjacent command.

[0099] The menu presenting section 12 includes the type of status information,
The direction of the rotation is changed according to the direction, the amount of motion (degree), and the like. For example, as shown in FIG. 21, when a rotation amount equal to or more than a threshold value is detected in the clockwise direction on the plane of the screen, the activation output command also rotates clockwise. When the counterclockwise rotation amount is detected, the active output command also rotates counterclockwise. At this time, the rotation speed, the command movement mode, and the like can be variously changed / set as in the first and second embodiments.

When the inclination or the change of the inclination is used as the state information, the movement of the active output command is displayed along the gravity or the virtual gravity as in the first and second embodiments. In this case, it is moved so as to rotate in the direction in which the component force in the screen direction of the gravity or the virtual gravity acts, and the movement is stopped when the command in the direction in which the component force acts is reached (FIG. 22).

Further, when the command of “active command movement” is input according to the status information, the movement (rotation) of the active output command is started. At that time, the “reverse” command is input according to another status information. In this case, the rotation direction is reversed, and when the “active command stop” command is input, the rotation is stopped. When the “active command movement” command is input in the stopped state, the rotation is started again in the direction that was being rotated before the stop.

Next, a fourth embodiment of the present invention will be described. FIG. 23 is a configuration diagram of a command menu selection device according to a fourth embodiment of the present invention. The command menu selection device includes a status information detection unit 1 and a menu presentation unit 2
2, a menu selection unit 3, a menu presentation mode determination unit 4, a menu timeout unit 5, a display unit 6, and a menu presentation content setting unit 9. Status information detecting unit 1, menu selecting unit 3, menu presenting mode determining unit 4,
The menu timeout unit 5, the display unit 6, and the menu presentation content setting unit 9 perform the same operations as in the first and second embodiments. The menu presenting unit 22 is almost the same as the menu presenting unit 2 of the first embodiment, except that the menu displayed on the screen through the display unit 6 is formed by projecting a three-dimensional space or a three-dimensional object onto the screen. It is characterized by becoming.

Next, the operation will be described. Menu presentation section 22
Other operations are the same as those of the first and second embodiments, and therefore the operation of the menu presenting unit 22 will be described.

The menu presentation unit 22 projects the state of the menu and each command in the three-dimensional space on the screen by detecting the state information (FIG. 24), or displays the state on the surface of the three-dimensional object. The menu and the state in which each command is arranged are projected on the screen (FIG. 25), and are displayed on the display unit 6. The menu presentation unit further displays an indicator (pointer) for moving on the three-dimensional space or the surface of the three-dimensional object, and moves and displays the pointer by inputting state information after the menu is displayed. . When the user moves the pointer to an area representing a desired command (when the desired command becomes an active output command), the user selects a command by the menu selection unit 3 by inputting state information or another input. / Confirm.

Next, a fifth embodiment of the present invention will be described. FIG. 26 is a configuration diagram of a command menu selection device according to the fifth embodiment of the present invention. The command menu selection device includes a status information detection unit 1 and a menu presentation unit 3.
2, a menu selection unit 3, a menu presentation mode determination unit 4, a menu timeout unit 5, a display unit 6, and a menu presentation content setting unit 9. Status information detecting unit 1, menu selecting unit 3, menu presenting mode determining unit 4,
The menu timeout unit 5, the display unit 6, and the menu presentation content setting unit 9 perform the same operations as in the first and second embodiments. The menu presenting unit 32 is almost the same as the menu presenting unit 2 of the first embodiment, but one or more menus are displayed on the virtual two-dimensional plane larger than the screen through the display unit 6. It is arranged above, and is characterized in that a part of the virtual two-dimensional plane displayed on the screen moves according to state information. Further, for the purpose of helping the user to understand, where the current two-dimensional plane is currently displayed on the screen is separately displayed (FIG. 27).

Next, the operation will be described. Menu presentation unit 32
Other operations are the same as those of the first and second embodiments,
The operation of the menu presentation unit 32 will be described.

The menu presentation section 32 displays a part of one or a plurality of menus arranged on a virtual two-dimensional plane having a size exceeding the screen. The displayable portion moves on the virtual two-dimensional plane according to state information such as the amount of movement in a direction parallel to the screen (FIG. 28). In the menu displayed on the screen,
Only the command displayed on the screen can be the active output command, and can be directly selected by the user, or the active output command can be moved only among the commands displayed on the screen. It is.

The menu presenting unit 32 changes the ratio of projecting the virtual two-dimensional plane on the screen according to the “zoom value” set by the user, and consequently enlarges / reduces the displayable range on the screen. .

Next, a sixth embodiment of the present invention will be described. FIG. 29 is a configuration diagram of a command menu selection device according to the sixth embodiment of the present invention. The command menu selection device includes a status information detection unit 1 and a menu presentation unit 2.
Menu selection unit 3 and menu presentation mode determination unit 4
A menu timeout section 5, a display section 6, a menu presentation content setting section 9, and a menu presentation content holding section 10. Status information detection unit 1, menu presentation unit 2,
The menu selection unit 3, the menu presentation mode discrimination unit 4, the menu timeout unit 5, the display unit 6, and the menu presentation content setting unit 9 perform the same operations as in the first and second embodiments. The menu presentation content holding unit 10 holds the content of the menu presented last time.

Next, the operation will be described. The operations other than the menu presentation content holding unit 10 are the same as those of the first and second embodiments, and thus the operation of the menu content holding unit 10 will be described.

The menu content holding unit 10 holds the menu presented last time, the presentation method thereof, and the command that was selected or activated when the menu presentation was stopped. Next, when the state information corresponding to the presentation of the previously presented menu is input, the menu presenting unit 2 sets the display output unit 6 to the activation output command starting from the one held in the menu content holding unit 10. Display is started through (FIG. 30). However, if the previous presentation method was chronological and the menu presentation was stopped without selecting a command, the display of the active output command is started from the command corresponding to the held command next. Start. FIG. 44 shows an example of the processing order of this part.

In this embodiment, the menu content holding unit 10
Holds only the latest menu presentation contents, but may be extended to hold the menu presentation history for a certain period. In this case, in addition to enabling the active command display to be continued from the previous one for a plurality of types of menu presentations, the same menu presentation can be performed continuously according to the history, or the active output can be performed in descending order of the selection frequency. Utilization methods, such as doing, can also be used.

Next, a seventh embodiment of the present invention will be described. FIG. 31 is a configuration diagram of a command menu selection device according to the seventh embodiment of the present invention. The command menu selection device includes a status information detection unit 1 and a menu presentation unit 4.
2, a menu selection unit 3, a menu presentation mode determination unit 4, a menu timeout unit 5, a display unit 6, a menu presentation content setting unit 9, and a random number generation unit 20. The state information detecting unit 1, menu selecting unit 3, menu presenting mode determining unit 4, menu timeout unit 5, display unit 6, and menu presenting content setting unit 9 are first and second.
The same operation as in the embodiment is performed. Menu presentation section 42
Generates a random menu based on a random number, in addition to the operation of the menu presentation unit 2 of the first and second embodiments. The random number generator 20 generates a random number used by the menu presenter 42.

Next, the operation will be described. Menu presentation section 42
The operation other than that of the random number generator 20 is the same as that of the first and second embodiments.
The operation of will be described.

When the user sets the “random number mode” to “all” for the menu presenting section 42, the menu presenting section 4
2 stops the normal operation, and first obtains one random number from the random number generator 20 in response to the input of the state information. The random number generation unit 20 generates random numbers by the number of menus associated with the state information, and provides one random number at a time in response to a request from the menu presentation unit 42. Menu presentation section 42
Is the type, direction, and amount of motion (degree) of the input status information
Regardless, etc., a menu indicated by the obtained random numbers is presented. Further, when the random number mode is set to “partial” instead of “entire number”, the user or the menu presenting unit 42 determines which of the presentable menus is to be randomly presented (FIG. 32). The random number generation unit 20 is notified to generate only the group of numbers indicating the determined menu.
The random number generation unit 20 outputs the generated random number to the menu presentation unit 42.
If the numbers do not match the group of numbers notified from, another random number is generated and provided to the menu presenting unit 42 until the numbers match. FIG. 45 shows an example of the order of the setting process of this part and an example of the order of the presentation process related thereto. These operations can provide a useful interface for games and the like.

Although random numbers are generated here, all menus are not presented by performing the same menu number group control, but presented, for example, by a menu presentation history or command input. An interface for limiting menus can be easily realized. These are also useful as interfaces for games or general applications.

Next, an eighth embodiment of the present invention will be described. FIG. 33 is a configuration diagram of a command menu selection device according to the eighth embodiment of the present invention. The command menu selection device includes a status information detection unit 1 and a menu presentation unit 2.
A menu selection unit 13, a menu presentation mode determination unit 4, a menu timeout unit 5, a display unit 6, a menu presentation content setting unit 9, and a command confirmation / restoration unit 30. Status information detection unit 1, menu presentation unit 2,
The menu presentation mode determination unit 4, menu timeout unit 5, display unit 6, and menu presentation content setting unit 9
Operations similar to those of the first and second embodiments are performed. The menu selection unit 13 performs almost the same operation as the menu selection unit 3 of the first and second embodiments, but temporarily confirms the selection of the selected command, and issues a confirmation instruction from the command confirmation / restoration unit 30. Then, the command is determined and the control of the device is executed. Command confirmation / restoration unit 3
“0” confirms the selected command to the user and restores the executed result to the state before execution.

Next, the operation will be described. Menu selection unit 13
The operations other than the command confirmation / restoration unit 30 are the same as those of the first and second embodiments, and thus the operations of the menu selection unit 13 and the command confirmation / restoration unit 30 will be described.

When a command is selected by the menu selection unit 13, the content is transmitted to the command confirmation / restoration unit 30. When the command confirmation mode is set to "confirmation" by the user, the command confirmation / restoration unit 30 presents the contents of the transmitted command to the user and requests confirmation (FIG. 34). When the user makes a confirmation input, the command confirmation / restoration unit 30 transmits confirmation information to the menu selection unit 13. Upon receiving the confirmation information, the menu selection unit 13 determines the selected command and controls the device. If there is a denial input by the user, the command confirmation / restoration unit 30 transmits the denial information to the menu selection unit. Upon receiving the denial information, the menu selection unit 13 does not finalize the selected command and ends the menu selection processing. As a result, even when unintended state information is input, it is possible to prevent the device from performing an operation that is not desired by the user.
When the command confirmation mode is not set to “confirm”, the command confirmation / restoration unit 30 transmits confirmation information unconditionally with respect to the transmission of the command content from the menu selection unit 13, As in the second embodiment, the determination processing is immediately performed. FIG. 46 shows an example of the processing order of this part.

When the device is controlled by command selection from menu presentation, the command confirmation / restoration unit 30 always retains the state before control execution. Regardless of whether an undo command is included in the presented menu or not, when the undo is executed by the dedicated undo button, the command confirmation / restoration unit 30 holds the command by itself (that is, when the latest control is executed). Before it was done)
Return the device to its state. FIG. 47 shows an example of the order of the holding processing and the order of the restoring processing of this part. This guarantees that you can always return to the previous state even if you execute an unintended control, and a method that can cope with accidental operation in an unstable situation. provide.

Although the operation has been mainly described above mainly using the menu presentation means using display on the screen, the same operation can be performed using a device using audio output or device shape deformation. However, an interface that is somewhat difficult to intuitively grasp (for example, a pie menu in the third embodiment, a three-dimensional space interface in the fourth embodiment, and a virtual two-dimensional plane interface in the fifth embodiment) is implemented by voice output. May be slightly less useful for general use,
Even in that case, if the visually impaired user can be aware of the pie shape, three-dimensional space, projection onto a virtual two-dimensional plane, etc. in his head, it is easy to use even if the output is voice or device shape deformation Can be an interface.

Although these command menu selection methods are particularly suitable for use in portable devices, they can also be applied to other types of devices and their independent control parts to achieve great effects. it can.

[0123]

As described above, according to the present invention, various devices can be used by utilizing the state and movement of the devices themselves and using a general menu selection interface that easily reflects the user's intention. Command menu selection that can be used, supports almost any operation control of the device, can be used for a great variety of controls, and provides a user interface that can be easily operated in various situations A method can be provided.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of a command menu selection device according to a first embodiment of the present invention.

FIG. 2 is a diagram showing an example of a sensor configuration for detecting movement and rotation.

FIG. 3 is a diagram showing stages of tilt information;

FIG. 4 is a diagram showing stages of acceleration / angular velocity information;

FIG. 5 illustrates an example of a state information detection button.

FIG. 6 is a diagram showing a display example of a menu on a screen.

FIG. 7 is a diagram showing a display example of an activation output command.

FIG. 8 is a diagram showing an example of menu presentation based on tilt information.

FIG. 9 is a diagram showing an example of menu presentation based on movement information.

FIG. 10 is a diagram showing an example of menu presentation based on a difference in tilt direction.

FIG. 11 is a diagram showing a display example of an active command based on tilt information.

FIG. 12 is a diagram showing an example of menu presentation in consideration of a virtual horizontal plane.

FIG. 13 is a diagram showing menu presentation by device shape deformation output.

FIG. 14 is a diagram showing an example of sub menu presentation.

FIG. 15 is a configuration diagram of a command menu selection device according to a second embodiment of the present invention.

FIG. 16 is a diagram showing an example of correspondence between status information and menu contents.

FIG. 17 is a diagram showing an example of correspondence between selected state information and menu contents.

FIG. 18 is a diagram showing an example of setting multiple inputs.

FIG. 19 is a configuration diagram of a command menu selection device according to a third embodiment of the present invention.

FIG. 20 shows an example of pie menu presentation.

FIG. 21 is a diagram illustrating an example of a state in which an active output command is rotated according to rotation information.

FIG. 22 is a diagram showing an example of a state in which an active output command rotates along the direction of gravity.

FIG. 23 is a configuration diagram of a command menu selection device according to a fourth embodiment of the present invention.

FIG. 24 is a diagram showing an example in which a menu and a command are arranged on a three-dimensional space and projected on a screen;

FIG. 25 is a diagram showing an example in which a menu and a command are arranged on the surface of a three-dimensional object and projected on a screen;

FIG. 26 is a configuration diagram of a command menu selection device according to a fifth embodiment of the present invention.

FIG. 27 is a diagram illustrating an example of a state in which a part of a virtual two-dimensional plane is displayed on a screen.

FIG. 28 is a diagram illustrating an example of movement and zooming of a screen display area on a virtual two-dimensional plane.

FIG. 29 is a configuration diagram of a command menu selection device according to a sixth embodiment of the present invention.

FIG. 30 is a diagram showing a state in which menu presentation is restarted based on information in a menu content holding unit.

FIG. 31 is a configuration diagram of a command menu selection device according to a seventh embodiment of the present invention.

FIG. 32 is a diagram showing an example of setting a menu that can be presented from all menus;

FIG. 33 is a configuration diagram of a command menu selection device according to an eighth embodiment of the present invention.

FIG. 34 is a diagram showing an example of command confirmation in a command confirmation / restoration unit;

FIG. 35 is a diagram showing a basic order of processing according to the first embodiment of the present invention;

FIG. 36 is a diagram showing an example of a menu presentation order based on a type, a direction, and an operation amount (degree) of state information.

FIG. 37 is a diagram showing an example of the display order of menus and active commands.

FIG. 38 is a diagram showing an example of the order of continuous menu presentation in time series.

FIG. 39 is a diagram showing an example of an order of continuous submenu presentation / selection.

FIG. 40 is a diagram showing an example of a menu presentation content setting order in the second embodiment of the present invention.

FIG. 41 is a diagram showing an example of the order of setting the activation command moving speed.

FIG. 42 is a diagram showing an example of the order of presentation parts related to the setting of the active command movement mode.

FIG. 43 is a diagram showing an example of the order of presentation parts related to the setting of input multiple times.

FIG. 44 is a view showing an example of the order of the next presentation related to holding the menu contents in the sixth embodiment of the present invention.

FIG. 45 is a diagram showing an example of the order of presentation portions related to menu presentation setting using random numbers in the seventh embodiment of the present invention.

FIG. 46 is a diagram showing an example of the order of command confirmation in the eighth embodiment of the present invention.

FIG. 47 is a diagram showing an example of the order of holding and restoring the device state.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 State information detection part 2 Menu presentation part 3 Menu selection part 4 Menu presentation mode discrimination part 5 Menu timeout part 6 Display part 7 Audio output part 8 Device shape transformation part 9 Menu presentation contents setting part 10 Menu presentation contents holding part 12 Menu Presentation unit 13 Menu selection unit 20 Random number generation unit 22 Menu presentation unit 30 Command confirmation / restoration unit 32 Menu presentation unit 42 Menu presentation unit

 ──────────────────────────────────────────────────続 き Continued on the front page (72) Inventor Yoshihiro Yamamoto 1006 Kadoma Kadoma, Osaka Prefecture Matsushita Electric Industrial Co., Ltd.

Claims (52)

[Claims] 1. An information / communication / AV-related device, comprising: status information detecting means for detecting status and movement of a device such as tilt, movement, rotation, etc., based on the status information. Menu presenting means for presenting a menu indicating a group of operation control commands of the device; and menu selecting means for selecting a desired command from the menu and instructing the device by the status information or other user input information. A method for selecting a command menu, comprising: 2. The command menu selection method according to claim 1, wherein said menu presenting means displays a menu as the operation control command group on a screen. 3. The command menu selection method according to claim 1, wherein said menu presentation means outputs a menu which is said group of operation control commands by voice. 4. The command menu selection method according to claim 1, wherein the menu presenting means presents a menu which is the operation control command group by deforming a device or a part of the device. 5. An input unit other than the state information,
A menu presenting mode discriminating means for transitioning a device to a menu presenting mode in which a menu is to be presented, wherein the menu presenting means presents the menu by interpreting the state information only during a period in the menu presenting mode. 2. The method according to claim 1, wherein the command menu is selected. 6. A menu for measuring a time from when a menu is presented by the menu presenting means to when a command is selected by the menu selecting means, and terminates the menu presentation when no command is selected for a predetermined time or more. 2. The method according to claim 1, further comprising time-out means. 7. The command menu selection method according to claim 6, wherein the menu time-out means changes the time until the menu presentation ends by setting. 8. When there is a command presenting another menu in the contents of the menu presented by the menu presenting means, and when a corresponding command is selected by the menu selecting means based on status information, 2. The command menu selection method according to claim 1, wherein the menu presenting means continuously presents the another menu, and continuously presents or selects a hierarchical or linked menu based on status information. 9. The command menu selection method according to claim 1, wherein the menu presenting means presents different types of menus according to any one of the type, direction, and amount of operation of the state information. . 10. The command according to claim 9, wherein the menu presenting unit changes the type of the menu presented according to any one of the type, direction, and amount of operation of the state information. Menu selection method. 11. The command according to claim 1, wherein the menu presenting means changes a position or a direction at which a menu is presented according to one of a type, a direction, and an amount of operation of the state information. Menu selection method. 12. The menu presentation means according to claim 11, wherein the menu presentation position or direction corresponding to one of the type, the direction, and the operation amount of the state information is changed by setting. Command menu selection method. 13. The command menu selection method according to claim 11, wherein, when the menu presentation method is a display on a rectangular screen, the menu presentation means displays the menu from four directions: up, down, left, and right. . 14. The command menu selection method according to claim 13, wherein the menu presenting means displays a menu having a rectangular shape or a shape close to a rectangular shape from the vicinity of the upper, lower, left and right periphery of the screen. 15. The menu presenting means according to claim 13, wherein the menu presenting means displays a menu having a rectangular shape or a shape close to the rectangle in one of four directions, up, down, left, and right, near the point of interest on the screen. Command menu selection method. 16. The menu presenting means, when the method of presenting the menu is display on a screen, and when the type of the status information is a tilt or a change in the tilt, the menu is presented in a direction along a vertical direction on the screen. 12. The command menu selection method according to claim 11, wherein is displayed. 17. The menu presenting means, when the method of presenting the menu is display on a rectangular screen, and when the type of the status information is a tilt or a change in the tilt, the menu presenting means selects one of four directions, up, down, left, and right on the screen. The command menu selection method according to claim 11, wherein the menu is displayed in a direction closest to the vertical direction. 18. A menu presenting mode discriminating means for shifting a device to a menu presenting mode in which a menu is to be presented by an inputting means other than the state information, wherein the menu presenting means comprises a menu presenting method. If the type of the state information is a tilt or a change in tilt, the plane including the screen at the time of transition to the menu presentation mode is regarded as a virtual horizontal plane, and the virtual horizontal plane is displayed. 12. The command menu selection method according to claim 11, wherein the menu is displayed in a direction along a virtual vertical direction with the side having the viewpoint facing upward. 19. The menu presenting means presents a menu having a plurality of selection items according to the status information, and changes one selectable item among the plurality of selection items according to the status information thereafter. 2. The command menu selection method according to claim 1, further comprising: 20. The menu presenting means, when the method of menu presentation is display on a screen, and when the status information is a tilt or a change in a tilt, selects one selectable item from the plurality of selection items. 20. The command menu selection method according to claim 19, wherein the command menu is sequentially moved to an adjacent item according to the state information of the inclination or the change of the inclination. 21. The method according to claim 19, wherein the menu presenting means changes the speed at which one selectable item of the plurality of selection items is changed stepwise or continuously by setting. The described command menu selection method. 22. The menu presenting means sets a speed at which one selectable item of the plurality of selection items is changed in accordance with one of a type, a direction, and an operation amount of the state information at the time of change. 20. The method according to claim 19, wherein the command menu is changed. 23. The menu presenting means, wherein the speed at which one selectable item among the plurality of selection items is changed is substantially constant when any of the type, direction, and amount of operation of the state information at the time of the change. 20. The method according to claim 19, wherein, if
Command menu selection method described in. 24. The menu presenting means, when changing one selectable item among the plurality of selection items,
20. The command menu selection method according to claim 19, wherein, for an item that cannot be functionally selected at that time, a time for setting one selectable item is shortened to make it substantially difficult to select. 25. The menu presenting means, when changing one selectable item among the plurality of selection items,
20. The command menu selection method according to claim 19, wherein an item that cannot be selected functionally at that time is skipped without setting a time for setting it as one selectable item, and the selection is disabled. 26. The command menu selection method according to claim 1, wherein the menu presentation means presents items that can be selected in a time series one after another. 27. The command menu selection method according to claim 26, wherein said menu presentation means presents menus having a plurality of selection items one after another in a time series. 28. The menu presenting means presents a menu having a plurality of selection items one after another in chronological order, and for a menu selected by the menu selecting means, further displays a plurality of menus of the selected menu. 27. The selection items are presented one after another in time series.
Command menu selection method described in. 29. The command menu selection method according to claim 26, wherein said menu presenting means changes an interval for presenting the menu in time series by setting. 30. The apparatus according to claim 30, wherein the menu presenting means has a function of changing an interval for presenting the menu in a time series according to any of the type, the direction, and the operation amount of the state information. Item 30. The command menu selection method according to Item 26. 31. When presenting a menu in chronological order, the menu presenting means shortens the time for presenting an item that cannot be functionally selected at that time, thereby making it substantially difficult to select. 27. The command menu selection method according to claim 26, wherein: 32. The menu presenting means, when presenting a menu in chronological order, skips an item which cannot be selected functionally at that time without presenting time and makes it impossible to select. 27. The command menu selection method according to claim 26, wherein: 33. When presenting menus in chronological order, the menu presenting means returns to the initial state when all menus have been presented, and continues to present menus from the beginning. The command menu selection method according to claim 26, characterized in that: 34. A method for measuring a time from when a menu is started to be presented by the menu presentation means,
34. The command menu selection method according to claim 33, further comprising a menu time-out means for terminating menu presentation when a command is not selected even after a predetermined time in which setting can be changed has elapsed. 35. The menu presenting means, which displays a menu on a screen, divides a circle, an ellipse, or a polygon into a (pseudo) sector from a point near the center and assigns a selection item to the menu ( 2. A function for presenting a pie menu such that adjacent items are selectable in order according to the state information (so that one selectable item is rotated). Command menu selection method described in. 36. The command menu selection method according to claim 35, wherein said menu presenting means has a function of changing a rotation direction according to any one of a type, a direction, and an operation amount of said state information. Method. 37. The command menu selection method according to claim 35, wherein said menu presenting means changes a time interval for presenting the menu by rotating in sequence, ie, a presentation speed, by setting. 38. The menu presenting means, when rotating and presenting a menu in order, shortens the time for presenting items that cannot be functionally selected at that time, thereby making it substantially difficult to select. The method according to claim 35, wherein the command menu is selected. 39. The menu presenting means, when presenting the menu by rotating in order, skips the item that cannot be functionally selected at that time without presenting time, and skips.
36. The command menu selection method according to claim 35, wherein selection is disabled. 40. The menu presenting means rotates in a direction along a vertical direction on a screen when the type of the state information is a tilt or a change in the tilt when presenting a menu by rotating in order. 36. The command menu selection method according to claim 35, further comprising displaying a menu and stopping when a selection item closest to the vertical direction is reached. 41. The menu presenting means starts rotation with the input of the state information as a trigger to start rotation, and stops the rotation, rotates in the opposite direction, or rotates in the same direction by inputting another state information. 36. The command menu selection method according to claim 35, wherein a menu presentation operation such as rotation restart is performed. 42. The menu presenting means projects and displays on a screen a state where menu selection items are arranged in a three-dimensional space, and designates a position in the three-dimensional space according to the state information. The command menu selection method according to claim 1, wherein an item to be selected by the menu selection means is indicated by projecting and displaying a state in which an indicator for the movement is displayed on a screen. 43. The menu presenting means for projecting and displaying on a screen a state where menu selection items are arranged on the surface of a three-dimensional object, and displaying the state on the surface of the three-dimensional object based on the state information. 2. The command menu selection method according to claim 1, wherein an item to be selected by the menu selection means is indicated by projecting and displaying on the screen the manner in which the indicator for moving the position is moved. 44. The method according to claim 1, wherein the menu presenting means presents the menu only when the same state information is input a fixed number or a predetermined number of times that the setting can be changed. Command menu selection method. 45. The menu presenting means for displaying a menu on a screen, wherein one or a plurality of menus are arranged on a virtual two-dimensional plane larger than the screen, 2. The method according to claim 1, wherein a part of the virtual two-dimensional plane displayed on the screen is moved according to the state information, and a desired selection item can be selected when displayed on the screen. The described command menu selection method. 46. The display device according to claim 45, wherein the menu presenting unit enlarges or reduces a displayable range by changing a ratio of projecting the virtual two-dimensional plane on a screen. Command menu selection method. 47. The menu presenting means displays a part of the virtual two-dimensional plane on a screen and separately displays which part of the virtual two-dimensional plane corresponds to the displayed part. 46. The command menu selection method according to claim 45, wherein: 48. The menu presenting means retains information on what menu is presented, and when the next menu presentation is requested, the retained information is used as a starting point for the same or subsequent menus. 2. The command menu selection method according to claim 1, wherein the content is presented on a menu. 49. The menu presenting means does not present a specific menu according to the state information, but presents a part or all of menus at random from the entire menu that can be functionally presented at that time. 2. The method according to claim 1, wherein the command menu is selected. 50. The command menu selection method according to claim 49, wherein said menu presentation means changes the menu presented at random by setting. 51. The method according to claim 1, wherein the menu selection means always presents the selected command to the user and requests confirmation when selecting a command based on the status information. Command menu selection method. 52. The menu selection means can always select a restoration (undo) command irrespective of whether or not it is included in a menu presented by the menu presentation means. 2. The method for selecting a command menu according to item 1.