WO2018191961A1

WO2018191961A1 - Head-mounted display equipment and content input method therefor

Info

Publication number: WO2018191961A1
Application number: PCT/CN2017/081467
Authority: WO
Inventors: 韩超
Original assignee: 深圳市柔宇科技有限公司
Priority date: 2017-04-21
Filing date: 2017-04-21
Publication date: 2018-10-25
Also published as: WO2018191961A9; CN108475178A

Abstract

A content input method, applied to head-mounted display equipment comprising a display device and a touch input device. Said method comprises: in response to a content input request, controlling a display device to display a soft keyboard input interface, the soft keyboard input interface including first and second selection regions, the first selection region including an initial row and a final row, the initial row including initial first letter sections, the final row including final first letter sections; in response to inputted first and second touch actions, selecting an initial first letter and a final first letter from the initial row and the final row, respectively, to form initial and final combinations; controlling to display, in the second selection region, Chinese pinyin and/or characters corresponding to the initial and final combinations; performing a selection of the displayed Chinese pinyin and/or characters in response to an inputted third touch action, and selecting a character. The invention thus can facilitate a user in input when wearing head-mounted display equipment.

Description

Head mounted display device and content input method thereof

Technical field

The present invention relates to a display device, and more particularly to a head mounted display device and a content input method thereof.

Background technique

At present, head-mounted display devices have gradually become popular because of their convenience and ability to achieve stereoscopic display and stereo. In recent years, with the advent of virtual reality (VR) technology, head-mounted display devices have become more widely used as hardware support devices for VR technology. Since the user cannot see the outside situation after wearing the head-mounted display device, it is often inconvenient when using an existing input device for input. In particular, when there is a Chinese input requirement, it is more inconvenient to use an existing input device for input due to the complexity of Chinese input.

Summary of the invention

The embodiment of the invention discloses a head-mounted display device and a content input method thereof, which can facilitate the user to input content.

A head mounted display device disclosed in an embodiment of the present invention includes a display device, a touch input device, and a processor, wherein the touch input device includes a touch operation for a user, and the processor is configured to respond to a content input request control The display device displays a soft keyboard input interface, and the soft keyboard input interface includes a first selection area and a second selection area, the first selection area includes a consonant letter line and a final letter line, and the consonant letter line includes an edge a plurality of initials of the initials arranged in a first direction, the row of finals comprising a plurality of initials arranged in a second direction, the initials comprising at least one initial, the final alpha comprising at least one final letter The second selection area is configured to display at least a Chinese pinyin and/or a Chinese character; the processor is configured to select in a consonant initial letter area of the initial letter line in response to the first touch action input on the touch input device Selecting an initial initial area and responding to a second touch input on the touch input device Action and select in the initials area of the finals of the finals and select a final area of the finals, and derive The initials of the selected initials in the initials of the initials and the initials of the initials in the initials of the finals are combined, and then the Chinese pinyin and/or Chinese characters corresponding to the combination of the finals are determined and controlled. The Chinese pinyin and/or Chinese characters corresponding to the combination of the vowels are displayed on the second selection area, and the processor selects and selects the Chinese characters displayed on the second selection area in response to the third touch action input on the touch input device. Chinese characters to be entered.

The embodiment of the present invention further provides a content input method, which is applied to a head mounted display device, where the head mounted display device includes a display device and a touch input device, wherein the method includes the steps of: responding to the content input request, and controlling the location The display device displays a soft keyboard input interface, wherein the soft keyboard input interface includes a first selection area and a second selection area, the first selection area includes a consonant letter line and a final letter line, and the consonant letter line includes an edge a plurality of initials of the initials arranged in the first direction, the row of initials comprising a plurality of initials arranged in the second direction, each of the initials including at least one initial, each initial in the initials Including at least one final character, the second selection area is for displaying at least Chinese pinyin and/or Chinese characters; and selecting in the initial initial area of the initial letter line in response to the first touch action input on the touch input device And selecting a parent letter area and responding to the second touch action input on the touch input device Selecting the initials of the mother letter line and selecting a final letter line, and drawing all the initials of the initials in the initial initials of the selected initials and the initials of the finals in the initials of the finals a combination of a vowel combination; and controlling display of the Chinese pinyin and/or kanji corresponding to the combination of the vowels on the second selection area; and displaying the second selection area in response to the third touch action input on the touch input device Chinese characters are selected and the Chinese characters to be entered are selected.

The head-mounted display device and the content input method thereof of the invention can provide a more user-friendly soft keyboard input interface and an input mode corresponding to the soft keyboard input interface, which can be conveniently performed by the user after wearing the head-mounted display device Character content, especially the input of Chinese characters.

DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings to be used in the embodiments will be briefly described below. Obviously, the drawings in the following description are only one of the present invention. For some embodiments, other drawings may be obtained from those skilled in the art without any inventive effort.

1 is a schematic diagram of a head mounted display device in accordance with an embodiment of the present invention.

2 is a block diagram showing the structure of a head mounted display device in accordance with an embodiment of the present invention.

FIG. 3 is a structural block diagram of a touch input device of a head mounted display device according to an embodiment of the present invention.

4 is a schematic diagram of a soft keyboard input interface displayed by a display device of a head mounted display device according to an embodiment of the invention.

FIG. 5 is a schematic diagram of a first selection area in a soft keyboard input interface according to an embodiment of the invention.

FIG. 6 is a schematic diagram of a second selection area of a soft keyboard input interface according to an embodiment of the invention.

FIG. 7 is a schematic diagram of a soft keyboard input interface in a digital input mode according to an embodiment of the invention.

8-10 are schematic diagrams showing changes of an input interface of a soft keyboard with an input process according to an embodiment of the invention.

FIG. 11 is a schematic diagram of a touch input device disposed on an earpiece of a head mounted display device according to an embodiment of the invention.

FIG. 12 is a schematic diagram of a head mounted display device according to another embodiment of the present invention.

FIG. 13 is a flowchart of a content input method in an embodiment of the present invention.

Figure 14 is a sub-flow diagram of an embodiment of step S134 of Figure 13.

detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

Please refer to FIG. 1, which is a schematic diagram of a head mounted display device 100 in accordance with an embodiment of the present invention. As shown As shown in FIG. 1, the head mounted display device 100 includes an earphone device 1 and a display device 2. The earphone device 1 is for outputting sound, and the display device 2 is for outputting a display screen.

Please refer to FIG. 2 and FIG. 3 together. FIG. 2 is a structural block diagram of the head mounted display device 100. The head mounted display device 100 includes a touch input device 3 and a processor 4 in addition to the earphone device 1 and the display device 2.

The processor 4 is electrically connected to the earphone device 1, the display device 2, and the touch input device 3. The touch input device 3 is used for a user to input a touch operation.

Referring to FIG. 4 together, the processor 4 controls the display device 2 to display a soft keyboard input interface T1 in response to a Chinese content input request, and the soft keyboard input interface T1 includes a first selection area Z1 and a second selection area Z2. . The first selection area Z1 includes a consonant letter line H1 and a final letter line H1, the consonant letter line H1 including a plurality of initials M1 arranged in a first direction and a plurality of initials M2 arranged in a second direction . Each of the initials M1 includes at least one initial, and each initial alpha region M2 includes at least one initial. The initial initial area M1 includes the initials of all initials of the Chinese pinyin, and the final initials M2 includes the initials of all the finals of the Chinese pinyin. The second selection area Z2 is used to display at least Chinese pinyin and/or Chinese characters.

The processor 4 is configured to select and select an initial initial area M1 in the initial initial area M1 of the initial letter line H1 in response to the first touch action input on the touch input device 3, and respond to the The second touch action input on the touch input device 3 is selected in the initial region M2 of the final letter line H2 and a final initial region M2 is selected, and is obtained from the selected initial initial region M1. And the initials of the initials and the initials of the initials in the initials M2 of the finals are combined, and then the Chinese pinyin and/or Chinese characters corresponding to the combination of the finals are determined, and the display is controlled on the second selection area Z2. The Chinese pinyin and/or Chinese characters corresponding to the combination of the finals. The processor 4 selects at least the Chinese characters displayed on the second selection area Z2 and selects the Chinese characters to be input in response to the third touch action input on the touch input device 3. In another embodiment, the third touch action further selects a Chinese pinyin displayed on the second selection area Z2, and then selects a Chinese character corresponding to the selected Chinese pinyin to complete the Chinese character to be input. Selected.

In some embodiments, as shown in FIG. 3 , the touch input device 3 includes a first touch panel 31 and a second touch panel 32 . The first touch panel 31 and the second touch panel 32 are used for inputting touch by a user. operating. The first touch action and the second touch action are touch actions input on the first touch panel 31 , and the third touch actions are touch actions input on the second touch panel 32 . The following description of the present application will be described by taking the touch input device 3 including the first touch panel 31 and the second touch panel 32 as an example. In other embodiments, the touch input device 3 can be a touch panel, and the first touch action, the second touch action, and the third touch action can be on the same touch pad. Input touch action. When the touch input device 3 is a touch panel, the first touch panel 31 and the second touch panel 32 described below in the present application may be replaced by the touch input device 3.

Please refer to FIG. 5 and FIG. 6 together. FIG. 5 is a schematic diagram of the first selection area Z1, and FIG. 6 is a schematic diagram of the second selection area Z2. As shown in FIG. 5, the initial letter line H1 and the final letter line H2 in the first selection area Z1 are vertically arranged and intersect each other. Wherein, the initial letter line H1 is arranged in the horizontal direction, and the final letter line H2 is arranged in the vertical direction. Since there are 21 initials, they are b, p, m, f, d, t, n, l, g, k, h, j, q, x, zh, ch, sh, r, z, c, s. There are 24 vowels, including single vowels and complex vowels. Among them, single vowels are a, o, e, i, u, v, and complex vowels are ai, ei, ui, ao, ou, iu, ie, ve, er. An, en, in, un, vn, ang, eng, ing, ong. Therefore, the initial letters of the initials are b, c, d, f, g, h, j, k, l, m, n, p, q, r, s, t, w, x, y, z; The starting letters are a, e, i, o, u/v. As shown in FIG. 5, the initial letter H1 includes an initial initial area composed of B and C, an initial initial area composed of D and F, and the like. The final letter line H2 includes a final alphanumeric area having the letter A, a final initial area having the letter E, a final initial area having the letter U or V (U/V), and the like.

In some embodiments, the first touch action is a touch action of sliding a touch in a horizontal direction and staying at a position of one of the selected initials M1 in the selected initial letter line H1 for more than a preset time, The second touch action is a touch action of sliding the touch in the vertical direction and staying at a position of one of the final initials M2 of the selected final letter line H2 for more than a preset time.

In other embodiments, the first touch action is a touch action of sliding a touch in a horizontal direction and clicking at a position of one of the initial initials M1 of the selected initial letter line H1, the first The two touch action is a touch action of sliding the touch in the vertical direction and clicking at a position of one of the final initials M2 of the selected final letter line H2.

As shown in FIG. 6, the second selection area Z2 includes at least a pinyin selection area Z21 and a Chinese character selection area Z22, and the pinyin selection area Z21 displays a plurality of Chinese characters arranged along the first preset track. In the phonetic alphabet Y1, the Chinese character selection area Z22 displays a plurality of Chinese characters Y2 arranged along the second predetermined trajectory. The pinyin selection area Z21 and the Chinese character selection area Z22 are distributed on both sides of the initial letter line H1. The processor 4 determines a corresponding Chinese pinyin Y1 and/or a Chinese character Y2 according to the combination of the initials of the selected initials M1 and the final initials M2, that is, the Chinese pinyin Y1 that matches the combination of the finals. And/or the Chinese character Y2, and controls the display of the corresponding Hanyu Pinyin Y1 on the Pinyin selection area Z21 of the second selection area Z2, and displays the corresponding Chinese character Y2 on the Chinese character selection area Z22 of the second selection area Z2. The Chinese pinyin Y1 displayed on the pinyin selection area Z21 and the Chinese character Y2 displayed on the Chinese character selection area Z22 are used in the Chinese pinyin Y1 and the Chinese character Y2 corresponding to the combination of the vowels, or have been used recently. Chinese Pinyin and Chinese characters.

In some embodiments, the third touch action input on the second touch panel 32 includes at least a sliding touch that is input on the second touch panel 32 along the first preset trajectory and stays at the corresponding position. A time-sensitive touch action, and a touch action including a sliding touch moving along the second predetermined trajectory and staying at the corresponding position for more than a preset time. In other embodiments, the third touch action input on the second touch panel 32 may include at least a sliding touch that is input on the second touch panel 32 along the first preset track and is in a corresponding position. a touch action of the hit, and a touch action including a sliding touch moving along the second preset track and clicking at the corresponding position.

The processor 4 selects a Chinese pinyin and/or a Chinese character displayed on the second selection area Z2 in response to the third touch action input on the second touch panel 32 to select a Chinese character to be input, including: The processor 4 controls the selection of a number of Hanyu Pinyin in the Pinyin selection area Z21 in response to the sliding touch action of the movement along the first preset trajectory input on the second touchpad 32, and stays at a position corresponding to a certain Chinese Pinyin. Determining the Chinese pinyin as the selected Hanyu Pinyin when the preset time is exceeded; the processor 4 controls the Chinese character selection area Z22 to display the Chinese characters corresponding to the Hanyu Pinyin, and responds to the second touchpad The sliding touch motion control along the second preset trajectory input on 32 performs switching selection in a plurality of Chinese characters of the Chinese character selection area Z22, and determines that the Chinese character is when the position corresponding to a certain Chinese character stays longer than the preset time. Selected Chinese characters.

Obviously, when the user determines that there are target Chinese characters to be input among the plurality of Chinese characters displayed by the Chinese character selection area Z22, the user can directly slide along the second preset track to the position corresponding to the target Chinese characters on the second touch control board 32. And staying at the position for more than the preset time to select the target Chinese character. At this time, the processor 4 responds to the third touch area input on the second touch panel 32 to the second selection area Z2. The Chinese pinyin and/or Chinese characters displayed are selected to select the Chinese characters to be input, including: the processor 4 controls the Chinese characters in response to the sliding touch action along the second preset track input on the second touchpad 32. The selection is performed in a plurality of Chinese characters of the selection area Z22, and when the position corresponding to a certain Chinese character stays longer than the preset time, the Chinese character is determined to be the selected Chinese character.

As shown in FIG. 4, the display device 1 further displays a text input box K1, and the processor 4 is further configured to display the selected target Chinese character output into the text input box K1. The content input request may be generated after clicking the text input box K1.

In some embodiments, the processor 4 further controls to highlight the initials of the initial initial letter M1 in the currently selected initial letter line H1, the initial initial area M2 in the final letter line H2, and the Chinese pinyin in the pinyin selection area Z21. Y1, Chinese character Y2 in the Chinese character selection area Z22.

That is, the processor 4 performs selection switching in the initial initial area M1 of the initial letter line H1 in response to the first touch action input on the first touch panel 31, and the sliding position along with the first touch action And changing the selected initial initial area M1 and highlighting the currently selected initial initial area M1 in real time, and the processor 4 is responsive to the second touch action input on the first touchpad 31. Selecting in the initial letter area M2 of the final letter line H2, and replacing the selected final initial area M2 with the change of the sliding position of the second touch action and highlighting the currently selected final initial area of the final character in real time. M2. Similarly, the processor 4 replaces the selected Hanyu pinyin when the sliding position of the sliding touch action along the first preset track input on the second touchpad 32 changes, and highlights the currently selected one in real time. Chinese Pinyin Y1. The processor 4 controls to change the currently selected Chinese character in response to the change of the sliding position of the sliding touch motion moved along the second preset track input on the second touch panel 32, and highlights the currently selected one in real time. The Chinese character Y2. Thereby, the user can be prompted which one of the selected characters corresponding to the current touch operation.

As shown in FIG. 6 , in some embodiments, the first preset trajectory in which the plurality of Chinese pinyin Y1 displayed by the pinyin selection area Z21 are arranged is an upward curved curve, and the Chinese character selection area Z22 displays a plurality of along The second predetermined trajectory in which the Chinese characters Y2 are arranged is an arc curved downward. That is, the pinyin selection area Z21 is an upwardly curved arcuate area, and the Chinese character selection area Z22 is an arcuate area that is curved downward. As shown in FIG. 6, the pinyin selection area Z21 and the Chinese character selection area Z22 are joined end to end to form a ring. Obviously, the sliding touch motion in the third touch motion along the first preset trajectory is that the touch trajectory is an arc-shaped sliding touch that is curved upward, the third touch action The sliding touch motion in the movement along the second predetermined trajectory is a sliding trajectory in which the touch trajectory is an arc curved downward.

As shown in FIG. 6, the second selection area Z2 further includes a function icon area Z23. The function icon area Z23 includes a plurality of function icons B1 including, for example, a Chinese/digital input switching icon, a symbol icon, a space icon, and a line feed icon. As shown in FIG. 4, the plurality of function icons B1 are distributed in the four regions formed by the initial letter line H1, the final letter line H2, the pinyin selection area Z21, and the Chinese character selection area Z22.

In some embodiments, the processor 4 further controls switching the activation states of the pinyin selection area Z21, the Chinese character selection area Z22, and the function icon area Z23 in the second selection area Z2 in response to the double tap operation input on the second touch panel 32. . That is, if the currently activated region is the pinyin selection region Z21, the pinyin Y1 on the pinyin selection region Z21 can be selected in response to the user's sliding touch, provided that the processor 4 responds to the second trackpad. The double-click operation input on the 32, the processor 4 controls the function icon area Z23 to be in an active state, and at this time, the processor 4 can select the corresponding function icon area Z23 in response to the touch operation on the second touch panel 32. The function icon B1 controls and performs the function corresponding to the function icon B1.

Referring to FIG. 7 together, when the current pinyin selection area Z21 and the Chinese character selection area Z22 respectively display Chinese pinyin and Chinese characters, and when the processor 4 responds to the touch operation on the second touch panel 32, the function icon area Z23 is selected. The corresponding function icon B1 is a Chinese/digital input switching icon B11, and the processor 4 controls the pinyin selection area Z21 and the Chinese character selection area Z22 to display numbers for the user to select a number for digital input. Similarly, the processor 4 can select a corresponding number in response to the third touch action input on the second touch panel 21, and display it in the text input box K1.

Referring back to FIG. 4, in some embodiments, the first selection area Z1 further includes a prompt area Q1 at an intersection of the initial letter line H1 and the final letter line H2, and the processor 4 is further configured to When a certain Chinese pinyin, Chinese character or number is selected, the control displays the selected Chinese pinyin, Chinese character or number on the prompt area Q1, prompting the user that the Chinese pinyin, Chinese character or number has been selected currently.

In some embodiments, the processor 4 also controls to highlight an active area for the user to select a character. For example, when the processor 4 inputs a double tap operation on the second touchpad 32, the control slave The processor is currently active and the selected area is switched to another area 4 Highlight the entire area that is currently active and remove the highlight of the active area before switching.

Wherein, the pinyin selection area Z21, the Chinese character selection area Z22 or the function icon area Z23 in the active state is highlighted with a bold color box around the pinyin selection area Z21, the Chinese character selection area Z22 or the function icon area Z23, and the pinyin is added. The selection area Z21, the Chinese character selection area Z22, or the function icon area Z23 is added with a color different from the other areas. The highlighting of the initial initial area M1 in the currently selected initial letter line H1, the initial initial area M2 in the final letter line H2, the Chinese pinyin Y1 in the pinyin selection area Z21, and the Chinese character Y2 in the Chinese character selection area Z22 may be highlighted. Including: the initial initial letter area M1 in the currently selected initial letter line H1, the initial initial area M2 in the final letter line H2, the Chinese pinyin Y1 in the pinyin selection area Z21 or the Chinese character Y2 in the Chinese character selection area Z22 The bold color box, or the initial initial area M1 in the currently selected initial letter line H1, the initial initial area M2 in the final letter line H2, the Chinese pinyin Y1 in the pinyin selection area Z21, and the Chinese character selection area Z22 The area of the Chinese character Y2 is different from the other characters. Wherein, when the highlighting is performed by adding a color, the color added by the pinyin selection area Z21, the Chinese character selection area Z22, or the function icon area Z23 is lighter than the color added by the selected character in the corresponding area.

As shown in FIG. 4 or FIG. 5, the final letter line H2 further includes a delete key C1, and the processor 4 also determines to cancel the selection when the delete key C1 is selected according to the touch action of the first touch panel 31. The currently selected final initial area M2 and/or further cancel the selected initial initial area M1.

In some embodiments, the processor 4 can also control the deletion of characters such as characters, numbers, and the like input in the text input box K1 in response to a delete touch operation on the first touch panel 31 or the second touch panel 32. The deleting touch operation may be an operation of sliding the touch back and forth. In some embodiments, the processor 4 controls the number of deleted characters to be different according to the difference in the distance of the back and forth sliding touch input on the first touch panel 31 or the second touch panel 32. That is, the processor 4 controls to delete the number of characters corresponding to the distance according to the distance of the back and forth sliding touch input on the first touch panel 31 or the second touch panel 32. For example, the processor 4 controls to delete one input in the text input box K1 according to the distance of the back and forth sliding touch input on the first touch panel 31 or the second touch panel 32 is less than a first preset distance. a character, and when the distance of the back and forth sliding touch input on the first touch panel 31 or the second touch panel 32 is greater than a second preset distance, the control deletes the input in the text input box K1 All characters. The second preset distance is greater than the first preset distance.

In some embodiments, the processor 4 controls the selection of the number of Chinese pinyin Y1 in the pinyin selection area Z21 in response to the sliding touch action along the first preset track input on the second touchpad 32, when selecting After the second touchpad 32 still has a sliding touch motion along the first preset trajectory after the Chinese pinyin Y1 in the pinyin selection area Z21, the processor 4 further controls to update the pinyin selection area. A plurality of Hanyu Pinyin Y1 displayed on Z21, that is, other Chinese Pinyin Y1 corresponding to the combination of the vowels are displayed. Similarly, the processor 4 controls the selection of the Chinese characters Y2 in the Chinese character selection area Z22 in response to the sliding touch motion movement along the second preset track input on the second touch panel 32, when selecting the pinyin selection area. When the second touchpad 32 still has a sliding touch motion along the first preset trajectory of the Chinese phonetic alphabet Y1 of Z21, the processor 4 further controls updating a plurality of Chinese characters Y2 displayed on the Chinese character selection area Z22. That is, display several other Chinese characters Y2 corresponding to the combination of the vowels or corresponding to the currently selected Hanyuphone Y1.

The first touch panel 31 and the second touch panel 32 generate a touch signal when detecting a touch operation, and the touch signal includes an identifier of the touch panel and coordinate information of the touch position. The processor 4 determines, according to the touch panel identifier in the received touch signal, whether the first touch panel 31 or the second touch panel 32 inputs a touch operation, and according to coordinate information in the continuously received touch signal. The change in the middle coordinate determines the trajectory and direction of the sliding touch.

For example, it is assumed that the vertical and horizontal directions of the first touch panel 31 and the second touch panel 32 are respectively mapped to the Y positive axis direction, the Y negative axis direction, the X negative axis direction, and the X positive axis direction of the Cartesian coordinate system. The processor 4 determines, according to the coordinate information in the received touch signal, that the coordinate change of the current touch position and the previous touch position is (Δx, Δy), where Δx is a horizontal direction increment, and Δy is a vertical direction increment, and the increment is symbol. The processor 4 judges that the symbols of Δx obtained multiple times are consecutively the same over the preset number of times, for example, all of them are negative values, and |Δx| and the sum of absolute values of (Δx) exceeding a preset number of times are greater than a preset threshold D1, And if the ratio of |Δy| and (the sum of the absolute values of Δy) exceeds the preset threshold D2, it is determined that the user's finger is sliding in the horizontal left direction, and it is determined that the current touch operation is the leftward sliding operation. Similarly, if the processor 4 determines that the sign of Δy obtained multiple times exceeds the preset number of times continuously, for example, all are negative values, and exceeds the preset number of times |Δy| and greater than the preset threshold D1, and exceeds the preset number of times |Δy| and less than the preset threshold D2, it is determined that the user's finger is performing a vertical downward sliding, and it is determined that the current touch operation is a downward sliding touch operation. Similarly, the right slip event and the upslid event are detected in the same way. The preset number of times may be 5 times or more.

For another example, the processor 4 determines, according to the coordinate information in the received touch signal, that the Δx is a clockwise increment, and the clockwise direction continuously changes N times in the same direction, determining that the user's finger is in the clockwise direction. Slide to determine that a clockwise slip event is currently occurring. Similarly, the processor 4 determines that the Δx is a counterclockwise increment according to the coordinate information in the received touch signal, and the N-phase change occurs continuously in the counterclockwise direction, and then the user's finger is determined to slide counterclockwise. , to determine that a counterclockwise slip event is currently occurring. Among them, N can be 5 or more times and the like.

Obviously, in other embodiments, the processor can directly determine the change of the coordinates of the touch position according to the comparison of the coordinate information in the touch signal received multiple times, and then directly obtain the touch according to the change of the coordinate. Track and direction.

Please refer to Figure 8-10 for a description of the input process for entering a text for the user. As shown in FIG. 8, assuming that the user needs to input the word "heart", the user can perform horizontal sliding on the first touchpad 31 to select the initial letter area M1 where the initial "x" is located, and on the first touchpad 31. Perform a vertical slide to select the final letter area M2 where the initial letter "i" is placed. That is, the processor 4 selects between the initials M1 in response to the horizontal sliding touch action on the first touch panel 31 (ie, selects a different initial initial area M1 following the change of the sliding position), and responds to When the position corresponding to the initial letter area M1 where "x" is located exceeds the preset time, the initial initial area M1 including the initial initial "x" is selected; the processor 4 is responsive to the first touchpad The vertical sliding touch action on 31 selects between the initials M2 of the final (ie, selects the different initials M2 following the change of the sliding position), and responds to the initial of the initial in the initial "i" of the final When the position corresponding to the letter area M2 stays longer than the preset time, the final initial area M2 including the final initial "i" is selected.

As shown in FIG. 9, the processor 4 obtains a combination of the finals according to the combination of the currently selected initial initial area M1 and the initial initial area M2, and then determines the Chinese pinyin and Chinese characters corresponding to the combination of the finals. And controlling at least a part of the Hanyu Pinyin corresponding to the combination of the vowels on the Pinyin selection area Z21 of the second selection area Z2, and controlling to display at least a part of the Chinese characters corresponding to the combination of the vowels on the Chinese character selection area Z22 .

As mentioned above, since the initial initial area M1 where "x" is located includes three initials of x, y, and z, the initial initial area M2 where "i" is located includes the initial initial of i, and the corresponding finals include i. , in, ing, etc., so the Chinese phonetic alphabet "xi", "yi", "zi", "xin", "yin", "xing", "ying", etc., the Chinese characters corresponding to these Chinese pinyin have "hi", "wash", "clothing", "one", "child", "word", "new", " Because of "," "行", "should" and so on.

As shown in FIG. 9, the processor 4 controls the pinyin selection area Z21 of the second selection area Z2 to display Chinese pinyin "xi", "yi", "xin", "ying", and controls the Chinese character selection area. Z22 displays the words "一", "衣衣", "以以", "因因" corresponding to the Chinese pinyin obtained by the combination of the vowels.

As shown in FIG. 10, if the current Chinese character selection area Z2 does not display the "heart" word required by the user, the user can control to input a sliding touch motion along the second preset track on the second touchpad 32, the processing The controller 4 controls the Chinese pinyin "xi", "yi", "xin", "ying" displayed in the pinyin selection area Z21 in response to the sliding touch motion on the second touchpad 32 input along the first preset trajectory In the middle of the switching selection, and the position corresponding to the Chinese pinyin "xin" stays longer than the preset time, the Chinese pinyin "xin" is selected. The processor 4 controls the Chinese character selection area Z2 to display only the Chinese characters corresponding to the Chinese pinyin "xin".

As shown in FIG. 10, if the Chinese character displayed in the current Chinese character selection area Z2 includes the "heart" word, the processor 4 responds to the sliding touch on the second touch panel 32 to input along the second preset track. And controlling to switch and select among a plurality of Chinese characters displayed in the Chinese character selection area Z22, and staying at a position corresponding to the Chinese character "heart" for more than a preset time, then selecting the Chinese character "heart" and controlling the text input box The Chinese character "heart" is displayed in K1. Thus, the input of the "heart" word is completed.

As shown in FIG. 1, in some embodiments, the touch input device 3 is disposed on the earphone device 1. The earphone device 1 includes an earpiece 11 and an earphone loop 12. For example, the first touch panel 31 and the second touch panel 32 of the touch input device 3 are disposed on the outer surface of the earpiece 11 of the earphone device 1.

Please refer to FIG. 11 , which is a schematic diagram of the touch input device 3 . In some embodiments, the first touch panel 31 of the touch input device 3 is a circular plate, and the second touch panel 32 is a surrounding device. The circular ring plate of the first touch panel 31 is described. The first touch panel 31 is disposed in a central area of the earpiece 11 , and the second touch panel 32 is disposed in an outer ring region of the earpiece 11 .

Referring to FIG. 12 together, in other embodiments, the touch input device 3 can be a separate input device connected to the earphone device 1 or the display device 2 by wire or wirelessly. For example, the touch input device 3 can be a mouse-like device for the user to hold input.

The processor 4 can be a central processor, a microcontroller, a microprocessor, a single chip, and a number A word signal processor or the like processes the chip.

The processor 4 can be located in the headset device 1 or in the display device 2.

Please refer to FIG. 13, which is a flowchart of a content input method according to an embodiment of the present invention. The method is applied to the aforementioned head mounted display device 100. The method includes the steps of:

In response to the content input request, the display device 2 is controlled to display a soft keyboard input interface T1. The soft keyboard input interface T1 includes a first selection area Z1 and a second selection area Z2, and the first selection area Z1 includes an initial letter line H1. And a final letter H2, the initial letter H1 includes a plurality of initials M1 arranged in a first direction and a plurality of initials M2 arranged in a second direction, each of the initials M1 including at least one The initials of the initials, each of the initials M2 includes at least one initial: and the second selected area Z2 is for displaying at least Chinese pinyin and/or Chinese characters (S131). In an embodiment, the content input request is generated by clicking on the text input box K1.

Selecting in the initial initial area M1 of the initial letter line H1 in response to the first touch action input on the touch input device 3 to select an initial initial area M1, and in response to the second input on the touch input device 3 Touching the action to select in the initial initial area M2 of the final letter line H2 to select a final initial area M2, and to obtain the initial initial and the initial initial area M2 in the selected initial initial area M1. The initials of the finals are combined into all the finals (S132).

In some embodiments, the initial letter H1 includes a plurality of initials M1 arranged in a horizontal direction and a plurality of initials M2 arranged vertically, the first touch action being a horizontal sliding touch and a touch action that exceeds a preset time in a position of the initial initial letter area M1 of the selected initial letter line H1, the second touch action being a sliding touch in the vertical direction and the selected final letter The position of one of the initials M2 in the line H2 stays longer than the touch action of the preset time. In other embodiments, the first touch action is a touch action of sliding a touch in a horizontal direction and clicking at a position of one of the initial initials M1 of the selected initial letter line H1, the first The two touch action is a touch action of sliding the touch in the vertical direction and clicking at a position of one of the final initials M2 of the selected final letter line H2.

Control displays the pinyin and/or kanji corresponding to the combination of the vowels on the second selection area Z2 (S133).

In some embodiments, the second selection area Z2 includes at least a pinyin selection area Z21 and a Chinese character The area Z22 is selected, and the step S133 includes: controlling, in the pinyin selection area Z21, a plurality of Chinese pinyin Y1 corresponding to the combination of the vowels arranged along the first preset trajectory, and controlling the display of the kanji selection area Z22. There are a plurality of Chinese characters Y2 corresponding to the combination of the vowels arranged along the second predetermined trajectory.

At least the Chinese characters displayed on the second selection area Z2 are selected in response to the third touch action input on the touch input device 3, and the Chinese characters to be input are selected (S134).

In some embodiments, the content input method further includes the steps of:

Control displays the selected Chinese character in the text input box K1 (S135).

In some embodiments, the content input method further includes the steps of:

The character input in the text input box K1 is controlled to be deleted in response to the delete touch action input on the touch input device 3 (S136). The deletion touch action may be a back and forth sliding touch input in a preset direction on the first touch panel 31 or the second touch panel 32 of the touch input device 3 . In some embodiments, the step S136 includes controlling to delete the corresponding number of characters of the distance according to the distance of the back and forth sliding touch input on the touch input device 3.

In some embodiments, the soft keyboard input interface T1 further includes a function icon area Z23, the function icon area Z23 includes a plurality of function diagrams, and the content input method further includes the step of responding to the double-click operation input on the touch input device 3. And controlling to switch the activation state of the pinyin selection area Z21, the kanji selection area Z22, and the function icon area Z23 in the second selection area Z2; and when the function icon area Z23 is in the active state, responsive to the touch operation on the touch input device 3 The corresponding function icon B1 on the function icon area Z23 is fixed, and the function corresponding to the function icon B1 is controlled. For example, in response to the touch action input on the touch input device 3 to the position corresponding to the function icon B1 and then clicked, the corresponding function icon B1 on the function icon area Z23 is selected, and the function corresponding to the function icon B1 is controlled.

In some embodiments, the content input method further includes the step of: the processor 4 further controlling to highlight the initial initial area M2 in the initial initial letter area M1 and the final letter line H2 in the currently selected initial letter line H1. The pinyin selects the Chinese pinyin Y1 in the region Z21 or the Chinese character Y2 in the Chinese character selection region Z22.

In some embodiments, the content input method further includes the step of: the processor 4 further controls to highlight the pinyin selection area Z21 and the Chinese character selection area in an active state for the user to select a character. Field Z22 or function icon area Z23.

In some embodiments, in some embodiments, the first selection area Z1 further includes a prompt area Q1 located at an intersection of the initial letter line H1 and the final letter line H2, and the content input method further includes the steps of: The processor 4 controls to display the selected Chinese pinyin, Chinese characters or numbers on the prompt area Q1 when a certain Chinese pinyin, Chinese character or number is selected, and prompts the user that the Chinese pinyin has been selected currently. Chinese characters or numbers.

Please refer to FIG. 14, which is a sub-flowchart of the step S134 in an embodiment. The step S134 includes:

The processor 4 selects a plurality of Hanyu Pinyin in the Pinyin selection area Z21 in response to the sliding touch motion movement along the first preset trajectory input on the touch input device 3, and stays at a position corresponding to a certain Chinese Pinyin over the said The Chinese pinyin is determined to be the selected Hanyu Pinyin when the time is preset (S1341). In some embodiments, the first predetermined trajectory is an upward curved curved trajectory, and the second predetermined trajectory is a downward curved curved trajectory.

The processor 4 controls the Chinese character selection area Z22 to display a Chinese character corresponding to the Hanyu Pinyin (S1343).

The processor 4 performs switching selection in a plurality of Chinese characters Y2 of the Chinese character selection area Z22 in response to the sliding touch motion movement along the second preset trajectory input on the touch input device 3, and stays at a position corresponding to a certain Chinese character Y2 The Chinese character Y2 is selected when the preset time is exceeded (S1345).

In other embodiments, when there are target Chinese characters to be input among the plurality of Chinese characters displayed by the Chinese character selection area Z22, the step S134 may further include: the processor 4 responding to the second pre-input input on the touch input device 3 The sliding touch motion control of the trajectory motion is switched and selected in a plurality of Chinese characters of the Chinese character selection area Z22, and when the position corresponding to a certain Chinese character stays longer than the preset time, the Chinese character is determined to be the selected Chinese character.

Therefore, the head-mounted display device 100 and the content input method of the present invention can facilitate user input of content, especially Chinese input, through optimization of the soft keyboard input interface T1 and optimization of the touch mode.

The above is a preferred embodiment of the present invention, and it should be noted that those skilled in the art can also make several improvements and retouchings without departing from the principles of the present invention. It is the scope of protection of the present invention.

Claims

A head mounted display device comprising a display device, a touch input device and a processor, wherein the processor is configured to control the display device to display a soft keyboard input interface in response to a content input request, the soft keyboard input interface comprising a first selection area and a second selection area, the first selection area including a consonant letter line and a final letter line line, the consonant letter line including a plurality of initials in a first direction, the final letter line including the edge a plurality of initials of the initials arranged in the second direction, the initials include at least one initial, the finalized letter region includes at least one final letter, and the second selected area is used to display at least Chinese pinyin and/or Chinese characters; The processor is configured to select and select an initial initial area in the initial area of the initials of the initials in response to the first touch action input by the touch input device, and to respond to the second input of the touch input device Touch the action and select in the initials of the finals of the finals and select a final initial a region, a combination of all the initials of the initials in the initial initials of the selected initials and the initials of the initials in the initials of the initials, and then determining the Chinese phonetic and/or Chinese characters corresponding to the combination of the initials And controlling to display Chinese pinyin and/or kanji corresponding to the combination of the vowels on the second selection area, the processor being configured to display at least on the second selection area in response to the third touch action input by the touch input device Chinese characters are selected and the Chinese characters to be entered are selected.
The head-mounted display device according to claim 1, wherein said display device further displays a text input box, and said processor is further configured to display said selected Chinese character output on said text input box in.
The head-mounted display device according to claim 2, wherein the first direction is a horizontal direction and the second direction is a vertical direction, and the first touch action is a sliding touch in a horizontal direction and is selected The position of the initial initial area of the initials stays longer than the touch action of the preset time, and the second touch action is a touch action of sliding the touch in the vertical direction and staying at the position of the initial initial area of the final need to exceed the preset time .
The head-mounted display device according to claim 2, wherein the second selection area comprises a pinyin selection area and a Chinese character selection area, and the pinyin selection area displays a plurality of Hanyu Pinyin arranged along the first preset track. The Chinese character selection area displays a plurality of Chinese characters arranged along a second preset trajectory, and the processor is based on the initial initials and the finals in the initial area of the selected initials. The combination of the initials of the initials in the letter area determines the corresponding Chinese Pinyin and/or Chinese characters, and controls the display of the corresponding Hanyu Pinyin on the Pinyin selection area, and displays the corresponding Chinese characters on the Chinese character selection area.
The head-mounted display device according to claim 4, wherein the third touch action comprises at least a sliding touch that is input on the touch input device and moves along the first predetermined trajectory and stays at the corresponding position beyond the preset a touch action of time, and a touch action including a sliding touch moving along the second predetermined trajectory and staying at the corresponding position for more than a preset time; the processor responsive to moving along the first predetermined trajectory input on the touch input device The sliding touch motion control selects a plurality of Hanyu Pinyin displayed in the Pinyin selection area, and determines that the Hanyu Pinyin is the selected Hanyu Pinyin when the position corresponding to a Chinese Pinyin exceeds the preset time; the processor And controlling the Chinese character selection area to display a Chinese character corresponding to the Hanyu Pinyin, and selecting, among the several Chinese characters displayed in the Chinese character selection area, in response to the sliding touch motion movement along the second preset track input on the touch input device, And determining that the Chinese character is the selected Chinese character when the position corresponding to a Chinese character stays longer than the preset time .
The head-mounted display device according to claim 1, wherein said processor is further configured to control highlighting an initial initial area in the currently selected initial letter line, and a final in the currently selected final letter line. The letter area, the Chinese pinyin in the currently selected pinyin selection area, or the Chinese character in the currently selected Chinese character selection area.
The head-mounted display device according to claim 4, wherein the second selection area further comprises a function icon area, the function icon area includes a plurality of function icons, and the processor is further responsive to the touch input device Controlling switching the activation state of the pinyin selection area, the Chinese character selection area, and the function icon area in the second selection area by the double-click operation input, the processor responding to the touch input device when the function icon area is in an active state The corresponding function icon on the function icon area is selected by the corresponding touch operation, and the function corresponding to the function icon is controlled.
The head-mounted display device according to claim 7, wherein the function icon comprises a Chinese/digital input switching icon, and the Chinese pinyin and Chinese characters are respectively displayed in the current pinyin selection area and the Chinese character selection area, and the processor is The processor is further configured to control the pinyin selection area and the Chinese character selection area to display a number, the processor is responsive when the Chinese/digital input switching icon on the function icon area is selected in response to a touch operation on the touch input device Touch the third input on the input device Touch the action to select the corresponding number and display it in the text input box.
A head mounted display device according to claim 4, wherein in some embodiments, said first selection area further comprises a prompt area located at an intersection of said initial letter line and a final letter line, said The processor is further configured to control displaying the selected character on the cue area when a certain character is selected.
The head-mounted display device according to claim 7, wherein when the processor inputs a double-tap operation on the touch input device, when the control is switched from the currently active state to the other region, It is used to highlight the entire area that is active after switching and to remove the highlighting of the area that was active before switching.
The head mounted display device according to any one of claims 1 to 10, wherein the final letter line further comprises a delete key, and the processor further determines the selection according to the second touch action of the touch input device. When the delete key is pressed, the control cancels the currently selected final initial area and/or further cancels the selected initial initial area.
A head mounted display device according to any one of claims 2 to 10, wherein the processor further controls to delete a character input in a text input box in response to a delete touch operation on the touch input device, Deleting a touch operation is an operation of sliding a touch back and forth, and the processor is further configured to control deletion of a different number of characters according to a difference in a distance of a back and forth sliding touch input on the touch input device.
The head mounted display device according to any one of claims 1 to 10, wherein the head mounted display device further comprises an earphone device, the earphone device comprising an earpiece and an earphone loop, the touch input device It is disposed on the outer surface of the earpiece of the earphone device.
The head-mounted display device according to claim 13, wherein the touch input device comprises a first touch panel and a second touch panel, and the first touch panel is a circular panel, the first The second touch panel is disposed in a central area of the earpiece, and the second touch panel is disposed in an outer ring area of the earpiece. The first touch action and the second touch action are touch actions input on the first touch panel, and the third touch action is a touch action on the second touch panel.
A content input method is applied to a head mounted display device, the head mounted display device comprising a display device and a touch input device, wherein the method comprises the steps of:

Controlling, by the content input request, the display device to display a soft keyboard input interface, wherein the soft keyboard input interface includes a first selection area and a second selection area, where the first selection area includes an initial letter line and a final letter line. The line of initials includes a plurality of initials arranged in a first direction, the line of initials comprising a plurality of initials arranged in a second direction, each of the initials including at least one initial. Each initial initial area includes at least one final initial, and the second selected area is configured to display at least Chinese pinyin and/or Chinese characters;

Selecting and selecting a mother letter area in the initial area of the initials of the initials in response to the first touch action input on the touch input device, and responding to the second touch action input on the touch input device Selecting in the initials area of the finals of the finals and selecting a final initials area, and obtaining the initials of the initials in the initial initials of the selected initials and the initials of the initials in the initials of the initials All combinations of vowels; and

Controlling displaying Chinese pinyin and/or Chinese characters corresponding to the combination of the finals on the second selection area;

And selecting a Chinese pinyin and/or a Chinese character displayed on the second selection area in response to the third touch action input on the touch input device and selecting a Chinese character to be input.
The content input method according to claim 14, wherein the method further comprises the steps of:

Controlling the selected Chinese character displayed in a text input box displayed by the display device.
The content input method according to claim 16, wherein the method further comprises the steps of:

The character input in the text input box is controlled to be deleted in response to the touch input, wherein the delete touch action is a back and forth sliding touch action input in the preset direction on the touch input device.
The content input method according to claim 15, wherein said second selection area includes at least a pinyin selection area and a kanji selection area, said step "controlling displaying said vowel combination corresponding to said second selection area Chinese Pinyin and/or Chinese characters include:

Controlling, displaying, in the pinyin selection area, a plurality of Chinese pinyin corresponding to the combination of the vowels arranged along the first preset trajectory, and controlling the kanji selection area to display a plurality of arranged along the second preset trajectory and The Chinese characters corresponding to the combination of the vowels.
The content input method according to claim 18, wherein said step "selecting a Chinese pinyin and/or a Chinese character displayed on the second selection area in response to the third touch action input on the touch input device, And select the Chinese characters to be entered" including:

Selecting a plurality of Hanyu Pinyin in the Pinyin selection area in response to the sliding touch motion movement along the first preset trajectory input on the touch input device, and staying at a position corresponding to a certain Chinese Pinyin for more than the preset time Determining that the Chinese pinyin is the selected Hanyu pinyin;

Controlling the Chinese character selection area to display a Chinese character corresponding to the Hanyu Pinyin;

Selecting among a plurality of Chinese characters in the Chinese character selection area in response to the sliding touch motion movement along the second preset track input on the touch input device, and selecting when a position corresponding to a Chinese character stays longer than the preset time Set the Chinese characters.
The content input method according to claim 18, wherein the second selection area further comprises a function icon area, wherein the function icon area includes at least a pinyin selection area, a Chinese character selection area, and a function icon area. a plurality of function icons, the content input method further comprising the steps of:

Controlling, in response to the double tap operation input on the touch input device, switching an activation state of the pinyin selection area, the Chinese character selection area, and the function icon area in the second selection area;

When the function icon area is in an active state, a corresponding function icon on the function icon area can be selected in response to a touch operation on the touch input device, and control of a function corresponding to the selected function icon is performed.