WO2005122106A1

WO2005122106A1 - Learning support system

Info

Publication number: WO2005122106A1
Application number: PCT/JP2005/010741
Authority: WO
Inventors: Takaaki Ookura; Shigeru Takami
Original assignee: Takaaki Ookura; Shigeru Takami
Priority date: 2004-06-07
Filing date: 2005-06-06
Publication date: 2005-12-22
Also published as: JPWO2005122106A1

Abstract

A learning support system in which a video such as a DVD movie and other learning data displayed synchronously with the video on a learner terminal are integrally reproduced and displayed to use the video materials interactively. The system is composed of means for reproducing video information, a display for displaying the video information means for acquiring index information (the current time in relation to the start of reproduction of the video) from the video being reproduced, a database where learning information is recorded with the index information used as a key, a learning information request button, and means for extracting learning information from the database by using as a key the index information of when the learning information request button is clicked and displaying the learning information. The system is characterized in that it is further compsed of control means for extracting learning information from the database by using as a key the index information acquired from the video information when a leaning information request is made while the video is being reproduced and displayed and allowing the display to display the learning information.

Description

[Document Name] Statement ¹

[Title of the Invention] Learning support system

【Technical field】

[0 0 0 1]

The present invention relates to a learning support system that interactively utilizes video teaching materials.

[Technical background]

[0 0 0 2]

Conventionally, in the education using language video teaching materials to train listening and speaking skills in foreign language learning, subtitle information recorded with video signals was played back synchronously and learned for a fixed period of time. By the way, there are some that present and answer the word-filling problem in the Sinalio sentence. In each case, the video and the learning materials were stored in the same storage medium.

[0 0 0 3]

In addition, there is a method in which instructor video and teaching materials are synchronized and distributed on a client screen using V〇D (Video On Demand), which has recently attracted attention (for example, see Patent Document 1). The speed of Internet communication has increased, and a system for distributing videos and learning materials from a server to each client has been provided. In particular, the use of SMIL (a multimedia presentation description language proposed by World Web Console (W3C)) has made it possible to control multimedia precisely.

[Patent Document 1] Japanese Patent Application Laid-Open No. 2004-296912 "Information processing device for remote education"

DISCLOSURE OF THE INVENTION

[Problems to be solved by the invention]

[0 0 0 4]

However, using a movie as a video teaching material requires complicated procedures in advance, such as negotiating with copyright owners of movie companies and purchasing rights, which is an obstacle to using the movie as a teaching material. Was. In addition, when content that is made into teaching materials using SMIL (such as asking questions according to the scene) is distributed from the server, many clients cannot use the high-speed communication environment. It is also necessary to perform processing such as reducing the size to reduce the receiving bit rate (data amount per unit time). It was virtually impossible to deliver the video of the MPEG2 standard used in DVD movies as it was on the Internet, and to conduct language learning through distance learning. For this reason, it is necessary to edit the video, record it on another recording medium such as DVDR along with the learning questions, and deliver it. Furthermore, if a movie is recorded as a language teaching material on a CD, DVD, etc., it will not be possible for teachers who use it to edit and use it for teaching purposes, even under copyright law. It prevented many teachers and learners from using the product as a language learning material for various purposes. In addition, if a movie recorded on a CD or DVD and a media file (a file recording the learner's voice) recorded elsewhere are played at the same time, the timing of the movie and the media file will be shifted. Easy and inconvenient for role practice. In addition, when creating self-made teaching materials using a video camera and distributing them to learners, it is best to finish recording the learning information such as slides and subtitles in the database at the end of recording. At the end of recording, it was difficult to index the video and complete the recording in the database at the end of recording, with the caption sentence separately recorded by personal computer summary writing or voice recognition software at the time of the shadow.

[0 0 0 5]

The present invention has been made to solve this problem, and includes videos such as movies provided on DVDs, self-made videos recorded by a video camera, and other teaching materials to be presented and played along with the videos. The purpose of this study is to provide a learning support system that plays back learning information in an integrated manner at the learner's terminal and effectively uses video teaching materials interactively anytime and anywhere.

[Means for Solving the Problems]

[0 0 0 6]

According to one embodiment of the present invention, a means for reproducing video information, a display for displaying the video information, a means for obtaining index information on the elapsed playback time of the video information, and learning using predetermined index information as keys. A database of recorded information and the Request detecting means for detecting a request; and when the request detecting means detects a request for information during reproduction and display of the video information, learning information is read from the database using the index information of the video information as a key. It is characterized by comprising control means for extracting and displaying on the display.

[0 0 0 7]

Another aspect of the present invention is a unit for reproducing video information, a display for displaying the video information, a unit for obtaining index information on the elapsed playback time of the video information, and learning using predetermined index information as a key. A database in which information is recorded; a plurality of the request detecting means in which index information is set in advance; and moving the video information to the indexed position when the request detecting means detects a request for learning information. Control means for extracting the learning information from the database using the index information set in the request detecting means as a key and displaying the learning information on the display is provided.

[0 0 0 8]

In the present invention, the learning information stored in the database includes a question, its correct answer, and instruction content. .

[0 0 0 9]

The present invention is characterized in that information input by a learner is recorded in the database using index information as a key.

[0 0 1 0]

According to the present invention, the database is shared by a plurality of learners, answers of the plurality of learners to a question extracted from the database are indexed for each learner, and the indexed information is unified. The answer of the learner is recorded in a database.

[0 0 1 1]

In addition to the above, the information input by the learner is recorded as audio, and at the time of playback, the video information and the recorded information are reproduced in synchronization with each other, and a function for role practice is provided. .

[0 0 1 2]

The present invention extracts the answers of a plurality of learners indexed to the video information stored in the database using the indexed information as a key, and tabulates the results based on the answers as a graph. The learning information is extracted from the database and displayed on the display means.

[0 0 1 3]

According to a further aspect of the present invention, there is further provided a camera for acquiring images and sounds, a unit for recording information obtained from the camera as video information together with index information, and a unit for recording learning information based on the index information. It is characterized by having.

【The invention's effect】

[0 0 1 4]

Since the learning support system of the present invention is configured so that learning information data such as questions is indexed by index information obtained from video information and stored on a data base, the video information and learning information are completely stored. Isolated. When the learning information request operation is detected, the learning information and the video information indexed by the index information are displayed side by side on the display of the learner's terminal at the same time. No longer infringed. At the same time, since the video information can be obtained directly from the playback means connected to the learner's terminal, video information processing such as reducing the image size and reducing the transmission bit rate even in an environment where high-speed communication cannot be used. It is no longer necessary and can be displayed without impairing the basic intention and performance of the DVD work. Individual DVDs of the same title are played individually on the learner's terminal, while learning information is extracted and obtained from a shared database, so that video information can be edited according to educational purposes, and learning information can be edited. It is no longer necessary to re-record on another storage medium such as CD or DVD-R. Also, while using the same title movie, it is possible for each teacher to edit indexing problems and presentation materials according to the teaching purpose, and to change the teaching content, so that a highly completed movie work can be created. Many teachers · Learners can learn languages for various purposes It can be used as a material. And ³匸, while playing the video information recorded learners have曰'At the same time, to play the recorded voice data and video information at the time of reproduction. At this time,

—Since the index information of the video information is recorded in the evening, the index information of the video information is compared with the index information of the recorded audio data. By moving the data, it is possible to finely correct the deviation for each index information unit. In addition, the responses of multiple learners indexed to the video information stored in the database are extracted by unifying the indexed information, and the results of aggregation based on the responses are configured as a graph, De—It is possible to extract from the evening base and display it on the display means. In addition, when a teacher prepares teaching materials, a means for recording video information, a means for recording learning information, a means for obtaining index information on the elapsed recording time of the video information, and a learning method using the index information as a key. By using a database that records information, it is possible to complete the recording by indexing video information and learning information at the end of recording with the index information obtained during recording.

BEST MODE FOR CARRYING OUT THE INVENTION

[0 0 1 5]

In the present invention, as means (11) for reproducing video information, a DVD drive, a CD drive, a multi-drive capable of handling a DVDR or a CD-R, a hard disk drive, a network drive, and streaming are switched or used. The system is configured so that multiple devices can be used simultaneously. The means (12) for obtaining the index information depends on the means (11) for reproducing the video information, and includes the following: MSWebDVD ActiveX control (registered trademark), Media Player ActiveX control.

(Registered trademark) can be switched or used at the same time. The index information of the video information obtained from the index information obtaining means (12) is playback frame information in the case of a DVD drive. In other cases, it was composed of index information recorded in advance in the video information or the current time based on the start of video title playback. The video information display means (13) is configured to switch among MSWebDVD ActiveX control (registered trademark) and Media Player ActiveX control (registered trademark) or to use a plurality of them simultaneously according to the means (11) for reproducing the video information. did. Furthermore, in the mode for creating teaching materials, the current time was used as a reference from the start of recording at the time of recording. A personal computer composed of CPU (18) running Windows (registered trademark) was used as the control means. In addition, the learning information request detection means (14) is configured and displayed as a button clicked on the screen with a mouse, a hyperlink set in a figure or a character string. FIG. 1 is a block diagram of the present invention.

[Example 1]

[0 0 1 6]

The operation of the language learning support system according to the embodiment of the present invention will be described in detail with reference to the drawings, taking as an example a case where "listening learning using English movie DVD" is performed.

[0 0 1 7]

As the learner terminal (27), a personal computer constituted by the control means was used. The means for reproducing video information (11) was composed of a DVD drive. The reproduction frame information is obtained at regular intervals (0.4 to 1 second) as the index information (21) by the means (12) for obtaining the index information. When the learning material for listening learning is selected, the form is used to inquire whether there is a question based on the index information of the displayed scene, or according to the number of questions previously stored in the database (19) by the teacher. After selecting one of the formats in which the index information stored in the evening (19) is preset, the learning information request detecting means (14) is displayed on the web browser (16) of the display (17). It is arranged as a button to be clicked with the mouse.

[0 0 1 8]

In the format in which the presence or absence of a question is inquired by the index information of the display surface, the number of the button is one. When the learner clicks the button, the learning information requesting operation information (22) is detected by the means (12) for obtaining the index information, and the CPU (18) reads the database (12) storing the learning information. An inquiry (23) to the learning information indexed by the index information is made to (19). At this time, if there is index information before the index information in the database and the index information is within the effective range of the learning information, the DVD drive is set to the pause state, and the learning information data extraction ( 24), and the learning information data is displayed on the web by displaying the learning information data (25). It is configured as a display area on the browser (16) and displayed on the learning information display means (15). If the learning information to be displayed is not found, the reproduction of the video is continued as it is, and the learning information display means (15) displays that no learning information is found.

[0 0 1 9]

According to the format in which the index information stored in the database (19) is set in advance in accordance with the number of learning information previously stored in the database (19) by the teacher, the number of learning information Only buttons are arranged. In the case where the learner does not explicitly click the button, the index information (21) obtained by the means (12) for obtaining the index information is sequentially set to the button in the previous period. It is compared with the index information, and when it matches, the learning information request operation is executed. When the learning information request operation information () is detected, the CPU (18) queries the database (19) storing the learning information about the learning information indexed by the index information (23), and obtains the learning information. Extract the data (24). The learning information is displayed on the learning information display means (15) by the learning information display (25), and the learning information is displayed along with the video information (20) by being juxtaposed with the video information display means (13). Helping you learn listening.

[0 0 2 0]

When the learner explicitly clicks the button in the learning scene, the CPU (18) transmits a query (23) of learning information indexed to index information set in advance to the button to the database. Perform for (19). When the learning information data is extracted (24), the learning information data is displayed on the learning information display means (15), and at the same time, the DVD playback position is moved to the position indexed by the index information. Send a playback position move request (26) to the drive. This makes it possible to display DVD video information along with the learning information for each learning information unit, supporting listening learning.

[0 0 2 1]

In one mode of the learning system, questions, their correct answers, and instruction contents are indexed into video information (20) and stored in the database (19), and the information input by the learner is stored in the database. 19), the history of the information input by the learner in the database (19) is searched, the correctness of the answer of the learner is determined, and the learning achievement is determined by a predetermined method. Evaluate and provide individual guidance. In addition, by connecting a plurality of learner terminals (27) to the network line (28), many teachers and learners share the database (19) and adopt the configuration shown in Fig. Aggregate the information entered by other learners, calculate the frequency of incorrect answers, and provide teachers with guidance materials. A teacher at a remote place connects to the database (19) through the network line (28) to browse the history of a specific learner, and performs remote tutoring to send guidance items.

[0 0 2 2]

The following describes the learning procedure of the learning support for the conversation space replacement problem in English movie listening learning, using the flowchart in Fig. 3. The learner loads the DVD (10) as the teaching material into the learner terminal (27), starts the language learning support system, and starts learning.

[0 0 2 3]

In setting the learning environment (S301), the learner inputs the learning material code (41) in the learning information management table of FIG. When a request (S302) is issued to transmit the learning information to the database (19), the database (19) stores a reference table name in which index information of the requested learning material code (41) is stored. (42) and the teaching material title (43) displayed on the learner terminal (27) are extracted, and the serial number (51) and the index information (52) for referring to the index information stored in the question table shown in FIG. ), The speaker (53), and the question (vacancy filling problem) (54) are generated as a learning information file (S303) and transmitted to the learner terminal (27).

[0 0 2 4]

When the learning information file is obtained (S302), the screen of FIG. 7 is displayed on the web browser (16). FIG. 7 shows a specific example of the embodiment of the present invention. The means for reproducing video information (11) was constituted by a DV drive. The means (12) for obtaining the index information is constituted by DirectX (registered trademark). The learning information request detecting means (14) includes a plurality of index information stored in the database (19) set in advance according to the number of conversation sentences that the teacher has previously stored in the database (19). Buttons.

[0 0 2 5] The video information display means (13) consists of a video information window (MSWebDVD ActiveX control), w. In this embodiment, two pieces of learning information display means (15) are arranged side by side to assign roles. One learning information display means (15) is an answer sentence display window (72), in which the result of evaluating the information input by the learner is displayed. The question sentence display window (73) is another learning information display means (15), and displays a question extracted from the database (19). Using the answer writing window (75), the learner writes the answer to the question. At the start of learning, the same question as the question message display window (73) is displayed in the answer message input box (81) of the answer writing window (75).

[0 0 2 6]

Fig. 8 shows one of the answers BOX arranged for each question in the answer writing window (75) of Fig. 7. In the answer box, an answer sentence input box (81) was placed in order to acquire the information input by the learner. As learning information request detection means (14), one learning information request button (83) in which index information of the conversation sentence is set in advance is arranged for each conversation sentence. In addition, an answer transmission button (84) was placed to send the information entered by the learner to the server. Speaker · Conversation display time B OX (82) is effective when teachers create teaching materials. Although it is invalid in the learning scene, the speaker name and time are displayed faintly, so they are placed for reference.

[0 0 2 7]

The procedure for inputting the answer to the question will be described in more detail with reference to FIG. The learner clicks the learning information request button (83) and moves the video information to the position where the question sentence displayed in the answer sentence input box (81) is indexed, and the video information Display window

Displayed at (71). At this time, only the question sentence indexed at the playback start position is in the closed caption state in the answer sentence display window (72), and the background portion of the question sentence is displayed in the question sentence display window (73). The learning information file is displayed so that it can be browsed by scrolling, including sentences that are colored and highlighted (S304). The learner listens to the audio being played, and

Enter the answer in (85) (S305) and click on the answer text transmission button (84). At this time, the answer sentence is stored in the memory of the learner terminal (27), and simultaneously displayed in the answer sentence display window (72), and the video information is moved to the playback position, which is the index information of the question, for playback. (S306).

[0 0 2 8]

If the correct / incorrect judgment permission signal (S307) is not received, the learner clicks the arbitrary learning information request button (83) to view the video information, write the answer to the question, and repeat the learning while checking. I do. At this time, if the repeat playback setting function (74) is used, the learner himself sets an arbitrary time range in preference to the index information set in the previous term learning information request button (83), and repeats as many times as necessary. It is possible to listen.

[0 0 2 9]

When the right / false judgment permission signal (S307) is received, the answer entry to the question is terminated by the right / false judgment permission judgment (S308).

[0 0 3 0]

Next, the procedure of the right / wrong judgment / individual guidance process will be described. The answer sentence (learning history data) stored in the memory of the learner terminal (27) is transmitted to the database (19) (S309). The database (19) extracts only the answers written in the vacant part (85) of the question from the answer sentence and, when the answers are stored, the index obtained by the index information obtaining means (12). Indexing is performed based on the information (63), indexing is performed using the learner index (61) obtained in the setting of the learning environment (S301), and the index is stored in the database (19). Then, correct / incorrect judgment is performed by comparing the correct answer data with the answer data. If there is an error, the stored instruction content is extracted, and the correct answer data and the individual instruction data are transmitted to the learner terminal (27) (S310). The learner receives the correct answer data and the individual instruction data (S311) and reflects on the learning result and reviews (S312). In this case, the sentence containing the incorrect answer and the sentence immediately after it are automatically and repeatedly played back as individual instruction data (the learning support system uses the repeat playback setting function (74) a fixed number of times prior to the learner's operation) Assist learners by providing guidance to automatically increase the volume of sentences containing incorrect answers.

[0 0 3 1]

The answer to the question is the time when the answer was stored, as shown in the answer table in Figure 6. (62) Indexed for each learner in the order of, when index ⁶ is stored, index information obtaining means, index information obtained (63), elapsed learning time (64), answer 1 to question 1 (65), Thereafter, the answer data from answer 2 (66) to answer n (67) are linked by the number of questions stored in the database ( ₁₉₎ to form one record.

[0 0 3 2]

Learners can use the learning support system to learn English movies using only the normal web browsing software (browser) set on the learner's terminal (27). There is no need to install it separately.

[0 0 3 3]

Although the foregoing description has been directed to exemplary systems according to the present invention, those skilled in the art will recognize that many other systems or variations of the above described systems can be readily configured. . For example, the language education system can be easily configured even when the video information is not stored on a DVD but is stored on a CD or a hard disk, or when streaming video information is used. Further, since the answer sentence display window and the question sentence display window are display areas configured on a browser, if a question stored in the database (19) is described in HTML language, a still image can be imported. It is also easy to write hyperlinks to related sites on the Internet.

[0 0 3 4]

As described above, in the present invention, in a learning situation in which video teaching materials are used interactively, a large number of teachers and learners can share learning information by sharing a database on a network while enabling individual learning support for each learner. It was made possible to refer at the same time as providing. This can contribute as a learning support system that incorporates the results of audiovisual education even in distance education. [Example 2]

[0 0 3 5]

In this embodiment, in addition to the first embodiment, learning for role practice is characterized in that information input by a learner is recorded as audio, and the video information and the recorded information are reproduced in synchronization during reproduction. It is a support system. FIG. 9 is a block diagram of the present invention.

[0 0 3 6]

The means for reproducing video information (101) was composed of a DV D drive. The means for obtaining index information (102) consisted of the MSWebDVD ActiveX control. In addition, a personal computer composed of a CPU (112) running Windows (registered trademark) was used as a control means. Furthermore, the learning information request detecting means (104) is configured and displayed as a button clicked with a mouse on the screen, a hyperlink set in a figure or a character string.

[0 0 3 7]

A microphone (139) is used as a device to acquire the information input by the learner as audio, and the recording means (130) for recording the input information as audio is composed of a Media Encoder (ActiveX control). The personal computer was used as the learner terminal (127). By means of acquiring the index information from the DVD being reproduced (102), the reproduction frame information of the DVD is acquired at regular intervals (0.41 second) as the index information (121). The database (113) stores conversation data for role-playing as learning information.

[0 0 3 8]

The operation will be described in detail with reference to the drawings, taking as an example a scene in which "Roll-playing learning using an English movie DVD" is performed. When the learning material for role practice is selected, the learning information request detecting means (104) responds to the learning information stored in the database (113) by using a mouse on the web browser (110) of the display (111). Multiple buttons or hyperlinks are clicked. In this embodiment, the learning information request detecting means (104) indicates a means for requesting conversation data for role playing learning. Also, on the web-browser, a recording request detecting means (106) for the learner to instruct the start and end of the recording and a reproduction request detection for the learner to select and reproduce the recording information (131) are provided. The means (107) is arranged as a button or a combo box clicked with a mouse.

[0 0 3 9]

The reproduction request detecting means (107) stores the recording information for each recording information in the database (113). Index information is set in advance. The learner explicitly requests the learning information request u «

When the conversation request information (122) is detected by clicking the button of (104), the CPU (112) searches the database (113) storing the learning information for the index information set in advance for the button. Inquiry (123) of the conversation indexed in, and extracts conversation data (124). The conversation data is displayed on the conversation display means (105) configured as a display area on the web browser (110) and is arranged side by side with the video information display means (103) so that the conversation data accompanies the video information. Will be displayed to assist with listening learning.

[0 04 0]

When the recording request information (134) is detected from the recording request detecting means (106) in the learning scene, the CPU (112) obtains the video information (120) being reproduced by the index information obtaining means (102). Using the index information (121) obtained as a key, the sound of the video information is muted, and the conversation data muted by the conversation display means (105) is displayed in red. At the same time, the mute of the recording means (130), which had been muted at the start of recording, is released, the learner's voice obtained from the microphone (139) is recorded, and the index information of the video information is recorded (131). It is stored in the database (113) together with the recording elapsed time position. When a recording stop request is detected from the recording request detecting means (106), the recording information (131) indexed by the index information is stored as a file in the database (113), and the reproduction request detecting means ( 107), the index data of the recording information is set.

[0 04 1]

After the recording is completed, when the learner explicitly selects the reproduction request detecting means (107) and the reproduction request information (135) is detected, an index preset in the reproduction request detecting means (107) is set. Using the information as a key, the video information (120) and the recorded information (131) are reproduced in synchronization. During the reproduction, when the index information (121) of the video information is detected, the recording information reproducing means (132) moves the reproduction position of the recording information to a position indexed by the index information. By sending the recording information playback position shift request (133) to the, the gap between the video information and the recording information is resolved in units of index information. The CPU (112) makes an inquiry (123) to the database (113) storing the conversation data about the conversation indexed by the index information. When the conversation data is extracted (124), the conversation data is displayed on the conversation display means (105), and the DVD video information and the conversation data can be displayed along with the recording information. Support learning by

[0 04 2]

The recording information (131) stored in the database ( ₁₁₃₎ will be described using the recording information table shown in FIG. In the learning scene, when the learner clicks the button of the recording request detecting means (106), recording is started by the recording means (130). The CPU (112) obtains the index information (121) from the video information at regular intervals by the index information obtaining means (102), and stores the index information by the recording means (130) at the recording elapsed time position of the recording information (131). At the same time, it is stored in the database (113). As shown in FIG. 10, the recording information table in the database (113) includes a serial number (140) for referring to index information, a recording elapsed time (141), and index information (142) obtained from video information at the time of recording. ), The data is concatenated to form one record.

[0 04 3]

The learning procedure for role-playing learning of English movies is explained using the flowchart in Fig. 11. In this embodiment, the table configuration of the database storing the learning information and the table configuration of the database storing the questions are the same as those in the embodiment.

4 and 5 are used for explanation, respectively.

[0 044]

The learner loads the DVD (108), which is a teaching material, into the learner terminal (127), starts the language learning support system, and starts learning. In setting the learning environment (S321), the learner inputs the teaching material code (41) in the learning information management table of FIG. When a request (S322) is made to transmit the learning information to the database (113), the database (113) stores the reference table name (42) in which the index information of the requested teaching material code (41) is stored. ) And the teaching material title (43) displayed on the learner terminal (127), and the serial number (51) and index information (52) for referring to the index information stored in the question table shown in Fig. 5 ), Speaker (53), question (54) It is generated as a file (S323) and transmitted to the learner terminal (1 ^ 7).

[0 0 4 5]

FIG. 12 is a specific example of an embodiment of a learning support system for role practice. When the learning information file is obtained, the screen shown in Fig. 12 is displayed on the web browser (110). The learner views the video information (120) on the video information display window (151) of the web browser (110) (MSWebDVD ActiveX Control (registered trademark)), and plays it on the conversational text display window (152) that is juxtaposed. The conversation data is displayed in synchronization with the video information inside, and the entire conversation data in the learning material extracted from the data evening (113) is displayed in a scrollable format in the learning information display window (153). (S324). Learners can record their own voice from My Evening by clicking the Record button (154). In the playback list (155), information on the recorded files that have already been recorded is displayed as a list. When the recording information to be played is selected from the playback list (155), the video information and the recording information are played in synchronization with each other based on the index information set in advance for the selected recording information. It is possible to check.

[0 0 4 6]

The recording and playback procedures will be described in more detail with reference to FIGS. 11 and 12. When the learner clicks an arbitrary sentence in the learning information display window (153), the video information display window is moved by moving the playback elapsed time position of the video information using the index information in which the relevant conversation is indexed as a key. Displayed at (151). At this time, the conversation data window (152) displays the conversation data indexed to the playback start position in the form of subtitles, and the learning information display window (153) displays the learning information file by scrolling. Is displayed (S324). The learner selects a speaker whose role is to be played from the mute target speaker list (157), and sets the mute stage using the mute stage setting request check button (158) (S325). The mute stage can be selected from `` complete mute, low volume, no mute ''. If it is complete mute, it supports roll-playing learning, and it is effective for language learning by setting low volume or no mute. Assist in effective shadowing training.

[0 0 4 7]

When the recording button (154) is clicked, the mute of the recording means (130) set to mute in advance is canceled to start recording (S326), and the learner performs role playing (S327). At this time, the sound of the video information is muted in accordance with the mute level set by the mute level setting request check button (158), and selected in the mute target speaker list (157) in the conversation display window (152). The conversation text of the speaker is displayed in red. When the learner finishes the role practice, he clicks the record button (154), cancels the mute of the video information, silences the recording means (130), and ends the recording (S328). The learner terminal (127) recording information which has been stored in memory of the (131) is sent the database ₍₁₁₃₎ _(S3 29), is stored in the de Isseki base (113) (S330). Recording information is added to the playback list (155) using the index information of the video information as a key.

[0 0 4 8]

After the recording is completed, when the audio to be played is selected from the playback list (155), the video information (120) and the recording information (131) are synchronized and played using the index information held in the playback list (155) as a key. Yes (S331). The conversation data indexed by the index information is extracted (124) from the database (113) and displayed on the conversation sentence display window (152). By playing back and confirming the recorded voice, learning through role practice is repeated. At this time, if the repetitive playback setting function (156) is used, an arbitrary time interval can be set prior to the index information of the recording information stored in the database (113) stored in the learning information display window (153). It can be set by the learner himself and played back as many times as he wants.

[0 0 4 9]

Although the foregoing description has been directed to exemplary systems according to the present invention, those skilled in the art will recognize that many other systems or variations of the above described systems can be readily configured. . For example, even when video information is stored on a CD or a hard disk instead of a DVD, the language education system can be easily configured. Furthermore, since the window for displaying conversational sentences and the window for displaying learning information are display areas configured on a web browser, if the questions stored in the database (113) are described in HTML language, a still image can be inserted. It is also easy to make links and enter hyperlinks to related sites on the Internet. Also, if the database resides on a separate server across the network, multiple learners It is also possible to store recorded information on an external server.

[0 0 5 0]

As described above, the present invention makes it possible to synchronize the video information and the recorded information in the learning scene in which the video teaching material is used for the role practice, and to eliminate the deviation in the reproduction timing. This can contribute as a learning support system for effective audiovisual education.

[Embodiment 3]

[0 0 5 1]

In the present embodiment, in addition to the first embodiment, answers of a plurality of learners indexed to the video information stored in the database are extracted by using the indexed information as a key, and based on the answer, A learning support system for extracting the learning information from a database as a graph and displaying the learning information as a graph on a display unit.

[0 0 5 2]

The present system includes a presentation index recording terminal (159), a learner terminal (161) to which a learner answers, a database (165) for indexing and recording answers of a plurality of learners, and It consists of a total information display terminal (173) that extracts and displays the information. A personal computer consisting of a CPU (164) running Windows (registered trademark) was used as a control means for the presentation index recording terminal (159), the learner terminal (161), and the terminal for displaying total information (173). . Before starting a presentation, these terminals synchronize the time held internally by the PC in a predetermined manner.

[0 0 5 3]

The means for recording video information (160) consisted of Media Encoder ActiveX Control (registered trademark). In this embodiment, the evaluation operation detecting means (166) of the learner terminal (161) and the reproduction position request detecting means (183) of the terminal for displaying total information (173) are learning information request detecting means. It is composed and displayed as a button clicked with the mouse, a figure or a hyperlink set in a character string on the browser (162). FIG. 13 is a block diagram of the present invention.

[0 0 5 4]

The operation of the learning support system according to the embodiment of the present invention in which “simultaneous synchronous mutual evaluation learning using video information of a presentation” is performed will be described in detail with reference to FIG. While the presenter's video information is being acquired by the presentation index recording terminal (159), the data input by the learner from the learner terminal (161) and evaluated from a predetermined evaluation viewpoint are recorded in the Maekurami database ( ₁₆₅₎ . And a synchronous mutual evaluation learning scene in which the learning information is extracted from the database as a graph and the results obtained by summing up the evaluation data after the presentation are finished are displayed from the database, and displayed on the totaling information display terminal (173) for learning. Be composed.

[0 0 5 5]

In the simultaneous evaluation scene, from the video information (171) obtained from the camera at the presentation index recording terminal (159), the current time based on the start of recording as index information (168) is obtained. Obtain at predetermined intervals by flat-tier (167). When the presentation means (174) composed of Power Point (registered trademark) detects the presentation end information (Π6), the CPU (164) compares the index information with the database (165) by using the presentation index. Sent as information (177).

[0 0 5 6]

The learning procedure of the learner who will be the audience (evaluator) will be described using the simultaneous evaluation procedure in Fig. 15. The learner, while watching the presenter's presentation at the learner terminal (161), explicitly decides on the evaluation operation detection means (166 ) Is clicked to perform evaluation (S341). When the evaluation operation information (169) is detected, the CPU (164) obtains the index information from the means for obtaining the index information (167) (S342), and indexes the data on the data base (165) using the index information. The attached evaluation data (170) is transmitted (S343) and stored (S344).

[0 0 5 7]

As shown in the evaluation table in Fig. 16, the presentation evaluation record contains a serial number (211) for referring to the evaluation data, the learner's user ID (212), the learner's terminal IP address (213), Evaluation data type (214), index information (215), deletion mark for data management (216) One record is concatenated and stored in the database (165). In this example, the sr-value data type (214) is mouse button information. The delete mark for data management (216) is set to 'Γ' when the learner determines that the last click was a mistake and presses a predetermined key to cancel it. Is done.

[0 0 5 8]

Next, a synchronous mutual evaluation learning scene will be described. In the terminal (173) for displaying the total information, the means (179) for reproducing the video information is constituted by Media Player ActiveX Control (registered trademark). The presentation slide display means (184) was composed of Power Point ActiveX Control (registered trademark). Reproduction elapsed time position information is obtained from the video information (185) being reproduced as index information (188) by means (180) for obtaining the index information. The learning material selection means (194) is arranged as a combo box that can be selected with the mouse on the web browser (162), and a list of learning information to be tabulated according to the learning information stored in the database (165). Is displayed.

[0 0 5 9]

When the learner selects the learning information to be counted from the learning material selection means (194), and the learning material selection tally request information (195) is detected, the CPU (164) acquires the learning information from the database (165) and acquires the learning information. A plurality of reproduction position request detection means (183) are arranged as buttons to be clicked with a mouse on the web browser (162) according to the learning information thus obtained. The index information stored in the database (165) is set to the button. At this time, the video information (185) obtained from the video information recording medium (178) is displayed on the video information display means (181), and the index information (188) obtained by the index information obtaining means (180) is obtained. ) Is sequentially compared with the index information stored in the button and when they match, the presentation slide associated with the index information is displayed on the presentation slide display means (184).

[0 0 6 0]

The CPU (164) requests the database (165) for evaluation data of the selected teaching material (189) and extracts the evaluation data (190). The CPU (164) sums up the number of the extracted evaluation data based on the evaluation data type and displays the number on the evaluation data display means (182) (191). It is displayed as a graph on the evaluation data total information display means (187) (193). By juxtaposing the evaluation data with the video information display means (181) and the slide display means (184), the evaluation data and the evaluation data total information are displayed along with the video information and the slide.

[0 0 6 1]

In the learning scene, when the learner explicitly clicks the button of the reproduction position request detecting means (183) and the reproduction position request information (186) is detected, the CPU (164) sets the button in advance. In accordance with the obtained index information, the aggregated evaluation data is displayed on the evaluation data display means (182), a slide is displayed on the slide display means (184), and at the same time, the video playback position is displayed on the index. A playback position shift request (197) is sent to the means (179) for playing the video information to move to the position indexed by the information. This makes it possible to display video information along with slides and evaluation data, and effectively supports synchronous mutual evaluation learning using the video information of the presentation.

[0 0 6 2]

In this learning support system, a presentation index recording terminal (159) and multiple learner terminals (161) are connected to a network line (196) in a simultaneous evaluation situation, and teachers and learners share a database (165). The configuration shown in Fig. 14 is taken. In the synchronous mutual evaluation learning scene, the terminal for displaying total information (173) is connected to the network line (196), and the totalized evaluation data is displayed on the display means. In this case, the presentation index recording terminal (159) and the plurality of learner terminals (161) in the simultaneous evaluation scene can be used as the terminal for displaying total information (173).

[0 0 6 3]

Further, the learning procedure in the terminal for displaying total information (173) in the synchronous mutual evaluation learning scene will be described in detail with reference to the synchronous mutual evaluation learning procedure in FIG. 15 and a specific example of the screen in FIG. The table configuration of the database that stores the learning information is the same as that of the first embodiment. Use for clarity. ¹¹

[0 0 6 4]

When the learner requests the database (165) to extract learning information in the setting of the learning environment (S351), the database (165) generates the learning information in the learning information management table of FIG. (S352) and sends it to the terminal for displaying total information (173). At this time, the video information (185) as the teaching material is obtained from the video information recording medium (178).

[0 0 6 5]

When the learning information is obtained, the screen in Figure 17 is displayed on the web browser (162). In the presentation learning information selection means (226), the learning material code (41) of the learning information acquired in the setting of the learning environment (S351) is set in advance. The learner uses the presentation learning information selection means (226) to select the teaching material to be counted (S353). When the teaching material selection aggregation request information (195) is sent to the database (165), the data for management is deleted from the evaluation table (Fig. 16) of the database (165) using the requested teaching material code (41) as a key. The evaluation records where the mark (216) is not “Γ” are extracted, the number of records is totaled at a predetermined time interval for each evaluation data type (214), a learning information file is generated, and a terminal for displaying total information is displayed. It is transmitted to (173) (S354).

[0 0 6 6]

The learner views the video information (185) in the video information display window (221) on the web browser (162), and the evaluation type total display window (222) and the evaluation time series total graph display window (227) ), The total value of each type of evaluation extracted and totaled from the database (165) and the total information of the time series are confirmed (S355). The slide is synchronously displayed on the presentation slide information display window (225) using the index information (188) obtained by the means U80) for obtaining the index information from the video information as a key. The learner moves the playback position of the video information (185) to an arbitrary position by explicitly clicking the video information playback control button (223) and the slide playback position control button (224). It is possible to refer to the evaluation type-based aggregation and evaluation time-series aggregation graph associated with the index information (188) of the video information (185).

[0 0 6 7]

Although the foregoing description has been directed to exemplary systems according to the present invention, those skilled in the art will recognize that many other systems or variations of the above described systems can be readily configured. . For example, in the learner terminal, the index information can be obtained not only from the video information being recorded by the camera but also from the DVD or hard disk, or from the learner terminal when streaming is used. It is possible. Also, when the video information reproduced by the terminal for displaying total information is stored not on a DVD but on a CD or a hard disk, or when a network drive or streaming is used, the learning support system can be easily configured. be able to.

[0 0 6 8]

In addition, when the database exists in the same terminal without passing through the network, the case where the evaluation data from multiple learners are simultaneously displayed on the terminal for displaying total information, etc. is possible. In addition, the explanation of the learner's terminal for the answer and evaluation has been described using a personal computer as an example, but mobile phones such as mobile phones and PHS, and other terminals that can transmit time information and terminal information when a key is pressed, It can be used as a learner terminal. Furthermore, since the window for displaying the totals by evaluation type and the window for displaying the time series total graphs are display areas configured on the web browser, if described in HTML language, numerical values, audio, still images, etc. besides graphs It is also easy to express with.

[0 0 6 9]

As described above, according to the present invention, in a learning situation using presentation video teaching materials, by sharing a database on a network, a large number of teachers and learners can provide evaluation data and can also refer to the total. This can contribute as a learning support system that incorporates the results of audiovisual education into distance learning.

[Example 4]

[0 0 7 0]

In this embodiment, in addition to the first embodiment, a camera for acquiring images and sounds, and a camera Means information recording Te video information and ^one with the index information, a further learning support system comprising a means for recording the broadcast on the basis of the index information.

[0 0 7 1]

FIG. 18 is a block diagram of the present invention. An operation of the real-time subtitle providing system according to an embodiment of the present invention will be described in detail with reference to the drawings.

[0 0 7 2]

A personal computer composed of a CPU (237) running Windows (registered trademark) was used as a control means of the learning information input terminal (239) and the subtitle providing system terminal (231). The means (234) for obtaining the index information from the video information (232) during recording obtained from the camera (243) for acquiring images and sounds was constituted by an add-in by VBA (registered trademark). The index information (241) of the video information (232) obtained by the means (234) for obtaining the index information is the current time with reference to midnight, and the means (234) for obtaining the index information ). The means (233) for recording the video information during the recording obtained from the camera (243) is constituted by a Media Encoder Control Control (registered trademark). The means (236) for recording the learning information based on the index information is constituted by an add-in using VBA (registered trademark).

[0 0 7 3]

The procedure for learning support using the captioning system will be described with reference to the flowchart of FIG. When the video information recording by the camera (243) is started (S371), the subtitle input operator inputs subtitle character data from an input device such as a keyboard of the learning information input terminal (239) (S372). . The input learning information (240) is transmitted to the captioning system terminal (231) via the network (238). The means for obtaining index information (234) obtains index information (241) from the video information (232) obtained from the camera (S373), and the means for recording learning information (236) uses the index information (241). The learning information is recorded as a key, and an index record is generated (S374).

[0 0 7 4]

The video information recording means (233) records the video information (232) obtained from the camera together with the index information (241) as video information (S375). When the recording of the video information is completed (S376), the CPU (237) collectively transmits the records generated by performing the indexing based on the index information (241) to the database (235) (S377), and the subtitle information (242 ) Is stored in the database (235) (S378). The caption information stored in the database is, as shown in the caption information table in FIG. 20, the recording index time (251), the time when the subtitle character string was started to be input (252), and the subtitle character string (253) in this order. To form one record.

[0 0 7 5]

Although the foregoing description has been directed to exemplary systems according to the present invention, those skilled in the art will recognize that many other systems or variations of the above described systems can be readily configured. . For example, the present invention is not limited to inputting and recording subtitle information in accordance with what is actually recorded in a learning scene performed in front of the eyes. Captions can be added using elapsed time as index information. Also, when the learning information input by the learning information input terminal does not pass through the network and the learning information is input from the same terminal, or when the caption data by multiple subtitle information input users is obtained in parallel, Similarly, it is also possible to use personal computer summary writing software ソ voice recognition software.

[0 0 7 6]

As described above, in the present embodiment, the video information and the learning information were obtained during the recording at the end of the recording by synchronizing the recording of the video information and the recording of the learning information in the learning support using the caption provision system. It is possible to complete recording by indexing with index information. This can contribute to a system to support international students and learners with hearing impairments. [Brief description of the drawings]

FIG. 1 is a block diagram of a learning support system.

FIG. 2 is a block diagram in a case where a plurality of learners connect to a network.

[Fig. 3] This is a flowchart in the case of performing listening learning of an empty space replenishment type.

FIG. 4 is a table configuration of a database storing learning information.

FIG. 5 is a table configuration of a database storing questions. FIG. 6 is a table configuration in which learner's answers are indexed and stored.

FIG. 7 is a specific example of listening learning using an English movie DVD.

FIG. 8 is a configuration example of an answer BOX.

FIG. 9 is a block diagram of a learning support system for role practice.

[Fig. 10] Fig. 10 is a table configuration of a database that stores recording information.

[Fig. 11] This is a flowchart for role-playing learning using the English movie DV.

[Figure 12] This is a specific example of role 'playing learning using English movie D VD'.

FIG. 13 is a block diagram of a learning support system.

[Fig. 14] Fig. 14 is a block diagram in the case where a plurality of learners connect to a network.

FIG. 15 is a flowchart in the case of performing presentation learning.

[Fig. 16] This is a table configuration in which evaluation data of each learner is indexed and stored.

[Figure 17] This is a specific example of the screen of the presentation learning support system.

FIG. 18 is a block diagram of a learning support system.

FIG. 19 is a flowchart in the case of performing real-time subtitle addition.

FIG. 20 is a table configuration of a database that stores subtitle information.

[Explanation of symbols]

0 Video information storage media (D V D, C D, etc.)

1 Means for playing video information

2 How to get index information (Acti veX control)

3 Video information display means (Acti veX control)

4 Learning information request detection means

5 Learning information display means

6 Web Browser

7 Display

8 C P U

9 Database (learning information and information entered by learners are stored)

0 Video information

1 Index information

2 Learning information request operation information

3 Inquiry of learning information

4 Learning information data extraction

5 Learning information data display

6 Play position move request

7 Learner terminal

8 Network line

1 Teaching material code

2 Reference table name

3 Teaching material title

1 Serial number for referring to index information

2 Index information

3 speakers

4 Question (Vacancy replenishment problem)

1 Learner index

2 Time when the answer was stored

3 Index information (obtained from the video information when the answer was stored)

4 Elapsed learning time (seconds)

5 Answer 1 (Answer to question 1)

6 Answer 2 (Answer to question 2)

7 Answer n (answer to question n)

1 Video information display window (MSWebDVD ActiveX Control)

2 Answer display window

3 Question text display window 74 Repeat playback setting function

75 Answer writing window

81 Enter Answer B OX

82 Speaker. Conversation display time B OX (Effective when editing teaching materials)

83 Learning information request button

84 Send answer text button

85 Fill-in-the-blank answer box

101 Means for Playing Video Information

102 Index information obtaining means

103 Video information display means (ActiveX control)

104 Learning information request detection means

105 Conversation display means

106 Recording request detection means

107 Reproduction request detection means

108 Video information storage media (DVD, CD, etc.)

110 Web Browser

111 Display

112 C P U

113 database (conversation information and recording information are stored)

120 Video information

121 Index information

122 Conversation request information

123 Conversation inquiry

124 Conversation data extraction

125 Conversation data display

126 Video playback position move request

127 learner terminal

130 Recording Method

131 Recording information

132 Recording information playback means

133 Recording information playback position move request

134 Recording request information

135 Playback request information

136 List of speakers to be muted

137 Mute target selection request

138 Mute level setting request ''

139 microphone

140 Serial number for referring to index information

141 Elapsed recording time

142 Index information (obtained from video information at the time of recording)

151 Video information display window (MSWebDVD ActiveX control)

152 Conversation display window

153 Learning information display window

154 Record button

155 Play List

156 Repeat playback setting function

157 List of speakers to be muted

158 Mute step setting request check button (complete mute, low volume, no mute) 159 Presentation index recording terminal

160 Means for Recording Video Information

161 learner terminal

162 Web Browser

163 Display

164 C P U

165 de overnight base (learning information is stored)

166 Evaluation operation detection means

167 Means of Obtaining Index Information

168 Index information

169 Evaluation operation information

170 Evaluation data

171 Video Information

172 camera

173 Total information display terminal

174 Means of Presentation

176 Presentation end information

177 Presentation Index Information

178 Video information storage media (DVD, CD, hard disk, streaming, etc.)

179 Means for Playing Video Information

180 Means of Obtaining Index Information

181 Video information display means (ActiveX control)

182 Evaluation data display means

183 Playback position request detection means

184 Presentation slide display method (Microsoft Power Point)

185 Video Information

186 Play position request information

187 Evaluation data total information display means

188 Index information

189 Evaluation data request

190 Evaluation data extraction

191 Evaluation data display

193 Evaluation data summary information display

194 Teaching Material Selection Method

195 Educational material selection tally request information

196 network line

197 Play position move request

211 Serial number for referring to evaluation data

212 Learner User 1D

213 IP address of student terminal

214 Evaluation data type

215 Index information (number of seconds elapsed when key is pressed)

216 Delete mark for data management

221 Video information display window (Microsoft Media Player)

222 Evaluation display window by evaluation type

223 Video information playback control button

224 Slide playback position control button

225 Presentation slide information display window (Microsoft Power Point) 226 Presentation learning information selection means

227 Evaluation time series total graph display window 231 Captioning system terminal 232 Video information

233 Means for recording video information

234 How to Get Index Information

235 database

236 Means for Recording Learning Information

237 C P U

238 Network

239 Learning information input terminal

240 learning information

241 index information

242 subtitle information

243 Camera

251 Recording index time

252 Time when character string input started

253 subtitle string

Claims

[Document Name] Claims 17

[Claim 1]

Means for reproducing video information; a display for displaying the information; means for obtaining index information relating to the elapsed time of the reproduction of the video information; a database in which learning information is recorded using predetermined index information as a key; Learning information request detection means for detecting a request when a user requests learning information; and an index of the video information when the request detection means detects a request for learning information during reproduction and display of the video information. A learning support system comprising: control means for extracting learning information from the data base using information as a key and displaying the information on the display.

[Claim 2]

Means for reproducing video information, a display for displaying the information, means for obtaining index information relating to the elapsed time of reproduction of the video information, a database in which learning information is recorded using predetermined index information as a key, and an index A plurality of the request detecting means in which information is set in advance, and when the request detecting means detects a request for learning information, video information is moved to the indexed position, and the request information is set in the request detecting means. Control means for extracting learning information from the database using the index information as a key and displaying the learning information on the display.

[Claim 3]

3. The learning support system according to claim 1, wherein the learning information stored in the database includes a question, its correct answer, and instruction content.

[Claim 4]

3. The learning support system according to claim 1, wherein information input by the learner is recorded in the database using the index information as a key.

[Claim 5]

The database according to claim 1 or 2, wherein the database is shared by a plurality of learners, answers of the plurality of learners to a question extracted from the database are indexed for each learner, and the index is obtained. A learning support system characterized in that learner's answers are recorded in a database using the information obtained as keys.

[Claim 6]

5. The learning support system for role practice according to claim 4, wherein the information input by the learner is recorded as audio, and the video information and the recorded information are reproduced in synchronization during reproduction.

[Claim 7]

6. The graph according to claim 5, wherein answers of a plurality of learners indexed to the video information stored in the database are extracted by using the indexed information as a key, and a result obtained based on the answers is graphed. The learning information is extracted from a database and displayed on a display means.

[Claim 8]

A camera according to claim 1 or 2, further comprising: a camera for acquiring images and sounds; a unit for recording information obtained from the camera as video information together with index information; and a unit for recording learning information based on the index information. Learning support system. [Document Name] Abstract

【wrap up】

【Task】

The objective is to provide a learning support system that plays and displays videos such as DVD movies and other learning data synchronized with them on the learner's terminal, and interactively uses video teaching materials. I do.

[Solution]

In order to achieve the above object, means for reproducing video information, a display for displaying the information, means for obtaining index information (current time based on the start of video reproduction) from the video being reproduced, and an index A means for extracting and displaying learning information from a database using a database in which learning information is recorded using information as a key, a learning information request button, and index information when the learning information request button is clicked as a key. The learning support system was constructed using. When a learning information request is issued during the playback of a video, the learning information is extracted from the database using the index information obtained from the video information as a key, and control means for displaying the learning information on the display is used. And

[Selection diagram] Fig. 1