TW202040498A - Video generation method, system and equipment based on online education and storage medium - Google Patents

Abstract

The invention provides a video generation method and system based on online education, equipment and a storage medium, and the method comprises the steps: segmenting at least one section of recorded video of the online education into a plurality of video paragraphs according to a preset duration; adding at least one video tag to the video paragraph according to the content information of the video paragraph; and editing the video paragraphs with the video tags according to a preset first user tag to obtain a video file comprising a plurality of video paragraphs. According to the method, the whole video is segmented into the video segments and the tags are added backwards, so that the whole video is conveniently selected and optimally edited, the watching value of video playback is increased, and the humanized experience is improved.

Description

Online education film generation method, system, equipment and storage medium

The present invention relates to the field of online education, and specifically relates to a method, system, equipment, and storage medium for film generation based on online education.

At present, the technology of entering the online virtual classroom to learn through a network connection is quite mature. The course of various classes can be recorded into different data types. The easiest way to record the course of the class is to record the user. Screen and save as a video file. Or it can be assembled into a self-customized multimedia (html tag, javascript, mp4/webm, xml data) through various script languages to play (such as BigBlueButton software).

However, once the number of classes in such online virtual classrooms starts to increase proportionally, and various content in the recording files need to be dynamically modified (for example: removing inappropriate messages, individual student audio files fail to be recorded separately and need to be manually removed File repair, paragraph exclusion when you don’t want users to see part of the recorded paragraph), the former method of skimming or the latter method of re-assembly through script language is extremely waste of computing resources and labor costs.

Usually in a teaching video, the entire length is between at least half an hour to 2 hours, and contains a lot of knowledge points. However, the existing video lacks retrieval or browsing functions. Students can only see the end mechanically. Or fast-forward playback, etc., the use efficiency of teaching videos is very low, which results in a fixed use scene of teaching videos and a single way for students to use teaching videos. Moreover, some teaching videos also include the opening, ending, teacher’s self-introduction or greetings, etc. The value of each video clip in the teaching video is different, and it is difficult for the teaching video to provide students with the most Video clips on demand.

Therefore, one of the objectives of the present invention is to solve the problems in the prior art and provide a method for generating a movie based on online education. By dividing the entire movie into movie paragraphs and adding tags, it is convenient to select and optimize the entire movie. Edit, increase the viewing value of film replay, and improve the humanized experience.

In addition, another object of the present invention is to provide a video generation system based on online education to solve the problems in the prior art. By dividing the entire video into video paragraphs and adding tags, it is convenient to select and select the entire video. Optimize editing, increase the viewing value of film replay, and improve the humanized experience.

In addition, another object of the present invention is to solve the problems in the prior art and provide a video generation device based on online education. By dividing the entire video into video paragraphs and adding tags, it is convenient to select and optimize the entire video. Edit, increase the viewing value of film replay, and improve the humanized experience.

Furthermore, another objective of the present invention is to provide a computer-readable storage medium based on online education to solve the problems in the prior art. By dividing the entire video into video segments and adding tags, it is convenient to select the entire video. And optimized editing, increase the viewing value of film replay, and improve the humanized experience.

Therefore, the online education-based movie generation method of the present invention includes a step S110, a step S120, and a step S130.

In step S110, at least one segment of the online education recorded video is divided into multiple video segments according to a preset duration.

In step S120, at least one video tag is added to each video segment according to the content information of the video segments.

The step S130 is to filter and edit each video segment according to each video tag, to obtain at least one video file containing multiple video segments.

Furthermore, the online education-based video generation system of the present invention includes a recording video segmentation module, a video tag adding module, and a video file editing module.

The recorded video segmentation module divides at least one segment of online education recorded video into multiple video segments according to a preset duration.

The video tag adding module adds at least one video tag to the video segment according to the content information of the video segment.

The video file editing module filters and edits the video segments according to the video tags, and obtains at least one video file containing multiple video segments.

In addition, the online education-based video generation device of the present invention includes a processor and a memory storing executable instructions of the processor. Wherein, the processor is configured to execute the steps of the aforementioned online education-based film generation method by executing the executable instruction.

Furthermore, the computer readable storage medium based on online education of the present invention realizes the steps of the aforementioned method for generating a video based on online education when the program is executed.

The effect of the present invention is that the method, system, equipment and storage medium of the present invention are based on online education. By dividing the entire movie into multiple movie paragraphs and adding tags, it is convenient to select and optimize the entire movie. Increase the viewing value of film replay and improve the humanized experience.

Referring to FIG. 1, an embodiment of the online education-based video generation method of the present invention includes a step S110, a step S120, a step S130, and a step S140.

In step S110, at least one segment of the online education recorded video is divided into multiple video segments according to a preset duration.

The step S120 is to add at least one video tag to the video segment according to the content information of the video segment.

The step S130 is to filter and edit the video segments according to the video tags to obtain at least one video file containing multiple video segments.

The step S140 is to create at least one user tag based on the personal information of the user terminal representing a user, filter video files with requirements for editing, obtain at least one video course and send it to the user terminal, that is, the user.

In this embodiment, by dividing the entire video into video segments and adding tags, each video segment can have at least one tag, which can facilitate the selection and optimization of the entire video, such as deleting unimportant video segments. Or centrally edit the video passages related to the knowledge points. Generally speaking, educational films generally have a fixed format, which is very different from ordinary films. There will be at least a blackboard part and a teacher on the screen of the educational film. The teacher will explain the blackboard part one by one. The method of tagging the film, but the workload is huge and it takes a long time.

This step S120 also includes a sub-step S121 and a sub-step S122.

The sub-step S121 is to perform image and text recognition on at least one frame in the movie paragraph to obtain a first text corresponding to the movie paragraph. And perform voice recognition on the movie paragraph to obtain a second text corresponding to the movie paragraph; the sub-step S122 is to obtain at least one word with the highest occurrence frequency according to the first text and the second text corresponding to the movie paragraph as the movie paragraph Video tags.

This embodiment completely uses the program method to set the tags of any video paragraphs of any educational videos, and to creatively extract a certain amount of picture frames from the video paragraphs, the prior art graphic recognition means can be used to obtain the tags from the blackboard writing part of the screen. Regarding the content of the writing on the blackboard, the first text content is used as the first text, and the voice recognition method of the prior art is also used. The self-taught teacher obtains the text of the explanation content for the explanation of the writing on the blackboard as the second text. The present invention uses the first text And the at least one word that appears most frequently in the second text is used as a movie tag for the main content of this movie paragraph. It should be noted that educational films are a special form of films. In the educational films, teachers do not read on the blackboard, but will combine the content of the blackboard for extended explanations or case introductions. The content of the blackboard is usually It is relatively concise, so, just for the text obtained on the blackboard, it is not certain that the instructor is explaining the part of the blackboard in this video. The accuracy of defining the film label from the blackboard alone is very low, which does not conform to the teaching habits of the teacher , Just recognizing the teacher’s voice to define the video label will be interfered by the teacher’s personal expression habits, etc., and the accuracy of the video film label is the same. Therefore, the present invention combines the different texts obtained in the two ways. In this way, the video tag is brought closer to the main content of the video paragraph, which greatly increases the accuracy of defining the video tag. Under the premise of taking into account the calculation cost, Provides an optimized way to add tags for the unique attributes of educational films.

In addition, this sub-step S122 also includes taking the at least one word with the highest total number of occurrences in the first text and the second text as the movie tag of the movie paragraph, but not limited to this, for example: "engine" appears in the first text 4 times, "maintenance" appeared 3 times, and the remaining words appeared at most 2 times. In the second text, "engine" appeared 8 times, "maintenance" appeared 6 times, and the remaining words appeared at most 2 times, and the remaining words appeared at most 2 times. The two words with the highest number of occurrences in the first text and the second text are "engine" and "maintenance", then "engine" and "maintenance" are used as the two movie tags of the movie paragraph, and this sub-step S122 includes At least one word that appears in both the first text and the second text and has the highest number of occurrences is used as the movie tag of the movie paragraph, but it is not limited to this. For example: "Li Bai" appeared 3 times in the first text, "Du Fu" appeared 3 times, and the remaining words appeared up to 2 times, in the second text "Li Bai" appeared 2 times, and "Ancient Poems" appeared 6 times. "Du Fu" appeared 4 times, and the remaining words appeared 2 times at most. Although "ancient poems" appeared the most times, in this preferred embodiment, the combination and effect of writing on the blackboard and the teacher's oral narration will be more comprehensively considered, and the first Both the first text and the second text appear and "Li Bai" with the highest number of occurrences is used as the movie tag of the movie paragraph.

In a preferred embodiment, the step S130 includes the following steps: searching for the video segment with the most played video tag and/or the video segment with the video tag having the most watched time by the user, and the video is obtained after editing File, but not limited to this. The present invention can filter and edit the video segments that most users are accustomed to watching (such as highlights, core knowledge points, etc.) to obtain video files, thereby optimizing the video files, Video files are more satisfied with the viewing experience of most users.

In a preferred embodiment, the step S130 includes the following steps: deleting video paragraphs with video tags whose number of times of being played is less than a preset threshold and/or video clips with video tags whose viewing time is less than a preset threshold Video paragraphs, and edited video files, but not limited to this. The present invention can filter and delete the video segments that most users are unwilling to watch (for example: opening, ending, advertisement, etc.), and finally edit and integrate the video files, thereby simplifying and optimizing the video files and improving the humanized experience.

In a preferred embodiment, the video tag of the video segment most played by the user is obtained from a historical database about the user as the user tag, and the video segment with the user tag is searched and edited to obtain the video course. Send video lessons to the user’s mobile terminal, but not limited to this. According to the user's viewing habits and preferences, the present invention can obtain the user's favorite video paragraphs by way of tag filtering to obtain the video file after editing, and improve the user's viewing experience according to the viewing needs of each user.

In a preferred embodiment, the step S140 includes a sub-step S141, a sub-step S142, a sub-step S143, and a sub-step S144.

The sub-step S141 is to extract keywords of the wrong question from the wrong question set of the historical database about the user.

This sub-step S142 is to generate edit tags based on the keywords of the wrong questions.

The sub-step S143 is to edit the video segment with the video tag hitting the edit tag, and obtain a video file about the user's wrong title set.

The sub-step S144 is to send the video file to the user.

The present invention is aimed at the learning process of students on the education website, and according to the wrong questions in each student's wrong question set, a targeted video file about the wrong questions is formed according to the different learning situation of each student, so that each student can In the video file provided according to his learning situation, he can see the explanation film about his historical wrong question, which greatly improves the humanized experience and student satisfaction.

In a preferred embodiment, the recorded videos are all recorded teaching videos on the teacher's end and the student's end stored in the online education server. Each teaching video is divided into multiple video segments according to the preset duration. Not limited to this, in addition, each instructor represents one instructor, and each student represents one student. With the present invention, a large number of ready-made teaching videos stored in the online education server can be intelligently processed, and these teaching videos can be divided into video paragraphs and tags respectively.

In a preferred embodiment, the recorded video is a real-time recorded video during one-to-one online education between the instructor and the student, and the recorded video within the preset duration is generated as a video segment every time a preset duration has passed , But not limited to this. By means of the present invention, in an educational video recorded in real time, each time a video segment is recorded, a video tag is added to the video segment, which improves the timeliness of adding video tags and facilitates the promotion of the overall program.

In a preferred embodiment, the selection range of the preset duration is 10 seconds to 10 minutes. For example, the length of each video segment is set to 30 seconds, or 1 minute, etc. by the preset duration. But not limited to this.

Preferably, in step S120, at least one video tag is added to the video segment according to a trigger event in the content information of the video segment, and the trigger event includes at least one of the following events:

The teacher or student end is connected to the online education video classroom system end via a network, that is, the instructor or student is connected to the online education video classroom.

The instructor or student sends an instruction to the video classroom system to execute a dialog box input interface, that is, the instructor or student opens the dialog box in the video classroom to input text.

The instructor or student sends an instruction to the video classroom system to execute a textbook page turning step, that is, the teacher or student turns the pages of the textbook in the video classroom.

The instructor or student sends an instruction to make the video classroom system execute a whiteboard interface, that is, the instructor or student uses the whiteboard in the video classroom.

The instructor or student sends an instruction to the video classroom system to play an audiovisual file, that is, the teacher or student plays the audiovisual file in the video classroom.

The instructor or student sends an instruction to make the video classroom system execute an animation special effect, that is, the teacher or student uses the animation special effect in the video classroom.

The instructor or student sends an instruction to the video classroom system to send points information, that is, the instructor or student sends points in the video classroom.

The instructor or student terminal cuts off the connection to the video classroom system terminal, that is, the instructor or student leaves the video classroom.

In a preferred embodiment of the present invention, by creating an online course recording and replaying mechanism in the online course, it can rely on a self-defined text event format, and the audio and video in the classroom, whiteboard actions, and classroom operation records are all in accordance with this format Save it in text files and audio-visual files, and use the above-mentioned data to implement various functions through this audio-visual file and text file when viewing the video file on the same set of online course software (for example: use algorithm to remove time difference, "replay" The entire class process), the various data in the event text file can also be edited through the background to make detailed adjustments. The details include the words written on the whiteboard, the lines drawn, etc. The method for replaying online course video files of the present invention can achieve the purpose of modifying and changing the content of each event and video playback section of the video file by simply modifying the text file of the course wb file. It has high maintenance flexibility.

The goal of the present invention is to create an online course recording and replay mechanism, which customizes a set of text event format. Events in this format will not only be stored in the video streaming file, but also archived as an editable UTF-8 file. Various events (such as handwriting events, page-changing events, etc.) allow people to dynamically modify the contents of the video file, and also determine the order in which the events of the video file are triggered (for example, the teacher’s video file or the student’s video file should be played first ), so you don’t need to assemble it through the script language, you can directly use the course-style interface to play after modification, which can also reduce the technical threshold and computing cost of "editing a replayable online classroom video file".

The present invention creates a text event format for recording various whiteboard actions and audiovisual behavior events triggered during online courses, and stores a text file (hereinafter referred to as wb file, whiteboard file) and an audiovisual string through the prior art In the stream file (hereinafter referred to as the teacher's video file), after the course is over, you can use this wb file and the teacher's video file to replay all the behaviors and videos in the course. It is modifiable and does not need to be recompiled.

A method of recording text events of the present invention is as follows:

a. Any user of the online course (teacher, student or IT staff) enters the classroom, the audio-visual streaming event host opens the classroom entity, creates a wb file file and writes a line of event'init4', which represents the start of the online course ( The format of the event is'current time-event name-event parameters', separated by'-' characters and two bytes of'CRLF' as the end of the event);

b. Every minute in the classroom entity, a line of event't' will be written in the wb file and the teacher's video file (if the teacher's video file exists), the event parameter is the current unix time (unit: milliseconds, 13 Composed of numbers);

c. When a teacher or student logs in to the course and connects to the classroom entity, and clicks to allow access to the local microphone and camera, the classroom entity will write a line of event'r' in the wb file and the teacher’s video file (if If the teacher’s video file exists), it means that the user’s video is streamed into a video file (event parameters: user name, user number, body classification, classroom type, video format).

d. When a teacher or student leaves the course and leaves the classroom entity, the classroom entity will write an event'o' in the wb file and the teacher's video file (if the teacher's video file exists), it means that the user will stop recording Audio and video streaming (event parameters: user name, user number, body respectively).

e. When any user (teacher, student or IT staff) is typing in the dialogue box in the course, the classroom entity will write a line of event'c' in the wb file and the teacher's audiovisual file (if the teacher's audiovisual file If it exists), it represents the content of the user's speech in the classroom (event parameters: customized user header (including user name and conversation object name), user name, user number, user identity, speech content).

f. When there is any user (teacher, authorized student or IT staff) who has the right to operate the teaching material to turn the page/present the page of the teaching material in the course, the classroom entity will write a line of event'p' in the wb file and In the teacher's audio-visual file (if the teacher's audio-visual file exists), it represents which page of the current textbook in the classroom is (event parameter: page index value, integer type starting from 0).

g. When there is any user (teacher, authorized student or IT staff) with whiteboard operation permission in the course operation (add/modify/delete) whiteboard event, the classroom entity will write a line of event's' in wb file and the teacher’s video file (if the teacher’s video file exists), it represents the current operation content of the whiteboard (such as: adding a hand drawing, uploading a picture, etc.) (event parameters: drawing operation, drawing type, the Parameters required for drawing type).

h. When the instructor uses special effects in the course and sends points to praise the students, the classroom entity will write an event'rw' in the wb file and the instructor's audiovisual file (if the instructor's audiovisual file exists), representing the current instructor Timely appreciation and bonus points for students (event parameters: appreciation type, student name and number, total number of student points, current accumulated points of the student in the class).

j. When the instructor plays the textbook audio file in the course, the classroom entity will write a line of event'w' every second during the playback in the wb file and the instructor's audiovisual file (if the instructor's audiovisual file exists), representing the current teaching The time and behavior of the teacher playing the audio file in the class (event parameters: the file name including the audio file path, the current playing state, the total length of the audio file (seconds), and the current playing position of the audio file (seconds)).

k. When the instructor switches users (such as students) as the main lecturer in the course, the classroom entity will write a line of event'sw' in the wb file and the instructor's audiovisual file (if the instructor's audiovisual file exists), The representative wants to cut the user into the speaker (switch the video on the user side to the video position on the original teacher side) (event parameters: user name and number, user category).

l. Every second of the classroom entity, the accumulated seconds after the classroom entity is established will be written as a time code to all online users' video and audio files, which are used to synchronize each audio track when the video file is played.

A video replay mechanism of the present invention is as follows:

The player program obtains the course number and verification code from the link parameters, and uses it to call the relevant API of the recording file to obtain the required data of the recording file (such as: the location of the host, the location of the textbook image folder, and the location of the wb file)

The playback terminal reads the wb file of the course, saves the page events and whiteboard events into a relevance hash and array structure, and obtains the teacher's video file name information from the teacher's recording event.

Make sure that the playback program does not have the parameter'playtype=1', and use the time stamp of the student's first recorded event'r' as the starting position for playback (five minutes after the teacher enters the classroom, time code 300 seconds), and wb file calculates the total time of the entire class and cuts out the total time zone that the instructor has logged out and logged in after the first'r' event, and finally uses the calculated result as the total time on the time axis.

Confirm that there is a special event'q' for manual modification in the wb file, completely use the events in the wb file (when playing, all events that are recorded in the teacher's video file and triggered by the existing technology CuePoint are also filtered out), and created in the program Timer to confirm every second and above whether there are events that can be triggered.

From the instructor’s recording event ‘r’, preload the instructor’s video and audio files, and monitor the callback message. If the callback is successful, go to step h.

Create a data structure for user playback from the recorded event ‘r’ of other users.

Obtain the classroom category from the instructor’s first recording event ‘r’ to determine which video file interface framework to use.

Jump the instructor’s video stream to the first login time (5 minutes) of the instructor, then pause, and use this position as the starting position of the timeline to jump out of the inquiry interface, allowing users to choose whether to start playing Video files. Choose ‘Yes’ to start playing from the starting point.

Every fifteen seconds, the latest trigger time code (315 seconds) of the instructor’s video file will be confirmed first, and this value will be used to compare the latest trigger time code (314 seconds) in the student’s video file. Because the gap is 1 second (315-314=1), seek the student's audio and video file to the student's current second position + 1 second (student_stream.seek (14+1)) to complete the synchronization of each audio and video track.

Confirm that the page turning ‘p-1’ event is triggered at the 50th second (time code 350). After clearing the canvas, update the textbook graphic file on the program to the second page textbook.

2 to 12 are schematic diagrams of an embodiment of the method for generating a film based on online education of the present invention, and FIG. 2 is a schematic diagram of dividing a recorded film in an embodiment of the method for generating a film based on online education of the present invention, as shown in FIG. 2, In another preferred embodiment of the present invention, a segment of recorded video is divided into multiple video segments A1, A2, A3, A4, A5, A6, A7 with a duration of 1 minute according to a preset duration (1 minute) , A8, A9...

Among them, FIG. 3 is a frame in the film segment A1 in FIG. 2. As shown in Figure 3, in the video paragraph A1 (teacher 10 mainly introduces the usage of the preposition like), one frame is extracted for graphic recognition to obtain the first text about the content of the blackboard: preposition:

1. like is the same as. Because like can be placed before nouns as verbs and prepositions, pay attention to the distinction:

What is she like? What is she like? (preposition).

2. as as/as...:

He was interested in playing chess as a child. He was interested in playing chess as a child.

3. by used/by/riding/being...:

The bridge was buillt by prisoners. This bridge was built by prisoners of war.

Perform voice detection on the movie paragraph A1 to obtain the second text. In this embodiment, the two words "preposition" and "like" that appear in both the first text and the second text and appear the most frequently are used as the movie of the movie paragraph A1 label.

FIG. 4 is a picture in the film segment A2 in FIG. 2. As shown in Figure 4, in the film paragraph A2 (teacher 10 mainly introduces the usage of the preposition as), one frame is extracted for graphic recognition to obtain the first text about the content of the blackboard (the same as the first text in A1, I will not repeat them here). Perform voice detection on the video paragraph A2 to obtain the second text. In this embodiment, the two words "preposition" and "as" that appear in both the first text and the second text and appear the most frequently "As the movie tag of the movie paragraph A2.

In the film paragraph A3 (teacher 10 is still introducing the usage of the preposition as), one frame is extracted for graphic recognition to obtain the first text about the content of the blackboard (the same as the first text in A1, so I won’t repeat it here) , Perform voice detection on the video paragraph A3 to obtain the second text. In this embodiment, the two words "preposition" and "as" that appear in both the first text and the second text and appear the most frequently are used as the video paragraph A3 Video tags.

FIG. 5 is a frame in the film segment A4 in FIG. 2. As shown in Figure 5, in the film paragraph A4 (teacher 10 mainly introduces the usage of the preposition by), one frame is extracted for graphic recognition to obtain the first text about the content of the blackboard (the same as the first text in A1, I will not repeat them here). Perform voice detection on the video paragraph A4 to obtain the second text. In this embodiment, the two words “preposition” and “by "As the movie tag of the movie paragraph A4.

FIG. 6 is a picture in the film segment A5 in FIG. 2. As shown in Figure 6, in the video paragraph A5 (teacher 10 mainly introduces the usage of the preposition in) one frame is extracted for graphic recognition to obtain the first text about the content of the blackboard: preposition

4. Use in... (language):

What's this in Chinese? How do you say this in Chinese?

5. on riding (car)/walking (step), through (radio/TV):

Do you go there on foot? Do you go there on foot?

6. Over (radio), across:

They keep in touch over the radio while working.

Perform voice detection on the movie paragraph A5 to obtain the second text. In this embodiment, the two words "preposition" and "in" that appear in both the first text and the second text and appear the most frequently are used as the movie of the movie paragraph A5 label.

In the film paragraph A6 (teacher 10 is still introducing the usage of the preposition in) 1 frame is extracted for graphic recognition, and the first text about the content of the blackboard is obtained (the same as the first text in A5, which will not be repeated here) , Perform voice detection on the video paragraph A6 to obtain the second text. In this embodiment, the two words "preposition" and "in" that appear in both the first text and the second text and appear the most frequently are used as the video paragraph A6 Video tags.

Figure 7 is a picture of the film paragraph A7 in Fig. 2. As shown in Fig. 7, in the film paragraph A7 (teacher 10 mainly introduces the usage of the preposition on), one frame is extracted for graphic recognition to obtain information about The first text of the content on the blackboard (same as the first text in A5, so I won’t repeat it here). Perform voice detection on the movie paragraph A7 to obtain the second text. In this embodiment, the two words "preposition" and "on" that appear in both the first text and the second text and appear the most frequently are used as the movie of the movie paragraph A7 label.

In the video paragraph A8 (teacher 10 is still introducing the usage of the preposition on), one frame is extracted for graphic recognition to obtain the first text about the content of the blackboard (the same as the first text in A5, so I won’t repeat it here) . Perform voice detection on the video paragraph A8 to obtain the second text. In this embodiment, the two words "preposition" and "on" that appear in both the first text and the second text are used as the video of the movie paragraph A8. label.

Figure 8 is a frame of the movie paragraph A9 in Figure 2. As shown in Figure 8, in the movie paragraph A9 (teacher 10 mainly introduces the usage of the preposition over), one frame is extracted for graphic recognition to obtain information about The first text of the content on the blackboard (same as the first text in A5, so I won’t repeat it here). Perform voice detection on the video paragraph A9 to obtain the second text. In this embodiment, the two words "preposition" and "over" that appear in both the first text and the second text are used as the video of the video paragraph A9. label.

9 is a schematic diagram of creating a user tag based on a user's personal information to obtain a video course and sending it to the user. FIG. 10 is a schematic diagram of filtering and editing video segments to obtain a video file. FIG. 11 is a schematic diagram of all video segments included in the video file. As shown in Figure 9, the keywords of the wrong questions are extracted from the wrong question set of the student 11’s historical database, and edit tags are generated based on the keywords of the wrong question. In this embodiment, the editor is generated based on the keywords of the wrong question of the student 11 The labels are "preposition", "as", "in", and "on". Filter the movie paragraphs A1, A2, A3, A4, A5, A6, A7, A8, A9... the movie tags that hit the editing tags "preposition", "as", "in", "on" and get three Video files B1, B2, and B3, among which, the video file B1 hits the editing tags "preposition" and "as"; the video file B2 hits the editing tags "preposition" and "in"; the video file B3 hits the editing tags "preposition", "on" ", edit and integrate the movie files B1, B2, and B3 into a movie file C (see FIG. 10), and send the movie file C to the mobile terminal 11A of the student 11. The student 11 can learn the video file C. The student 11 playing the video file C on the mobile terminal 11A is essentially playing the video paragraphs A2, A3, A5, A6, A7, A8 in order, so as to review themselves very specifically. The knowledge points of the most likely to be wrong topics greatly improve learning efficiency and humanized experience.

FIG. 12 is a schematic diagram of creating user tags and obtaining video lessons separately based on the personal information of multiple users and sending them to users. With reference to Figures 9, 10, 11, and 12, the present invention can divide the recorded videos into the recorded teaching videos of all teachers and students stored in the online education server, and divide each teaching video into multiples according to the preset duration. Video paragraphs are formed into different video files (C1, C., C3) according to the different needs of each student (11, 12, 13) (such as wrong question sets, viewing preferences, etc.), and distributed to each student Mobile terminals (11A, 12B, 13C), even the same online education video class, after editing according to the different needs of each student, each student can get customized or selected video files tailored to their individual situation, improving teaching Efficient, and better match different students with different learning progress and knowledge background, maximize the use of existing online education recording video resources, and play a better information matching effect.

FIG. 13 is a schematic diagram of the first embodiment of the online education-based film generation method of the present invention. As shown in FIG. 13, an embodiment of the present invention also provides an online education-based film generation system for implementing the above-mentioned online education-based film generation system. The online education-based film generation system 5 of the educational film generation method includes a recording film segmentation module 51, a film tag adding module 52, a film file editing module 53, and a user film customization module 54.

The recorded video segmentation module 51 divides at least one segment of online education recorded video into multiple video segments according to a preset duration.

The video tag adding module 52 adds at least one video tag to the video segment according to the content information of the video segment.

The video file editing module 53 filters and edits the video segments according to the video tags, and obtains at least one video file containing multiple video segments.

The user video customization module 54 creates at least one user tag according to the user's personal information, filters video files with requirements for editing, and obtains at least one video course and sends it to the user.

In a preferred embodiment, the video tag adding module performs graphic recognition on at least one frame of the video paragraph to obtain the first text of the video paragraph, and performs voice recognition on the video paragraph to obtain the second Text, and obtain at least one word with the highest number of occurrences as the movie tag of the movie paragraph according to the first text and the second text corresponding to the movie paragraph.

In a preferred embodiment, the recorded video is a recorded instructional video of all teachers and students stored in the online education server, and each instructional video is divided into multiple video segments according to a preset duration.

Or the recorded movie can also be a real-time recorded movie during one-to-one online education between the instructor and the student, and the recorded movie within the preset time period is generated into a movie segment every time the preset time period passes.

In a preferred embodiment, the video tag adding module adds at least one video tag to the video segment according to a trigger event in the content information of the video segment, and the trigger event includes at least one of the following events:

The teacher or student connects to the video classroom of online education, the teacher or student opens the dialog box in the video classroom to enter text, the teacher or student turns the page of the textbook in the video classroom, the teacher or student uses the whiteboard in the video classroom , Instructors or students play video files in the video classroom, teachers or students use animation special effects in the video classroom, teachers or students send points in the video classroom, and the teacher or students leave the video classroom.

The online education-based video generation system of the present invention divides the entire video into video segments and adds tags, which facilitates selection and optimization of the entire video, increases the viewing value of the video replay, and improves the humanized experience.

An embodiment of the present invention also provides a video generation device based on online education, which includes a processor and a memory storing executable instructions of the processor. Wherein, the processor is configured to execute the steps of the online education-based film generation method by executing executable instructions.

As described above, in this embodiment, by dividing the entire video into video segments and adding tags, it is convenient to select and optimize the entire video, increase the viewing value of video replay, and improve the user-friendly experience.

Those skilled in the art can understand that various aspects of the present invention can be implemented as systems, methods or program products. Therefore, various aspects of the present invention can be implemented in the following forms, namely: complete hardware implementation, complete software implementation (including hardware, microcode, etc.), or a combination of hardware and software implementations Way, here can be collectively referred to as "circuit", "module", or "platform".

14 is a schematic diagram of the structure of the online education-based film generation device of the present invention. The electronic device 600 according to this embodiment of the present invention is described with reference to FIG. 14. The electronic device 600 shown in FIG. 14 is only an example and should not be used. The function and scope of use of the embodiments of the present invention bring any restrictions.

As shown in FIG. 14, the electronic device 600 is represented in the form of a computing device. The components of the electronic device 600 may include but are not limited to: at least one processing unit 610, at least one storage unit 620, a bus bar 630 connecting different platform components (including the storage unit 620 and the processing unit 610), a display unit 640, and the like.

Wherein, the storage unit 620 stores a program code, which can be executed by the processing unit 610, so that the processing unit 610 executes the steps according to various exemplary embodiments of the present invention described in the above electronic prescription circulation processing method section of this specification, for example , The processing unit 610 can perform the steps shown in FIG. 1.

The storage unit 620 may include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 6201 and/or a cache storage unit 6202, and may further include a read-only storage unit (ROM) 6203.

The storage unit 620 may also include a program/utility tool 6204 having a set (at least one) program module 6205. The program module 6205 includes but is not limited to: an operating system, one or more application programs, other program modules, and programs Data, each of these examples or some combination may include the implementation of a network environment.

The bus 630 may represent one or more of several types of bus structures, including a storage unit bus or a storage unit controller, a peripheral bus, a graphics acceleration port, a processing unit, or any bus using a variety of bus structures Structure of the local bus.

The electronic device 600 can also communicate with one or more external devices 700 (such as keyboards, pointing devices, Bluetooth devices, etc.), and can also communicate with one or more devices that enable a user to interact with the electronic device 600, and/ Or communicate with any device (such as a router, a modem, etc.) that enables the electronic device 600 to communicate with one or more other computing devices. This communication can be performed via an input/output (I/O) interface 650. In addition, the electronic device 600 can also communicate with one or more networks (such as a local area network (LAN), a wide area network (WAN), and/or a public network, such as the Internet) through the network interface card 660. The network interface card 660 can communicate with other modules of the electronic device 600 through the bus 630. It should be understood that although not shown in the figure, other hardware and/or software modules can be used in conjunction with the electronic device 600, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID System, tape drive and data backup storage platform, etc.

The embodiment of the present invention also provides a computer-readable storage medium for storing a program. The steps of the online education-based video generation method implemented when the program is executed. In some possible implementations, various aspects of the present invention can also be implemented It is a form of a program product, which includes program code. When the program product runs on a terminal device, the program code is used to make the terminal device execute the various exemplary embodiments of the present invention described in the above electronic prescription circulation processing method section of this manual A step of.

As shown above, in this embodiment, by dividing the entire video into video segments and adding tags, it is convenient to select and optimize the editing of the entire video, increase the viewing value of the video replay, and improve the humanized experience.

15 is a schematic diagram of the structure of the computer-readable storage medium of the present invention. Referring to FIG. 15, a program product 800 for implementing the above method according to an embodiment of the present invention is described, which can be a portable compact disk read-only The memory (CD-ROM) does not include program codes and can be run on terminal devices, such as personal computers. However, the program product of the present invention is not limited to this. The readable storage medium can be any tangible medium that contains or stores the program. The program can be used or combined with the instruction execution system, device or device.

The program product can use any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but not limited to, electrical, magnetic, optical, electromagnetic, infrared, Or semiconductor systems, devices or devices, or any combination of the above, more specific examples (non-exhaustive list) of readable storage media include: electrical connections with one or more wires, portable optical discs, hard drives , Random access memory (RAM), read-only memory (ROM), removable programmable read-only memory (EPROM or flash memory), optical fiber, portable optical disc read-only memory (CD -ROM), optical signal memory, magnetic memory, or any suitable combination of the above.

The computer-readable storage medium may include a data signal propagated in the fundamental frequency or as part of a carrier wave, which carries readable program codes. This propagated data signal may take many forms, including but not limited to electromagnetic signals, optical signals, or With any suitable combination of the above, the readable storage medium can also be any readable medium other than the readable storage medium, and the readable medium can be sent, propagated or transmitted for use by or in combination with the instruction execution system, apparatus, or device The program code contained on the readable storage medium can be transmitted by any suitable medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the above.

The programming code used to perform the operations of the present invention can be written in any combination of one or more programming languages. Programming languages include object-oriented programming languages, such as Java, C++, etc., as well as regular programming languages—such as "C" language or a similar programming language, the code can be executed completely on the user's computing device, partly on the user's device, executed as an independent software package, partly on the user's computing device and partly on the user's computing device. Executed on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device can use any type of network, including a local area network (LAN). ) Or wide area network (WAN), connected to user computing equipment, or, can be connected to external computing equipment (for example, using an Internet service provider to connect via the Internet).

In summary, the purpose of this embodiment is to provide a method, system, equipment, and storage medium for generating a movie based on online education. By dividing the entire movie into movie paragraphs and adding tags, it is convenient to select and optimize the entire movie. Editing, increasing the viewing value of film replays and improving the humanized experience can indeed achieve the purpose of the invention.

However, the above are only examples of the present invention. When the scope of implementation of the present invention cannot be limited by this, all simple equivalent changes and modifications made in accordance with the scope of the patent application of the present invention and the content of the patent specification still belong to Within the scope of the patent for the present invention.

S110~S140: steps A1~A9: Video paragraph B1~B3: Video file C: Learning video file C1~C3: Video file 11~13: Trainees 11A~13A: mobile terminal 1: Picture 5: Film generation system based on online education 51: Recording video segmentation module 52: video tag adding module 53: Video file editing module 54: User video customization module 600: electronic equipment 610: Processing Unit 620: storage unit 6201: RAM 6202: Cache storage unit 6203: ROM 6204: Programs/Utilities 6205: program module 630: Bus 640: display unit 650: I/O interface 660: network interface card 700: External device 800: program products

Other features and effects of the present invention will be clearly presented in the embodiments with reference to the drawings, in which: FIG. 1 is a flowchart illustrating an embodiment of the method for generating a movie based on online education of the present invention; Figure 2 is a schematic diagram illustrating the segmented recorded movie in this embodiment; FIG. 3 is a schematic diagram illustrating a frame in a video segment A1 of the embodiment; FIG. 4 is a schematic diagram illustrating a frame in a video segment A2 of the embodiment; FIG. 5 is a schematic diagram illustrating a frame in a video segment A4 of the embodiment; FIG. 6 is a schematic diagram illustrating a frame in a video segment A5 of the embodiment; FIG. 7 is a schematic diagram illustrating a frame in a video segment A7 of the embodiment; FIG. 8 is a schematic diagram illustrating a frame in a video segment A9 of the embodiment; FIG. 9 is a schematic diagram illustrating that in this embodiment, a user tag is created based on a user's personal information to obtain a video course and sent to the user; FIG. 10 is a schematic diagram illustrating that a video file is obtained by screening and editing video paragraphs in this embodiment; FIG. 11 is a schematic diagram illustrating all video segments included in the video file of this embodiment; FIG. 12 is a schematic diagram illustrating that this embodiment separately creates user tags based on the personal information of multiple users, respectively obtains video courses, and sends them to users respectively; FIG. 13 is a block diagram illustrating an online education-based film generation system related to this embodiment; FIG. 14 is a schematic diagram illustrating an online education-based film generation device related to this embodiment; and FIG. 15 is a schematic diagram illustrating a computer-readable storage medium based on online education related to this embodiment.

S110~S140: steps

Claims (20)

A video generation method based on online education, including the following steps: S110. Divide at least one segment of online education recording video into multiple video segments according to a preset duration; S120: Add at least one video tag to each video segment according to the content information of the video segments; and S130. Filter and edit each video segment separately according to each video tag to obtain at least one video file containing multiple video segments. The method for generating a movie based on online education according to claim 1, wherein the step S120 includes: S121. Perform graphic recognition on at least one frame of the video paragraphs to obtain a first text corresponding to the video paragraph, and perform voice recognition on the video paragraph to obtain a second text corresponding to the video paragraph ,and S122: Obtain at least one word with the highest number of occurrences as a movie tag of the movie paragraph according to the first text and the second text corresponding to the movie paragraph. The method for generating a movie based on online education according to claim 2, wherein in step S122, at least one word with the highest total number of occurrences in the first text and the second text is used as the movie tag of the movie paragraph. The method for generating a movie based on online education according to claim 2, wherein, in step S122, both the first text and the second text appear, and at least one word with the highest number of occurrences is used as the movie of the movie paragraph label. The method for generating a movie based on online education according to claim 1, wherein, in the step S130, the movie section with the movie tag with the most played times and/or the movie with the most watched time by a user is searched for Tag video paragraphs, and get the video file after editing. The method for generating a movie based on online education according to claim 1, wherein, in the step S130, the movie segment with the movie tag whose number of times of being played is lower than the preset threshold is deleted and/or the movie segment that has been viewed by a user terminal is deleted. A video segment with a video tag whose length is less than a preset threshold, and the video file is obtained after editing. The method for generating movies based on online education as described in claim 1, further includes: S140. Create at least one user tag based on one person's information on a user terminal, filter the video files with requirements for editing, and obtain at least one video course and send it to the user terminal. The method for generating a video based on online education according to claim 7, wherein the video tag of the video segment most played by the user is obtained from a historical database on the user as the user tag, and the search has The video section of the user tag is merged and edited to obtain the video course, and the video course is sent to the mobile terminal of the user terminal. The method for generating a movie based on online education according to claim 7, wherein the step S140 includes: S141. Extract the keywords of the wrong question from the wrong question set in the historical database on the user side. S142: Generate an edit label according to the keywords of the wrong question, S143. Edit the video segment of the video tag hitting the edit tag to obtain the video file of the wrong title set on the user side, and S144. Send the video file to the user terminal. The method for generating videos based on online education according to claim 1, wherein the recorded videos are all recorded teaching videos on the teacher’s end and the student’s end stored in the online education server. Set the duration to be divided into multiple video segments. As described in claim 1, the method for generating a movie based on online education, wherein the recorded movie is a real-time recorded movie during one-to-one online education between the teacher and the student, and the movie is recorded every time a preset time period has elapsed. It is assumed that the recorded movie within the duration is generated as a movie segment. According to the method for generating a movie based on online education according to any one of claim 10 and 11, wherein the preset duration is selected from 10 seconds to 10 minutes. The method for generating a movie based on online education according to claim 1, wherein in step S120, at least one movie tag is added to the movie section according to a trigger event in the content information of the movie section, and the trigger event includes the following events At least one of A teacher terminal or a student terminal connects to the video classroom system terminal of the online education via a network, The instructor or the student sends an instruction to make the video classroom system execute a dialog box input interface, The instructor or the student sends an instruction to make the video classroom system execute a textbook page turning step, The teacher or the student sends an instruction to make the video classroom system execute a whiteboard interface, The teacher or the student sends an instruction to make the video classroom system play an audiovisual file, The teacher or the student sends an instruction to make the video classroom system execute an animation special effect, The teacher or the student sends an instruction to the video classroom system to send a point information, and The teacher terminal or the student terminal disconnects the connection to the video classroom system terminal. A film generation system based on online education, which is used to implement the method for film generation based on online education described in claim 1. The film generation system based on online education includes: A recording video segmentation module, which divides at least one segment of online education recording video into multiple video segments according to a preset duration; A video tag adding module that adds at least one video tag to the video segment according to the content information of the video segment; and A video file editing module filters and edits the video segments according to the video tags to obtain at least one video file containing multiple video segments. The online education-based film generation system according to claim 14, wherein: The movie tag adding module performs graphic recognition on at least one frame in the movie paragraph to obtain a first text corresponding to the movie paragraph, Perform voice recognition on the video segment to obtain a second text corresponding to the video segment, and According to the first text and the second text corresponding to the movie paragraph, at least one word with the highest occurrence frequency is obtained as the movie tag of the movie paragraph. The online education-based video generation system according to claim 14, further comprising a user video customization module, which creates at least one user tag based on the personal information of a client, and filters the video files with requirements for editing, Obtain at least one video course and give it to the user. The online education-based film generation system according to claim 14, wherein: The recorded video is a plurality of recorded instructional videos of all teachers and students stored in the online education server. Each instructional video is divided into multiple video segments according to the preset duration, and The recorded video is a real-time recording video during one-to-one online education between a teacher and a student. Each time a preset duration has passed, the recorded video within the preset duration is generated into a video segment. one. The online education-based video generation system according to claim 14, wherein the video tag adding module adds at least one video tag to the video segment according to a trigger event in the content information of the video segment, and the trigger event includes the following events At least one of A teacher or a student is connected to the online education video classroom system via a network, The instructor or the student sends an instruction to make the video classroom system execute a dialog box input interface, The instructor or the student sends an instruction to make the video classroom system execute a textbook page turning step, The teacher or the student sends an instruction to make the video classroom system execute a whiteboard interface, The teacher or the student sends an instruction to make the video classroom system play an audiovisual file, The teacher or the student sends an instruction to make the video classroom system execute an animation special effect, The teacher or the student sends an instruction to the video classroom system to send a point information, and The teacher terminal or the student terminal disconnects the connection to the video classroom system terminal. A video generation device based on online education, including: A processor; and A memory in which the executable instructions of the processor are stored; The processor is configured to execute the steps of the online education-based film generation method of any one of claims 1 to 13 by executing the executable instructions. A computer-readable storage medium based on online education for storing programs, including: When the program is executed, the steps of any one of claims 1 to 13 of the online education-based video generation method are realized.

Images