JP5080368B2 - Video content search apparatus and computer program - Google Patents

Description

  The present invention relates to a video content search apparatus and a computer program for supporting a user to view desired video content at a desired time in a system for accumulating and viewing a large number of video content such as broadcast programs. In particular, the present invention uses an arbitrary video content, for example, a video content currently being viewed by a user as a search key, without specifying a search keyword, and other video content that is highly related to the video content or its video content. The present invention relates to a video content search apparatus and a computer program that realize a function of associatively searching a part of scenes.

2. Description of the Related Art Conventionally, a search function provided in a search service for web content or the like is to find a desired content by a user specifying a search keyword.
In Patent Document 1, when a request to receive / reproduce content data of a TV broadcast program is recognized, a related keyword related to the keyword of the search request is recognized, and program information is searched using the keyword and the related keyword. The technology to do is described. Patent Document 2 describes a technique for reducing the inconvenience of character input operations, particularly when naming or changing the name of a folder or recording medium in which content is stored.
JP 2005-348071 A JP 2006-31205 A

When searching for video content such as broadcast programs, entering characters is a cumbersome operation, and you may have to keep an eye on the video content you are watching while entering characters. It is desirable to enable search operations that are not performed. In addition, hard disk recorders that record video provide a function to search video content by following a simple classification list such as chronological list or genre classification by operating the remote controller. Advanced search functions that enable access to specific video parts based on video content have not been realized.
When the technique of Patent Document 2 is applied to the input of a search request keyword in Patent Document 1 described above, the number of inputs can be reduced, but the keyword input operation itself is still necessary.

  The present invention has been made in consideration of such circumstances, and its purpose is to specify any video content such as what is being viewed without specifying a search keyword as a search key and to provide a detailed relation to the video content. An object of the present invention is to provide a video content search apparatus and a computer program that can associatively search high-quality video content and a part of the scene.

[1] According to one aspect of the present invention, metadata indicating a relationship between a segment obtained by time-dividing video content and a theme of the segment, and associative index data indicating a relationship between the theme and a segment corresponding to the subject A search key acquisition unit that receives a designation of an arbitrary segment, reads the subject of the designated segment from the metadata stored in the storage unit, and uses it as a search key; A search execution unit for searching the associative index data stored in the storage unit based on a search key and specifying a segment corresponding to a subject indicated by the search key; and the segment specified by the search execution unit A search result output unit for outputting video content as a search result , wherein the metadata includes the subject of the segment and the main content. A related subject representing a relationship with another subject related to the subject, and the association index data further represents a relationship between the related subject and a segment corresponding to the relevant subject. The search key acquisition unit reads out the subject of the specified segment and the related subject from the metadata stored in the storage unit, and uses it as a search key. A video characterized by searching for the associative index data by using the subject indicated by the search key, and the subject represented by the related subject indicated by the search key and other subjects, and identifying the segment. It is a content search device .

According to the present invention, when a search request related to a segment of an arbitrary video content is received, a subject and a related subject are acquired as search keys from the metadata of the video content, and an associative index is based on the acquired search key. Search for data. Then, the video content including the segment specified as a result of the search is output as the search result. Thus, without specifying a search keyword, for example, video content that is being viewed by the user is used as a search key, and video content with high content relevance or video content with similar content is retrieved associatively. It becomes possible.

[ 2 ] Further, one aspect of the present invention is the video content search apparatus described above, wherein the related subject is a source subject corresponding to the video content and another subject related to the source subject. The search execution unit searches the associative index data by using the subject indicated by the search key as a subject key, or a relationship between the target subject and the source subject and the target subject. The associative index data is searched by the related theme key with the theme indicated by the search key as the source theme, and the segment is specified, and the search result output unit includes the segment specified by the search execution unit The content is output as a group of similar video contents.

[ 3 ] Also, one aspect of the present invention is the video content search apparatus described above, wherein the search execution unit searches the associative index data using the related subject indicated by the search key as the related subject key, The associative index data is searched using the source theme of the related subject indicated by the search key and the relation as the related subject key, and the associative index data is used as the related subject key of the related subject indicated by the search key. Search or specify the segment by searching the associative index data using the source subject of the related subject indicated by the search key as the subject key, and the search result output unit is specified by the search execution unit Output video content that contains segments as similar video content groups. The features.

[ 4 ] Further, one aspect of the present invention is the video content search apparatus described above, wherein the search execution unit searches the associative index data using a target subject of a related subject indicated by the search key as a subject key. And the search result output unit outputs the video content including the segment specified by the search execution unit using the target subject of the related subject indicated by the search key as the subject key. It is what is output as.

[ 5 ] Further, one aspect of the present invention is the video content search apparatus described above, wherein the metadata further includes information on the video content including the segment and a time range of the segment in the video content. The search result output unit includes the video content including the segment specified by the search execution unit and the time range of the segment in the video content from the metadata stored in the storage unit. It is obtained and output.

[ 6 ] Further, according to one aspect of the present invention, there is provided the video content search apparatus described above, wherein the video content search apparatus receives the input of the information specifying the video content and the time range information and stores the content data of the video content It further comprises a display unit that acquires content data of the video content from the content storage unit and displays a video corresponding to the time range.

[ 7 ] Further, according to one aspect of the present invention, there is provided a computer used as a video content search device for searching for video content. A storage unit for storing associative index data representing a relationship between the subject and a segment corresponding to the subject, a segment that receives designation of an arbitrary segment, and that receives the designation from the metadata stored in the storage unit A search key acquisition unit that reads the subject of the search key as a search key, searches the associative index data stored in the storage unit based on the search key, and performs a search execution that identifies a segment corresponding to the subject indicated by the search key Video content including the segment specified by the search execution unit as a search result Search result output unit to force, to function as, the metadata is for further comprising a relationship with the subject matter representing the relationship between the other subject matter related to the subject matter and the subject matter of the segments, the associative index data, It further represents a relationship between the related theme and a segment corresponding to the related theme, and the search key acquisition unit is a subject of the specified segment from the metadata stored in the storage unit And the search subject is read out as a search key, and the search execution unit uses the subject indicated by the search key, and the subject represented by the related subject indicated by the search key and other subjects. A computer program for searching the associative index data and specifying a segment .

  According to the present invention, an arbitrary video content, for example, a video content being viewed is used as a search key without specifying a search keyword, and video content or a part of the scene is highly associated with the search key. Search is possible.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
[1. Overview of video content search device]
A video content search apparatus according to an embodiment of the present invention uses an arbitrary video content, for example, a subject key associated with a currently viewed video content and a related subject key as a search key. Retrieving video content with high content relevance and some scenes associatively. The theme key and the related theme key are assigned manually to the video content or automatically by analyzing the video content. Thematic key indicates the main theme that constitutes the content of the video content, what the main subject is, etc. The related theme key means the causal relationship between the theme and other themes Thematic key is the specified theme key. The video content group searched by the search key includes a similar video content group consisting of video content having a theme key and a related theme key, and a target indicated by the related theme key, that is, a partner having a causal relationship. Two types of related video content groups including video content having a theme key are included. That is, the similar video content group is a video content group that is designated as a search key, for example, and includes the same subject as the subject of the video content that is being viewed, and the related video content group is caused by the subject of the search key, for example. It is a video content group including the resulting theme.

[2. Configuration of video content search device]
FIG. 1 is a block diagram showing a functional configuration of a video content search apparatus 1 according to an embodiment of the present invention, in which only functional blocks related to the present invention are extracted and shown.
In the figure, the video content search device 1 can be composed of one or a plurality of computer devices, and includes a video content acquisition unit 2, a video content storage unit 3, a video content registration unit 4, a metadata storage unit 5, and video content. A display unit 6 and a video content search unit 7 are included.

  The video content acquisition unit 2 receives video content moving image data, audio data, closed captions from an external device connected via a network, a digital broadcast tuner, a video server connected to the video content search device 1, and the like. Data, data broadcast data (data used for data broadcast accompanying video content broadcast as a program), EPG (Electronic Program Guide) data, and a video content ID for uniquely identifying the video content Correspondingly, it is written in the video content storage unit 3 in a file format.

  The video content storage unit 3 includes a video content storage unit 31, a reading unit 32, and a writing unit 33. The video content storage unit 31 stores moving image data, audio data, closed caption data, data broadcast data, EPG data, and the like constituting the video content in a file format in association with the video content ID. Furthermore, the video content storage unit 31 stores a metadata index that is data indicating association between a video content ID and a metadata ID that uniquely identifies the metadata of the video content. The reading unit 32 reads data stored in the video content storage unit 31. The writing unit 33 writes data into the video content storage unit 31.

The metadata accumulation unit 5 includes a storage unit 51, a registration execution unit 52, a metadata reading unit 53, and a search execution unit 54. The storage unit 51 stores a metadata ID and metadata composed of a plurality of segment data in association with each other. A segment is a unit obtained by time-dividing video content for each content group, and metadata is a collection of segment data for each segment included in the same video content as one file. Each segment data constituting the metadata includes a segment ID for uniquely identifying the segment data, a video content ID indicating the original video content to which the segment belongs, a segment time range in the video content, a segment theme key, and a related theme key As a descriptor, and a plurality of theme keys and related theme keys can be set. The theme key is a symbol representing the main topic, event, or subject that is the subject in the segment. The related theme key indicates that there is a relationship from one theme to another theme in the segment, and consists of a triple of a source theme key, a relationship key, and a target theme key. That is, the source subject key indicates the subject in the segment, the other subject to which the target subject key goes, and the relationship key relates to the other subject to which the subject in the segment goes Indicates. Further, the storage unit 51 is index data used to obtain a segment ID of segment data including the theme key or the related theme key as a descriptor from the given theme key or the related theme key. Store the association index. The video content storage unit 31 and the storage unit 51 are realized using a hard disk device, an optical disk device, or the like.
The registration execution unit 52 writes metadata to the storage unit 51 and updates an associative index stored in the storage unit 51. The metadata reading unit 53 reads the metadata stored in the storage unit 51. The search execution unit 54 searches for the associative index stored in the storage unit 51.

  The video content registration unit 4 includes a video content file acquisition unit 41 and a registration request unit 42. The video content file acquisition unit 41 reads out moving image data, audio data, closed caption data, data broadcast data, and EPG data constituting the video content instructed by the administrator from the video content storage unit 3. The registration request unit 42 analyzes the video content read from the video content storage unit 3 by the video content file acquisition unit 41 by the administrator, extracts the subject key and the related subject key, and extracts the segment of the video content. Then, registration metadata created by collecting the segment data of the extracted segments for each identical video content is output to the metadata storage unit 5.

  The video content display unit 6 includes a display unit 61, a search key acquisition unit 62, and a search result output unit 63. The display unit 61 reads out a video content file from the video content storage unit 3, and acquires a video portion in a time range designated by the user, that is, moving image data, audio data, etc., from the read video content file. For example, it is displayed on a video display device such as a television receiver or a computer provided in the user's home. Further, closed caption data, data broadcast data, EPG data, etc. in the read video content file are also displayed in response to a request from the user. When the search key acquisition unit 62 detects the time point when the user makes a search request and acquires the elapsed time from the beginning of the video content being displayed at that time, the search key acquisition unit 62 includes the subject key of the segment including the elapsed time in the time range, and The related theme key is acquired from the metadata corresponding to the video content being displayed, and the search is started using these as the search key. The search result output unit 63 outputs the search result activated by the search key acquisition unit 62. The video content display unit 6 may be a video display device such as a television receiver or a computer.

  The video content search unit 7 includes a search instruction unit 71. When the search is started by the video content display unit 6, the search instruction unit 71 requests the search of the associative index stored in the metadata storage unit 5 based on the subject key specified as the search key and the related subject key. Then, a similar video content group having a subject common to the search key and a related video content group having a subject having some relationship (for example, a causal relationship) with the subject possessed by the search key are acquired, and these are acquired as a video content ID. And a list of segment time range pairs.

[3. Operation of video content search device]
Next, the operation of the video content search apparatus 1 will be described.

[3.1 Metadata registration procedure]
FIG. 2 is a diagram showing a metadata registration procedure. The video content registration unit 4 registers the metadata created by the administrator in the metadata storage unit 5. Here, it is assumed that the video content acquisition unit 2 of the video content search device 1 has already registered the acquired video content file in the video content storage unit 31 of the video content storage unit 3.

  The video content file acquisition unit 41 of the video content registration unit 4 outputs, to the video content storage unit 3, a video content ID that specifies the video content to be registered as metadata, instructed by the administrator. The reading unit 32 of the video content storage unit 3 reads the moving image data, audio data, closed caption data, data broadcast data, and EPG data of the video content specified by the video content ID from the video content storage unit 31, and the file format Is output to the video content registration unit 4 (step S11).

The administrator analyzes the moving image data, audio data, closed caption data, data broadcast data, and EPG data in the file read by the video content file acquisition unit 41 of the video content registration unit 4, and analyzes the subject key and the related data. A theme key is extracted and a segment is extracted. The administrator uses a video content ID for specifying the original video content to which the segment belongs, a time range of the segment, a subject key acquired from the segment, and data indicating a related subject key for each video content. Metadata is generated and input to the video content registration unit 4 (step S12).
For the automatic extraction of the theme key and the related theme key, for example, it is possible to use a technique described in Japanese Patent Application Laid-Open No. 2007-219947. This is a technique for extracting a noun pair having a causal relationship from text data even if there is no word as a clue. According to this technique, for example, a subject key and a relationship between text data included in closed caption data are included. The subject key can be extracted.

  The registration request unit 42 of the video content registration unit 4 receives an instruction from the administrator and outputs the generated registration metadata to the metadata storage unit 5. When the registration execution unit 52 of the metadata storage unit 5 assigns a segment ID to each segment indicated by the received registration metadata, the segment ID, the segment ID, and the like are set based on the information set in the registration metadata. Segment data of each segment including a video content ID that specifies the original video content, a time range, a subject key, and a related subject key are generated, and metadata is generated for each of the same video content. When the registration execution unit 52 of the metadata storage unit 5 assigns a new metadata ID, the registration execution unit 52 writes it in the storage unit 51 in association with the generated metadata (step S13).

  The registration execution unit 52 of the metadata storage unit 5 outputs the metadata ID of the newly registered metadata and the video content ID set in the metadata to the video content storage unit 3. The writing unit 33 of the video content storage unit 3 searches the metadata index stored in the video content storage unit 31 based on the received video content ID, and enters the received metadata ID in the entry of the corresponding video content ID. Is registered (step S14). Further, the registration execution unit 52 of the metadata accumulating unit 5 adds the subject data of the segment data to the entry of the subject key set in each segment data in the newly registered metadata and the associative index corresponding to the related subject key. A segment ID is registered (step S15).

  In step S11 of FIG. 2, the video content acquisition unit 2 reads the video content file specified by the video content ID “# C1”. In step S13, the writing unit 33 of the video content storage unit 3 A metadata ID “# M1” is assigned, and the metadata is stored in the video content storage unit 31. This metadata is specified by the segment ID “# (M1-S1)”, the video content ID “# C1”, the time range “1-450”, the subject key indicating the subject “N1”, and the related subject “N3 ( It includes segment data in which a related theme key indicating "source theme) -R2 (relation) -N4 (target theme)" is set. In step S14, the writing unit 33 of the video content storage unit 3 sets the metadata ID “# M1” and the video content ID “# C1” to the metadata index stored in the video content storage unit 31. Register in association. Hereinafter, the symbol indicating the theme “X” set to the theme key, the source theme key, and the target theme key will be described as “#X”, and the symbol indicating the relationship “Y” set to the relationship key will be described. It is described as “#Y”.

FIG. 3 is a schematic diagram illustrating a configuration example of the associative index.
The theme table T shows correspondence between the theme key, the pointer P1 of the segment list L1, and the pointer P2 of the relation list L2. The pointer P1 registered corresponding to the theme key in the theme table T specifies the segment list L1, and the segment list L1 includes the segment ID of the segment including the theme indicated by the subject key in the list format. It is registered with. Therefore, each entry in the segment list L1 includes a segment ID and a pointer P11 to an entry in which the next segment ID is registered. Note that data indicating the end of the list is set in the pointer of the last entry of the data in the list format.

  The pointer P2 registered corresponding to the theme key in the theme table T specifies the relationship list L2, and the relationship list L2 includes a relationship between related themes using the subject key as a source theme key. A key and a target theme key and a segment list pointer in which a segment including the related theme key is registered are set in a list format. Therefore, each entry of the segment list L2 includes a relation key and a target theme key of the related theme key, and a pointer of the segment list L3 in which a segment including the related theme indicated by the related theme key is registered. It consists of P3 and a pointer P4 to the next entry. The segment list L3 has the same configuration as the segment list L1, and each entry includes a segment ID and a pointer P31 to an entry in which the next segment ID is registered.

  In step S15 in FIG. 2, the registration execution unit 52 of the metadata storage unit 5 performs the following for each theme key to be registered that is set in the segment data.

  The registration execution unit 52 searches the subject table T and determines whether or not a subject key to be registered has already been registered. When the registration execution unit 52 determines that the subject key to be registered is already registered in the subject table T, the registration executing unit 52 additionally registers the segment ID in the list of segments including the subject key. Specifically, when a subject key (for example, “# N1”) to be registered is already registered in the subject table T and a pointer P1 to the segment list corresponding to the subject key is set, An entry in which a segment ID (for example, “# (M1-S1)”) is set is additionally registered in the segment list L1 specified by the pointer P1. When the subject key (for example, “# N1”) to be registered is already registered in the subject table T, but the pointer P1 to the segment list corresponding to the subject key is not set, the registration executing unit 52 A new segment list L1 is generated. Then, the pointer P1 of the generated segment list L1 is set in the theme table T so as to correspond to the subject key, and the segment ID (for example, “# (M1-S1)” is set in the first entry of the generated segment list L1. ) Is set.

  On the other hand, if it is determined that the subject key to be registered is not registered in the subject table T, the registration execution unit 52 creates a new segment list L1 in the associative index, and stores the subject key and the segment ID in the subject table T. sign up. Specifically, when the subject key to be registered (for example, “# N1”) is not registered in the subject table T, the subject key is registered in a new entry in the subject table T. When the registration execution unit 52 generates a new segment list L1, the pointer P1 of the generated segment list L1 is set in the new entry added to the subject table T, and the segment ID (for example, the first entry in the segment list L1) , “# (M1-S1)”).

Next, the registration execution unit 52 registers each related theme key as follows.
In the registration execution unit 52, a triple of a source theme key, a relation key, and a target theme key constituting a related theme key to be registered, which is set in the segment data, is attached to the theme table T and the theme. It is determined whether it is registered in the relationship list L2.

  When the registration execution unit 52 determines that the above triplet is registered in the subject table T and the relationship list L2 associated with the subject, the segment ID is added to the segment list L3 including the related subject key. Add Specifically, in the theme table T, the source theme key (for example, “# N1”) of the subject key with relation to be registered is registered, and the relationship specified by the pointer P2 corresponding to the subject key. When a combination of a relationship key and a target theme key (for example, a relationship key “# R1” and a target theme key “# N2”) of a related subject key to be registered is registered in the entry of the list L2, the related key And an entry of a segment ID (for example, “# (M1-S4)”) is additionally registered in the segment list L3 specified by the pointer P3 corresponding to the set of the target subject key.

  On the other hand, if it is determined that the above triplet is not registered in the subject table T and the relationship list L2 associated with the subject, the registration execution unit 52 selects a new entry if there is no source subject key entry in the subject table T. Next, an associated relation list L2 is created to register a set of relation keys and target subject keys, and a new segment list L3 is created to register a segment ID. When the target theme key is not registered in the theme table T, a new entry is added.

Specifically, when the source theme key (for example, “# N1”) of the related subject key to be registered is not registered in the theme table T, the source theme key is registered in a new entry of the theme table T. . When the registration execution unit 52 generates the new relationship list L2, the registration execution unit 52 sets the pointer P2 of the relationship list L2 to the new entry added to the subject table T, and further, the registration target is registered in the first entry of the generated relationship list L2. The combination of the relationship key of the related theme key and the target theme key (for example, “# R1” and “# N2”) is set. When the registration execution unit 52 generates a new segment list L3, the registration execution unit 52 sets the pointer P3 of the segment list L3 in the first entry of the relationship list L2 in which the relationship key and the target subject key are set, and the first of the segment list L3. A segment ID (for example, “# (M1-S4)”) is registered in the entry.
Furthermore, when the target theme key (for example, “# N2”) is not registered in the theme table T, the registration execution unit 52 adds a new entry and registers the target theme key. The pointer P1 is not set in the new entry added to the theme table T, and when another segment having the added target theme key as the theme key is newly registered, a segment for registering the segment is registered. The list L1 is generated and the pointer P1 is set.

[3.2 Search procedure]
[3.2.1 Obtaining Search Key]
The video content display unit 6 of the video content search apparatus 1 acquires a subject key and a related subject key as search keys according to the procedure shown in FIG. 4 and transmits a search request to the video content search unit 7.

  The display unit 61 of the video content display unit 6 outputs necessary video content, for example, the video content ID of the video content to be displayed on the device owned by the user, to the video content storage unit 3. The reading unit 32 of the video content storage unit 3 reads data constituting the video content specified by the received video content ID from the video content storage unit 31 and outputs the data to the video content display unit 6 in a file format (step S21). . Further, the display unit 61 of the video content display unit 6 outputs the video content ID to the video content storage unit 3, and the reading unit 32 of the video content storage unit 3 stores the metadata index stored in the video content storage unit 31. The metadata ID registered corresponding to the video content ID is acquired from the video content ID and returned to the video content display unit 6 (step S22). The display unit 61 of the video content display unit 6 outputs the metadata ID acquired in step S22 to the metadata storage unit 5, and the metadata reading unit 53 of the metadata storage unit 5 is specified by the metadata ID. The metadata is read from the storage unit 51 and output to the video content display unit 6 in a file format (step S23).

  The display unit 61 of the video content display unit 6 acquires the data of the video part in the range specified by the user from the video content file and displays it as a moving image. When the search key acquisition unit 62 of the video content display unit 6 detects that the user has performed an operation for instructing a search request during display as a moving image, the search key acquisition unit 62 detects the time when the search request was made. The elapsed time from the beginning of the video content being displayed at that time is acquired. The search key acquisition unit 62 of the video content display unit 6 acquires the segment ID, the subject key, and the related subject key of the segment whose elapsed time is included in the time range with reference to the metadata read in step S23 (step S23). S24). The search key acquisition unit 62 of the video content display unit 6 requests the video content search unit 7 to search using the segment ID, the subject key, and the related subject key acquired in step S24 as search keys (step S25).

[3.2.2 Output of Similar Video Content Group and Related Video Content Group]
Next, according to the procedure shown in FIG. 5, the video content search unit 7, based on the theme key specified by the received search key, the related theme key, a similar video content group having a common theme with the search key, A related video content group having a subject having some relationship (for example, a causal relationship) with the subject for which the search key waits is searched and displayed by the video content display unit 6.

  The search instruction unit 71 of the video content search unit 7 is a key necessary for acquiring a similar video content group and a related video content group from the associative index based on the subject key and the related subject key specified as the search key. The reference theme key and the source theme key, the relation key and the target theme key triplet constituting the reference related theme key are determined and output to the metadata storage unit 5 (step S31). Note that the reference theme key and the reference related theme key are determined by the procedure shown in detail in FIG.

  The search execution unit 54 of the metadata storage unit 5 searches the associative index using the reference subject key and the reference related subject key in accordance with the procedure shown in detail in FIG. IDs of segments corresponding to the content group and the related video content group are acquired (step S32). Furthermore, when the search execution unit 54 of the metadata storage unit 5 refers to the metadata stored in the storage unit 51 and acquires the ID of the video content to which the segment specified by the segment ID acquired in step S32 belongs. Then, the obtained segment ID is output to the video content search unit 7 (step S33).

  The search instruction unit 71 of the video content search unit 7 outputs the video content ID and the segment ID received from the metadata storage unit 5 in step S33 to the video content storage unit 3 as a search result, and is specified by the video content ID. A request is made to output to the video content display unit 6 the data file that constitutes the video content and the video content ID and segment ID information (step S34).

  Upon receiving an instruction from the video content search unit 7 in step S34, the video content storage unit 3 receives the video content ID and segment ID received as a search result, and the video content ID read by the reading unit 32 from the video content storage unit 31. The data file constituting the video content specified by is output to the video content display unit 6. The search result output unit 63 of the video content display unit 6 receives from the video content storage unit 3 the video content ID and segment ID of the search result, and a file of data constituting the video content specified by the video content ID. Then, the received video information and segment information are displayed using the received information (step S35). For example, the segment data read out from the metadata storage unit 5 corresponding to the video content ID and the segment ID is acquired from the video content ID or the segment ID, or is output together with the search result from the video content search unit 7 and passes through the video content storage unit 3 The time range of the received segment is displayed. In addition, the title of the video content obtained from the EPG data, the performer, the broadcast date and time, or the like may be displayed, or a still image or a moving image corresponding to the segment time range may be displayed from the video data.

  When the display unit 61 of the video content display unit 6 displays the search result and receives the input of the video content ID and time range information selected by the user from the search result, step S21 and subsequent steps in FIG. The same processing is performed. That is, the display unit 61 of the video content display unit 6 reads the data constituting the video content specified by the received video content ID from the video content storage unit 3 in a file format, and also reads the video from the metadata storage unit 5. The content metadata is read in the file format, the data of the video portion in the specified time range is acquired from the video content file, and displayed as a moving image.

[3.2.3 Determination of Reference Theme Key and Reference Related Theme Key]
FIG. 6 shows a procedure in which the video content search unit 7 determines the reference theme key and the reference related theme key in step S31 of FIG. Here, it is assumed that the segment ID of the video content at the time when the user makes a search request is the search key segment “S0”, and the subject key “# N1” and the source subject key “#” are obtained from the segment data of the search key segment ID. It is assumed that a related theme key composed of a triplet of “N3” −relation key “# R2” −target theme key “# N4” is obtained as a search key.

[3.2.3.1 Search by subject key]
The search instruction unit 71 of the video content search unit 7 requests the metadata storage unit 5 to search for the segment ID linked to the same subject key as the subject key “# N1” specified as the search key ( Step S41). Therefore, the search instruction unit 71 determines the reference theme key as “# N1” and outputs it to the metadata storage unit 5. The video content search unit 7 sets the associative index by the metadata storage unit 5 according to “3.2.4.1 Search procedure for segment ID linked to the same subject key as the specified subject key” described later. When the segment ID (N1 similar segment ID) group as a result of the search is received, the process proceeds as a search result of the similar video content group related to the subject “# N1” of the search key segment “# S0” (step S42).

  Further, the search instruction unit 71 searches for a segment ID linked to a combination of the same source theme key as the theme key “# N1” designated as the search key, and an arbitrary relationship key and target theme key. A request is made to the metadata storage unit 5 (step S43). That is, the search instruction unit 71 uses the source theme key “# N1” -relation key “*”-target theme key “*” (“*” indicates a wild card, that is, an arbitrary one) for reference. It is determined as a subject key and is output to the metadata storage unit 5. In the video content search unit 7, the metadata storage unit 5 links to a combination of a source theme key that is the same as the specified theme key described later, and an arbitrary relationship key and target theme key. When a segment ID (N1 similar segment ID) group obtained as a result of searching the associative index is received by the “procedure for searching the segment ID”, similar video content related to the subject “# N1” of the search key segment “# S0” is received. The process proceeds as a group search result (step S44).

[3.2.3.2 Search by Related Theme Key]
The search instructing unit 71 requests the metadata storage unit 5 to search for the target theme key of the related theme key specified as the search key and the segment ID linked to the same theme key (step S45). That is, the search instruction unit 71 determines the target theme key “# N4” of the related theme key as the reference theme key “# N4” and outputs it to the metadata storage unit 5. The video content search unit 7 causes the metadata storage unit 5 to search for a segment ID linked to the same subject key as the target subject key of the related subject key specified in “3.2.4.3” described later. When the segment ID (N3-R2 related segment ID) group obtained as a result of searching the associative index is received, it is associated with the relationship “# R2” from the subject “# N3” of the search key segment “# S0”. The process proceeds as a search result of the related video content group (step S46).

  Next, the search instructing unit 71 searches for the segment ID linked to the combination of the source theme key and the relationship key that are the same as the related theme key specified as the search key and any target theme key. A request is made to the data storage unit 5 (step S47). That is, the search instruction unit 71 determines the source theme key “# N3” −relation key “# R2” −target theme key “*” as a reference key with a reference relationship, and outputs it to the metadata storage unit 5. In the video content search unit 7, the metadata storage unit 5 sets a combination of a source theme key and a relationship key that are the same as a later-described related theme key specified in “3.2.4.4” and an arbitrary target theme key. When the segment ID (N3-R2 similar segment ID) group as a result of searching the associative index is received by the “procedure for searching the segment ID linked to“ ”, this is received as the subject“ # N3 ”of the search key segment“ # S0 ”. As a result of searching for similar video content groups associated by the relationship “# R2”, the process proceeds (step S48).

  Subsequently, the search instruction unit 71 requests the metadata storage unit 5 to search for a segment ID linked to the same subject key as the source subject key of the related subject key designated as the search key (step S49). ). That is, the search instruction unit 71 determines the source theme key “# N3” of the related theme key as the reference theme key “# N3”, and outputs it to the metadata storage unit 5. The video content search unit 7 causes the metadata storage unit 5 to search for a segment ID linked to the same subject key as the source subject key of the later-described “3.2.4.5 designated related subject key”. ”, The segment ID (N3 similar segment ID) group as a result of searching the associative index is received as a search result of the similar video content group related to the subject“ # N3 ”of the search key segment“ # S0 ”. Advance (step S50).

  Furthermore, the search instruction unit 71 searches the metadata so as to search the segment ID linked to the combination of the source theme key that is the same as the related theme key designated as the search key, and the arbitrary relationship key and target theme key. A request is made to the storage unit 5 (step S51). That is, the search instruction unit 71 determines the source subject key “# N3” −relation key “*” − target subject key “*” as a reference subject key for reference, and outputs it to the metadata storage unit 5. In the video content search unit 7, the metadata storage unit 5 sets a combination of a source theme key that is the same as the related theme key specified in “3.2.4.6”, an arbitrary relationship key, and a target theme key. When the segment ID (N3 similar segment ID) group as a result of searching the associative index is received by the “procedure for searching the segment ID linked to”, it is similar to the subject “# N3” of the search key segment “# S0”. The process proceeds as a search result of the video content group (step S52).

  In addition, the search instruction unit 71 may determine the related subject key specified as the search key as the related key for reference, and output it to the metadata storage unit 5. In the video content search unit 7, the metadata storage unit 5 is linked to a combination of a source subject key, a relationship key, and a target subject key that are the same as the later-described related subject key [3.2.4.7. When the segment ID (N3-R2-N4 similar segment ID) group as a result of searching the associative index is received by the procedure for searching the segment ID], it is received as a related subject “# N3-” of the search key segment “# S0”. The process proceeds as a search result of similar video content groups related to “# R2- # N4”.

[3.2.4 Search by reference theme key and reference related subject key]
FIG. 7 shows a procedure for performing a search in the metadata storage unit 5 using the reference theme key and the reference related theme key determined by the video content search unit 7 according to the procedure shown in FIG. In the figure, the metadata accumulating unit 5 receives the reference subject key or the reference related subject key determined by the video content search unit 7 (step S61). When the metadata accumulating unit 5 acquires the ID of the similar segment and the related segment included as the reference theme key or the reference key key relation with reference (step S62), the video content ID corresponding to the segment ID is acquired. And outputs the result (step S63). At this time, information on the time range acquired from the segment data of the metadata specified by the segment ID may be output together.

[3.2.4.1 Procedure for retrieving a segment ID linked to the same subject key as the specified subject key]
(1) The search execution unit 54 of the metadata storage unit 5 selects a subject key that matches the reference subject key “# N1” received from the video content search unit 7 in step S41 of FIG. Search from a column.
(2) When a matching subject key is detected, the search execution unit 54 acquires a pointer P1 to the segment list corresponding to the detected subject key from the subject table T, and uses the acquired pointer P1 to obtain a segment list L1. Is identified. The search execution unit 54 acquires the segment ID and the pointer P11 to the next entry from the entry of the specified segment list L1, and the segment ID and the pointer P11 to the next entry from the entry specified by the acquired pointer P11. To obtain all segment IDs. If the segment ID cannot be acquired, a message indicating that the search has failed is output to the video content search unit 7.

(3) For each segment ID acquired in (2), the search execution unit 54 acquires a video content ID with reference to the segment data specified by the segment ID. The search execution unit 54 outputs a set of the segment ID (N1 similar segment ID) acquired in (2) and the video content ID acquired corresponding to each of the segment IDs to the video content search unit 7. In other cases, a message indicating that the search has failed is output to the video content search unit 7.

[3.2.4.2 Procedure for retrieving a segment ID linked to a combination of a source theme key identical to a specified theme key and an arbitrary relation key and target theme key]
(1) The search execution unit 54 includes the reference related subject key (source theme key “# N1” −relation key “*” − target theme key “*”) received from the video content search unit 7 in step S43 of FIG. The subject key that matches the source theme key “# N1” of the subject table T is searched from the subject key column of the subject table T.

(2) When a matching subject key is detected, the search execution unit 54 acquires a pointer P2 to the relationship list corresponding to the detected subject key from the subject table T, and uses the acquired pointer P2 to obtain a relationship list L2 Is identified. When the search execution unit 54 acquires the pointer P3 of the segment list L3 and the pointer P4 to the next entry from the entry of the specified relation list L2, the pointer to the segment list L3 from the entry specified by the acquired pointer P4 The acquisition of the pointer P3 and the pointer P4 to the next entry is repeated to acquire the pointers P3 to all the segment lists L3. Subsequently, when the search execution unit 54 specifies the segment list L3 of the acquired pointer P3, the search execution unit 54 acquires the segment ID from the entry and the pointer P31 to the next entry for each segment list L3, and is specified by the acquired pointer P31. All the segment IDs are acquired by repeatedly obtaining the segment ID and the pointer P31 to the next entry from the next entry. If the segment ID cannot be acquired, a message indicating that the search has failed is output to the video content search unit 7.

(3) For each segment ID acquired in (2), the search execution unit 54 acquires a video content ID with reference to the segment data specified by the segment ID. The search execution unit 54 outputs a set of the segment ID (N1 similar segment ID) acquired in (2) and the video content ID acquired corresponding to each of the segment IDs to the video content search unit 7. In other cases, a message indicating that the search has failed is output to the video content search unit 7.

[3.2.4.3 Procedure for Searching Segment ID Linked to Same Subject Key as Target Theme Key of Specified Related Theme Key]
(1) The search execution unit 54 searches the subject key string of the subject table T for a subject key that matches the reference subject key “# N4” received from the video content search unit 7 in step S45 of FIG.
(2) When a matching subject key is detected, the search execution unit 54 acquires a pointer P1 to a segment list corresponding to the detected subject key from the subject table T, and a segment specified by the pointer P1 Search is performed by tracing the list L1 in the same manner as described above, and all segment IDs are acquired. If the segment ID cannot be acquired, a message indicating that the search has failed is output to the video content search unit 7.

(3) For each segment ID acquired in (2), the search execution unit 54 acquires a video content ID with reference to the segment data specified by the segment ID. The search execution unit 54 outputs a set of the segment ID (N3-R2 related segment ID) acquired in (2) and the video content ID acquired corresponding to each of the segment IDs to the video content search unit 7. In other cases, a message indicating that the search has failed is output to the video content search unit 7.

[3.2.4.4 Procedure for Retrieving Segment ID Linked to Combination of Source Theme Key and Relationship Key Same as Specified Relational Theme Key and Arbitrary Target Theme Key]
(1) The search execution unit 54 includes the reference related subject key (source subject key “# N3” −relation key “# R2” −target subject key “*” received from the video content search unit 7 in step S47 of FIG. 6). The subject key that matches the source theme key “# N3” of the subject table T is searched from the subject key column of the subject table T.

(2) When a matching subject key is detected, the search execution unit 54 acquires a pointer P2 to the relationship list corresponding to the detected subject key from the subject table T, and uses the acquired pointer P2 to obtain a relationship list L2 Is identified. The search execution unit 54 determines whether the relationship key “# R2” of the subject key with reference relationship is set in the entry of the specified relationship list L2, and if so, the segment list pointer P3 from the entry. To get. On the other hand, if not set, the pointer P4 to the next entry is acquired, and it is repeated to determine whether or not the relation key “# R2” is set in the entry specified by the acquired pointer P4. When the search execution unit 54 specifies the segment list L3 by using the pointer P3 acquired from the entry in which the relation key “# R2” is set, the search execution unit 54 performs the search by tracing the specified segment list L3 in the same manner as described above. Get an ID. If the segment ID cannot be acquired, a message indicating that the search has failed is output to the video content search unit 7.

(3) For each segment ID acquired in (2), the search execution unit 54 acquires a video content ID with reference to the segment data specified by the segment ID. The search execution unit 54 outputs a combination of the acquired segment ID (N3-R2 similar segment ID) and the video content ID acquired corresponding to each of the segment IDs to the video content search unit 7. In other cases, a message indicating that the search has failed is output to the video content search unit 7.

[3.2.4.5 Procedure for Retrieving a Segment ID Linked to the Same Theme Key as the Source Theme Key of the Specified Related Theme Key]
(1) The search execution unit 54 searches the subject key string of the subject table T for a subject key that matches the reference subject key “# N3” received from the video content search unit 7 in step S49 of FIG.
(2) When a matching subject key is detected, the search execution unit 54 acquires a pointer P1 to a segment list corresponding to the detected subject key from the subject table T, and a segment specified by the pointer P1 Search is performed by tracing the list L1 in the same manner as described above, and all segment IDs are acquired. If the segment ID cannot be acquired, a message indicating that the search has failed is output to the video content search unit 7.

(3) For each segment ID acquired in (2), the search execution unit 54 acquires a video content ID with reference to the segment data specified by the segment ID. The search execution unit 54 outputs a set of the acquired segment ID (N3 similar segment ID) and the video content ID acquired corresponding to each of the segment IDs to the video content search unit 7. In other cases, a message indicating that the search has failed is output to the video content search unit 7.

[3.2.4.6 Procedure for Retrieving a Segment ID Linked to a Combination of a Source Theme Key Same as a Specified Related Theme Key and an Arbitrary Relationship Key and a Target Theme Key]
(1) The search execution unit 54 includes the reference related subject key (source theme key “# N3” −relation key “*” − target theme key “*”) received from the video content search unit 7 in step S51 of FIG. The subject key that matches the source theme key “# N3” of the subject table T is searched from the subject key column of the subject table T.

(2) When a matching subject key is detected, the search execution unit 54 acquires a pointer P2 to the relation list corresponding to the detected subject key from the subject table T, and is specified by the acquired pointer P2. The related list L2 is traced in the same manner as described above, and the pointer P3 to the segment list is obtained from all entries, and all the segment IDs are obtained from each segment list L3 specified by the obtained pointer P3. . If the segment ID cannot be acquired, a message indicating that the search has failed is output to the video content search unit 7.

(3) For each segment ID acquired in (2), the search execution unit 54 acquires a video content ID with reference to the segment data specified by the segment ID. The search execution unit 54 outputs a set of the acquired segment ID (N3 similar segment ID) and the video content ID acquired corresponding to each of the segment IDs to the video content search unit 7. In other cases, a message indicating that the search has failed is output to the video content search unit 7.

[3.2.4.7 Procedure for Retrieving a Segment ID Linked to the Same Source Theme Key, Relationship Key, and Target Theme Key Combination as the specified Related Theme Key]
(1) When the search execution unit 54 receives the reference related subject key (source subject key “# N3” −relation key “# R2” −target subject key “# N4”) from the video content search unit 7, A theme key that matches the theme key “# N3” is searched from the theme key column of the theme table T.

(2) When a matching subject key is detected, the search execution unit 54 acquires a pointer P2 to the relationship list corresponding to the detected subject key from the subject table T, and uses the acquired pointer P2 to obtain a relationship list L2 Is identified. The search execution unit 54 determines whether or not the relationship key “# R2” and the target theme key “# N4” of the related subject key with reference relationship are set in the entry of the specified relationship list L2. The segment list pointer P3 is obtained from the entry. On the other hand, if not set, the pointer P4 to the next entry is acquired, and it is determined whether the relation key “# R2” and the target subject key “# N4” are set in the entry specified by the acquired pointer P4. Repeat to do. When the search execution unit 54 specifies the segment list L3 by the pointer P3 acquired from the entry in which the relation key “# R2” and the target subject key “# N4” are set, the search execution unit 54 traces the specified segment list L3 in the same manner as described above. To retrieve all segment IDs. If the segment ID cannot be acquired, a message indicating that the search has failed is output to the video content search unit 7.

(3) For each segment ID acquired in (2), the search execution unit 54 acquires a video content ID with reference to the segment data specified by the segment ID. The search execution unit 54 outputs a combination of the acquired segment ID (N3-R2-N4 similar segment ID) and the video content ID acquired corresponding to each of the segment IDs to the video content search unit 7. In other cases, a message indicating that the search has failed is output to the video content search unit 7.

[3.2.5 Search example]
FIG. 8 is a diagram illustrating an example of search.
In step S31 of FIG. 5, the subject indicated by the search key is “deterioration of employment” and the related subject is “subprime problem caused dollar depreciation”, that is, the source subject “subprime problem” -relationship -Let's say that it is a triple consisting of the target theme "dollar depreciation".

When the search execution unit 54 of the metadata storage unit 5 receives the subject key “# (deterioration of employment)” specified by the search key from the search instruction unit 71 of the video content search unit 7 as a reference subject key, “ “Employment deterioration” identifies similar segments of the subject.
Further, the search execution unit 54 of the metadata storage unit 5 receives the same source theme key as the subject key specified by the search key from the search instruction unit 71 of the video content search unit 7, an arbitrary relationship key, and a target theme key. When a subject key with reference relation (source theme key “# (deterioration of employment)” − relation key “*” − target theme key “*”) is received, a similar segment of the subject is “employment deterioration”. For example, “showed recession due to worsening employment” identifies the subject segment.

Further, the search execution unit 54 of the metadata storage unit 5 refers to the target subject key “# (dollar depreciation)” of the related subject key specified by the search key from the search instruction unit 71 of the video content search unit 7. When received as a subject key, the related segment associated with “subprime problem has occurred”, ie, “dollar depreciation” identifies the subject segment.
In addition, the search execution unit 54 of the metadata storage unit 5 receives from the search instruction unit 71 of the video content search unit 7 the same source theme key and relationship key as the related subject key specified by the search key, and an arbitrary target. When receiving a reference related theme key consisting of a combination with a theme key (source theme key “# (subprime problem)” — relation key “# (trigger)” — target theme key “*”) Similar segments of the subject “prime problem caused something”, for example, “subprime problem caused stock price drop” identify the subject segment.

Further, the search execution unit 54 of the metadata storage unit 5 refers to the source theme key “# (subprime problem)” of the related theme key specified by the search key from the search instruction unit 71 of the video content search unit 7. When received as a subject key for use, the “subprime problem” identifies similar segments of the subject.
In addition, the search execution unit 54 of the metadata storage unit 5 receives the same source theme key as the related subject key specified by the search key from the search instruction unit 71 of the video content search unit 7, an arbitrary relationship key and target. If a reference related theme key (source theme key “# (subprime problem)” − relation key “*” − target theme key “*”) is received, the “subprime problem” is determined. Similar segments of the subject, for example, “subprime issues affected TSE” identify the subject segment.

[4. effect]
According to the above-described embodiment, any video content, for example, the video content being viewed is used as a search key without specifying a search keyword, and the video content or a part of the scene with high content relevance is selected as a search key. It becomes possible to search associatively. That is, it is possible to search for a similar video content group having a common theme with the video content being viewed and a related video content group having a subject that has some relationship (for example, a causal relationship) with the subject.

[5. Others]
The above-described video content search apparatus 1 has a computer system inside. The operation processes of the video content acquisition unit 2, the video content storage unit 3, the video content registration unit 4, the metadata storage unit 5, the video content display unit 6, and the video content search unit 7 of the video content search device 1 are as follows. The program is stored in a computer-readable recording medium in the form of a program, and the above processing is performed by the computer system reading and executing the program. The computer system here includes a CPU, various memories, an OS, and hardware such as peripheral devices.

Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used.
The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory in a computer system serving as a server or a client in that case, and a program that holds a program for a certain period of time are also included. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

1 is a block diagram of a video content search apparatus according to an embodiment of the present invention. It is a figure which shows the metadata registration procedure of the video content search apparatus by the embodiment. It is the schematic which shows the structural example of the associative index by the embodiment. It is a figure which shows the search key acquisition procedure of the video content search apparatus by the embodiment. It is a figure which shows the output procedure of the similar video content group of the video content search apparatus by the embodiment, and a related video content group. It is a figure which shows the determination procedure of the theme key for reference of the video content search part by the embodiment, and the theme key with a reference relationship. It is a figure which shows the search procedure using the theme key for reference of the metadata storage part by the same embodiment, and the theme key with relation for reference. It is a figure which shows the example of a search of the video content search apparatus by the embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Video content search device 2 ... Video content acquisition part 3 ... Video content storage part 4 ... Video content registration part 5 ... Metadata storage part 6 ... Video content display part 7 ... Video content search part 31 ... Video content storage part 32 ... Reading unit 33 ... Writing unit 41 ... Video content file acquisition unit 42 ... Registration request unit 51 ... Storage unit 52 ... Registration execution unit 53 ... Metadata reading unit 54 ... Search execution unit 61 ... Display unit 62 ... Search key acquisition unit 63 ... Search result output unit 71 ... Search instruction unit

Claims (7)

A storage unit for storing a segment obtained by time-dividing video content and metadata representing a relationship between the subject of the segment and associative index data representing a relationship between the subject and a segment corresponding to the subject;
A search key acquisition unit that receives designation of an arbitrary segment and reads out the subject of the segment that has received the designation from the metadata stored in the storage unit as a search key;
A search execution unit that searches the associative index data stored in the storage unit based on the search key and identifies a segment corresponding to the subject indicated by the search key;
A search result output unit for outputting video content including the segment specified by the search execution unit as a search result;
Equipped with a,
The metadata further includes a related subject that represents a relationship between the subject of the segment and other subjects related to the subject;
The associative index data further represents an association between the related theme and a segment corresponding to the related theme.
The search key acquisition unit reads out the subject of the specified segment and the related subject from the metadata stored in the storage unit, and uses it as a search key.
The search execution unit searches the associative index data using the subject indicated by the search key, the subject expressed by the related subject indicated by the search key, and other subjects, and identifies the segment. ,
Film image content search device you wherein a. The related subject is composed of a source subject corresponding to the video content, a target subject that is another subject related to the source subject, and a relationship between the source subject and the target subject.
The search execution unit searches the associative index data by using the subject indicated by the search key as a subject key, or searches the associative index data by a related subject key using the subject indicated by the search key as a source subject. To identify segments,
The search result output unit outputs video content including the segment specified by the search execution unit as a similar video content group.
The video content search apparatus according to claim 1 , wherein: The search execution unit
Searching the associative index data using the related subject indicated by the search key as the related subject key;
Searching the associative index data using the source theme of the related subject indicated by the search key and the relationship as the related subject key;
Search the associative index data using the source theme of the related subject indicated by the search key as the related subject key, or
The segment is identified by searching the associative index data using the source theme of the related theme indicated by the search key as a theme key,
The search result output unit outputs video content including a segment specified by the search execution unit as a similar video content group.
The video content search apparatus according to claim 2 , wherein: The search execution unit is to search the associative index data using a target theme of a related theme indicated by the search key as a theme key to identify a segment,
The search result output unit outputs video content including a segment specified by the search execution unit as a related video content group using a target subject of a related subject indicated by the search key as a subject key.
The video content search apparatus according to claim 2 or claim 3 , wherein The metadata further includes information on video content including the segment and a time range of the segment in the video content,
The search result output unit obtains and outputs the video content including the segment specified by the search execution unit and the time range of the segment in the video content from the metadata stored in the storage unit To do,
Video content searching apparatus according to any one of claims of claims 1 to 4, characterized in. The content data of the video content is acquired from the video content storage unit that receives the information specifying the video content and the time range information, and stores the content data of the video content, and the video corresponding to the time range The video content search device according to claim 5 , further comprising: a display unit that displays. A computer used as a video content search device for searching for video content includes: a metadata representing a relationship between a segment obtained by time-sharing video content and a subject of the segment; and a relationship between the subject and a segment corresponding to the subject A storage unit for storing associative index data representing
A search key acquisition unit that receives designation of an arbitrary segment and reads out the theme of the segment that has received the designation from the metadata stored in the storage unit,
A search execution unit that searches the associative index data stored in the storage unit based on the search key and identifies a segment corresponding to the subject indicated by the search key;
A search result output unit that outputs video content including the segment specified by the search execution unit as a search result;
To function as,
The metadata further includes a related subject that represents a relationship between the subject of the segment and other subjects related to the subject;
The associative index data further represents an association between the related theme and a segment corresponding to the related theme.
The search key acquisition unit reads out the subject of the specified segment and the related subject from the metadata stored in the storage unit, and uses it as a search key.
The search execution unit searches the associative index data using the subject indicated by the search key, the subject expressed by the related subject indicated by the search key, and other subjects, and identifies the segment. ,
A computer program characterized by the above.

Images