JPH10327381A - Method for reproducing and displaying video information and recording medium recording video information - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide highly customizable character information having control information of a standard information system to facilitate development and verification of a program, and to have expandability in a reproduction function. It is an object of the present invention to provide a method for reproducing and displaying video information and a recording medium on which the video information is recorded, which enables recording and reproduction of video information including the above. A control processor (1) in a video playback device (100).
01 executes a machine language instruction for the control processor stored in the read only memory 103 and the main memory 102, and executes the DVD reading device 104 via the control bus.
By examining the state of each component such as, or instructing a predetermined operation, reproduction of the video recorded on the DVD and reproduction of character information associated with the unit video are performed. Take control.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

TECHNICAL FIELD The present invention relates to, for example, a CD-RO
The present invention relates to a method for reproducing and displaying video information applied to an image / video reproducing apparatus that drives a high-density rotation recording medium such as an M player or a DVD player, and a recording medium on which video information is recorded. It is possible to select a reproduction method or to superimpose a previously recorded moving image and computer graphics created at the time of reproduction, and to enhance and enhance the reproduction function. It relates to a recorded recording medium.

Further, the present invention divides a continuous long-time data stream video into unit videos, and controls video and character information using a unit video playback control program using an open standard language or the like. The present invention relates to a video information reproduction / display method and a recording medium on which video information is recorded so that character information such as subtitles can be reproduced in accordance with video reproduction.

[0003] The present invention also relates to a playback / display apparatus for a video information recording medium in which a unit video playback control program for generating character information in a gap between unit videos of a continuous data stream is interposed.

[0004]

2. Description of the Related Art Unlike a VTR (Video Tape Recorder), a DVD player allows random access to a recording medium. For example, a DVD player presents a menu screen to a user during reproduction of a moving image, and selects a menu prepared in advance. A so-called multi-story in which the subsequent reproduction contents can be changed according to the selected one from among the above.

[0005] In the DVD, various formats for controlling reproduction are defined in order to take advantage of the feature that a recording medium is randomly accessible. Then, the control processor built in the DVD player extracts the format information from the information read from the recording medium, and displays a menu or changes the position to be read from the recording medium based on the extracted format information. It has become.

Conventionally, the above-mentioned DVD player has two major problems. As the first problem,
In order to enable various trick play (reproduction), the format is extremely complicated, and therefore, there is a problem that it is difficult to develop and verify a program that reproduces and displays all formats according to specifications. Further, as a second problem, there is a problem of lack of expandability that reproduction and display can be performed only by a method specified by the current format specification.

[0007]

As described above, in the conventional DVD player, since the format is very complicated, it is difficult to develop and verify a program for reproducing and displaying all formats according to specifications. In addition, there is a problem that reproduction and display can be performed only by a method specified by the current format specification and expandability is poor.

[0008] The present invention has been made in view of the above circumstances,
Having control information in a standard information system facilitates program development and verification, and expands the playback function, enabling recording and playback of video information including highly customizable text information. It is another object of the present invention to provide a method for reproducing and displaying video information and a recording medium on which video information is recorded.

Another object of the present invention is to provide a method for reproducing and displaying video information and a recording medium on which the video information is recorded, which can finely control the composite display of a character string on a video.

It is another object of the present invention to provide a method for reproducing and displaying video information which handles character information and eliminates restrictions on the model of the control processor, and a recording medium on which the video information is recorded. .

Further, the present invention reduces the size of a unit video reproduction control program by making a subtitle character font and a character output function using the same into a shared program, thereby reducing the load time of the unit video reproduction control program. It is an object of the present invention to provide a method for reproducing and displaying video information and a recording medium on which the video information is recorded, which can shorten the processing time and can simplify and speed up the processing.

Also, the present invention provides a method of reproducing video information in which a user performs some selection operation with one program code of a unit video reproduction control program, and the other program code enables reproduction display according to the operation. It is an object of the present invention to provide a display method and a recording medium on which video information is recorded.

According to the present invention, a user can arbitrarily determine the order of reproduction and display, thereby realizing video reproduction using a general menu and multi-story in which the user selects a story during video reproduction. It is an object of the present invention to provide a method for reproducing and displaying video information and a recording medium on which the video information is recorded.

Further, according to the present invention, a subtitle character can be displayed longer by using a unit video reproduction control program using a generally open standard language so that coarse lines can be easily grasped in fast forward reproduction. It is an object of the present invention to provide a method for reproducing and displaying video information and a recording medium on which the video information is recorded.

Further, the present invention can hold subtitles of various languages as data of a unit video reproduction control program using a generally open standard language and the like, and can provide a user with a type of language used for subtitles. It is an object of the present invention to provide a method for reproducing and displaying video information and a recording medium on which video information is recorded, in which the user can arbitrarily select the video information.

The present invention also provides a method for reproducing and displaying video information in which a user can arbitrarily select the size and font of characters to be displayed as subtitles by a unit video reproduction control program using a standard language or the like which is generally open. And a recording medium on which video information is recorded.

Further, the present invention provides video information including character information with high customizability, which has expandability in a reproduction function by having control information of a standard information system, and which can record and reproduce video information. It is an object of the present invention to provide a reproduction display device for a recording medium.

[0018]

According to the present invention, there is provided a unit image for generating character information having control information of a standard information system in a gap between unit images Fi-1 and Fi of a continuous data stream. The intermediary of the playback control program Pi facilitates the development and verification of the program, and enables the recording and playback of video information including highly customizable text information with an extended playback function. I do.

Further, the present invention divides an image of a continuous long data stream into unit images and controls the image and character information using a unit image reproduction control program using an open standard language or the like. By doing so, it is possible to reproduce character information such as subtitles in accordance with the reproduction of video.

That is, according to the present invention, a processor for executing a unit image reproduction control program, a random access memory used by the processor, and character information are generated in a gap between unit images Fi-1 and Fi of a continuous data stream. A unit for reproducing a video information recording medium having a unit video reproduction control program Pi interposed therebetween, a unit video restoration circuit for generating and outputting character information based on information included in the unit video reproduction control program, It is used for a video playback device comprising: a graphic memory used for outputting character information by a video playback control program; and a signal combining unit that combines an output signal of the unit video restoration circuit and an output signal of the graphic memory. A method for reproducing and displaying video information, wherein when reproducing and displaying the unit video Fi, the unit video is read from the recording medium. At the time of reading i, the unit video reproduction control program Pi is read and stored in the random access memory, and thereafter, a process of generating a video signal based on the unit video Fi read from the recording medium, and stored in the random access memory The character information generation process executed by the unit video reproduction control program Pi is performed in parallel, and the video signal generated in the video signal generation process and the video signal generated in the character information generation process are combined. Output to a video playback device.

Further, the present invention is a recording medium for storing video information based on a continuous series of data streams,
Video information based on a series of data streams that are continuously reproduced is divided into unit videos Fi (i = 1N) having a predetermined information amount,
A unit image reproduction control program Pi for generating character information is interposed in the gap between the unit images Fi-1 and Fi to record a series of data streams by a combination thereof, and the reproduction of the unit image Fi is performed in advance. When proceeding to a predetermined point, the unit video reproduction control program Pi
However, the present invention is characterized by a recording medium of video information in which information including a program for realizing a function of generating character information based on information contained in the program is recorded.

In the method for reproducing and displaying video information and the recording medium, the data for generating character information included in the unit video reproduction control program includes at least a numerical data transfer instruction and two numerical data transfer commands. Any one of an instruction set such as an arithmetic instruction, a comparison instruction, and a conditional branch instruction is included.

In the above-mentioned video information reproducing / displaying method and recording medium, a unit video is obtained by dividing a series of data streams of moving images or still images into one or more scenes each having a frame as a minimum unit. It is characterized by becoming.

A method for reproducing and displaying video information as described above,
And the recording medium on which the video information is recorded, the unit video Fi
Before reproducing the unit video, the unit video reproduction control program Pi is stored in the main memory. Thereafter, the unit video reproduction control program Pi reads the unit video Fi from the recording medium and reproduces the video signal. A character string is output in accordance with the progress of playback of the video, and the video signals are combined and output. Therefore, the unit video playback control program Pi converts the subtitle of the movie as a character string (for example, a movie without dubbing, For example, for a person with a disability, a commentary (for example, for a hearing impaired person) to be added to a video of a work of art, and lyrics of a popular song can be easily recorded and reproduced on a plate. At this time, since each instruction which is a component of the unit video reproduction control program Pi is a transfer instruction of numerical data, an arithmetic instruction of two numerical data, a comparison instruction, and the like, a program of the control processor which correctly executes the instructions. Development burden is reduced. Further, the video creator creates a source program of the unit video reproduction control program Pi that outputs a character string in accordance with the progress of the unit video Fi by using a high-level programming language such as C language, for example.
Since it is possible to develop an object program Pi that can be executed by the control processor by compiling with a language compiler or the like, it is possible to finely control the composite display of the character string on the video.

According to the present invention, there is provided a method for reproducing and displaying video information, and a program code (P) for a unit video reproduction control program Pi in a recording medium on which video information is recorded.
The instructions constituting i) have specifications that do not depend on the type of control processor, and the execution of the program code is performed by an interpreter.

As a result, the model of the control processor is not limited, and the system can be easily constructed with a general-purpose device configuration. Further, the present invention provides a method for reproducing and displaying the video information and a method for commonly using at least two program codes (Pi) and (Pj) constituting a unit video reproduction control program in a recording medium on which the video information is recorded. The shared program is stored in an area different from each program code in the main memory.

By using a subtitle font and a character output function using the same as a shared program, the size of each program code (Pi) is reduced, and the load time of the unit video reproduction control program is reduced. it can.

According to the present invention, there is provided a method for reproducing and displaying video information, and in a recording medium on which video information is recorded, at least two program codes (Pi) and (Pj) constituting a unit video reproduction control program are: It is characterized in that a common data area is provided on the main memory, and that changed data can be referred to on the other hand.

This allows the user to make a selection with one of the program codes, and reproduce and display according to the other program code. Also, the present invention
In the method for reproducing and displaying video information and the recording medium on which the video information is recorded, at least one program code (Pi) has a function for allowing a user to select a reproduction order of the video, and The two other program codes (Pj) determine a set of a unit video playback control program and a unit video to be reproduced and displayed next according to the content selected by the user based on the program code (Pi). Features.

[0030] This allows the user to freely determine the order of reproduction and display, thereby realizing a video reproduction using a general menu and a multi-story in which the user selects a story during reproduction of the video. For example, in the case of a language teaching material, it is possible to realize a function of deciding which person to practice conversation in a scene of conversation between two people.

Further, according to the present invention, there is provided a method for reproducing and displaying video information and a recording medium on which the video information is recorded, wherein at least one program code (Pi) includes a unit video F
When the reproduction display speed of i is higher than the standard reproduction speed, the timing of erasing the character information being displayed is made later than in the case of the standard reproduction speed.

Thus, in the case of fast forward reproduction, the characters of the subtitles are displayed longer, so that it is possible to realize a function that makes it easier to grasp the coarse lines. Also, the present invention provides a method for reproducing and displaying video information and a recording medium on which video information is recorded, wherein at least one program code (Pi) allows a user to select a type of language used for subtitles. And at least one other program code (Pj) displays subtitles in accordance with the content selected by the user by the unit video reproduction control program.

Thus, the user can select the type of language used for subtitles for the user. Since the number of subtitles is not so large, a function of holding subtitles of various languages as data of the program code (Pi) and displaying only one type of program code can be easily realized.

According to the present invention, there is provided the method for reproducing and displaying video information, and in the recording medium on which the video information is recorded, at least one program code (Pi) is a character size to be displayed as subtitles to a user. And at least one other program code (Pj)
Is characterized in that subtitles are displayed according to the content selected by the user by the unit video reproduction control program.

Thus, the user can select the size and font of characters to be displayed as subtitles, and can realize an effective character information reproducing function when the user has a visual impairment or does not need subtitles.

Further, according to the present invention, in the method for reproducing and displaying the video information and the recording medium on which the video information is recorded, at least one program code (Pi) allows a user to make some selection on the video. For displaying a graphics screen for overlay.

Thus, as in the case of subtitles, the selection screen can correspond to various types of screens. Further, the present invention is a playback display device of a video information recording medium in which a unit video playback control program for generating character information in a gap portion between unit videos of a continuous data stream is provided, wherein the unit video information is Means for reading, reproducing processing, means for reading the unit video reproduction control program, and means for generating character information based on information included in the unit video reproduction control program, and the reproduced video and the generated Means for synthesizing the character information in association with each other.

[0038] With this, it is possible to construct a system capable of recording and reproducing video information including character information with high customizability, which has expandability in the reproduction function by having control information of a standard information system. .

By using the above-described method for reproducing and displaying video information of the present invention, a recording medium on which video information is recorded, or a reproduction and display device for a video information recording medium, control information of a standard information system is provided. Program development
It is possible to construct a system capable of recording and reproducing video information including text information with high customizability, which facilitates verification and has expandability in the reproduction function.

Further, it is possible to finely control the display of the combination of the character strings on the video, and it is possible to improve the versatility by eliminating the limitation of the model of the control processor. In addition, since the subtitle font and the output function of characters using the subtitle character are made into a shared program, the size of the unit video playback control program can be reduced, and the load time of the unit video playback control program can be shortened. Simplification and high speed can be achieved.

Further, one of the program codes of the unit video reproduction control program allows the user to perform some selection operation, and the other program code enables the reproduction and display according to the operation, and the user performs the reproduction and display. Since the order can be determined arbitrarily, it is possible to realize video playback using a general menu and multi-story in which the user selects a story during video playback, and in the case of fast forward playback, rough lines are easily grasped. Since the subtitle characters can be displayed longer, a user-friendly system with enhanced functions can be realized.

Further, subtitles of various languages can be held as data of a unit video reproduction control program using a standard language or the like which is generally open, and the user can arbitrarily select the type of language used for subtitles. The user can arbitrarily select the size and font of characters to be displayed as subtitles, so that a user-friendly function-extended system can be realized.

[0043]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing a configuration of a system according to an embodiment of the present invention. In the figure, reference numeral 100 denotes an image reproducing apparatus which forms the center of the system according to the embodiment of the present invention. The video playback device 100 includes a control processor 1
01, main memory 102, read only memory (RO
M) 103, DVD reading device 104, video signal decompression circuit 105, video RAM-A 106, video RAM-B1
07, a video signal generation circuit 108, a real-time clock 109, an infrared light receiving circuit 110, and the like, each of which is connected by a bus 111 and various signal lines.

Further, it is connected to the television monitor 200 by an image signal line 112 and an audio signal line 113. The user is a remote controller (remote controller) 201
Can be used to instruct the video reproducing apparatus 100 to start or end video reproduction.

In the video reproducing apparatus 100, the control processor 101 executes a machine language instruction for the control processor stored in the read-only memory 103 and the main memory 102, and executes a DVD reading apparatus via a control bus. By examining the state of each component such as 104 and instructing a predetermined operation, it controls the entire system such as playback of a video recorded on a DVD. In this embodiment, initialization processing at power-on as shown in FIG. 4 and DV processing as shown in FIG.
Controls D playback processing.

The DVD recording format (unit video Fi)
6 is shown in FIG. 6, and a time chart at the time of DVD reproduction is shown in FIG. FIG. 2 shows an example of the area configuration of the main memory 102 shown in FIG. 1, and FIG. 3 shows an example of the area configuration of the read-only memory 103.

As shown in FIG. 2, the main memory 102 has a program instruction area 120 for storing a unit video reproduction control program read from a DVD, and a program data area 121 for storing data used by the unit video reproduction control program. , A shared library instruction area 122 for storing a group of subroutines used continuously during playback of a certain DVD, and a shared library data area 123. However, these areas are not fixedly allocated, and when starting playback of a certain DVD,
Once the size of each area is determined, the size of each area does not change until the reproduction of the DVD ends.

The read only memory 103 is used as a storage area for a machine language instruction sequence executed by the control processor 101. As shown in FIG.
A power-on initialization program 130 for performing processing up to the start of VD reproduction, a DVD reproduction program 131 used for reproducing a DVD having a recording format according to the present invention, and a unit video reproduction control program described later are, for example, Java. Java used when it is a virtual machine
a It has a program area such as an execution environment (bytecode interpreter) 132 and a basic input / output routine (BIOS) 133 (Java is a product name of Sun Microsystems).

The DVD reading device 104 has a status register and a command register (not shown). When the control processor 101 reads the status register, the DV indicates whether the DVD is currently loaded or not.
The state of the D reading device 104 can be known.

The DVD reading device 104 ejects the currently loaded DVD by writing a value into the command register by the control processor 101,
Data is read out from a certain sector of the DVD as a bit string of a designated number of sectors at a speed of about 6 Mbit / sec and written to the main memory 102 via the bus 111, or the bit string is read via a dedicated signal line. To the video signal expansion circuit 105.

The video signal expansion circuit 105 decodes the bit string (data encoded in the MPEG2 format) sent from the DVD reading device 104, writes the image information into the video RAM-A 106, and converts the audio information into analog audio. The signal is output to the audio signal line.

Since the bit string sent from the DVD reading device 104 is not always supplied at a constant speed without interruption, the video signal expansion circuit 105 has an internal buffer (not shown) for reproducing a continuous video. (Not shown).

The video signal expansion circuit 105 includes a status register (not shown).
01 can read the sequence number of the video information currently being reproduced by reading the status register.

The video RAM-A 106 is composed of 704 horizontal pixels × 480 vertical pixels, and each pixel is composed of a 6-bit memory for each of red, blue and green, and a moving image decoded by the video signal decompression circuit 105 is decoded at 30 frames per second. Write about the frequency.

The video RAM-B 107 also has 704 horizontal pixels × 480 vertical pixels, and each pixel is composed of a 6-bit memory for each of red, blue and green. An arbitrary image can be displayed by the control processor 101 writing data via the bus 111.

The video signal generation circuit 108 outputs the video RA
The information of the corresponding pixels of the M-A 106 and the video RAM-B 107 is read almost simultaneously, and the video RAM-B 107
If any data is written to the video signal line 112, a video signal is generated using the data of the video RAM-B 107, otherwise, the video signal is generated using the data of the video RAM-A 106. Output to

The real-time clock 109 is a kind of counter that holds the current time, and is configured using a backup memory. The control processor 101 can know the current date and time, for example, in seconds by reading the contents of the counter.

The infrared receiving circuit 110 receives infrared rays emitted from the remote controller 201 when the user presses various buttons on the remote controller. The infrared light receiving circuit 110 includes a status register (not shown). Control processor 101
Can read which button has been pressed by reading the status register.

The user uses the remote controller 201 as a tool for transmitting a request to the video reproducing apparatus 100. Power on / off of the video playback device 100, start of video playback,
In addition to a dedicated button for instructing pause, etc.,
Buttons are provided for moving a cursor displayed on the TV monitor 200 up, down, left and right in order to select a desired item from the menu screen displayed on the TV monitor 200 and to indicate a certain position on the image.

Next, the overall operation of the video reproducing apparatus 100 will be described focusing on the operation of the control processor 101. FIG. 3 shows a breakdown of the program stored in the read-only memory 103.

When the video reproducing apparatus 100 is turned on, the control processor 101
Power-on reset program 130 stored in
Execute

The power-on reset program 130
As shown in FIG. 4, after initializing the DVD reading device 104 and the like (step 401 in FIG. 4), the remote controller 201 is initialized.
Then, the user waits for the button to be pressed (step 402 in FIG. 4).

When the reproduction start button is pressed (Y in step 403 in FIG. 4), the status register of the DVD reader 104 is read (step 40 in FIG. 4).
4) If a DVD is loaded (step 405 in FIG. 4)
Y), the DVD playback program 131 is started.

Here, before describing the video reproduction processing, the unit video recorded on the DVD, the unit video reproduction control program, and the recording method thereof will be described. The DVD records, for example, one movie.

A movie is divided into unit images Fi for each scene, and is usually encoded by MPEG2.
It is recorded in a plurality of consecutive sectors. The reproduction time of one unit video is usually about 10 seconds to 1 minute.

In this embodiment, the image of each unit video Fi does not include subtitle information, and the unit video reproduction control program Pi displays subtitles in synchronization with the reproduction of the unit video Fi. In the development of the unit video reproduction control program Pi, a high-level program such as C language is used. The unit video reproduction control program Pi for displaying subtitles is an extremely simple program. The following program is an example. main (argc, argv) {while (seq_no () <1000); put_string ("Hello", font20, 300, 400, 63, 63, 63); while (seq_no () <1020); clear_display ();} Seq_no () appearing in the third line of the program is a function for determining the sequence number of the image currently being reproduced, and the control processor reads the status register of the video signal expansion circuit 105. In the third line,
Wait until the sequence number of the video to be played becomes 1000.

Put_st appearing on the fourth line of this program
ring ("Hello", font20, 300, 400,63, 63, 63) is Hel
Using the character font indicated by font20, the character string lo is displayed on the screen in the intensity of red 63, blue 63, and green 63 (in this case, the brightest white) from the position of X coordinate 300 and Y coordinate 400. Function to display. Thereby, writing to the video RAM-B 107 by the control processor 101 is performed.

In the fifth line of this program, the program waits until the sequence number of the video to be reproduced reaches 1020. "Clear_display ()" appearing on the sixth line of this program is a function for clearing the RGB values of all the pixels of the video RAM-B 107. As a result, the character string "Hello" disappears from the screen.

The source program of the unit video reproduction control program is compiled by the control processor 10 using a compiler.
1 is compiled into a directly executable machine language instruction sequence.
However, a function appearing in the above source program can be realized in a different manner depending on the model of the video reproducing apparatus. For example, depending on the model, the address of the status register of the video signal expansion circuit and the method (format) of interpreting the read data may change. Therefore, as a preferred embodiment of the present invention, a machine language instruction sequence corresponding to a function appearing in the above source program may be stored in the read-only memory 103 as a basic input / output routine (BIOS) 133.

Further, when the control processor 101 compiles into a machine language instruction sequence that can be directly executed, reproduction cannot be performed if the type of the control processor 101 is different.
To solve this problem, for example, it may be compiled into byte code of a Java virtual machine. In this case, it is necessary to prepare software called a bytecode interpreter or a just-in-time compiler on the video reproducing apparatus 100 side, and the software is called a read-only memory 10.
The third Java execution environment area 132 may be provided.

The character string to be displayed may be different in the type of language to be used depending on the video software. Therefore, the character code is represented by 16 bits or 32 bits, for example, as employed in the Java language.

The function prepared on the video reproducing apparatus 100 side, such as put_string (), processes only outline fonts, for example.
Read the outline font from, and as shown in FIG.
Shared library data area 123 in main memory 103
It is desirable to store it in

In the case of the above program, as described above, the contents of the function are prepared in the read-only memory 103, so that the size of the executable program after compilation is about 100 bytes including the header. is there.

At this time, since the sector length of the DVD is about 2 Kbytes, one unit video reproduction control program Pi is recorded in one sector. Also, in this embodiment,
The description is continued assuming that the length (the number of sectors) of the corresponding unit video is stored in the header portion (not shown).

As shown in FIG. 5, the DVD reproduction program 131 initializes the video RAM-B 107, that is, sets all RGB values of each pixel to zero and initializes the main memory 102. In addition, the value of a variable, which is a current sector number and is secured in the main memory 102, is set to 0
(Step 501 in FIG. 5).

The current sector number is stored in the DVD reading device 104
Used to hold the sector number read from the.
By allocating the current sector number to a fixed address in the shared library data area 122 of the main memory 102, the unit video reproduction control program can refer to or change the value. When the user selects an item among the above, the unit video reproduction control program writes the sector number corresponding to the selected item in the current sector number, so that reproduction can be started from that sector number.

Next, the DVD playback program 131 instructs the DVD reading device 104 to store the unit video playback control program in the program command area of the main memory (step 502 in FIG. 5), and waits for the end (FIG. 5). Step 503). Then, the current sector number is advanced by one. (Step 504 in FIG. 5).

Next, the DVD reproduction program 131 instructs the DVD reading device 104, the video signal expansion circuit 105, and the video signal synthesis circuit 108 to reproduce the unit video. As a result, reproduction of the unit video starts. However, the current sector number is given to the DVD reading device 104 as the read start position, and the number of read sectors is the number of sectors of the unit video previously stored in the header portion of the unit video playback control program, Is read from the main memory 102 and given.

Next, the DVD reproduction program 131 starts executing the unit video reproduction control program already stored in the program command area of the main memory 102 (steps 502 and 503 in FIG. 5).

As a result, the reproduction process of the unit video using the DVD reading device 104, the video signal expansion circuit 105, and the video RAM-A 106, the control processor 101, the main memory 102, the read only memory 103, and the video RA
Subtitle display processing using the MB 107 progresses simultaneously,
The video signal generation circuit 108 outputs the synthesized signal as a video signal. Also, audio included in the unit video is used.

Next, the DVD reproducing process will be described along the time axis with reference to FIG. First, the unit video reproduction control program P1 is read from the DVD reading device 104, and during this time, the control processor 101 waits for the end.

Next, the execution of the unit video reproduction control program P1, the reading of the unit video F1 from the DVD reader 104, and the decoding processing by the video signal expansion circuit 105 are executed in parallel.

Here, the unit video reproduction control program P1
Is created so as to return to the playback control program 121 before the playback of the unit video F1 is completely completed.
The unit video reproduction control program P2 can be read from the DVD reader 104 in a state where the reading of the unit video F1 from the DVD reader 104 has been completed but the decoding by the video signal decompression circuit 105 has not been completed yet. . This is reading of one sector, and is completed in about 10 milliseconds since it is recorded immediately after the unit video F1 reproduced immediately before.

Therefore, the following equation (1) is stored in the video signal decompression circuit 105.
By providing a bit stream buffer for 0 milliseconds, continuous video can be reproduced.
As described above, according to the embodiment of the present invention, by dividing a video into unit videos and controlling using a unit video playback control program, subtitles can be played back along with playback of the video.

As described above, by generating subtitles by a program, selection of whether or not to display as subtitles, selection of language (Japanese or Korean, etc.), character size (for low vision users), etc. are used. Will be able to choose freely.

In addition to normal subtitles, it is also possible to display sound effects by characters for the hearing impaired. In the case of reproducing a video at a higher speed than usual, it is also possible to delay the timing of turning off the display of subtitles. Thereby, the contents of the conversation can be more easily understood.

In addition, a unit video reproduction control program Pi for generating character information, which has control information of a standard information system, is interposed in the gap between the unit video Fi-1 and Fi of the continuous data stream. This makes it easy to develop and verify programs, and enables recording and playback of video information, including highly customizable text information with scalable playback functions, and further converts a series of data stream images into unit images. By controlling the video and text information using a unit video reproduction control program using a divided and open standard language or the like, text information such as subtitles can be reproduced in accordance with the video reproduction.

Further, before reproducing the unit video Fi, the unit video reproduction control program Pi is reproduced by the above-described video information reproducing and displaying method and the recording medium on which the video information is recorded.
Is stored in the main memory. Thereafter, the unit video playback control program Pi reads the unit video Fi from the recording medium and reproduces the video signal.
Since a character string is output in accordance with the progress of the reproduction of i and the video signals are synthesized and output, the unit video reproduction control program Pi outputs the subtitle of the movie as a character string (for example, a movie without dubbing, A descriptive sentence (for example, for the hearing impaired, etc.) added to an image of a work of art, a lyrics of a popular song can be easily recorded and reproduced on a plate. At this time, since each instruction which is a component of the unit video reproduction control program Pi is a transfer instruction of numerical data, an arithmetic instruction of two numerical data, a comparison instruction, and the like, a program of the control processor which correctly executes the instructions. Development burden is reduced. Also, the video creator
For example, using a high-level programming language such as C language, a source program of a unit video reproduction control program Pi that outputs a character string according to the progress of the unit video Fi is created, and the source program is compiled by a C language compiler or the like, and the control processor is created. It is possible to develop an object program Pi that can be executed, so that it is possible to finely control the composite display of a character string on a video.

At this time, the method of reproducing and displaying the video information and the program code (Pi) of the unit video reproduction control program Pi in the recording medium on which the video information is recorded are used.
Can be specified without depending on the type of the control processor, so that the program code can be executed by the interpreter. As a result, there is no restriction on the model of the control processor, and a system can be easily constructed with a general-purpose device configuration.

Further, at least two program codes (Pi) and (P
By storing the shared program commonly used from j) in an area different from each program code in the main memory, the subtitle font and the output function of the character using it are used as the shared program. In addition, the size of each program code (Pi) is reduced, and the load time of the unit video reproduction control program can be reduced.

Further, at least two program codes (Pi) and (P
j) has a common data area on the main memory and allows the user to refer to the changed data on the one hand, thereby allowing the user to make some choices in one program code and in the other program code Reproduction and display corresponding to this is possible.

Further, at least one program code (Pi) is provided with a function for allowing a user to make a selection regarding the order of video reproduction, and at least one other program code (Pj) is provided with the program code (Pi).
Allows the user to freely determine the order of playback and display by providing the unit video playback control program and the function to determine the set of unit video for the next playback and display according to the content selected by the user. Since it is possible to realize a multi-story in which a user can select a story during playback of a video using a general menu and a video being played, for example, in the case of a language teaching material, a conversation between two people in a scene of a conversation between two people Functions such as deciding whether or not to practice can be realized.

When the reproduction display speed of the unit video Fi is higher than the standard reproduction speed in at least one program code (Pi), the timing of erasing the character information being displayed is made later than in the case of the standard reproduction speed. By providing the function of performing the fast forward reproduction, the characters of the subtitles are displayed longer in the case of fast forward reproduction, so that it is possible to realize a function that makes it easy to grasp the coarse line.

Further, at least one program code (Pi) is provided with a function of allowing a user to select the type of language used for subtitles, and at least one other program code (Pj) is provided with a unit video reproduction control program. By providing a function of displaying subtitles according to the content selected by the user, the user can arbitrarily select the type of language used for subtitles for the user.

Also, at least one program code (Pi) has a function of allowing a user to select the size of characters to be displayed as subtitles, and at least one other program code (Pj) has a unit video reproduction control program. With the function to display subtitles according to the content selected by the user, the user can select the size and font of the character to be displayed as subtitles, and if the user has visual impairment or does not need subtitles An effective character information reproducing function can be realized.

Also, by providing at least one program code (Pi) with a function of displaying a graphics screen for allowing the user to make a selection on an image in an overlay manner, as in the case of subtitles, The screen can correspond to various types of screens.

In this embodiment, the recording medium is D
Although VD is taken as an example, the present invention is not limited to this.
It is needless to say that the present invention can be applied to other recording media such as a D-ROM and a PD (phase change magneto-optical disk).

[0098]

As described above in detail, according to the present invention, the control information of a standard information system facilitates the development and verification of a program, and the expandability of the reproduction function enables the customization. And a method for reproducing and displaying video information and a recording medium on which video information is recorded, which enables recording and reproduction of video information including character information having a high degree of quality.

Further, according to the present invention, it is possible to provide a method for reproducing and displaying video information and a recording medium on which the video information is recorded, which can finely control the display of a character string on a video. Further, according to the present invention, it is possible to provide a method for reproducing and displaying video information that handles character information and a recording medium on which the video information is recorded, with the versatility improved by eliminating the restrictions on the model of the control processor.

According to the present invention, the size of the unit video reproduction control program can be reduced by making the subtitle character font and the output function of the character using the same into a shared program, thereby reducing the size of the unit video reproduction control program. It is possible to provide a method for reproducing and displaying video information and a recording medium on which video information is recorded, in which the load time can be shortened and the processing can be simplified and speeded up.

Further, according to the present invention, one of the program codes of the unit video reproduction control program allows the user to perform some selection operation, and the other program code enables reproduction and display according to the operation. And a recording medium on which video information is recorded.

Further, according to the present invention, the order of reproduction and display by the user can be arbitrarily determined, and a multi-story where the user selects a story during the reproduction of a video using a general menu and the reproduction of a video. And a recording medium on which the video information is recorded.

Further, according to the present invention, in the case of fast-forward playback, a subtitle character is made longer so that coarse lines can be easily grasped by using a unit video playback control program using a generally open standard language or the like. A method for reproducing and displaying video information that can be displayed and a recording medium on which the video information is recorded can be provided.

Further, according to the present invention, subtitles of various languages can be held as data of a unit video reproduction control program using a generally open standard language and the like, and a language used by a user for subtitles can be stored. A method for reproducing and displaying video information and a recording medium on which the video information is recorded can be provided.

Further, according to the present invention, reproduction of video information which allows a user to arbitrarily select the size and font of characters to be displayed as subtitles by a unit video reproduction control program using a generally open standard language or the like. A display method and a recording medium on which video information is recorded can be provided.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a hardware configuration of a video playback device according to an embodiment of the present invention.

FIG. 2 is a flowchart showing a processing procedure of the embodiment. Programs included in read-only memory

FIG. 3 is a configuration of a main memory.

FIG. 4 is a flowchart of a power-on initialization program.

FIG. 5 is a flowchart of a DVD reproduction program.

FIG. 6 shows a unit image of a DVD and a unit image control program.

FIG. 7 is a time chart at the time of reproducing a DVD.

[Explanation of symbols]

REFERENCE SIGNS LIST 100 video reproduction device 101 control processor 102 main memory 103 read-only memory (ROM) 104 DVD reading device 105 video signal decompression circuit 106 video RAM-A 107 video RAM- B, 108: video signal generation circuit, 109: real time clock, 110: infrared light receiving circuit, 111: bus, 112: image signal line, 113: audio signal line, 120: program instruction area, 121: program data area, 122: Shared library instruction area, 123: shared library data area, 130: power-on initialization program, 131: DVD playback program, 132: Java execution environment (bytecode interpreter), 133: basic input / output routine (BIOS), 200: TV monitor.

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁶ Identification code FI H04N 5/781 H04N 5/93 Z 5/93

Claims (32)

[Claims] 1. A processor for executing a unit video reproduction control program, a random access memory used by the processor, and a unit video Fi of a continuous data stream.
-1 and a reading device for a video information recording medium in which a unit video reproduction control program Pi for generating character information in a gap portion of Fi is provided, and character information is generated based on information contained in the unit video reproduction control program. A unit video restoring circuit for generating and outputting an image, a graphic memory provided for outputting character information by a unit video reproduction control program, and a signal combining unit for combining an output signal of the unit video restoring circuit and an output signal of the graphic memory. A video reproducing method used in a video reproducing apparatus comprising: a unit video reproducing control program Pi for reading and reproducing a unit video Fi from the recording medium when reproducing and displaying a unit video Fi; A process of generating a video signal based on the unit video Fi read from the storage medium, The character information generation process executed by the unit video reproduction control program Pi stored in the random access memory is executed in parallel, and the video signal generated in the video signal generation process and the character information generation process are generated in the character information generation process. A video signal to be reproduced and displayed on a video reproducing apparatus. 2. The data for generating character information possessed by the unit video reproduction control program includes at least a numerical data transfer instruction, an arithmetic instruction of two numerical data, or a command set such as a comparison instruction or a conditional branch instruction. 2. The method for reproducing and displaying video information according to claim 1, wherein the method includes: 3. The reproduction and display of video information according to claim 1, wherein the unit video is obtained by dividing a series of data streams of a moving image or a still image into one or more scenes each having a frame as a minimum unit. Method. 4. An instruction constituting a program code (Pi) of the unit video reproduction control program Pi has a specification independent of a type of a control processor, and execution of the program code is performed by an interpreter. Item 4. A method for reproducing and displaying video information according to Item 1, 2 or 3. 5. At least two program codes (Pi) and (Pj) constituting a unit video reproduction control program
5. The method for reproducing and displaying video information according to claim 1, wherein the common program Pcom is stored in an area different from each program code in the main memory. 6. At least two program codes (Pi) and (Pj) constituting a unit video reproduction control program
6. The video information reproducing / displaying method according to claim 1, wherein a common data area is provided on a main memory, and data changed on one side can be referred to on another side. 7. At least one program code (P
i) has a function for allowing the user to make a selection regarding the playback order of the video, and at least one other program code (Pj) is used in accordance with the content selected by the user according to the program code (Pi). 7. A method for reproducing and displaying video information according to claim 1, wherein a set of a unit video reproduction control program and a unit video to be reproduced and displayed is determined. 8. At least one program code (P
3. The method according to claim 1, wherein when the reproduction display speed of the unit video Fi is higher than the standard reproduction speed, the timing of erasing the character information being displayed is made later than in the case of the standard reproduction speed. Or a method for reproducing and displaying the video information described in 3 or 4 or 5 or 6 or 7. 9. At least one program code (P
i) has a function of allowing the user to select the type of language to be used for subtitles, and at least one other program code (Pj) displays subtitles according to the content selected by the user by the unit video reproduction control program. 7. The method according to claim 1, wherein
Or a method for reproducing and displaying video information described in 7 or 8. 10. The at least one program code (Pi) has a function of allowing a user to select a size of a character to be displayed as a caption, and at least one other program code (Pj) includes a unit video reproduction control. 10. The method for reproducing and displaying video information according to claim 1, wherein subtitles are displayed according to contents selected by a user by a program. 11. The display according to claim 1, wherein the at least one program code (Pi) displays a graphics screen for allowing the user to make a selection on the video in an overlay. Or 5 or 6
Or a method for reproducing and displaying the video information described in 7 or 8 or 9 or 10. 12. A video information based on a series of data streams that are continuously reproduced is converted into a unit video Fi (i) having a predetermined information amount.
= 1 N), and a unit video reproduction control program Pi for generating character information is interposed in the gap between the unit videos Fi-1 and Fi, and a series of data streams based on a combination of these is recorded. When the reproduction of the unit video Fi proceeds to a predetermined point, the unit video reproduction control program Pi includes information including a program for realizing a function of generating character information based on information contained in the program. Recording media for video information that has recorded thereon. 13. Data for generating character information possessed by a unit video reproduction control program includes at least one of a transfer instruction of numerical data, an arithmetic instruction of two numerical data, and an instruction set such as a comparison instruction and a conditional branch instruction. 13. The recording medium for video information according to claim 12, wherein 14. The video information recording medium according to claim 12, wherein the unit video is obtained by dividing a series of data streams of a moving image or a still image into a size of one scene or a plurality of scenes using a frame as a minimum unit. . 15. At least two program codes (Pi) and (Pi) constituting a unit video reproduction control program.
15. The video information recording medium according to claim 12, wherein a common program Pcom used in common with j) is recorded. 16. At least two program codes (Pi), (P
16. The recording medium for video information according to claim 12, wherein j) has a common data area, and data changed on one side can be referred to on the other. 17. At least one program code (Pi) has a function of enabling a user to select a reproduction order of video, and at least one other program code (Pj) has a function of reproducing unit video. 17. The system according to claim 12, wherein a set of a unit video reproduction control program and a unit video to be reproduced and displayed next is determined according to the content selected by the user by the control program. Recording medium for the described video information. 18. The at least one program code (Pi) makes the timing of erasing character information being displayed slower than at the standard playback speed when the playback display speed of the unit video Fi is higher than the standard playback speed. 18. The video information recording medium according to claim 12, wherein the video information is recorded on a recording medium. 19. At least one program code (Pi) has a function for allowing a user to select a type of language to be used for subtitles, and at least one other program code (Pj) controls unit video reproduction. 19. The recording medium according to claim 12, wherein subtitles are displayed according to contents selected by a user by a program. 20. At least one program code (Pi) has a function of allowing a user to select a size of a character to be displayed as a caption, and at least one other program code (Pj) is a unit video reproduction control program. 20. The recording medium according to claim 12, wherein subtitles are displayed according to the content selected by the user. 21. The at least one program code (Pi) displays a graphics screen for allowing a user to make a selection on an image in an overlay. Or the recording medium according to 16 or 17 or 18 or 19 or 20. 22. A reproduction and display device for a video information recording medium, in which a unit video reproduction control program for generating character information in a gap between unit videos of a continuous data stream is provided, wherein the unit video information is read. Means for performing playback processing; means for reading the unit video playback control program, and generating character information based on information included in the unit video playback control program; and means for performing the playback processed video and the generated characters. Means for synthesizing information in association with each other. 23. A means for generating character information includes at least a numerical data transfer instruction, an arithmetic instruction of two numerical data, a comparison instruction or a condition for generating the character information of the unit video reproduction control program. 23. A device according to claim 22, further comprising means for processing any one of a command set such as a branch instruction.
The video playback device according to any one of the preceding claims. 24. A means for reproducing the unit video information, wherein a series of data streams of a moving image or a still image is divided into one or a plurality of scenes each having a frame as a minimum unit and reproduced. 24. The video playback device according to 22 or 23. 25. The means for generating character information includes an interpreter for executing a program code of a unit video reproduction control program.
5. The video reproducing device according to 4. 26. A means for generating character information includes a shared program Pcom commonly used from at least two program codes (Pi) and (Pj) constituting a unit video reproduction control program, as each program in the main memory. 26. The video reproducing apparatus according to claim 22, further comprising processing means for storing the code in an area different from the code. 27. A means for generating character information stores at least two program codes (Pi) and (Pj) constituting a unit video reproduction control program as a common data area on a main memory, and changes one of them. 27. The video reproducing apparatus according to claim 22, further comprising a processing means capable of referring to the other data on the other side. 28. A means for generating character information includes a processing means for allowing a user to select a reproduction order of a video by at least one program code (Pi), and at least one other program code (Pj). 25), comprising a unit video playback control program for next playback and display and a processing means for determining a set of unit videos in accordance with the content selected by the user with the program code (Pi). Or the video reproduction device according to 25, 26 or 27. 29. A means for generating character information includes: when at least one program code (Pi), the playback display speed of a unit video Fi is higher than a standard playback speed;
24. Control means for setting a timing for erasing the character information being displayed later than in the case of the standard reproduction speed.
Or the video reproduction device according to 24, 25, 26, 27, or 28. 30. A means for generating character information includes processing means for allowing a user to select the type of language used for subtitles by at least one program code (Pi), and at least one other program code (Pj). )
30. The video playback device according to claim 22, further comprising processing means for displaying subtitles in accordance with the content selected by the user in the unit video playback control program. 31. The means for generating character information includes means for allowing a user to select the size of characters to be displayed as subtitles using at least one program code (Pi), and at least one other program code. 23. A means for displaying subtitles according to the content selected by the user in the unit video reproduction control program by (Pj).
Or the video reproducing device according to 23, 24, 25, 26, 27, 28, 29, or 30. 32. The means for generating character information includes means for displaying, by at least one program code (Pi), a graphics screen for allowing a user to make a selection on an image in an overlay manner. 22 or 23 or 24 or 25 or 26 or 27 or 28 or 2
30. The video playback device according to 9 or 30, or 31.