JP2002094939A - Recording device and playback device - Google Patents

Abstract

(57) [Summary] (With correction) [PROBLEMS] To record a moving image with a high frame rate and make it playable by a reproducing device with a low frame rate. In a recording apparatus, when encoding image data captured by an image sensor that performs imaging at a high frame rate and recording the encoded image data on a recording medium, the image data having a high frame rate is actually encoded. As the frame rate information, information indicating a low frame rate is added to the encoded data. With the low frame rate information, the recorded image data can be slowly reproduced by another reproducing apparatus that supports only image data with a low frame rate.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a recording apparatus and a reproducing apparatus such as a camera-integrated recording apparatus and an image pickup apparatus, and more particularly to an apparatus for recording and reproducing an image having a high frame rate.

[0002]

2. Description of the Related Art DVD (Digita) is a large-capacity recording medium.
l DVD Specifications for Rewritable / Re-recorda
ble Discs Part3 Video Recording standard (hereinafter Video Rec
ording standard) has been standardized. For example, the apparatus described in the Technical Report of the Institute of Image Information and Television Engineers Vol. 23, No. 75, pp. 1 to 6 is a recording / reproducing apparatus conforming to the Video Recording standard, so-called DVD recorder. For recording devices
If the Video Recording standard is applied, the above recorders and P
It is possible to provide a recording device that is compatible with other devices conforming to the Video Recording standard such as the C drive.

[0003] The Video Recording standard uses MPEG (Moving Picture Expert Gr.) As a compression coding method for moving images.
oup) The standard is adopted. The MPEG standard has several subsets represented by Profile and Level as described in the Journal of the Institute of Television Engineers of Japan, Vol. 49, No. 4, pp. 431 to 434, and the Video Recording standard is MP @ ML (Mai
nProfile at Main Level). The upper limit of the frame rate that can be handled by MP @ ML is 30 Hz.

On the other hand, in a display apparatus for appreciating a moving image, a technique of interpolating and generating a video signal of a frame rate of 60 Hz from a video signal of a frame rate of 30 Hz and displaying the same is used. As a result, an effect of suppressing flickering of the screen and an effect of improving the sense of resolution can be obtained. In a recording apparatus, an image with a frame rate of 60 Hz has been able to be picked up by the progress of a CCD (Charge Coupled Device) manufacturing process and the like. Frame rate 60Hz
When the image data is recorded, the data amount becomes twice the frame rate of 30 Hz, so that the effect of improving the resolution and smoothness of motion, the effect of preventing blur during still reproduction, and the effect of improving the resolution can be obtained. Image data captured at a frame rate of 60 Hz is MP @ H which is a higher subset of MP @ ML.
14 (MainProfile at High-1440 Level) or MP ＠
It can be encoded using HL (Main Profile at High Level).

[0005] However, the Video Recording standard is M
Since only P @ ML is supported, frame rate 6
MP @ H14 or M
If encoding is performed using P @ HL, the data cannot be reproduced by a reproducing device such as a recorder that conforms to the Video Recording Standard, and compatibility is lost.

[0006]

SUMMARY OF THE INVENTION It is an object of the present invention to provide a reproducing apparatus which records image data having a high frame rate and which supports only image data having a low frame rate. It is an object of the present invention to provide a recording device that records image data so that the image data can be reproduced.

Another object of the present invention is to provide a reproducing apparatus for reproducing high frame rate image data recorded by the recording apparatus.

[0008]

Means for Solving the Problems In order to achieve the present invention, the following constitution is provided.

In a recording apparatus, when image data picked up by an image pickup device for picking up images at a high frame rate is encoded and recorded on a recording medium, image data having a high frame rate is actually encoded. As the rate information, information indicating a low frame rate is added to the encoded data. With the low frame rate information, the recorded image data can be slowly reproduced by another reproducing apparatus that supports only image data with a low frame rate.

When information depending on the time axis, such as effective coding bit rate information and virtual buffer delay information, is added to recorded data, reproduction is performed at a low frame rate and the time axis is extended. Means for adding the numerical value converted to the value is provided. This is to prevent the data from being lost in the consistency when the data is reproduced by another reproducing apparatus, thereby preventing the reproduction from being disrupted or stopped.

When recording with reference time information added thereto, a means for adding reference time information in accordance with the time axis when reproducing at a low frame rate is provided. this is,
This is to prevent the frequency of the reference clock generated from the reference time information from being deviated and the reproduction from being disrupted or stopped when reproduced by another reproducing apparatus.

When the reproduction time information indicating the presentation time and the decoding start time of the image is added to the recording data, means for adding the time on the time axis when the reproduction is performed at a low frame rate is provided. This is to prevent the presentation time and the decoding start time of the image and the sound from being shifted from each other and causing the reproduction to be disturbed or stopped when reproduced by another reproduction apparatus.

When audio data is multiplexed and recorded, an up-sampling means for increasing the number of audio data to be recorded is provided so that a desired audio sampling rate is obtained when reproduced at a low frame rate. . this is,
This is to ensure that sound is also reproduced when reproduced by another reproduction device.

Further, a means for converting the pitch of the sound to be recorded into a high sound and then recording the sound may be provided. this is,
This is to prevent a situation in which the time axis is extended and the voice is lowered to make it difficult to hear when played back by another playback device.

Next, in order to reproduce image data having a high frame rate at a high frame rate, the following configuration is adopted.

In the recording apparatus, there is provided means for inserting information for identifying a high frame rate into a management information recording area of a recording medium to be used or a user data storage field multiplexed with recording data.

Further, in the reproducing apparatus, there are provided means for detecting the identification information and means for decoding image data at a high frame rate when a high frame rate is detected. This is for reproducing at the same high frame rate as when recorded.

When decoding is performed using information that depends on the time axis, such as effective coding bit rate information and virtual buffer delay information, information added for a low frame rate is converted to a high frame rate. A means is provided which is used after being converted to the time axis. This is to prevent the reproduction data from being lost due to loss of consistency and from being disrupted or stopped.

When decoding using the reference time information, there is provided means for converting the reference time information added for the low frame rate into the time axis of the high frame rate and using the converted information. This is to prevent the reproduction clock from being disturbed or stopped due to the deviation of the frequency of the reference clock generated from the reference time information.

When decoding is performed using reproduction time information indicating the presentation time and the decoding start time of an image, the information represented by the time on the time axis at the time of reproduction at a low frame rate is converted to a high frame rate. Means for converting the time to the time on the time axis at the time of reproduction. This is to prevent the presentation time and the decoding start time of the image and the audio from being shifted and the reproduction from being disrupted or stopped.

When audio data is up-sampled and multiplexed, down-sampling means is provided to reduce the number of samples of reproduced audio data. This is to enable reproduction of audio data that has been upsampled for a low frame rate.

Further, if the sound pitch is converted and recorded, means for converting the height of the reproduced sound and returning it to the original height is provided. This is to restore the sound recorded at a higher pitch for a low frame rate to a normal sound.

[0023]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of the present invention will be described with reference to FIGS.

FIG. 2 is a circuit block diagram of a recording / reproducing apparatus integrated with a camera according to the present invention. The recording medium 201 is an optical disk such as a DVD-RW, a DVD-RAM, or the like.

The subject image obtained from the optical lens is CC
The camera signal processing unit 20 is converted into an electric signal by the D sensor 207.
8 and converted to Y, U, V signals,
Image enhancement is performed. Camera signal processing unit 2
08 generates a drive pulse necessary for the CCD sensor 207 and a synchronizing signal necessary for video output, and supplies them to each unit. An operation key 203 is an input means for operating the camera-integrated recording / reproducing apparatus. The camera control microcomputer 210 optimally controls the camera signal processing unit 208 based on the image information obtained from the state of the optical system and the CCD sensor and the information obtained from the operation of the entire apparatus. The LCD display panel 215 displays an input video and a reproduced image. Pickup unit 2
Numeral 02 denotes a recording / reproducing means for writing and reading signals to and from the recording medium 201, and includes a semiconductor laser and a lens. The digital video signal obtained from the camera signal processing unit 208 is
For example, in this example, MP data is
It is sent to the EG-2 codec section 217. MPEG-2
The codec unit 217 includes a memory unit 21 such as an SDRAM.
2 is used as a video memory, and the video of the camera signal processing unit 208 is developed and the moving image data is reduced to 1/1 according to the MPEG-2 standard.
Compress to about 0/1/60. The compressed video data is output to the system internal bus 205 according to a command from the system control microcomputer 213. On the other hand, although the audio signal is not shown, the signal obtained from the microphone built in the camera is A / D converted, and the system control microcomputer 2
13 is compressed by software processing, multiplexed with video data output by the MPEG-2 codec unit 217, and
A data stream is generated in accordance with the Video Recording Standard. This data stream is sent to a signal processing circuit 204 via a buffer RAM 206 for avoiding a writing error due to vibration or shock applied to the recording medium 201. The signal processing circuit 204 is a circuit in which a tracking, focus and DVD spindle servo circuit for DVD and a circuit for error correction at the time of data writing and reading are integrated. The data stream is provided with a correction code,
Digital modulation is performed by the read / write circuit 216, and the data is recorded on the recording medium 201 by the pickup unit 202. In the present embodiment, the signal processing circuit 204,
The read / write device 216 and the pickup unit correspond to the recording unit.

In the case of reproduction, data is read from the recording medium 201 in a state where the data is digitally modulated by the pickup unit 202, waveform equalization and servo signal detection are performed by the read / write circuit 216, and the signal processing circuit 204
The data stream is output to the system internal bus 205 as a data stream according to the Video Recording Standard. At this time, the buffer RAM 206 is also used. This data stream is separated into video data and audio data by the system control microcomputer 213, and the audio data is decoded by software processing and output from a speaker (not shown). The original video data is restored by the MPEG-2 codec unit 217 by an expansion operation, sent to the camera signal processing unit 208 as an 8-bit parallel signal and converted into an RGB signal by an 8-bit parallel signal. And is displayed on the LCD panel 215 as a reproduced image.
Similarly, since an NTSC video signal is output from the camera signal processing unit 208, it can be displayed on an external TV monitor from a video output terminal provided in the camera. Also,
The video and audio data can be transmitted to an external personal computer via the USB controller 218. In the present embodiment, the signal processing circuit 204, the read / write device 216, the pickup unit corresponds to a reading unit from a recording medium, the MPEG-2 codec unit 217 corresponds to a decoding circuit, and the camera signal processing circuit 208 corresponds to a reproducing unit.

FIG. 1 is an explanatory diagram of moving image data captured and reproduced by the camera-integrated recording / reproducing apparatus according to the present embodiment. In a), b), and c), the horizontal axis represents time, and one square represents one screen. In the present embodiment, two imaging modes called 60i and 60p are provided.
a) is moving image data obtained by the 60i imaging mode, and b) is moving image data obtained by the 60p imaging mode. Switching between 60i and 60p is performed by the operator selecting the operation key 203 by pressing it, the system control microcomputer 213 recognizes this, and switches the CCD drive by the camera signal processing unit 208 via the camera control microcomputer 210. .

The screen 101 and the screen 102 are two field images interlaced with each other. In the 60i imaging mode, two interlaced field images are alternately output from the camera signal processing unit 208 at approximately 1/60 second intervals. The frame rate is about 30 Hz.

The screen 103 is one frame image scanned sequentially. In the 60p imaging mode, one frame image sequentially scanned is output from the camera signal processing unit 208 at approximately 1/60 second intervals. Frame rate is about 6
0 Hz, which is output at twice the data rate of the 60i imaging mode. At this time, an instruction from the system control microcomputer 213 is received, and the MPEG-2 codec unit 2
17 performs the encoding process at twice the speed.

FIG. 1d) shows the encoding parameters in each imaging mode. In the present embodiment, even when encoding is performed at a frame rate of about 60 Hz, the information indicating the frame rate to be inserted into the encoded stream in accordance with the MPEG-2 standard is not a value indicating the frame rate of about 60 Hz, but a frame rate of about 60 Hz. It is characterized in that a value indicating 30 Hz is inserted. With this information, a frame rate of about 30
Hz on a playback device that only supports
It can be reproduced as in c). In FIG. 1c), 6
Since an image shot at 0 Hz is reproduced at 30 Hz, 1 /
Instead of reproducing and outputting one image every 60 seconds, 1 /
Since one image is reproduced every 30 seconds, the time for reproducing the image is doubled, but the inconvenience of the reproduction being disturbed or stopped due to the mismatch of the rate control information can be solved. Although FIG. C) shows a configuration in which frame images are displayed every 1/30 seconds, the frame images in FIG. B) are actually interlaced with each other every 1/60 seconds as in a). Split into two fields for display.

In the MPEG-2 codec 217, the bit rate and the virtual buffer delay (vbv_delay)
The frame time as a time reference when calculating the rate control information such as the above is not about 1/60 second but about 1/30 second. This prevents the reproduction from being disturbed or stopped due to inconsistency in the rate control information when reproduced as shown in c).

FIG. 3 is a diagram showing the structure of a data stream recorded on the recording medium 201. In accordance with the DVD Video Recording Standard, the data stream is a video pack 301 containing video data, an audio pack 302 containing audio data, and an RDI pack 30 containing related information.
3 are connected. One pack is composed of one pack header 304 and a plurality of PES packets 305. The SCR information 306 indicating the reference time is inserted into the pack header. PES indicating the presentation time of the image is added to the video PES packet together with the video data.
A TS 307 and a DTS 307 indicating a decoding start time are added.

The SCR information has a reference of 27 MHz during reproduction.
As compared with the clock count value, a PLL (Phase Lock Loop) is configured, so if there is a large deviation, there is a possibility that reproduction may be disturbed or stopped. In the present embodiment, as shown in FIG. 3B), a value counted at twice the frequency of 54 MHz in the 60p imaging mode is added to the SCR information. In this case, since the SCR advances at twice the speed of real time, when the time axis is doubled by reproduction as shown in FIG. 1c), the count value of the reference 27 MHz clock is matched.
Thereby, it is possible to prevent the reproduction from being disrupted or stopped. Also, since the PTS and DTS are used in comparison with the SCR value during reproduction, they are also counted and matched at twice the frequency of 54 MHz in the 60p imaging mode.

As described above, in the present embodiment, an image recorded at a frame rate of about 60 Hz can be reproduced by a reproducing apparatus that supports only a frame rate of about 30 Hz.

Next, a method for recording audio will be described with reference to FIG. FIG. 4 is a flowchart of the audio encoding process in the system control microcomputer 213. First, the imaging mode is determined (401), and in the case of the 60p imaging mode, the audio pitch is converted to a double-height audio (402), and the number of samplings is increased twice ( 403), and encode (404). In the case of the 60i imaging mode, encoding is performed as it is. By increasing the number of samplings by two times, the original sampling rate is obtained when reproduction is performed as shown in FIG. 1c), so that speech can be decoded normally. Also, by increasing the pitch twice, the original pitch will be obtained when reproduced as shown in FIG.
Voice is easy to hear.

Here, the recording area of the recording medium 201 will be described with reference to FIG. In FIG. 5, the management information area 5
Reference numeral 01 denotes an area for recording the contents, addresses, and the like of information recorded in the data recording area 502;
It is called AT area. A data recording area 502 is an area for recording a captured moving image, still image (one frame image), and audio. These areas 501 and 502 are generally often defined by standards.

FIG. 6 shows an example of data recorded in the data recording area 502. The thumbnail recording unit 605
Is a dedicated recording area for thumbnail images created in this embodiment. This area can be set to any area in the data recording area 502, but is preferably set to a dedicated area different from the captured video recording unit 606 in order to read out the thumbnail images at high speed. The thumbnail recording unit 605 includes a plurality of pieces of thumbnail information 601 and 602. The photographed video recording unit 606 records photographed moving images, still images, and sounds in chronological order.

FIG. 6B shows the details of the information included in the thumbnail information 601. The video ID 607 indicates which image the thumbnail is, and includes the identification number of the thumbnail (or the identification number of the moving image) and the storage address of the corresponding image (in the case of the thumbnail 601, the start address of the video data 603). It is. The title 608 is character information indicating the content of the thumbnail information, and is usually added by the operator at any time after the creation of the thumbnail. The thumbnail data is created by, for example, reducing an image (for example, a leading image) at a predetermined position of each recording scene and recording the image in a still image format (for example, a JPEG format). The related information stores, for example, the shooting date and time and the date and time when the thumbnail was created, in addition to the moving image / still image, the 60i imaging and the 60p imaging. Further, the different information of the 60i imaging and the 60p imaging may be written in an RDI pack which is a user data storage field in the recording data shown in FIG. In this manner, 6 is stored in the management information recording area of the recording medium or the user data storage field multiplexed on the recording data.
Since the other information of the 0i imaging and the 60p imaging is recorded, the frame rate information can be reduced by 30% using an apparatus capable of reproducing an image having a frame rate of about 60 Hz described below.
Original 60 Hz image recorded as 60 Hz
It can be reproduced at a frame rate of z.

Next, referring to FIG. 7 to FIG. 9, the image recorded according to the above embodiment is converted to a frame rate of about 60 Hz.
A method of reproducing an image using a device capable of reproducing the image will be described.

First, an operation of selecting a desired image from thumbnail images will be described with reference to FIG.

FIG. 7 shows a screen used to select a desired image after capturing images of a plurality of scenes.
It is displayed on the D panel 215. A plurality of thumbnail images 701 are displayed on the screen 700. Here, 12 thumbnails are displayed on one screen. At the upper left of each thumbnail, icons 702, 703, and 704 indicating the characteristics of the image corresponding to the thumbnail are displayed. The movie camera icon 702 indicates that the image corresponding to the thumbnail is a moving image, the icon 703 indicates that the image is a still image, and the note icon 704 indicates that the image is a still image to which sound is added. . “× 2” next to the icon 702
Is displayed as a moving image captured by 60p. The characteristics of the recorded data can be clearly understood by the content identification icons displayed superimposed on these thumbnails.

The scroll bar 705 indicates which of the thumbnail images of a plurality of pages is being displayed. The date and time 706 and the comment 707 are the comment of the time at which the selected thumbnail image (indicated by the selection frame 710) was recorded and the character attached to the image. The display changes each time the selection frame 710 moves. Reference numeral 708 denotes operation keys for moving the selection frame, and reference numeral 709 denotes a key for starting reproduction of an image corresponding to the selected thumbnail.

Next, the procedure for searching and displaying images using thumbnails will be described with reference to the flowchart of FIG. First,
When the thumbnail image list display is instructed by the operator, the management area of the recording medium is read (800), the recording area of the thumbnail image is recognized, and a desired number (for example, 12) of thumbnails are read (801). . The read thumbnails are displayed as a list as described with reference to FIG. 7 (802). Next, a desired thumbnail is selected by the operator using the operation keys (803), and an imaging mode is determined (804).

In the case of the 60i imaging mode, the storage position of the image corresponding to the thumbnail is recognized from the video ID 607 of the thumbnail, data reproduction is started from the storage position, and the MPEG-2 codec unit 217 operates at a normal speed. Decryption is performed (805). The reproduced moving image is as shown in FIG. The reproduction is continued until the moving image data ends (806).

In the case of the 60p imaging mode, the storage position of the image corresponding to the thumbnail is recognized from the video ID 607 of the thumbnail, data reproduction is started from the storage position, and the MPEG-2 codec unit 217 operates at twice the speed. (807) Note that whether or not the image has been shot in the 60p imaging mode is output at a frame rate of 60 Hz to the above-described management information recording area of the recording medium or the user data storage field multiplexed with the recording data. Information for identifying that the image data is obtained is recorded. When this information is read, encoding or the like is performed so that a moving image captured in the 60p mode is reproduced in the 60p mode. As shown in FIG. 1B), the reproduced moving image reproduces a frame image every 1/60 second. The reproduction is continued until the moving image data ends (808). As described above, according to the present embodiment, a moving image captured in the 60p mode is
It can be played back in p-mode.

Further, since the rate control information such as the bit rate and the virtual buffer delay (vbv_delay) is calculated in a frame time of about 1/30 second, when the image is reproduced in the 60p mode, the MPEG-2 codec 217 outputs the frame control information. The time is used after being converted to about 1/60 second. This prevents the reproduction from being disturbed or stopped due to inconsistency in the rate control information when the reproduction is performed as shown in b).

Further, as shown in FIG. 3B), in the 60p imaging mode, the SCR information is a value counted at twice the frequency of 54 MHz. Value). Thereby, it is possible to prevent the reproduction from being disrupted or stopped. Also, since the PTS and DTS are used in comparison with the SCR value at the time of reproduction, they are also used after being converted to 1/2 values in the 60p imaging mode.

Next, the speech encoding process will be described with reference to FIG. FIG. 9 shows the system control microcomputer 2
13 is a flowchart of a speech encoding process performed in the audio encoding process 13;
First, decoding is performed (901), and the imaging mode is determined (90).
2) In the case of the 60p imaging mode, the number of samples is １ ／
The sound pitch is converted to a half pitch (904). In the case of the 60i imaging mode, the decoding result is output as it is. By reducing the number of samplings by a factor of two, the original sampling rate is achieved, so that speech can be decoded normally. Also, by lowering the pitch by half, the original pitch is obtained, so that the voice can be easily heard.

[0049]

According to the present invention, it is possible to provide a recording apparatus which records image data having a high frame rate and can reproduce the image data even if the reproducing apparatus only supports image data having a low frame rate. .

Further, according to the present invention, it is possible to provide a reproducing apparatus for reproducing image data having a high frame rate recorded by the recording apparatus at a high frame rate.

[Brief description of the drawings]

FIG. 1 is an explanatory diagram of moving image data imaged and reproduced by a camera-integrated recording and reproducing device according to the present invention.

FIG. 2 is a circuit block diagram of a camera-integrated recording / reproducing apparatus according to the present invention.

FIG. 3 is a diagram showing a structure of a data stream to be recorded.

FIG. 4 is a flowchart of a speech encoding process.

FIG. 5 is an explanatory diagram of a recording area of a recording medium.

FIG. 6 is a view showing an example of data recorded in a data recording area 502.

FIG. 7 is a view showing a screen used to select a desired image.

FIG. 8 is a flowchart showing a procedure for searching and displaying images using thumbnails.

FIG. 9 is a flowchart of audio decoding processing.

[Explanation of symbols]

 101, 102: Field image 103: Frame image 207: CCD sensor 217: MPEG-2 codec 201: Recording medium

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 5/225 H04N 5/85 Z 5/85 5/92 H (72) Inventor Yukio Isobe Yokohama-shi, Kanagawa 292 Yoshida-cho, Totsuka-ku F-term (Reference) 5C022 AC01 AC42 AC69 5C052 AA03 AC01 CC11 5C053 FA24 GB06 GB37 HA01 HA21 JA01 JA21 JA26 KA04 KA24 KA26 LA01 LA06 LA14 5D044 AB05 AB07 BC06 DE39 DE44 DE49 DE53 EF05 FG18 GK03 GK12 5D110 AA16 AA17 AA27 AA29 DA04 DA06 DA17 DB03 DC05 DC16

Claims (14)

[Claims] An image pickup device for photoelectrically converting an optical image at a first frame rate and outputting an electric signal, an encoding circuit for encoding an electric signal output from the image pickup device, and the encoding circuit Recording means for recording the encoded data output from the imaging device on a recording medium, wherein the encoding circuit encodes the first signal when encoding the electric signal output from the image sensor at the first frame rate. A recording device for adding information indicating a second frame rate lower than the frame rate of the above to the encoded data. 2. The recording apparatus according to claim 1, wherein a first mode for outputting an electric signal from the image sensor at the first frame rate, and an electric signal from the image sensor at a second frame rate. Selecting means for selecting a second mode to be output, wherein the encoding circuit outputs a second frame to the encoded data when the first mode is selected and when the second mode is selected. A recording apparatus to which information indicating a rate is added. 3. The recording apparatus according to claim 1, wherein said encoding circuit converts an effective encoding bit rate of a numerical value converted from a state in which a time axis is extended from a first frame rate to a second frame rate. A recording apparatus for adding information, virtual buffer delay information, or information depending on a time axis to the encoded data. 4. The recording apparatus according to claim 1, wherein the encoding circuit adds reference time information adjusted to a time axis at the time of reproduction at a second frame rate to the encoded data. Recording device. 5. The recording apparatus according to claim 1, wherein said encoded data is added with reproduction time information indicating a presentation time or a decoding start time of an image on a time axis when reproduced at a second frame rate. A recording device characterized by the above-mentioned. 6. The recording apparatus according to claim 1, further comprising an up-sampling means for increasing the number of audio data samples to be recorded so as to have a desired audio sampling rate when reproduced at the second frame rate. A recording apparatus for multiplexing encoded data output and recorded at the second frame rate and audio data output and encoded by the upsampling means. 7. The recording apparatus according to claim 6, further comprising: means for changing a height of audio data to be recorded so that a desired audio height is obtained when reproduced at the second frame rate. A recording apparatus for multiplexing encoded data output and recorded at a second frame rate and audio data whose height has been changed. 8. A recording apparatus according to claim 1, wherein said recording means includes a management information recording area of said recording medium or a user data storage field multiplexed on recording data.
A recording apparatus for recording information for identifying that there is image data output at a first frame rate. 9. A means for reading coded data in which information indicating a second frame rate lower than the first frame rate is recorded as frame rate information on a recording medium;
A decoding circuit for decoding the read coded data; and a reproduction circuit for reproducing the data decoded by the decoding circuit, wherein the user multiplexes the data in the management information recording area or the recording data of the recording medium. The encoding circuit performs encoding at a first frame rate when information for identifying image data output at a first frame rate recorded in a data storage field is read. Playback device. 10. The reproducing apparatus according to claim 9, wherein the decoding circuit is configured to control the effective encoding bit rate information or virtual buffer delay information added for the second frame rate or the time axis. A decoding device that converts the information to be converted into a time axis of a first frame rate and decodes the converted information. 11. The reproducing apparatus according to claim 9, wherein the decoding circuit converts the reference time information added for the second frame rate into a time axis of the first frame rate for decoding. A reproducing apparatus characterized in that: 12. The reproducing apparatus according to claim 9, wherein said decoding circuit sets a presentation time or a decoding start time of an image represented by a time on a time axis when reproduced at a second frame rate. A reproduction apparatus, wherein the reproduction time information shown is converted to a time on a time axis at the time of reproduction at the first frame rate and decoded. 13. The reproducing apparatus according to claim 9, further comprising downsampling means for reducing the number of samples of the upsampled and multiplexed audio data. 14. A reproducing apparatus according to claim 9, further comprising means for converting the sound height to return to the original height when reproducing the sound data whose sound height has been changed. A reproducing apparatus characterized by the above-mentioned.