+

WO2018135258A1 - Dispositif de traitement d'informations, support d'enregistrement d'informations, procédé de traitement d'informations, et programme - Google Patents

Dispositif de traitement d'informations, support d'enregistrement d'informations, procédé de traitement d'informations, et programme Download PDF

Info

Publication number
WO2018135258A1
WO2018135258A1 PCT/JP2017/046703 JP2017046703W WO2018135258A1 WO 2018135258 A1 WO2018135258 A1 WO 2018135258A1 JP 2017046703 W JP2017046703 W JP 2017046703W WO 2018135258 A1 WO2018135258 A1 WO 2018135258A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
information
packet
file
clip
Prior art date
Application number
PCT/JP2017/046703
Other languages
English (en)
Japanese (ja)
Inventor
幸一 内村
伸一 竹田
Original Assignee
ソニー株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ソニー株式会社 filed Critical ソニー株式会社
Priority to JP2018563247A priority Critical patent/JP7070432B2/ja
Publication of WO2018135258A1 publication Critical patent/WO2018135258A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • G11B20/12—Formatting, e.g. arrangement of data block or words on the record carriers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H04N5/92—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N5/926—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback by pulse code modulation

Definitions

  • the present disclosure relates to an information processing device, an information recording medium, an information processing method, and a program. More specifically, an MMT (MPEG Media Transport) format data, which is being standardized as a future data transmission standard in broadcast waves, etc., is input, recorded on a medium, and can be played back.
  • MMT MPEG Media Transport
  • the present invention relates to a medium, an information processing method, and a program.
  • the MMT format is composed of encoded data that constitutes content such as images (Video), audio (Audio), and subtitles (Subtitles), control data, attribute data, and management information that are applied to content reception and playback processing, etc.
  • Control data SI: Signaling Information (signaling information)
  • a data transfer method transport format for transmitting via broadcast waves or a network.
  • the MMT format is scheduled to be used for broadcasting next-generation content such as 4K images and high dynamic range (HDR) images.
  • next-generation content such as 4K images and high dynamic range (HDR) images.
  • HDR high dynamic range
  • the MPEG-2TS format is often used as a transmission format for current images (Video), audio (Audio), subtitles (Subtitles), etc., or a data recording format for media.
  • BDMV and BDAV standards are widely used as recording / playback application standards (formats) compatible with the MPEG-2TS format.
  • BDMV and BDAV are data recording / playback application standards mainly using BD (Blu-ray (registered trademark) Disc), but these standards are not limited to BD, and other standards such as flash memory and HD are also used.
  • the present invention is also applicable to data recording / playback using media other than BD.
  • a data recording / playback processing configuration using BD is described in, for example, Japanese Patent Application Laid-Open No. 2011-023071.
  • BDMV is an application standard developed for BD-ROM in which, for example, movie content is recorded in advance, and is widely used mainly in non-rewritable BD-ROM such as package content.
  • BDAV is a standard developed for the purpose of applying to data recording / playback processing using a rewritable BD-RE type disc or a BD-R type disc that can be recorded only once.
  • BDAV is used, for example, for recording / reproducing video captured by a user with a video camera or the like and recording / reproducing television broadcast.
  • MMTP MMT Protocol
  • TLV Type Length Value
  • the MMTP packet and the TLV packet store reproduction data such as images, audio, subtitles, and various control information (SI: Signaling Information).
  • SI Signaling Information
  • MMTP packets and TLV packets that store content such as images, audio, and subtitles are recorded on recording media such as BD (Blu-ray (registered trademark) Disc), flash memory, and HD (hard disk).
  • BD Blu-ray (registered trademark) Disc
  • HD hard disk
  • the BDAV format defines database files such as playlist files and clip information files as playback control information files, and a BDAV compatible playback application performs data playback processing with reference to these playback control information files (database files). Execute. Therefore, it is necessary to perform reproduction processing on the MMT format data using the reproduction control information recorded in these playlist files and clip information files.
  • database files such as playlist files and clip information files defined in the BDAV format are originally defined as recording files for reproduction control information corresponding to MPEG-2TS format data. Therefore, when playing back MMT format data having a format different from the MPEG-2TS format, normal playback may not be possible if the playback control information recorded in the playlist file or clip information file defined in the current BDAV format is applied. There is sex.
  • the present disclosure has been made in view of the above-described problems, for example, to input distribution data according to the MMT format, record the data on a recording medium such as a BD, and reproduce the MMT format data from the recording medium. It is an object to provide an information processing apparatus, an information recording medium, an information processing method, and a program.
  • the first aspect of the present disclosure is: A data processing unit that inputs MMT (MPEG Media Transport) format data and generates recording data in accordance with the BDAV format, which is a data recording format for an information recording medium, or SPAV format;
  • the data processing unit A clip AV stream file composed of a TLV packet sequence storing MMT format data as reproduction data;
  • the information processing apparatus generates a reproduction control information file in which control information that enables acquisition of a specific TLV packet from the clip AV stream file is recorded.
  • the second aspect of the present disclosure is: A data processing unit for executing a reproduction process of recorded data of the information recording medium;
  • the information recording medium includes a clip AV stream file composed of a TLV packet sequence storing MMT (MPEG Media Transport) format data, and a playback control information file storing playback control information of the clip AV stream file in a BDAV format.
  • MMT MPEG Media Transport
  • the data processing unit In the data reproduction process using the clip AV stream file constituted by the TLV packet sequence, The information processing apparatus is configured to acquire reproduction target data from the TLV packet according to the recording information of the reproduction control information file and execute reproduction control.
  • the third aspect of the present disclosure is: A clip AV stream file composed of a TLV packet sequence storing MMT (MPEG Media Transport) format data; Having a playback control information file storing playback control information of the clip AV stream file as recorded data;
  • the reproduction control information file is IP data flow identification information for extracting a target packet from a TLV packet included in the clip AV stream file, and a packet identifier, Information having a data recording configuration in which a playback device that plays back the data stored in the clip AV stream file can acquire playback target data from the TLV packet sequence with reference to the IP data flow identification information and the packet identifier It is on a recording medium.
  • the fourth aspect of the present disclosure is: An information processing method executed in an information processing apparatus,
  • the information processing apparatus includes: A data processing unit that inputs MMT (MPEG Media Transport) format data and generates recording data in accordance with the BDAV format, which is a data recording format for an information recording medium, or SPAV format;
  • the data processing unit is A clip AV stream file composed of a TLV packet sequence storing MMT format data as reproduction data;
  • the present invention is an information processing method for generating a reproduction control information file in which control information that enables acquisition of a specific TLV packet from the clip AV stream file is recorded.
  • the fifth aspect of the present disclosure is: An information processing method executed in an information processing apparatus,
  • the information processing apparatus includes: A data processing unit for executing a reproduction process of recorded data of the information recording medium;
  • the information recording medium includes a clip AV stream file composed of a TLV packet sequence storing MMT (MPEG Media Transport) format data, and a playback control information file storing playback control information of the clip AV stream file in a BDAV format.
  • MMT MPEG Media Transport
  • the data processing unit is In the data reproduction process using the clip AV stream file constituted by the TLV packet sequence,
  • the reproduction control is performed by acquiring the reproduction target data from the TLV packet according to the recording information of the reproduction control information file.
  • the sixth aspect of the present disclosure is: A program for executing information processing in an information processing apparatus;
  • the information processing apparatus includes: A data processing unit that inputs MMT (MPEG Media Transport) format data and generates recording data in accordance with the BDAV format, which is a data recording format for an information recording medium, or SPAV format;
  • the program is stored in the data processing unit.
  • a clip AV stream file composed of a TLV packet sequence storing MMT format data as reproduction data;
  • the seventh aspect of the present disclosure is: A program for executing information processing in an information processing apparatus;
  • the information processing apparatus includes: A data processing unit for executing a reproduction process of recorded data of the information recording medium;
  • the information recording medium includes a clip AV stream file composed of a TLV packet sequence storing MMT (MPEG Media Transport) format data, and a playback control information file storing playback control information of the clip AV stream file in a BDAV format.
  • MMT MPEG Media Transport
  • the program is stored in the data processing unit.
  • the data reproduction process using the clip AV stream file constituted by the TLV packet sequence According to the recording information of the reproduction control information file, there is a program for acquiring reproduction target data from a TLV packet and executing reproduction control.
  • the program of the present disclosure is a program that can be provided by, for example, a storage medium or a communication medium provided in a computer-readable format to an information processing apparatus or a computer system that can execute various program codes.
  • a program in a computer-readable format, processing corresponding to the program is realized on the information processing apparatus or the computer system.
  • system is a logical set configuration of a plurality of devices, and is not limited to one in which the devices of each configuration are in the same casing.
  • a configuration in which MMT format data can be recorded on a medium as BDAV or SPAV format data and played back is realized.
  • a stream file composed of a TLV packet sequence storing MMT format data and a playback control information file are generated and recorded on a medium.
  • the IP data flow identification information and the packet identifier are recorded together.
  • the IP data flow identification information uses data including a source IP address or the like, or a CID recorded in a compressed IP header.
  • a specific IP data flow is selected based on the IP data flow identification information, and a single packet with a packet identifier set can be selected from a group of packets belonging to the selected flow.
  • a configuration is realized in which MMT format data can be recorded on a medium as BDAV or SPAV format data and played back. Note that the effects described in the present specification are merely examples and are not limited, and may have additional effects.
  • media information recording medium
  • FIG. It is a figure explaining the example of a process recorded on an information recording medium (media) as a TLV packet sequence which stored the MMTP packet which is MMT format data for the reception data from a broadcasting station etc.
  • FIG. It is a figure explaining the example of a process in the case of recording MMT format data as BDAV format data. It is a figure explaining the data structure of a play list file. It is a figure explaining EP map. It is a figure explaining EP map. It is a figure explaining EP map. It is a figure explaining EP map. It is a figure explaining the CPI type recording data of a play list file. It is a figure explaining the data structure of the play item of a play list file. It is a figure explaining the play item recording data of a play list file.
  • MPT MMT package table
  • FIG. 25 is a diagram for describing a configuration example of an information processing apparatus that executes data recording processing on an information recording medium (media). It is a figure which shows the flowchart explaining the process sequence of the data recording process with respect to an information recording medium (media). It is a figure which shows the flowchart explaining the process sequence of the data recording process with respect to an information recording medium (media). It is a figure which shows the flowchart explaining the process sequence of the data recording process with respect to an information recording medium (media).
  • FIG. 25 is a diagram for describing a configuration example of an information processing apparatus that executes data reproduction processing from an information recording medium (media). It is a figure which shows the flowchart explaining the process sequence of the data reproduction process from an information recording medium (media). It is a figure which shows the flowchart explaining the process sequence of the data reproduction process from an information recording medium (media). It is a figure explaining the hardware structural example of the information processing apparatus applied to the process of this indication.
  • FIG. 1 An example of a communication system, which is an example of a usage configuration of an information processing apparatus that executes the processing of the present disclosure, will be described with reference to FIG.
  • the information processing apparatus 30 shown in FIG. 1 is loaded with media such as a BD (Blu-ray (registered trademark) Disc), flash memory, and hard disk (HDD), and performs data recording processing for these mounted media, The data reproduction process is executed.
  • media such as a BD (Blu-ray (registered trademark) Disc), flash memory, and hard disk (HDD)
  • the data recorded on the medium by the information processing apparatus 30 is transmission content provided by the transmission apparatus 20 such as the broadcast station (broadcast server) 21 or the data distribution server 22, for example. Specifically, it is a broadcast program provided by a television station. These transmission contents are transmitted from the transmission device 20 to the information processing device 30 via a broadcast wave or a network such as the Internet.
  • the information processing device 30 is, for example, a BD player 31, a television 32, a PC 33, a portable terminal 34, etc.
  • These information processing devices are, for example, a BD (Blu-ray (registered trademark) Disc) 41, an HDD (hard disk) 42, and the like.
  • Various media such as the flash memory 43 are mounted, and data recording processing and data reproduction processing from these media are executed.
  • MMT MPEG Media Transport
  • the MMT format is a data transfer method (transport format) for transmitting encoded data, which is content configuration data, such as images (Video), audio (Audio), subtitles (Subtitles), etc., via a broadcast wave or a network. It is specified.
  • the transmission apparatus 20 encodes the content data, generates a data file including the encoded data and the metadata of the encoded data, and stores the generated encoded data in an MMTP (MMT Protocol) packet defined in the MMT. Transmit via broadcast wave or network.
  • MMT Protocol MMT Protocol
  • the data provided to the information processing device 30 by the transmission device 20 is control configured by various management information such as guide information such as program guides, notification information, and control messages in addition to reproduction target data such as images, sounds, and captions.
  • Information SI: Signaling Information (signaling information)).
  • MMT MPEG Media Transport format
  • FIG. 2 is a diagram showing a stack model in the MMT format.
  • a physical layer PHY
  • the physical layer is divided into a broadcast layer that performs broadcast processing and a broadband layer that performs network processing.
  • the MMT enables processing using two communication networks, a broadcast system and a network system.
  • TLV Type Length Value
  • PHY physical layer
  • TLV is a format defining layer that defines a multiplexing method for IP packets. A plurality of IP packets are multiplexed and transmitted as TLV packets.
  • TLV-SI is a transmission layer of control information (SI) such as control messages according to the TLV format.
  • the control information (SI) is configured by setting information necessary for receiving and playing back content (program) on the information processing apparatus 30 side, guide information such as a program guide, notification information, control information, and management information. .
  • the control information (SI) stored in the TLV packet generated by the TLV layer is TLV-SI, which is mainly composed of control information related to reception processing.
  • Control information (SI) stored in the MMTP packet which is a packet generated according to the MMT protocol (MMTP), is MMT-SI shown in the highest layer, and is mainly composed of control information related to playback control.
  • a UDP / IP layer is set on the TLV layer.
  • the UDP / IP layer can be divided into an IP layer and a UDP layer in detail, but is a layer that defines transmission for storing a UDP packet in the payload of the IP packet.
  • An MMT layer and a File delivery method layer are set on the UDP / IP layer. The setting is such that the MMTP packet is stored in an IP packet and transmitted, and the method of transmitting data as an IP packet using the File delivery method, which is a data transmission method that does not use an MMTP packet, can be used together.
  • Image (Video) data that is encoded image data in accordance with HEVC (High Efficiency Video Coding), which is an image encoding standard
  • Audio data that is encoded audio data in accordance with AAC (Advanced Audio Coding) that is an audio encoding standard
  • Subtitle data that is encoded subtitle data in accordance with TTML (Timed Text Markup Language) that is a subtitle encoding standard
  • Control information MMT-SI
  • HTML5 Hyper Text Markup Language 5
  • the control information is control information (signaling information) transmitted in an MMTP packet, such as setting information necessary for reproducing content (program) on the information processing device 30 side, program guide, etc. It consists of various management information such as guidance information, notification information, and control information.
  • time information is absolute time information and is directly stored in a UDP packet and transmitted.
  • Other data services for data distribution can be distributed using a file distribution method (File delivery method) different from MMT.
  • control information MMT-SI
  • applications composed of various management information such as images, voices, subtitles, various notification information and control information, and the like are transmitted by MMTP packets.
  • FIG. 3 shows the following four types of data configuration examples.
  • A MPU (Media Presentation Unit)
  • B MMTP payroto
  • c MMTP packet
  • d TLV packet
  • a TLV packet is a packet transmitted via a broadcast wave or a network, and each header information of a UDP header, an IP header, and a TLV header is set in the TLV packet.
  • the TLV packet is set as an individual packet for each data type.
  • one type of data is stored in the TLV payload of one TLV packet.
  • image (V), audio (A), caption (S), or control information (SI) including various management information is individually stored.
  • Control information (SI) includes control information (MMT-SI) stored in the MMTP packet and control information (TLV-SI) transmitted in the TLV packet, which are stored in different individual TLV packets. .
  • TLV payload that is the payload of the TLV packet is the MMTP packet shown in FIG. 3C is the MMTP packet shown in FIG. 3C .
  • the MMTP packet shown in FIG. 3C includes an MMTP header and an MMTP payload.
  • One type of data is stored in the MMTP payload of one MMTP packet. Specifically, for example, image (V), audio (A), caption (S), control information (MMT-SI) stored in the MMTP packet, and any one of these data is an individual MMTP packet.
  • FIGS. 3A and 3B show the detailed configuration of image data stored in the MMTP payload of the MMTP packet shown in FIG.
  • FIG. 3B shows only the MMTP payload shown in FIG. 3C selected with the MMTP payload being image data (V).
  • the MMTP payload shown in FIG. 3B is composed of a header and a data unit.
  • the data unit stores image data and the following various parameters.
  • AU Delimiter Access Unit Delimiter
  • SPS Sequence Parameter Set
  • PPS Physical Parameter Set
  • SEIs Supplemental Enhancement Information
  • the MPU (Media Presentation Unit) shown in FIG. 3A is one data processing unit of reproduction target data such as images, sounds, and captions in the MMT format.
  • the example shown in FIG. 3A is an example of an MPU of image data, and is the same unit as a GOP (Group of Pictures) as a so-called encoding / decoding processing unit.
  • the image data is divided into parameters and image configuration data defined in the MMT format, stored in the MMTP payload shown in FIG. It is configured as an MMTP packet shown in c). Furthermore, the MMTP packet is set as the payload of the TLV packet shown in FIG. 3D, and the TLV packet is transmitted via a broadcast wave or a network.
  • MMTP packets and TLV packets in units of data types are also set and transmitted for each data such as voice and caption, and each MMT-SI data.
  • the TLV-SI is stored in the TLV packet without being stored in the MMTP packet and transmitted.
  • BDAV which is a recording data format in the case of recording and reproducing the distribution content in accordance with the above MMT format on, for example, a BD (Blu-ray (registered trademark) Disc), flash memory, or HD (hard disk or other media)
  • BD Blu-ray (registered trademark) Disc
  • HD hard disk or other media
  • BD Blu-ray (registered trademark) Disc
  • flash memory flash memory
  • HD Blu-ray (registered trademark) Disc
  • playback control information for performing playback processing of these content And index information is required.
  • the reproduction control information and index information are generally called a database file. These playback control information and index information differ depending on the playback application that executes the playback processing of the recording data of the media.
  • BDMV and BDAV standards data recording formats
  • data recording formats data recording formats
  • application standards are established as data recording / reproducing application standards mainly using BD (Blu-ray (registered trademark) Disc).
  • BDMV and BDAV are data recording / playback application standards mainly using BDs, and are data recording formats (standards), but these standards are not limited to BDs, but other BDs such as flash memories.
  • the present invention can also be applied to data recording / playback using media.
  • BDMV is an application standard developed for BD-ROM in which, for example, movie content is recorded in advance, and is widely used mainly in non-rewritable BD-ROM such as package content.
  • BDAV is a standard developed for the purpose of applying to data recording / playback processing using a rewritable BD-RE type disc or a BD-R type disc that can be recorded only once.
  • BDAV is used, for example, for recording / reproducing video captured by a user with a video camera or the like and recording / reproducing television broadcast.
  • the BDAV format defines playlist files, clip information files, and the like as recording files for playback control information, and the BDAV compatible playback application uses the recording information of these playback control information files (database files).
  • the data reproduction process is executed using the data.
  • FIG. 4 is a diagram showing an example of a directory structure of data recorded on the information recording medium (medium) 40 in accordance with the BDAV format. As shown in FIG. 4, various management information, reproduction control information, and reproduction target data storage files are set in the directory.
  • the management information file includes, for example, an info file (info), a menu file (menu), a mark file (mark), and the like shown in FIG. These store mainly title management information to be shown to the user. Also, as a playback control information file, Playlist file (playlist), Clip information file (clipinf) For example, these files are recorded. Further, a clip AV stream file (stream) is recorded as a reproduction data storage file.
  • the playlist file is a file that defines the playback order of contents in accordance with the program information of the playback program specified by the title.
  • the playlist file includes specification information of a clip information file that records playback position information and the like.
  • the clip information file is a file specified by the playlist file, and has reproduction position information of the clip AV stream file.
  • the clip AV stream file is a file storing AV stream data to be reproduced and management information.
  • a clip AV stream file is composed of a packet storing management data, each piece of data such as an image, audio, and caption to be reproduced.
  • management information defined in the MPEG-2TS format and recorded in a clip AV stream file for example, there is PSI / SI (Program Specific Information / Service Information).
  • MPEG-2TS format data composed of TS (Transport Stream) packets, but data including high-definition images such as 4K and 8K images in the future are described above. It is expected to be MMT format data composed of MMTP packets.
  • a stream file (nnnnn.m2ts) composed of MPEG-2 TS format data composed of TS packets
  • MMT format data (nnnnnn.mmtv) composed of MMTP packets
  • the discussion is progressing in the direction of recording a clip AV stream file when MMT format data is recorded on a medium as a packet sequence of packets storing data according to the MMT format. Specifically, the discussion is proceeding in the direction of recording as a packet string of an MMTP (MMT Protocol) packet or a TLV (Type Length Value) packet that is an upper packet of the MMTP packet. This specific example will be described in detail later.
  • MMT Protocol MMT Protocol
  • TLV Type Length Value
  • Management information file, playlist file, clip information file, and these data files are management information storage files applied to playback processing of images, audio, subtitles, and the like, which are playback data stored in the clip AV stream file. These are files that store reproduction control information, reproduction data attribute information, and the like, and are called database files.
  • the sequence for reproducing the content recorded on the information recording medium is as follows.
  • FIG. 5 shows the following data recorded on the information recording medium (medium) 40, that is, Playlist files, Clip information file, Clip AV stream file, It is a figure explaining the correspondence of these data.
  • An AV stream made up of reproduction target data such as images, sounds, and subtitles as actual reproduction target data is recorded as a clip AV stream (Clip AV Stream) file, and further, as management information and reproduction control information file of these AV streams.
  • a playlist (PlayList) file and a clip information (Clip Information) file are defined.
  • a playlist layer including a playlist (PlayList) file, A clip layer consisting of a clip AV stream (Clip AV Stream) file and a clip information (Clip Information) file, It can be divided into these two layers.
  • One clip AV stream (Clip AV Stream) file is associated with one clip information (Clip Information) file, and these pairs are considered as one object, and these are grouped into a clip (Clip) or a clip. Called a file.
  • Clip Information Detailed information of data included in the clip AV stream file, for example, management information such as an EP map in which I picture position information of MPEG data is recorded is recorded in the clip information file.
  • a clip AV stream file is composed of TS packets in the case of MPEG-2 TS format data. Further, in the case of MMT format data, it is composed of MMTP packets.
  • the clip information (Clip Information) file includes, for example, the data position of the byte sequence data of the clip AV stream file and the playback time position such as the playback start point (entry point: EP) when expanded on the time axis.
  • the playlist has information indicating an access point corresponding to a playback start position or playback end position of a clip (Clip) with a time stamp which is information on the time axis. For example, it is possible to acquire a data read position of a clip AV stream file, that is, an address as a playback start point by referring to the clip information file based on a time stamp indicating a playback time elapsed position from the start point of the content. Become.
  • the clip information file (Clip Information file) is used to find address information from which to start decoding the stream in the clip AV stream file from this time stamp.
  • a clip AV stream file that stores data to be played is composed of TS packets in the case of conventional MPEG-2 TS format data.
  • high-definition image data such as 4K and 8K images that are expected to be used in the future
  • MMT format data it is constituted by MMTP packets.
  • the MMT format and the MPEG-2TS format will be described with reference to FIGS.
  • the MPEG-2TS format stores encoded data and management information (PSI / SI), which are content configuration data, such as images (Video), audio (Audio), subtitles (Subtitles), etc. in a recording medium (media), broadcast waves,
  • PSI / SI content configuration data
  • This is a format that defines a data storage format (container format) for encoded data and the like for transmission over a network.
  • the MPEG-2TS format is a format standardized by ISO13818-1, and is used for data recording, digital broadcasting, and the like for BD (Blu-ray (registered trademark) Disc), for example.
  • FIGS. 6A to 6C are diagrams showing the structure of MPEG-2TS format data.
  • FIG. 6A shown at the bottom is a diagram showing the overall structure of MPEG-2TS format data.
  • the MPEG-2TS format data is composed of a plurality of elementary streams (Elementary streams).
  • An elementary stream is a unit that is set as one unit such as an image, sound, or caption.
  • PES Packetized Elementary stream
  • FIG. 7 the explanatory diagram of the MMT format shown in FIG. 7 is a diagram explaining the correspondence with the MPEG-2TS format described with reference to FIG. 6 in an easy-to-understand manner. is there.
  • the MMT format is a data transfer method for transmitting encoded data, which is content configuration data, such as an image (Video), audio (Audio), subtitle (Subtitle), etc., via a broadcast wave or a network.
  • content configuration data such as an image (Video), audio (Audio), subtitle (Subtitle), etc.
  • Transport format is specified.
  • FIG. 7 is a diagram for explaining the MMT format which is a file format defined in ISO / IEC 23008-1.
  • FIG. 7A to 7C show the structure of MMT format data.
  • FIG. 7A shown at the bottom is a diagram showing the overall configuration of MMT format data.
  • the MMT format data is composed of a plurality of media presentation units (MPUs).
  • MPU is a unit set as one unit, such as an image, an audio
  • 1 MPU corresponds to 1 GOP (Group of Picture) which is one MPEG compressed image unit.
  • Payload_type 0x0 (MPU)
  • Packet_id the same packet identifier
  • the MMTP packet has a variable length and can be set to various packet sizes.
  • Each MMTP packet includes a header (MMTP header) that stores attribute information and the like, and a payload (MMTP payload) that stores actual data of the encoded image and the like.
  • SPAV format As a format similar to the BDAV format.
  • BDMV and BDAV are data recording / playback application standards mainly using BD.
  • SPAV format is an application standard for data recording / playback mainly for hard disks.
  • both the BDAV format and the SPAV format are formats that can be used for recording and reproduction using various media such as BD, flash memory, and HD.
  • SPAV format data can be recorded / reproduced by a process similar to the data recording / reproduction process in the BDAV format.
  • the SPAV format is partially different from the BDAV format in the file name setting.
  • FIG. 8 shows a directory structure example of SPAV format.
  • the management information file includes, for example, an info file (INFO), a menu file (MENU), a mark file (MARK), and the like shown in FIG. These store mainly title management information to be shown to the user. Also, as a playback control information file, Playlist file (PLAYLIST), Clip information file (CLIPINF) For example, these files are recorded. Further, a clip AV stream file (STREAM) is recorded as a reproduction data storage file.
  • the setting of the directory name of SPAV format and the extension of each file is different from the BDAV format described with reference to FIG.
  • the data stored in each file and the role of each file are the same as in the BDAV format.
  • the MMT format is a data distribution format that will be used for 4K images and the like that are scheduled to be distributed by broadcasting stations and the like in the future, and is a format according to the protocol stack described with reference to FIG. is there.
  • the BDAV format is a data recording format for media, and as described with reference to FIG. 4, a database file including playback control information files such as a playlist file and a clip information file is defined.
  • the BDAV format is a data recording format and also supports a data recording / playback application standard. Data playback recorded on a medium according to the BDAV format is performed using a playback application compatible with the BDAV format.
  • the clip AV stream file [02001. set to the BDAV format shown in FIG. 4 or the SPAV format shown in FIG. mmtv etc.] the packet sequence of the packet storing the data according to the MMT format is recorded.
  • the clip AV stream file [02001. for playlist files and clip information files that are playback control information files corresponding to “mmtv etc.” the recording device generates playlist files and clip information files in which control information corresponding to MMT format data is set, and records them on the media. It will be. This process will be described later.
  • the clip AV stream file storing the MMT format data has been discussed in the direction of recording as a packet sequence of a MMTP (MMT Protocol) packet or a TLV (Type Length Value) packet that is a higher-order packet of the MMTP packet.
  • MMT Protocol MMT Protocol
  • TLV Type Length Value
  • FIG. 9 is a diagram for explaining an example of processing for recording an MMTP (MMT Protocol) packet sequence according to the MMT format on a recording medium such as a BD, a flash memory, or an HD (hard disk).
  • MMT Protocol MMT Protocol
  • FIG. 9 shows the following three data.
  • A TLV packet sequence that is broadcast distribution data
  • B One TLV packet processed as reception / playback data
  • C MMTP packet sequence proposed as a configuration of media recording data
  • a TLV packet sequence that is broadcast distribution data is a sequence (sequence) of TLV packets having the MMT (MPEG Media Transport) format described above with reference to FIG.
  • This TLV packet sequence is transmitted from a transmission apparatus 20 such as a broadcasting station.
  • TLV packet to be processed as received reproduction data is one TLV packet that is received by the information processing apparatus 30 such as a television or a recorder and performs reproduction processing.
  • the information processing apparatus 30 such as a television or a recorder and performs reproduction processing.
  • the detailed structure of one TLV packet which comprises the TLV packet sequence shown to (A) is shown.
  • This is a TLV packet having the MMT (MPEG Media Transport) format described above with reference to FIG.
  • MMT MPEG Media Transport
  • the MMTP packet sequence shown as the configuration of media recording data is an MMTP packet sequence that is currently proposed as recording data for media.
  • the MMTP packet recorded on the medium is an MMTP packet that is a part of the configuration data of the TLV packet, as understood from the dotted line showing the correspondence with FIG. 9B, and is composed of the following elements: .
  • (B) MMTP packet data (MMTP_packet_data) ( payload)
  • One configuration currently proposed as recording data for an information recording medium is to extract only MMTP packets that are constituent elements of TLV packets as shown in FIG. 9C and record them in a line. It is the structure to do.
  • FIG. 10 is a diagram for explaining an example of processing for recording a packet sequence of higher-order TLV packets storing MMTP packets, not MMTP (MMT Protocol) packets, on a recording medium such as a BD, flash memory, or HD (hard disk). It is.
  • MMTP MMT Protocol
  • FIG. 10 shows the following three data as in FIG. (A) TLV packet sequence which is broadcast distribution data (B) One TLV packet processed as reception / playback data (C) TLV packet sequence proposed as a configuration of media recording data
  • the TLV packet sequence shown as the configuration of media recording data is a TLV packet sequence that is another example currently proposed as recording data for media.
  • MMT format data for media such as BD
  • MMTP MMT Protocol
  • TLV Type Length Value
  • a playback control information file that supports the BDAV format That is, reproduction is performed using a playlist file or clip information file.
  • the BDAV format is a data recording format and also supports a data recording / reproducing application standard, and reproduction of data recorded on a medium according to the BDAV format is executed using a reproducing application compatible with the BDAV format.
  • the BDAV format defines BDAV format-specific database files such as playlist files and clip information files that are playback control information files, and the BDAV compatible playback application uses the recording information of these playback control information files (database files).
  • the data reproduction process is executed using the data.
  • database files such as playlist files and clip information files defined in the BDAV format are originally defined as files that can be generated based on the distribution data in the MPEG-2TS format. Therefore, even if the distribution data according to the MMT format, which is different from the MPEG-2TS format, is recorded as it is in the playlist file or clip information file stipulated in the current BDAV format, it cannot be used by the current BDAV compatible playback application. It may become.
  • the playlist file or clip corresponding to the MMT format data is used. It is necessary to generate an information file and record it on a medium. Further, when reproducing MMT format data recorded on a medium, it is necessary to perform reproduction using a playlist file or clip information file compatible with MMT format data.
  • a clip information file (nnnnn.clpi) 72 corresponding to the MMT format data storage clip AV stream file 71 and a playlist file (nnnnn.rpls) 73 are generated and the media ( BD, flash memory, HDD, etc.) and processing for use in reproduction is required.
  • the clip information file (nnnnn.clpi) 72 corresponding to the MMT format data storage clip AV stream file 71 and the playlist file (nnnnn. rpls) 73 can be used to perform the playback process.
  • the data distributed according to the MMT format which is the distribution data of the broadcasting station, is not configured to include all the recording data of the playlist file and the clip information file specified in the BDAV format.
  • the MMT format data storage clip AV stream file 71 has a data format different from that of the MPEG-2TS format data, such as a playlist file corresponding to the MPEG-2TS format data and a playlist file having the same format as the clip information file. Even if a clip information file is used, there is a problem that correct reproduction processing cannot be executed.
  • the recording mode of MMT format data on a medium such as a BD that is, the MMT format data storage clip AV stream file 71 shown in FIG. MMTP (MMT Protocol) packet sequence, or Packet sequence of TLV (Type Length Value) packet, Discussion is proceeding in the direction of recording as one of these packet sequences.
  • MMT Protocol MMT Protocol
  • TLV Type Length Value
  • information on data to be reproduced by applying the playlist is recorded in the playlist file.
  • the playlist file includes information relating to a play item to be applied to content reproduction processing, and further information specifying a clip information file in which reproduction position information and the like are recorded.
  • FIG. 12 is a diagram illustrating a data configuration (syntax) of [PlayList] recorded in one play list (PlayList) file. The number of bits (No. of bits) and the data notation (Mnemonic) are shown together with the data structure (Syntax). Note that “uimsbf” in data notation means “unsigned integer most significant bit first” notation. “Bslbf” means “bit string, left bit means first (bit string, left bit first)”.
  • the main recording data of [PlayList] shown in FIG. 12 will be described.
  • the length indicates the number of bytes from immediately after this length field to the end of the playlist file configuration data.
  • PL_CPI type (PL_CPI_type) 101 is information indicating a CPI type in a clip information file referred to by a play item (PlayItem) defined in the playlist file.
  • the number of play items (number_of_PlayItems) 102 indicates the number of play items (PlayItems) defined in the playlist file.
  • the number of sub play items (number_of_SubPlayItems) 103 indicates the number of play items (PlayItems) defined in the play list file.
  • play item information (PlayItem ()) 104 detailed information of each play item and sub play item is recorded.
  • the PL_CPI type (PL_CPI_type) 101 is information indicating the CPI type in the clip information file referred to by the play item (PlayItem) defined in the playlist file.
  • CPI Chargeristic Point Information
  • CPI is recording data of a clip information file, for example, data for acquiring a data address of a playback start point at which random access playback can be started.
  • the CPI defined in the BDAV format includes, for example, different types of maps such as an EP map (EP_map) and a TU map (TU_map). Each of these maps is data corresponding to, for example, playback time information (PTS: Presentation Timestamp) serving as a random access point and a source packet number (SPN: Source Packet Number) that is a packet identifier of the packet at that position.
  • PTS Playback time information
  • SPN Source Packet Number
  • Both the EP map and the TU map are map data in which random access point information is recorded.
  • the EP map is map data in which finer random access point information is recorded, and the TU map is rougher than the EP map. This is map data in which random access point information is recorded.
  • In the BDAV format two types of maps, an EP map and a TU map, are defined, but the TU map is hardly used, and only the EP map is currently used.
  • EP_map and TU_map have address information for finding the location of the entry point (EP) where decoding should start in the AV stream.
  • the playlist has information indicating the access point corresponding to the playback start position and playback end position of the clip (Clip) with a time stamp which is information on the time axis.
  • the clip information file (Clip Information file) is used to find address information from which to start decoding the stream in the clip AV stream file from this time stamp.
  • the clip information file has an EP map (EP_map) shown in FIG.
  • the EP map records access point information corresponding to the playback start position and playback end position where random playback can be started in the playback data stored in the clip AV stream file. That is, in the EP map, correspondence data between a time stamp representing the reproduction start position on the time axis and address information for packet acquisition corresponding to the packet position information is recorded.
  • A a time stamp (PTS: Presentation Timestamp) representing the access point on the time axis;
  • B A source packet number (SPN: Source Packet Number) corresponding to an address indicating a packet position in the clip AV stream. It has these correspondence information.
  • a corresponding address is obtained based on the time stamp, and, for example, a decoding start point that is a reproduction start position in the AV stream according to the address (SPN) Can be found.
  • FIG. 14 is a diagram for explaining a specific configuration and usage example of the EP map (EP_map).
  • EP_map the EP map
  • a video stream composed of source packets identified by a packet identifier: PID is multiplexed.
  • the video stream is distinguished for each source packet by the PID included in the header of the transport packet in the source packet.
  • the source packet of the video stream has an IPB picture constituting MPEG data, that is, an I (Intra) picture, a P (Predictive) picture, and a B (Bidirectionally predictive) picture.
  • the I picture is picture data that can be decoded independently, and other P pictures and B pictures require reference to the preceding and following I pictures when decoding. For example, the reproduction start point by random access is set at a packet position having an I picture that can be independently decoded.
  • the EP map holds position information of an I picture as reproduction start point position information that can be accessed at random, as correspondence data between the above-described PTS and SPN. That is, (A) a time stamp (PTS: Presentation Timestamp) representing the access point on the time axis; (B) A source packet number (SPN: Source Packet Number) corresponding to an address indicating a packet position in the clip AV stream. This is correspondence information.
  • PTS Presentation Timestamp
  • SPN Source Packet Number
  • the EP map (EP_map) is data included in the clip information file.
  • FIG. 14A shows a clip AV stream, and each rectangle shows a 192-byte source packet.
  • a source packet including the first byte of an I (Intra) picture is indicated by a hatched square.
  • White squares without diagonal lines indicate source packets containing data that cannot be random access points, and source packets containing data of other streams.
  • the source packet is configured by adding a 4-byte header (TP_extra_header) to a 188-byte transport packet.
  • the transport packet part includes a header part (TP header) and a payload part.
  • SPN_EP_start which is EP map registration data shown in FIG. 14C2 is a source packet number (SPN) of a source packet including the first byte of an access unit (Access Unit) including an I picture starting from a sequence header (SQH). Represents.
  • a series of numbers set for all packets in the clip AV stream file is a source packet number (SPN).
  • SPN source packet number
  • the source packet number of the first source packet is zero
  • the source packet number of the next packet is 1, and thereafter, the source packet number is incremented by 1 for each next packet.
  • the EP map is Stream PID (Stream_PID), EP entry number (number_of_EP_entries), Presentation time stamp EP start (PTS_EP_start), and Source packet number EP start (SPN_EP_start), These data are recorded.
  • Stream_PID Stream_PID
  • EP entry number number_of_EP_entries
  • PTS_EP_start Presentation time stamp EP start
  • SPN_EP_start Source packet number EP start
  • the presentation time stamp EP start represents an access unit PTS (presentation time stamp) starting from a randomly accessible I picture.
  • the source packet number EP start (SPN_EP_start) represents a source packet number (SPN: Source Packet Number) including the first byte of the access unit (Access Unit) referred to by the value of PTS_EP_start.
  • the value of the PID (packet identifier) of the video stream is stored in stream_PID, and EP_map () that is table information indicating the correspondence between PTS_EP_start and SPN_EP_start is generated.
  • EP_map table information indicating the correspondence between PTS_EP_start and SPN_EP_start.
  • PTS pts (x1) and source packet number (SPN) X1
  • PTS pts (x2) and source packet number (SPN) X2
  • ... PTS pts (xk) and source packet number (SPN) Xk
  • An EP map (EP_map) including the above table is stored in a clip information file corresponding to one clip AV stream.
  • the EP map (EP_map) having such data is referred to, for example, to specify the decoding start position when performing random access or the like.
  • EP_map The EP map (EP_map) having such data is referred to, for example, to specify the decoding start position when performing random access or the like.
  • FIG. 15 a description will be given of a method of calculating address information to start decoding a stream in a clip AV stream file using EP_map when playback is started from time x on the time axis in the clip. .
  • the playlist (PlayList) has information specifying start of reproduction from time x on the time axis in the clip
  • the time stamp [PTS_EP_start [m] having the closest value smaller than x ] Is specified.
  • the EP map in the clip information file is referred to, and the source packet number [SPN_EP_start [m] corresponding to the time stamp [PTS_EP_start [m]]. ]] Is specified.
  • the SPN that is the packet position information corresponding to the PTS that is, [SPN_EP_start [m]] is acquired from the PTS that is the reproduction time information determined according to the playlist information.
  • This packet position [SPN_EP_start [m]] can be acquired as a reproduction start point in the clip AV stream file, that is, address information to start decoding, and can be reproduced by performing decoding processing.
  • the usage example of the EP map described with reference to FIG. 13 to FIG. 15 is a packet acquisition processing example corresponding to a random access point using MPEG-2TS format data.
  • the MPEG-2TS format data using the EP map, from the PTS that is the reproduction time information determined according to the playlist information, the SPN that is the packet position information corresponding to the PTS, that is, [SPN_EP_start [ m]].
  • the MMT format data has a format different from that of the MPEG-2TS format data, it is impossible to execute a process similar to that of the MPEG-2TS format data to obtain a random access point compatible packet. That is, when the reproduction target data is MMT format data, it is necessary to perform data processing corresponding to MMT format data different from the above-described processing.
  • the EP map is defined in the clip information file, and it is necessary to record the MMT format data compatible EP map for executing the random access point acquisition processing corresponding to the MMT format data in the clip information file compatible with the MMT format data. is there. That is, it is necessary to record the EP map corresponding to the MMT format data in the clip information file (nnnnn.clpi) 72 corresponding to the MMT format data storage clip AV stream file 71 shown in FIG. This specific example will be described later.
  • the EP map corresponding to the MPEG-2TS format data is different from the EP map corresponding to the MMT format data.
  • the PL_CPI type (PL_CPI_type) recorded in the playlist file shown in FIG. 12 is included in the clip information file referenced by the play item (PlayItem) specified in the playlist file. This is information indicating the CPI type.
  • CPI Chargeristic Point Information
  • FIG. 16 shows the following CPI type recording data.
  • Conventional CPI type recording data only MPEG-2TS compatible data is recorded
  • New CPI type recording data recording MPEG-2TS compatible data and MMT compatible data
  • the data shown in “(1) Conventional CPI type recording data (recording only MPEG-2TS compatible data)” in FIG. 16 is data defined as the PL_CPI type (PL_CPI_type) of the conventional playlist file.
  • PL_CPI type (PL_CPI_type) 1 means that the CPI type in the clip information file referred to by the play item (PlayItem) defined in this playlist file is an EP map compatible with MPEG-2TS.
  • PL_CPI type (PL_CPI_type) 2 means that the CPI type in the clip information file referred to by the play item (PlayItem) defined in the playlist file is an MPEG-2TS compatible TU map.
  • the play item information (PlayItem ()) 104 records detailed information of each play item and sub play item.
  • FIG. 17 is a diagram illustrating a data configuration (syntax) of play item information (PlayItem ()) 104.
  • the clip information file name (Clip_Information_file_name) 111 the file name of the clip information file to be applied to the reproduction processing using this play item is recorded.
  • the reference STC identifier (ref_to_STC_id) 112 indicates an STC identifier of an STC (system time clock) continuous section to be referred to by this play item.
  • STC system time clock
  • STC system time clock
  • one STC is used in a continuous playback section.
  • one STC is used in a continuous playback section in which one play item is played, and different STCs are referred to by switching play items.
  • information specifying an STC (system time clock) to be referred to by the play item is recorded.
  • the start time (IN_time) 113 is a recording area of the play item playback start time.
  • the end time (OUT_time) 114 is a recording area for the play end time of the play item.
  • these start time and end time information are the difference time information (45 KHzh from the start time of the STC corresponding to the play item specified by the reference STC identifier (ref_to_STC_id) 112. Clock) is recorded.
  • the 45 KHz clock is a general clock used for recording / reproducing MPEG-2TS format data.
  • each reproduction target data (MMT format data) corresponding to a play item is not associated with an individual STC. . Therefore, the MMT format data is recorded in the play item information (PlayItem ()) of the playlist to be reproduced.
  • PlayItem () the play item information of the playlist to be reproduced.
  • Start time (IN_time) 113, End time (OUT_time) 114 is It is necessary to set time information unique to the MMT format data. An example of this change will be described with reference to FIG.
  • FIG. 18 shows the following data example.
  • (1) Conventional play item information recording data MPEG-2TS compatible playlist
  • (2) New play item information recording data MMT compatible playlist
  • “(1) Conventional play item information recording data (MPEG-2TS compatible playlist)” shown in FIG. 18 (1) is the play item information (PlayItem ()) when the reproduction target data is MPEG-2TS format data.
  • the start time (IN_time) is playback start time information of the play item (PlayItem) playback start point, and as described above, STC [system time clock (45 KHz clock)] applied to the playback processing using this play item. ) Record the elapsed time information from the starting point.
  • the STC is an STC specified by the reference STC identifier (ref_to_STC_id) 112 described with reference to FIG.
  • the end time (OUT_time) is the playback end time information of the play item (PlayItem) playback end point.
  • the STC system time clock (45 KHz clock) applied to the playback processing using this play item. )]) Record the elapsed time information from the starting point.
  • the STC is an STC specified by the reference STC identifier (ref_to_STC_id) 112 described with reference to FIG.
  • “(2) New play item information recording data (MMT compatible playlist)” shown in FIG. 18 (2) is recorded in the play item information (PlayItem ()) when the reproduction target data is MMT format data.
  • the recording data of start time (IN_time) and end time (OUT_time) is shown.
  • the start time (IN_time) is playback start time information of a play item (PlayItem) playback start point.
  • time information according to NTP Network Time Protocol
  • the end time (OUT_time) is playback end time information of the play item (PlayItem) playback end point.
  • NTP Network Time Protocol
  • the time information according to NTP is transmitted together with MMT format data including broadcast content transmitted by the transmission device 20 such as the broadcast server (broadcast station) 21 shown in FIG.
  • the information processing apparatus 30 such as a television (TV) 32 acquires time information according to NTP (network time protocol) transmitted by the transmission apparatus 20 and records it in a playlist.
  • NTP Network Time Protocol
  • the transmission apparatus 20 uses MPU (Media Presentation Unit) unit playback time information, which is one data processing unit in the MMT format described above with reference to FIG. 3, as time according to NTP (Network Time Protocol).
  • MPU Media Presentation Unit
  • NTP Network Time Protocol
  • an information processing device 30 that receives distribution content (program) from a transmission device 20 such as a broadcast server (broadcast station) 21 shown in FIG. 1 as MMT format data and records the received content on an information recording medium (media). It is necessary to extract various information from the received data to generate a playlist file and a clip information file.
  • the MMT format data includes control information necessary for receiving and playing back content (program) on the information processing apparatus 30 side, and guide information such as a program guide.
  • Control information including notification information, management information, and the like.
  • Control information (signaling information) defined in the MMT format includes signaling information (MMT-SI) transmitted in MMTP packets and signaling information (TLV-SI) transmitted in TLV packets.
  • the information processing apparatus 30 that receives MMT format data and records the received data on a medium extracts various information from signaling information such as TLV-SI and MMT-SI included in the MMT format, for example, and plays a playlist file. And a clip information file.
  • MMT package table MMT Package Table
  • the MMT package table is a table in which, for example, data attribute information (asset descriptor) is recorded in detail for each data type (asset type) such as image, audio, subtitle, and the like.
  • MMT MMT Package Table
  • FIG. 19 is a diagram illustrating a data configuration (syntax) of an MMT package table (MPT).
  • MMT MMT Package Table
  • the MMT package table (MPT: MMT Package Table) defined in the MMT format is, for example, data attribute information (asset descriptor) for each data type (asset type) such as image, audio, subtitle, etc.
  • asset type data type
  • Asset type (asset_type)
  • Asset descriptor (asset_descriptors_byte)
  • the asset type is an area for recording an identifier for each data type, such as an image, audio, or caption.
  • An asset is a unit of data processing having a common attribute, and images, audio, subtitles, and the like are set as different assets.
  • a specific example of the asset type (asset_type) recorded in the MMT package table (MPT) is shown in FIG.
  • the asset type (asset_type) recorded in MPT includes, for example, the following types.
  • hvc1 HEVC image mp4a: audio stpp: subtitles, etc.
  • aapp application
  • Asset descriptor As shown in the lower part of the MPT in FIG. Asset descriptor (asset_descriptors_byte) In this field, various asset information corresponding to each asset type (for example, image, audio, subtitle) and their data types are recorded.
  • One piece of information recorded as the asset descriptor includes reproduction time information such as an image and sound.
  • the reproduction time information is recorded as time information according to NTP (Network Time Protocol).
  • FIG. 21 shows the data structure (syntax) of an MPU time stamp descriptor in which playback time information (time stamp) in units of MPU recorded as asset descriptors (asset_descriptors_bytes) is recorded in the MMT package table (MPT).
  • the MPU is the MPU (Media Presentation Unit) shown in FIG. 3A as described above with reference to FIG. 3, and is one data processing unit in the MMT format.
  • the example shown in FIG. 3A is an example of an MPU of image data, and is the same unit as a GOP (Group of Pictures) as a so-called encoding / decoding processing unit.
  • the MPU time stamp descriptor recorded in the MMT package table (MPT) corresponds to the reproduction time information in units of MPU. As shown in FIG. 21, the following data is recorded in the MPU time stamp descriptor.
  • MPU sequence number MPU_sequence_number
  • MPU playback time MPU_presentation_time
  • An MPU identifier is recorded in the MPU sequence number (MPU_sequence_number).
  • MPU_presentation_time the playback time (presentation time) of the MPU is recorded as time information according to NTP (Network Time Protocol).
  • NTP time NTP time stamp
  • the NTP time is, for example, absolute time information of 64-bit data, that is, absolute time information indicating an elapsed time from a predetermined reference time.
  • the upper 32 bits indicate time information (elapsed time information) of 1 second or more, and the lower 32 bits indicate time information (elapsed time information) of 1 second or less. It is also possible to set the whole to 32 bits and use short-format NTP time information that indicates time information of 1 second or more in the upper 16 bits and time information of 1 second or less in the lower 16 bits.
  • an MPU time stamp that is playback time information (time stamp) in units of MPU is recorded as an asset descriptor (asset_descriptors_byte).
  • the transmitter 20 shown in FIG. 1 records reproduction time information in units of MPU (Media Presentation Unit), which is one data processing unit in the MMT format, in the MMT package table (MPT) as NTP time information, and information on a television or the like. It transmits to the processing apparatus 30.
  • the information processing apparatus 30 acquires this time information and records it in the playlist.
  • the information processing apparatus 30 acquires the playlist control file that is the reproduction control information file from the MMT package table (MPT). NTP time information is recorded.
  • the information processing apparatus 30 uses the playlist file when the reproduction target data to be recorded as the clip AV stream file on the information recording medium (medium) is MMT format data.
  • the start time (IN_time) and end time (OUT_time) of the play item information (PlayItem ()) time information according to NTP (Network Time Protocol) is recorded.
  • PlayListMark which is another element recorded in the playlist file.
  • the mark is, for example, data that can be recorded in a playlist file or a clip information file as chapter delimitation of image data stored in a clip AV stream file, scene change points, bookmarks, highlights, or characteristic scene time designation information. is there. Mark recording on the playlist file and clip information file is performed by recording a time stamp indicating the mark time.
  • FIG. 22 is a diagram illustrating a data configuration (syntax) of a playlist mark (PlayListMark) that is an element of a playlist file.
  • the playlist mark number (number_of_PlayList_marks) 121 indicates the number of marks stored in the playlist mark (PlayListMark).
  • the mark type (mark_type) 122 is a field indicating a mark type. For example, information indicating which type of mark is each mark, such as a representative image position of a playlist, a chapter start position, a chapter end position, a scene change position, an edit position, or the like is recorded.
  • the mark time stamp (mark_time_stamp) 123 is a field for recording a time stamp indicating a point where a mark is set.
  • the elementary stream packet ID entry (entry_ES_PID) 124 is a field for recording an identifier of a packet in which a mark is set.
  • the duration 125 is a field for recording a time interval between adjacent marks, for example, a chapter length.
  • the recorded data of the playlist mark (PlayListMark) shown in FIG. 22 is also defined when conventional MPEG-2TS format data is recorded as a clip AV stream file, but the MMT format is used as a clip AV stream file. There is no special provision for cases where data is recorded. Therefore, it is necessary to define the recording data of the play list mark (PlayListMark) when MMT format data is recorded as a clip AV stream file.
  • FIG. 23 shows the following data example.
  • Conventional playlist mark information recording data MPEG-2TS compatible playlist
  • New playlist mark information record data MMT compatible playlist
  • “(1) Conventional playlist mark information recording data (MPEG-2TS compatible playlist)” shown in FIG. 23 (1) is a playlist mark (PlayListMark) when the reproduction target data is MPEG-2TS format data. Recording data to be recorded is shown.
  • the mark time stamp (mark_time_stamp) is a field for recording a time stamp indicating a point where a mark is set.
  • a time stamp at the mark setting position is recorded here.
  • This time stamp is recorded as 45 KHz clock data, which is a general clock used for recording and reproducing MPEG-2TS format data.
  • the elementary stream packet ID entry (entry_ES_PID) is a field for recording an identifier of a packet in which a mark is set.
  • the reproduction data is MPEG-2TS format data
  • the packet ID (PID) of the TS packet at the mark setting position is recorded here.
  • the duration is a field for recording a time interval between adjacent marks, for example, a chapter length.
  • the reproduction data is MPEG-2TS format data
  • the time interval between adjacent marks is recorded here as 45 KHz clock data which is a general clock used for recording and reproduction of MPEG-2TS format data.
  • “(2) New playlist mark information recording data (MMT compatible playlist)” shown in FIG. 23 indicates recording data recorded in a playlist mark (PlayListMark) when the reproduction target data is MMT format data. ing.
  • the mark time stamp (mark_time_stamp) records the time stamp of the mark setting position as time information according to NTP (Network Time Protocol).
  • NTP Network Time Protocol
  • the time information according to NTP is acquired from, for example, the MPT described above with reference to FIG. 18 and others, that is, the MMT package table (MPT: MMT Package Table) defined in the MMT format. .
  • An elementary stream packet ID entry (entry_ES_PID) is a field for recording an identifier of a packet in which a mark is set.
  • the reproduction data is MMT format data
  • the packet ID of the MMT packet is set as a packet ID at the mark setting position. Record the ID.
  • the duration is a field for recording a time interval between adjacent marks, for example, a chapter length.
  • the reproduction data is MMT format data
  • it is recorded as 45 KHz clock data as in the MPEG-2TS format data.
  • the time interval between marks can be calculated at the time of data recording, and is set to be recorded in accordance with the data recording format of the conventional MPEG-2TS format data.
  • the clip information file information on data to be reproduced by applying the clip information file is recorded. Specifically, for example, it has playback position information of a clip AV stream file.
  • FIG. 24 is a diagram illustrating a data configuration (syntax) of one clip information file.
  • the clip information file information related to reproduction data associated with the clip information is recorded. As shown in FIG. 24, for example, the following information is recorded.
  • Clip information [ClipInfo ()] 201 records attribute information of the AV stream file corresponding to the clip information file.
  • Sequence information [SequenceInfo ()] 202 records information related to the playback sequence of the playback target data stored in the AV stream file corresponding to the clip information file.
  • Program information [ProgramInfo ()] 203 records information related to a program (program) including definition information of a playback section and a time section of a clip AV stream played back by a clip information file.
  • the CPI information [CPI ()] 204 is, for example, data for acquiring the data address of the playback start point, and EP_map and TU_map described above with reference to FIGS. 13 to 15 are recorded. As described above with reference to FIG. 12, the CPI type (CPI_type) is recorded in the playlist file.
  • the CPI type (CPI_type) is information indicating a CPI type in a clip information file referred to by a play item (PlayItem) defined in the playlist file.
  • clip information [ClipInfo ()] 201 is an area for recording attribute information of the AV stream file corresponding to the clip information file.
  • the following data is recorded in the clip information [ClipInfo ()] 201.
  • A Application type 211
  • B Clip stream type (Clip_stream_type) 212
  • C Transcode mode flag (transcode_mode_flag) 213
  • D TS average rate (TS_average_rate) 214
  • E TS recording rate (TS_recording_rate) 215,
  • F Number of source packets (num_of_source_packets) 216
  • Application type (application type) 211 is information indicating the type of playback application based on this clip information file. Specifically, a normal image playback type, a slide show playback processing type, and the like are defined.
  • the clip stream type (Clip_stream_type) 212 is information indicating the type of data stored in a clip AV stream file that is data to be reproduced by this clip information file.
  • the MPEG-2TS format data includes a stream type in which a black image is inserted between streams in addition to a normal MPEG-2TS stream, and identification information of these types is recorded.
  • the transcode mode flag (transcode_mode_flag) 213 receives data stored in a clip AV stream file that is data to be reproduced by this clip information file, that is, data to be reproduced recorded on an information recording medium (medium), such as broadcast reception This is a flag indicating whether the data is recorded as it is or is recorded after being subjected to a conversion process such as a predetermined compression process.
  • Flag value 0: No conversion at the time of recording (transparent)
  • Flag value 1: Conversion at the time of recording (transcoded) Such a setting flag is recorded.
  • TS average rate (TS_average_rate) 214 TS recording rate (TS_recording_rate) 215, These are the average bit rate and recording rate of the transport stream of the clip AV stream file, which is the data to be played back by this clip information file, in units of bytes / seconds.
  • the number of source packets (num_of_source_packets) 216 is file size information of a clip AV stream file that is data to be reproduced by this clip information file. In the case of MPEG-2TS format data, the number of source packets is recorded.
  • the clip data [ClipInfo ()] 201 shown in FIG. 25 defines the following data as data to be recorded.
  • A Application type 211
  • B Clip stream type (Clip_stream_type) 212
  • C Transcode mode flag (transcode_mode_flag) 213
  • D TS average rate (TS_average_rate) 214
  • E TS recording rate (TS_recording_rate) 215,
  • F Number of source packets (num_of_source_packets) 216
  • FIG. 26 shows the application type (Application type) 211 recorded in the clip information [ClipInfo ()] shown in FIG. (1) Conventional clip information (ClipInfo) recording data (MPEG-2TS compatible clip information file) (2) New clip information (ClipInfo) recording data (MPEG-2TS / MMT compatible clip information file) It is the figure which showed these each data.
  • Conventional clip information (ClipInfo) recording data MPEG-2TS compatible clip information file
  • New clip information (ClipInfo) recording data MPEG-2TS / MMT compatible clip information file
  • “(1) Conventional clip information (ClipInfo) recording data (MPEG-2TS compatible clip information file)” shown in FIG. 26 (1) is clip information (ClipInfo) when the reproduction target data is MPEG-2TS format data.
  • the reproduction target data is MPEG-2TS format data
  • the application type (Application type) 1
  • the playback application type by this clip information file is “Main TS for a main-path of Movies”, that is, playback of the main TS (transport stream) corresponding to the image main path.
  • Main TS main-path of Movies
  • the playback application type of this clip information file is “Main TS for a main-path of Time based slide show”, that is, the main path corresponding to the main path of the time-based slide show. Indicates a TS playback application.
  • the reproduction target data is only the MPEG-2TS format data, and the setting shown in FIG. 26 (1) is used.
  • the reproduction target data is MPEG-2TS format data or MMT format data.
  • the corresponding value of the setting value and meaning of the application type (Application type) recorded in the clip information (ClipInfo) when two different format data are assumed.
  • the playback application type of this clip information file is “Main TLV / MMT for a main-path of Movies”, that is, the MMT stored in the TLV packet corresponding to the image main path. Indicates that this is a format data playback application.
  • the playback device stores the data stored in the clip AV stream file recorded on the information recording medium (media) in the TLV packet based on the recording data of the clip information file. It can be confirmed that the data is MMT format data, and a reproduction process corresponding to the MMT format data can be executed.
  • the reproduction target data is MPEG-2TS format data
  • the clip stream type (Clip_stream_type) 1
  • the type of data stored in the clip AV stream file that is the reproduction target data by this clip information file is “A Clip AV stream of BDAV MPEG-2TS”, that is, BDAV MPEG. -2 indicates that the clip AV stream is in TS format.
  • the reproduction data type of this clip information file is “A Bridge-Clip AV stream of BDAV MPEG-2TS”, that is, a bridge type clip in the BDAV MPEG-2TS format. Indicates an AV stream.
  • the bridge type clip AV stream is a stream in which a black image is inserted between the streams.
  • the reproduction target data is only the MPEG-2TS format data, and the setting shown in FIG. 27 (1) has been used.
  • the reproduction target data is MPEG-2TS format data or MMT format data.
  • the corresponding values of the set value and meaning of the clip stream type (Clip_stream_type) recorded in the clip information (ClipInfo) when two different format data are assumed are shown.
  • the data type stored in the clip AV stream file that is the reproduction target data by this clip information file is “A Clip AV stream of BDAV TLV / MMT”, that is, the BDAV format.
  • the playback device stores the clip AV stream file recorded on the information recording medium (medium) in the TLV packet recorded according to the BDAV format based on the recording data of the clip information file.
  • the data is the MMT format data, and to execute a reproduction process corresponding to the MMT format data.
  • the transcode mode flag (transcode_mode_flag) 213 indicates that the clip AV stream file storage data, which is data to be reproduced by this clip information file, is recorded as it is received data such as broadcasts, or is a predetermined value. It is a flag indicating whether the data is recorded after being subjected to conversion processing such as compression processing.
  • Flag value 0: No conversion at the time of recording (transparent)
  • Flag value 1: Conversion at the time of recording (transcoded) Such a setting flag is recorded. This setting can be used with the same setting for the MMT format data.
  • TS average rate (TS_average_rate) 214 TS recording rate (TS_recording_rate) 215, As described above, these represent the average bit rate and recording rate of the transport stream of the clip AV stream file, which is the data to be reproduced by this clip information file, in units of bytes / seconds.
  • This bit rate information is premised on calculation based on the TS packet.
  • the reproduction target data is MMT format data stored in the TLV packet, it is necessary to record the bit rate corresponding to the TLV packet.
  • TLV_average_rate the TLV average rate
  • TLV average rate (TLV_average_rate) (File size) / ((ATS of TLV packet at the end of file) ⁇ (ATS of TLV packet at the beginning of file))
  • ATS is a time stamp (ATS) indicating the start timing of processing (decoding or the like) of data stored in the TLV packet, and can be acquired from the TLV packet or control information (SI).
  • the calculated value calculated by the above formula is As the TLV average rate (TLV_average_rate), In the clip information [ClipInfo ()] shown in FIG. Recorded in the field of TS average rate (TS_average_rate) 214. Alternatively, when the reproduction target data is in the MMT format, an invalid value may be recorded in this field, and the average rate information may not be used.
  • TLV recording rate (TLV_recording_rate) (T2-t1) / S
  • TLV recording rate (TLV_recording_rate) (T2-t1) / S
  • t2 ATS of the maximum size TLV packet in the file
  • t1 ATS of the TLV packet next to the maximum size TLV packet in the file
  • S Size of the maximum size TLV packet in the file
  • a file is a clip AV stream file composed of TLV packets.
  • the ATS is a time stamp (ATS) indicating the start timing of processing (decoding or the like) of data stored in the TLV packet, and can be acquired from the TLV packet or control information (SI).
  • the calculated value calculated by the above formula is As a TLV recording rate (TLV_recording_rate), In the clip information [ClipInfo ()] shown in FIG. Recording is performed in the field of TS recording rate (TS_recording_rate) 215. Alternatively, when the reproduction target data is in the MMT format, an invalid value may be recorded in this field, and the recording rate information may not be used.
  • the number of source packets (num_of_source_packets) 216 is file size information of a clip AV stream file that is data to be reproduced by this clip information file. As described above, when the reproduction target data is MPEG-2TS format data, the number of source packets is recorded.
  • the TS packet has a fixed length unlike the MMTP packet described above, and the packet size of one TS packet is fixed to 188 bytes. Therefore, the data size can be grasped based on the number of packets.
  • the reproduction target data is MMT format data
  • the MMTP packet that constitutes the configuration packet of the MMT format data and the TLV packet have a variable length, and various packets The size can be set. Therefore, even if the number of packets is recorded in the field of the number of source packets (num_of_source_packets) 216, the data size cannot be grasped.
  • the file size (byte size) of the clip AV stream file composed of a plurality of TLV packets is recorded in this field.
  • this field records 64 bit data as a setting capable of recording 64-bit data, and records the file size (byte size) of a clip AV stream file composed of TLV packets as 64-bit data.
  • an invalid value may be recorded in this field to make it an unused field.
  • sequence information [SequenceInfo ()] 202 records information related to the playback sequence of the playback target data stored in the AV stream file corresponding to the clip information file.
  • sequenceInfo [SequenceInfo ()] 202.
  • ATC start position SPN SPN_ATC_start
  • B Number of STC sequences (num_of_STC_sequence)
  • C Program clock reference packet ID (PCR_PID) 223
  • D STC start position SPN (SPN_STC_start)
  • E Display start time (presentation_start_time) 225
  • F Display end time (presentation_end_time) 226
  • FIG. 29 shows (a) a packet sequence stored in a clip AV stream file.
  • one rectangle corresponds to one TS packet.
  • packet numbers 0 to nn are the configuration data of one clip AV stream file.
  • the packet of this one clip AV stream file is a packet sequence arranged according to one ATC (arrival time clock).
  • a packet sequence arranged according to one ATC is called an ATC sequence.
  • One clip information file packet 0 to nn shown in FIG. 29 includes one or more STC sequences. In the example shown in FIG. 29, three STC sequences are included. STC sequences # 0 to # 2.
  • One STC (system time clock) is a clock defined based on one PCR (program clock reference), and source packets belonging to one STC sequence are reproduced and controlled by one STC (for example, 45 KHz).
  • the STC sequence # 0 shown in FIG. 29 is a packet sequence that can be continuously reproduced in accordance with an STC (system time clock) that is a clock defined based on the PCR (program clock reference) stored in the PCR storage packet a.
  • the STC sequence # 1 is a PCR stored in the PCR storage packet b.
  • the STC sequence # 2 is a packet sequence that can continuously reproduce the PCR stored in the PCR storage packet c according to the STC defined as a reference.
  • FIG. 29 has been described as an example in which three STC sequences are included in one ATC sequence, the number of STC sequences included in one ATC sequence can be variously set.
  • the ATC start position SPN (SPN_ATC_start) 221 is an area for recording the SPN (source packet number) of the ATC start position of the clip AV stream file to be reproduced by this clip information file.
  • the ATC start position SPN (SPN_ATC_start) 0.
  • the program clock reference packet ID (PCR_PID) 223 contains a packet storing a PCR (program clock reference) corresponding to each STC sequence included in the clip AV stream file to be reproduced by this clip information file. Record the packet identifier.
  • SPN_STC_start In the STC start position SPN (SPN_STC_start) 224, the SPN (source packet number) of the start position of each STC sequence included in the clip AV stream file to be reproduced by this clip information file is recorded.
  • the above description is an example of recorded data when the reproduction target data by the clip information file is MPEG-2TS format data. Next, each recording data when the reproduction target data by the clip information file is MMT format data will be described.
  • the ATC start position SPN (SPN_ATC_start) 221 is an area for recording the SPN (source packet number) of the ATC start position of the clip AV stream file to be reproduced by the clip information file, as described above.
  • the TS packet has a fixed length unlike the MMTP packet described above, and the packet size of one TS packet is fixed to 188 bytes. Therefore, the data size can be grasped based on the number of packets.
  • the reproduction target data is MMT format data
  • the MMTP packet and the TLV packet that constitute the MMT format data have a variable length and have various packet sizes. Can be set. Therefore, even if the packet number is recorded in the field of the ATC start position SPN (SPN_ATC_start) 221, the data size cannot be grasped.
  • sequenceInfo () when the reproduction target data is MMT format data stored by a TLV packet will be described.
  • the ATC start position SPN (SPN_ATC_start) 221 is an area for recording the SPN (source packet number) of the ATC start position of the clip AV stream file to be reproduced by this clip information file.
  • the ATC start position SPN (SPN_ATC_start) 0.
  • a packet sequence arranged according to one ATC is an ATC sequence.
  • the SPN source packet number in the start position is recorded.
  • the ATC sequence is one of the following sequences. (1) Either a time stamp (timestamp) associated with an MMTP packet, a packet sequence number (packet_sequence_number), or a sequence (TLV packet sequence) defined by a combination of both of these data, or (2) A sequence (TLV packet sequence) defined by an NTP transmission timestamp (transmit_timestamp),
  • TLV packet sequence When a clip AV stream file is composed of a TLV packet sequence storing MMT format data, one of the sequences (1) and (2) (TLV packet sequence) is defined as an ATC sequence.
  • the NTP in (2) is time information according to a network time protocol as described above with reference to FIG.
  • a transmitting apparatus such as a broadcasting station stores NTP data in which transmission time stamps (transmit_timestamp) are stored at regular intervals (33.04647 msec intervals) in a TLV packet in which reproduction data and the like are stored, and further in a TLV packet. Store in and send.
  • This NTP time information transmission is mainly used for time adjustment of the receiving side apparatus.
  • the ATC sequence in the clip AV stream file constituted by the TLV packet sequence storing the MMT format data is defined as one of the sequences (1) and (2) (TLV packet sequence).
  • data recorded at the ATC start position SPN (SPN_ATC_start) 221 of the sequence information (SequenceInfo ()) shown in FIG. 30 is the following recording data.
  • SPN_ATC_start SPN_ATC_start
  • the number of bytes up to (start position) is recorded data. For example, the number of bytes is recorded with 64 bits.
  • STC sequence number (num_of_STC_sequence) 222 is an area for recording the number of STC sequences included in a clip AV stream file to be reproduced by this clip information file.
  • the number of STC sequences (num_of_STC_sequence) 1. In other words, only one STC sequence is included in one ATC sequence.
  • the program clock reference packet ID (PCR_PID) 223 is a packet packet storing a PCR (program clock reference) corresponding to each STC sequence included in the clip AV stream file to be reproduced by this clip information file. This is an area for recording an identifier.
  • the reproduction target data is MMT format data
  • the data position cannot be specified from the packet identifier. Therefore, an invalid value is recorded in this field, and the setting is not used.
  • the STC start position SPN (SPN_STC_start) 224 is an area for recording the SPN (source packet number) at the start position of each STC sequence included in the clip AV stream file to be reproduced by this clip information file.
  • a packet sequence arranged according to one STC is an STC sequence.
  • the SPN source packet number
  • One STC is a clock defined based on one PCR (program clock reference), and source packets belonging to one STC sequence are reproduced by one STC (for example, 45 KHz). Be controlled.
  • the STC sequence is the following sequence.
  • MPU presentation time indicating an MPU-compatible reproduction (presentation) time, which is one data processing unit of reproduction target data such as images, sounds, and captions in the MMT format, or an MPU-compatible sequence identifier MPU
  • a sequence defined by one or both of the corresponding sequence numbers (mpu_sequence_number).
  • the STC sequence is the sequence shown in (1) above.
  • MPU presentation time (mpu_presentation_time), the MPU corresponding sequence number (mpu_sequence_number), and these data are data recorded in the MPU time stamp descriptor described above with reference to FIG.
  • the MPU time stamp descriptor is recording data in the MMT package table (MPT) described above with reference to FIG.
  • the setting of the MPU presentation time leap identifier (mpu_presentation_time_leap_indicator), which is an identifier indicating whether or not “leap second” is included in the MPU presentation time (mpu_presentation_time), is considered. It is also necessary to do.
  • the MPU presentation time leap identifier (mpu_presentation_time_leap_indicator) is set to [1] when “leap second” is included in the MPU presentation time (mpu_presentation_time), and [0] otherwise.
  • the data stored in the clip AV stream file is MMT format data
  • either the MPU presentation time (mpu_presentation_time) or the MPU-compatible sequence number (mpu_sequence_number) that is an MPU-compatible sequence identifier, or The sequence defined by both is used as the STC sequence.
  • the reproduction target data is MMT format data
  • the reproduction target data is MMT format data
  • the number of bytes from the top of the packet) to the start position of the STC sequence according to the above definition is recorded. For example, the number of bytes is recorded with 64 bits.
  • (E) Display start time (presentation_start_time) 225, (F) Display end time (presentation_end_time) 226 These are areas for recording the display start time and end time of each STC sequence included in the clip AV stream file to be played back by this clip information file.
  • the MPU presentation time (mpu_presentation_time) is data recorded in the MPU time stamp descriptor described above with reference to FIG.
  • the MPU time stamp descriptor is recording data in the MMT package table (MPT) described above with reference to FIG.
  • the MPU presentation time (mpu_presentation_time) time information recorded in the MPT is 64-bit time information according to NTP (Network Time Protocol), and this 64-bit NTP time information is expressed as “(e)”. It is recorded in the “data recording area of display start time (presentation_start_time) 225”.
  • the program information [ProgramInfo ()] 203 records information related to a program (program) including definition information of a playback section and a time section of a clip AV stream played back by a clip information file.
  • the main data recorded in the program information [ProgramInfo ()] shown in FIG. 31 will be described.
  • C In the program map PID [program_map_PID [i]] 233, the storage location information of the map of the program sequence (program_sequence) is recorded.
  • Stream_PID the packet identifier (PID) of the TS packet that transmits the stream is recorded.
  • PID packet identifier
  • E Stream coding information [StreamCodingInfo] 235 records coding (encoding) information of a stream to be played.
  • the program sequence is a section in which encoded information in the AV stream included in the clip AV stream file is continuous.
  • an image data section encoded in one image encoding mode, an audio data section encoded in one audio encoding mode, and the like are respectively defined as individual program sequences.
  • the number of program sequences [num_of_program_sequences] 231 is The number of program sequences may be recorded regardless of whether the reproduction target data is the MPEG-2TS format or the MMT format.
  • the clip AV stream file storing the reproduction target data is composed of a TLV packet sequence storing MMT format data
  • the number of bytes is recorded with 64 bits.
  • the program map is map data in which information such as an image, audio, subtitles, and the like such as an encoding mode of each program sequence unit is recorded.
  • the clip AV stream file storing the reproduction target data is MMT format data
  • the MMT package table (MPT: MMT Package Table) has data attribute information (asset description) for each data type (asset type) such as image, audio, subtitle, etc. There is a table that records (child) in detail. In the MMT format, one asset corresponds to one program sequence.
  • each asset unit such as an image, audio, and subtitles is referred to with reference to this MMT package table (MPT). It is possible to acquire attribute information such as an encoding mode.
  • MPT MMT package table
  • the packet storing the MMT package table is recorded in the recording area of the program map PID [program_map_PID [i]] 233 shown in FIG. PID (packet identifier) may be recorded.
  • PID packet identifier
  • the PID (packet identifier) applied to the identification is basically the PID of the MMTP packet, but the PID of the upper IP packet or TLV packet can also be used.
  • the problem here is that the packet storing the target MMT package table (MPT) may not be identified by the PID (packet identifier). The reason for this will be described with reference to FIG. 32 and FIG.
  • FIG. 32 shows the following figures. (1) Transmission packet of broadcast server 21 (2) PID (packet identifier) setting example for transmission packet of broadcast server 21
  • the transmission packet of the broadcast server 21 shown in FIG. 32 (1) indicates a packet sequence of a TLV packet.
  • the TLV packet is configured by a packet storing various data such as reproduction target data such as images, sounds, and captions, and control information (SI). It is assumed that the broadcast server 21 transmits a plurality of program contents corresponding to a plurality of channels, such as a BS 101 channel and a BS 102 channel, and control information.
  • the following packet sequence is shown in the PID (packet identifier) setting example for the transmission packet of the broadcast server 21 shown in FIG.
  • A Broadcast server compatible control information (SI)
  • B Data corresponding to channel 101 (reproduction data (image, sound, subtitles, etc.) + Control information corresponding to channel 101 (SI))
  • C Channel 102 compatible data (reproduction data (image, audio, caption, etc.) + Channel 102 compatible control information (SI))
  • the broadcast server 21 mixes the above-mentioned (A), (B), (C), and these three series packets and transmits them as one IP data flow.
  • Each packet identifier (PID) of a plurality of packets included in one IP data flow is set so as not to overlap.
  • the broadcast server compatible control information (SI) is a TLV packet sequence composed of a program table of a plurality of channel program contents transmitted by the broadcast server 21 and control information necessary for receiving processing of the contents of each channel. It is.
  • Channel 101 compatible data production data (image, audio, subtitles, etc.) + Channel 101 compatible control information (SI)
  • This is a TLV packet sequence composed of data unique to the channel 101 such as necessary control information.
  • Channel 102 compatible data (reproduction data (image, audio, subtitles, etc.) + Channel 102 compatible control information (SI)) is used for reproduction data of channel 102 program content, reproduction processing of program content of this channel, and the like. It is a TLV packet sequence composed of data specific to the channel 102 such as necessary control information.
  • channel 101 compatible data includes control necessary for reproduction of the program content of channel 101.
  • a TLV packet storing an MPT-101 storage packet that is a packet storing an MMT package table (MPT) corresponding to the channel 101 storing information is included.
  • channel 102 compatible data (reproduction data (image, audio, subtitles, etc.) + Channel 102 compatible control information (SI)) is necessary for reproducing the program content of channel 102.
  • a TLV packet storing an MPT-102 storing packet which is a packet storing an MMT package table (MPT) corresponding to the channel 102 storing the control information is included.
  • MPT MMT package table
  • the example shown in FIG. 32 is an example in which the broadcast server 21 transmits the three data series (A), (B), and (C) shown in FIG. 32 (2) as one IP data flow.
  • a unique PID packet identifier
  • a unique PID is set for each of all packets included in the three data series (A), (B), and (C) shown in FIG.
  • a unique PID is set for all TLV packets included in the three data series (A), (B), and (C) shown in FIG.
  • PID packet identification
  • the MPT-101 stored packet storing the MMT package table (MPT) corresponding to the channel 101 and the MPT-102 stored packet storing the MMT package table (MPT) corresponding to the channel 102 are also stored in the PID (packet identifier). It becomes possible to identify based on.
  • FIG. 33 shows the following figures as in FIG. (1) Transmission packet of broadcast server 21 (2) PID (packet identifier) setting example for transmission packet of broadcast server 21
  • the transmission packet of the broadcast server 21 shown in FIG. 33 (1) indicates a packet sequence of a TLV packet.
  • the TLV packet is configured by a packet storing various data such as reproduction target data such as images, sounds, and captions, and control information (SI). It is assumed that the broadcast server 21 transmits a plurality of program contents corresponding to a plurality of channels such as a CS301 channel and a CS302 channel, and control information.
  • the PID (packet identifier) setting example for the transmission packet of the broadcast server 21 shown in FIG. 33 (2) shows the following packet sequence as in FIG. (A) Broadcast server compatible control information (SI) (B) Data corresponding to channel 301 (reproduction data (image, sound, caption, etc.) + Control information corresponding to channel 301 (SI)) (C) Data corresponding to channel 302 (reproduction data (image, sound, caption, etc.) + Control information corresponding to channel 302 (SI))
  • SI Broadcast server compatible control information
  • the broadcast server 21 transmits, for example, the above-mentioned (A), (B), (C), and these three series packets mixedly. However, in the example shown in FIG. 33, the broadcast server 21 transmits (A), (B), (C), and these three sequences as three separate IP data flows. As described above, each packet identifier (PID) of a plurality of packets included in one IP data flow is set so as not to overlap.
  • PID packet identifier
  • the packet distribution example shown in FIG. 33 differs from FIG. 32 in that the broadcast server 21 transmits each of the three data series (A), (B), and (C) shown in FIG.
  • a PID (packet identifier) that is not duplicated in the sequence (C) is set in the TLV packet of the data sequence (C).
  • the example shown in FIG. 33 is an example in which PIDs (packet identifiers) with no duplication are set and transmitted in units of data series in this way.
  • the same PID (packet identifier) is set. May be set.
  • the PID (packet identifier) of the MPT-301 stored packet storing the MMT package table (MPT) corresponding to the channel 301 included in the data sequence (B) is the same as the data sequence (A) or (C) There is a possibility that it is set in another packet.
  • the PID (packet identifier) of the MPT-302 stored packet storing the MMT package table (MPT) corresponding to the channel 302 included in the data sequence (C) is the same PID (packet identifier) as the data sequence (A). Or (B) may be set for other packets.
  • the receiving apparatus uses only the PID (packet identifier) to store the MPT-301 stored packet storing the MMT package table (MPT) corresponding to the channel 301, or the channel 302. It becomes impossible to identify and selectively extract the MPT-302 stored packet storing the corresponding MMT package table (MPT).
  • MPT MMT package table
  • Japanese broadcast regulations allow transmission processing to be performed with one IP data flow setting shown in FIG. 32 for BS broadcasting and with a plurality of IP data flow settings shown in FIG. 33 for CS broadcasting.
  • Control information is transmitted from a transmission device such as the broadcast server 21 to the reception device.
  • This control information is control information included in the broadcast server correspondence control information (SI) shown in FIGS. 32 (2) (A) and 33 (2) (A), and is a package list table (PLT: Package List Table). Called.
  • a package list table (PLT: Package List Table) will be described with reference to FIG.
  • FIG. 34 shows the following packet sequences.
  • SI Broadcast server compatible control information
  • B Channel X compatible data (reproduction data (image, audio, subtitles, etc.) + Channel X compatible control information (SI))
  • C Channel Y compatible data (reproduction data (image, audio, caption, etc.) + Channel Y compatible control information (SI))
  • the broadcast server correspondence control information includes a package list table (PLT: Package List Table).
  • PKT Package List Table
  • the packets (MPT-X, MPT-Y) stored in the MMT package table (MPT) corresponding to each channel included in the other data series ((B), (C)) are selectively extracted.
  • MPT identification information for recording is recorded.
  • the receiving device refers to the MPT identification information recorded in the package list table (PLT), so that each data series, that is, a packet stored in the MMT package table (MPT) corresponding to each channel (MPT-X, MPT-Y) Can be selected and extracted. Further, the MMT package table (MPT) corresponding to each channel records PIDs (packet identifiers) in units of assets (images, sounds, subtitles, etc.) of the channel, and the receiving device can receive the MMT package table (MPT). It is possible to read PID (packet identifier) in units of assets (image, audio, subtitles, etc.) recorded in, and individually select and extract packets storing the image, audio, subtitles of that channel.
  • FIG. 35 shows the data structure (syntax) of the package list table (PLT).
  • the MMT general position information (MMT_general_location_info) 241 shown in FIG. 35 is the MPT identification information described above. That is, it is MPT identification information for selectively extracting the stored packets (MPT-X, MPT-Y) of the MMT package table (MPT) corresponding to each channel.
  • FIG. 36 is a diagram illustrating a data configuration (syntax) of MMT general position information (MMT_general_location_info) 241.
  • a packet identifier (packet_id) 242 shown in FIG. 36 is a PID (packet identifier) of the MMT package table (MPT) corresponding to each data series (each channel).
  • the receiving apparatus can selectively extract packets stored in the MMT package table (MPT) corresponding to each channel (for example, MPT-X and MPT-Y in FIG. 34). Become.
  • FIG. 37 is a diagram showing the data structure (syntax) of the MMT package table (MPT).
  • the MMT general position information (MMT_general_location_info) 243 shown in FIG. 37 is identification information for each asset (image, audio, caption, etc.). That is, it is information for identifying a packet storing an image, sound, and caption corresponding to a channel belonging to one channel.
  • FIG. 38 is a diagram illustrating a data configuration (syntax) of MMT general position information (MMT_general_location_info) 243 recorded in the MMT package table (MPT).
  • a packet identifier (packet_id) 244 shown in FIG. 38 is a PID (packet identifier) in units of assets (image, audio, caption, etc.) described above.
  • the receiving apparatus can individually select and extract a packet storing an image, audio, and caption corresponding to one channel.
  • the receiving apparatus has been described with reference to FIGS. (A)
  • the MMT package table (MPT) corresponding to each channel is identified and acquired, and the recorded data of the acquired MMT package table (MPT)
  • PTT package list table
  • MPT recorded data of the acquired MMT package table
  • the receiving apparatus records data on a medium such as a BD
  • a medium such as a BD
  • the data series (B) and data series (C) described with reference to FIGS. 32 to 34 packets belonging to the data series including these reproduction target data (TLV packets) are selected and BD or the like is selected. May be recorded on media.
  • the (A) broadcast server correspondence control information is not a recording target for the medium.
  • the package list table (PLT) included in the (A) broadcast server compatible control information is not recorded on the media.
  • the PID packet identifier
  • PPT package list table
  • all data series (A) to (C) are set to be recorded on the medium, and all TLV packets of a plurality of data series transmitted from one broadcasting station are recorded in one clip AV stream file.
  • Packets having the same packet identifier are mixed in one clip AV stream file, and in order to identify them, a packet storing a package list table (PLT) included in the clip AV stream file
  • PLT package list table
  • the clip AV stream file is MMT format data
  • the information processing apparatus that records data on a medium such as a BD has program information shown in FIG. 31 in the clip information file for recording the reproduction control information.
  • the PID (packet identifier) of the packet storing the MMT package table (MPT) is recorded in the program map PID [program_map_PID [i]] 233 recording area of the [ProgramInfo ()] 203, and this MPT or MPT is used.
  • IP data flow identification information that can identify “IP data flow (corresponding to data series (B), (C), etc. shown in FIGS. 32 to 34)” corresponding to the reproduction data to be reproduced is recorded.
  • FIG. 39 shows the data structure (syntax) of the program information [ProgramInfo ()] 203 recorded in the clip information file, as described with reference to FIG.
  • the data structure (syntax) of the program information [ProgramInfo ()] 203 shown in FIG. 39 is the program information [ProgramInfo ()] when the clip AV stream file reproduced by applying this clip information file is MMT format data. 203 data structure.
  • the data recording areas of the data 251 to 256 correspond to the recording area of the program map PID [program_map_PID [i]] 233 described with reference to FIG.
  • the storage location information of the map of the program sequence (program_sequence) is recorded in the recording area of the program map PID [program_map_PID [i]] 233.
  • the clip AV stream file reproduced by applying the clip information file is MMT format data, as shown in FIG. 39, the following data is stored in the recording area of the original program map PID [program_map_PID [i]] 233: Record.
  • Source IP address (src_IP_address) 251
  • Destination IP address (dest_IP_address) 252
  • Destination port (destination_port) 253
  • Source port (source_port) 254
  • Next header information (next_header) 255
  • MPT stored packet identifier MPT_PID
  • the data sets (1) to (5) correspond to the IP data flow identification information.
  • Source IP address (src_IP_address) 251 (2) Destination IP address (dest_IP_address) 252 (3) Destination port (destination_port) 253 (4) Source port (source_port) 254
  • Source IP address (src_IP_address) 251 (2) Destination IP address (dest_IP_address) 252
  • Destination port (destination_port) 253 Destination port (destination_port) 253
  • Source port (source_port) 254 These data are IP packet correspondence information corresponding to the IP packet stored in the TLV packet.
  • Next header information (next_header) 255 is a recording area for protocol type information, and records a fixed value [00010001] indicating UDP.
  • the data set composed of the five data (1) to (5) is information specific to the IP data flow. For example, when a plurality of IP data flows are mixedly transmitted from the same broadcast server, the data sets (1) to (5) are data sets having different settings for each IP data flow, and the IP data flow identification is performed. Data that can be used as information.
  • the information processing apparatus can determine the IP data flow by referring to the IP data flow identification information including these five data.
  • MPT stored packet identifier MPT_PID
  • MPT_PID MPT stored packet identifier
  • the program information [ProgramInfo ()] program of the clip information file corresponding to the clip AV stream file The following data is recorded in the map PID [program_map_PID [i]] recording area.
  • Source IP address (src_IP_address) 251 Destination IP address (dest_IP_address) 252 (3) Destination port (destination_port) 253 (4) Source port (source_port) 254 (5) Next header information (next_header) 255 (6) MPT stored packet identifier (MPT_PID) 256
  • the playback device that plays back data from the media reads the data (1) to (6) from the clip information file, and one IP data flow and its IP data. It is possible to select a packet that stores a flow-compatible MPT.
  • the IP data flow identification information constituted by the data (1) to (5) is recorded in the IP header of the IP packet stored in the TLV packet, and the recording device uses the data ( 1) to (5) are acquired, recorded in a clip information file, and recorded on a medium such as a BD. Also, the playback device refers to the IP header of the IP packet in the TLV packet in the clip AV stream file, reads the corresponding data of the data (1) to (5), and records the packet (TLV packet) recorded on the medium. / IP packet / MMTP packet) can be identified.
  • a clip AV stream file including a packet sequence of TLV packets is recorded on a medium such as a BD.
  • An IP packet is stored in each TLV packet, and an MMTP packet is stored in the IP packet.
  • Control information such as reproduction target data (image, audio, subtitle) and MMT package table (MPT) is stored as a payload of the MMTP packet.
  • the packet type (packet_type) is recorded in the TLV header set in the TLV packet.
  • the TLV packet can be identified as any of the following types (a) to (c).
  • “Compressed IP packet” indicates that the IP header of the IP packet stored in the TLV packet is set as compressed data. Specifically, it is an IP packet in which an IP header is set without data such as length data. In “IP (V6) packet” and “TLV-SI packet”, the IP header of the IP packet stored in the TLV packet is set as uncompressed data including length data and the like.
  • FIG. 41 is a diagram illustrating a data example of an IP header of an IP packet stored in a TLV packet storing an uncompressed type IP packet. Further, FIG. 42 shows a data ray of a packet data byte (packet_data_byte) in the IP header shown in FIG.
  • the IP header of the IP packet stored in the TLV packet includes the following five data sets that constitute the IP data flow identification information described with reference to FIG. Are recorded.
  • Destination port (destination_port) 253 Destination port (destination_port) 253
  • Source port (source_port) 254 Next header information (next_header) 255
  • An information processing apparatus that records received data from a transmission apparatus such as a broadcast server on a medium such as a BD reads, for example, the recording information of the IP header and stores an IP packet composed of the same IP header recording information.
  • a clip AV stream file composed of packets can be generated and recorded on a medium. Further, as described above with reference to FIG. 39, the IP of (1) to (5) above is recorded in the program map PID [program_map_PID [i]] recording area of the program information [ProgramInfo ()] of the clip information file. Record data flow identification information.
  • the PID (packet identifier) of the MPT storage packet recorded as the clip AV stream file is also recorded in the program map PID [program_map_PID [i]] recording area of the program information [ProgramInfo ()].
  • the PID (packet identifier) of the MPT storage packet recorded as a clip AV stream file can be obtained from the package list table (PLT) transmitted from the transmission apparatus described above with reference to FIGS. .
  • the MPT storage packet matching the IP data flow identification information of the data series (channel) to be recorded on the media is extracted and extracted.
  • the PID (packet identifier) of the packet may be recorded.
  • the example of the IP header of the IP packet described with reference to FIGS. 41 and 42 is a data configuration example of the IP header in the case of an uncompressed IP packet.
  • an example of the data structure of the IP header in the case of a compressed IP packet will be described with reference to FIGS.
  • the compressed IP header includes Context identifier (CID), IPv6 header information UDP header information is recorded.
  • CID Context identifier
  • IPv6 header information UDP header information is recorded.
  • the IPv6 header information and the UDP header information include five data sets that constitute the IP data flow identification information described above with reference to FIG. 39, as in the IP header of the uncompressed IP packet. The following five pieces of data are recorded.
  • Destination port (destination_port) 253 (4) Source port (source_port) 254
  • An information processing apparatus that records received data from a transmission apparatus such as a broadcast server on a medium such as a BD reads, for example, the recording information of the IP header and stores an IP packet composed of the same IP header recording information.
  • a clip AV stream file composed of packets can be generated and recorded on a medium. Further, as described above with reference to FIG. 39, the IP of (1) to (5) above is recorded in the program map PID [program_map_PID [i]] recording area of the program information [ProgramInfo ()] of the clip information file. Record data flow identification information.
  • program map PID [program_map_PID [i] of the program information [ProgramInfo ()] is also obtained for the PID (packet identifier) of the MPT storage packet recorded as the clip AV stream file by the same process as the process of the previous uncompressed IP packet. ] Record in the recording area.
  • the packet sequence to be recorded in the clip AV stream file is a TLV packet sequence including a compressed IP packet
  • the above IP data flow identification information (1) to (5) is not recorded in the clip information file. Is also possible. Instead of the above IP data flow identification information (1) to (5), it is the recording data of the IP header in the case of the compressed IP packet shown in FIG. Context identifier (CID), May be recorded in the clip information file.
  • CID Context identifier
  • the context identifier is set as an identifier unique to the IP data flow. Specifically, the five data mentioned above, ie, (1) Source IP address (src_IP_address) 251 (2) Destination IP address (dest_IP_address) 252 (3) Destination port (destination_port) 253 (4) Source port (source_port) 254 (5) Next header information (next_header) 255 Different values depending on these data sets are set as the value of the context identifier (CID).
  • the IP data flow can be identified based on the context identifier (CID).
  • CID context identifier
  • the IP data flow to which the packet belongs is determined. It becomes possible to do.
  • a packet in which the same CID is set in the IP header is a packet belonging to the same IP data flow.
  • the packet sequence to be recorded in the clip AV stream file is a TLV packet sequence including a compressed IP packet
  • a context identifier is used instead of the IP data flow identification information of (1) to (5) above. (CID) may be recorded in the clip information file.
  • FIG. 45 shows the data structure (syntax) of program information [ProgramInfo ()] 203 recorded in the clip information file shown in FIG. 24, as described above with reference to FIG.
  • the data structure (syntax) of the program information [ProgramInfo ()] 203 shown in FIG. 45 is MMT format data in which a clip AV stream file reproduced by applying this clip information file is stored in an IP packet having a compressed IP header. Is the data configuration of program information [ProgramInfo ()] 203.
  • the data recording area of the data 261 to 262 corresponds to the recording area of the program map PID [program_map_PID [i]] 233 described with reference to FIG.
  • the clip AV stream file reproduced by applying the clip information file is MMT format data stored in the IP packet having the compressed IP header, as shown in FIG. 45, the original program map PID [program_map_PID [i] ]
  • the following data is recorded in the recording area 233.
  • MPT_PID MPT stored packet identifier
  • (1) context identifier (CID) 261 corresponds to IP data flow identification information.
  • the context identifier (CID) is information recorded in the compressed IP header of the IP packet stored in the TLV packet.
  • the context identifier (CID) is information unique to the IP data flow. For example, when a plurality of IP data flows are mixedly transmitted from the same broadcast server, (1) the context identifier (CID) has a different value for each IP data flow.
  • the information processing apparatus can determine the IP data flow by referring to the context identifier (CID).
  • MPT_PID MPT stored packet identifier
  • the program information [ProgramInfo ()] program of the clip information file corresponding to the clip AV stream file The following data is recorded in the map PID [program_map_PID [i]] recording area.
  • MPT_PID MPT stored packet identifier
  • a playback apparatus that plays back data from the media reads the data (1) to (2) from the clip information file, and one IP data flow and its IP data. It is possible to select a packet that stores a flow-compatible MPT.
  • the context identifier (CID) 261 is recorded in the compressed IP header of the IP packet stored in the TLV packet, and the recording device obtains (1) the context identifier (CID) 261 from the compressed IP header. It is acquired, recorded in a clip information file, and recorded on a medium such as a BD. Also, the playback device refers to the compressed IP header of the IP packet in the TLV packet in the clip AV stream file, reads the context identifier (CID), and records the packet (TLV packet / IP packet / MMTP packet) recorded on the medium. ) To which the IP data flow belongs.
  • FIG. 46 shows the data structure (syntax) of program information [ProgramInfo ()] 203 recorded in the clip information file shown in FIG. 24, as described above with reference to FIGS. 39 and 45.
  • the data structure (syntax) of the program information [ProgramInfo ()] 203 shown in FIG. 46 is the program information [ProgramInfo ()] when the clip AV stream file reproduced by applying this clip information file is MMT format data. 203 data structure.
  • the data recording area of the data 265 to 266 corresponds to the recording area of the program map PID [program_map_PID [i]] 233 described with reference to FIG.
  • the clip AV stream file reproduced by applying the clip information file is MMT format data
  • the following data is stored in the recording area of the original program map PID [program_map_PID [i]] 233: Record.
  • PKT Program list table
  • MPT MMT package table
  • FIG. 47 shows the following two data configuration examples.
  • A1 Program list table (PLT) information
  • (A1) program list table (PLT) information is composed of the following data.
  • PTT Program list table (PLT) packet identification information (PLT_PID) 272
  • the IP data flow identification information 271 is composed of the following five data sets described above with reference to FIG. (1) Source IP address (src_IP_address) (2) Destination IP address (dest_IP_address) (3) Destination port (destination_port) (4) Source port (source_port) (5) Next header information (next_header)
  • the IP data flow identification information 271 is IP data flow identification information corresponding to an IP data flow including a packet storing a program list table (PLT). That is, it is IP data flow identification information that can identify the IP data flow of (A) broadcast server correspondence control information (SI) described with reference to FIGS.
  • PKT program list table
  • the program list table (PLT) packet identification information (PLT_PID) 272 is a packet identifier (PID) set in the packet storing the program list table (PLT) included in the IP data flow identified by the IP data flow identification information 271. It is.
  • the information processing apparatus When reproducing data from the media, the information processing apparatus first refers to the IP data flow identification information 271 recorded in the clip information file, and thereby includes an IP data flow including a packet storing a program list table (PLT). Is determined. Further, Program list table (PLT) packet identification information (PLT_PID) 272 It is possible to read this data, check the PID of the PLT storage packet included in the determined IP data flow, and specify the program list table (PLT) storage packet of the IP data flow based on this PID. .
  • PLT program list table
  • the MPT PID corresponding to each data series (each IP data flow) can be acquired.
  • MMT package table (MPT) information is recorded.
  • MMT package table (MPT) information is composed of the following data.
  • the IP data flow identification information 273 includes the following five data sets described above with reference to FIG. (1) Source IP address (src_IP_address) (2) Destination IP address (dest_IP_address) (3) Destination port (destination_port) (4) Source port (source_port) (5) Next header information (next_header)
  • the IP data flow identification information 273 is IP data flow identification information corresponding to an IP data flow including a packet storing an MMT package table (MPT). That is, the IP data flow identification information that can identify the IP data flow (B) or (C) described with reference to FIGS.
  • MPT MMT package table
  • the MMT package table (MPT) packet identification information (MPT_PID) 274 is a packet identifier (PID) set in a packet storing the MMT package table (MPT) included in the IP data flow identified by the IP data flow identification information 272. It is.
  • the information processing apparatus When reproducing data from the media, the information processing apparatus refers to the IP data flow identification information 273 recorded in the clip information file to determine the IP data flow including the packet storing the MMT package table (MPT). To do. further, MMT package table (MPT) packet identification information (MPT_PID) 274 It is possible to read this data, check the PID of the MPT stored packet included in the determined IP data flow, and specify the MMT package table (MPT) stored packet of the IP data flow based on this PID. .
  • MPT MMT package table
  • MMT MMT package table
  • the program information [ProgramInfo ()] program of the clip information file corresponding to the clip AV stream file The following information shown in FIG. 47 is recorded in the map PID [program_map_PID [i]] recording area.
  • PHT Program list table
  • MPT MMT package table
  • a playback device that plays back data from the media reads the data (A1) and (A2) from the clip information file.
  • the playback apparatus determines the IP data flow of the program list table (PLT) stored packet based on these data, and determines the program list table (PLT) based on the packet identifier (PID) of the program list table (PLT) stored packet. ) Can be obtained. Further, the IP data flow of the MMT package table (MPT) stored packet can be determined, and the MMT package table (MPT) can be acquired based on the packet identifier (PID) of the MMT package table (MPT) stored packet.
  • FIG. 48 shows the clip information file shown in FIG. (1) Program list table (PLT) information (PLTInfo) 265 (2) MMT package table (MPT) information (MPTInfo) 266 It is a figure which shows another specific example of the said data (1), (2).
  • PHT Program list table
  • MPT MMT package table
  • FIG. 48 is an example of PLT information and MPT information applicable when the packet stored in the clip AV stream file is MMT format data having a compressed IP header.
  • FIG. 48 shows the following two data configuration examples.
  • (B1) program list table (PLT) information is composed of the following data.
  • Context identifier (CID) 276
  • Program list table (PLT) packet identification information (PLT_PID) 277
  • the context identifier (CID) 276 is used as IP data flow identification information as described above.
  • the context identifier (CID) 276 is used as IP data flow identification information corresponding to an IP data flow including a packet storing a program list table (PLT).
  • PHT program list table
  • MMT package table (MPT) information is composed of the following data.
  • the context identifier (CID) 278 is used as IP data flow identification information corresponding to an IP data flow including a packet storing an MMT package table (MPT).
  • a playback device that plays back data from the media reads the data (B1) and (B2) from the clip information file.
  • the playback apparatus determines the IP data flow of the program list table (PLT) stored packet based on these data, and determines the program list table (PLT) based on the packet identifier (PID) of the program list table (PLT) stored packet. ) Can be obtained. Further, the IP data flow of the MMT package table (MPT) stored packet can be determined, and the MMT package table (MPT) can be acquired based on the packet identifier (PID) of the MMT package table (MPT) stored packet.
  • FIG. 49 is a diagram illustrating a data configuration (syntax) of stream coding information [StreamCodingInfo] set in the program information [ProgramInfo ()] recording area of the clip information file. The following data is recorded in the stream coding information [StreamCodingInfo].
  • Image stream coding information 281 (2) audio stream coding information 282,
  • coding modes of image streams and audio streams recorded on the information recording medium (media) are allowed, and identifiers corresponding to each coding type are preliminarily set for both images and sounds. It is prescribed.
  • type identifiers 0x01, 0x02, 0x1B, and the like are associated with each other according to the coding type (encoding type).
  • FIG. 50 shows an example of setting the coding type of an image stream or an audio stream defined in the current BDAV format.
  • the coding type 0x01 is an MPEG-1 image stream
  • 0x02 is an MPEG-2 image stream
  • 0x03 is an MPEG-1 audio stream.
  • HEVC encoding which is an image encoding type not defined in the current BDAV format
  • MPEG-4 AAC encoding and MPEG-4 ALS encoding which are audio encoding types not defined in the current BDAV format. It is necessary to newly assign an encoding type identifier for these encoding types.
  • FIG. 50 shows a setting example of coding type identifiers of new encoded data of these MMT format data.
  • a new encoding used in this way in the MMT format Sets the data coding type identifier.
  • Information recorded as the image stream coding information 281 is the following information.
  • Pieces of information are information relating to images recorded on the information recording medium (media). Furthermore, when the media recording image has a format different from that of the input image (original image), for example, when the input image (original image) is data that has undergone format conversion or the like, the image information described above is used. In addition to the above, the following information is also recorded as information on the original image before conversion, that is, information on the original image input by the information processing apparatus through broadcast waves or the like.
  • Original video format original_video_format
  • Original aspect ratio original_aspect_ratio
  • (2) Information recorded as the audio stream coding information 282 is the following information.
  • FIG. 49 shows the following information recording areas as information recording areas of these new encoded data.
  • a new information recording area is set, and the above information (1a) to (1e) is recorded for image data, and the above information (2a) to (2b) is recorded for audio data.
  • the above information (1a) to (1e) is recorded for image data
  • the above information (2a) to (2b) is recorded for audio data.
  • An example of stream coding information [StreamCodingInfo] recording data for HEVC image data will be described with reference to FIG.
  • the information recorded as stream coding information about the HEVC image is the following information as shown in FIG. (1) Video format (video_format) (2) Frame rate (3) Aspect ratio (aspect_ratio) (4) Video signal transfer characteristics (video_transfer_characteristics)
  • Pieces of information are information relating to images recorded on the information recording medium (media). Furthermore, when the media recording image has a format different from that of the input image (original image), for example, when the input image (original image) is data that has undergone format conversion or the like, the image information described above is used. In addition to the above, the following information is also recorded as information on the original image before conversion, that is, information on the original image input by the information processing apparatus through broadcast waves or the like. (5) Original video format (original_video_format) (6) Original aspect ratio (original_aspect_ratio) (7) Original video signal transfer characteristics (original_video_transfer_characteristics)
  • FIG. 51B is a diagram illustrating a specific recording example and meaning of video signal transfer characteristics (video_transfer_characteristics).
  • a value from 0 to 15 is set as the video signal transfer characteristic (video_transfer_characteristics).
  • This video signal transfer characteristic is information indicating the correspondence between the input signal value and the output signal.
  • Rec. ITU-R BT. 709-5, IEC 61966-2-4, Rec. ITU-R BT. 2020, SMPTE ST 2084, and ARIB STD-B607 all show input / output characteristic curves indicating the correspondence between input signals and output signals, and have different characteristics.
  • the set value of the video signal transfer characteristic (video_transfer_characteristics) is 0 to 15
  • the input / output characteristic of the HEVC encoded image can be known.
  • the following data is recorded in the stream coding information [StreamCodingInfo] set in the program information [ProgramInfo ()] recording area of the clip information file.
  • StreamCodingInfo set in the program information [ProgramInfo ()] recording area of the clip information file.
  • Image stream coding information 281 (2) audio stream coding information 282,
  • Information recorded as the image stream coding information 281 is the following information.
  • the data received by the information processing apparatus via broadcast waves or the like is MMT format data, and includes image data in a data format that is not defined in the conventional BDAV format. Accordingly, the image information (1a) to (1e) must be changed or added in accordance with the image format stored in the MMT format data. This modification will be described with reference to FIG.
  • FIG. 52 is a diagram showing a modification example of the following data recording area.
  • FIG. 52 shows the following recorded data example.
  • the conventional image format recording data has the following settings.
  • Each of the bit values 0 to 15 is a setting in which the image modes of 480i, 576i, 480p, 1080p, 720p, and 1080p are associated with each other.
  • i means an interlace type
  • p means a progressive type image output configuration
  • numerical values 480, 576, etc. mean the number of pixels in the horizontal direction of the image.
  • 1080p is a progressive image with 1080 pixels in the horizontal direction.
  • the new image format recording data is a setting in which the definition of 4K image or 8K image is further added to the above (p) conventional image format recording data.
  • the following additional data 286 shown in the figure is added.
  • Bit value: 7 2160p
  • These are the latest image formats that may be distributed according to the MMT format.
  • the correct image data format (coding information) is recorded in the stream coding information in the clip information file defined in the BDAV format for the latest format image distributed according to the MMT format. It becomes possible.
  • FIG. 53 is a diagram showing a modification example of the following data recording area.
  • (1b) Frame rate FIG. 53 shows the following recorded data example.
  • the conventional frame rate recording data has the following settings. Each of the bit values 0 to 15 is associated with each image having a frame rate of 24000/1001 (23.976) to 60 Hz.
  • the correct image data format (coding information) is recorded in the stream coding information in the clip information file defined in the BDAV format for the latest format image distributed according to the MMT format. It becomes possible.
  • FIG. 54 is a diagram showing a recording example of the following data.
  • the distribution data according to the MMT format is also within the definition data range of the conventional BDAV format and does not need to be changed.
  • each of bit values 0 to 15 can record data of 4: 3, 16: 9, 2.21: 2 as aspect ratios.
  • the stream coding information [StreamCodingInfo] set in the program information [ProgramInfo ()] recording area of the clip information file includes: (2) audio stream coding information 282, Is recorded.
  • Audio type Audio_presentation_type
  • Sampling frequency sampling_frequency
  • the audio type recording data in FIG. 55 (a) has data settings that can identify various audio type information such as mono channel, stereo, and surround for bit values 0 to 15.
  • the sampling frequency in FIG. 55 (b) is set to data that can identify each sampling frequency of 48 to 192 kHz with respect to bit values 0 to 15.
  • distribution data according to the MMT format is also within the range of definition data in the current BDAV format and does not require any particular change.
  • the information processing apparatus can apply these stream coding information to confirm the attributes of the image data and audio data to be reproduced, and perform decoding processing and reproduction processing according to the confirmed image attributes and audio attributes. It becomes.
  • an information processing apparatus that receives distribution content (program) from a broadcasting station in MMT format data and records the received content on an information recording medium (medium), receives the image attribute information from the received data according to the MMT format data. It is necessary to extract information corresponding to (image stream coding information) and audio attribute information (audio stream coding information) and generate a clip information file in which these data are recorded.
  • the MMT format data includes setting information necessary for receiving content (program) on the information processing apparatus 30 side, guide information such as a program guide, and notifications.
  • Guide information such as a program guide
  • Control information SI configured by information, control information, and the like is included.
  • the information processing apparatus 30 that receives MMT format data and records the received data on a medium uses the above-described image attribute information (image stream coding information) from control information such as TLV-SI and MMT-SI included in the MMT format. Then, data corresponding to information corresponding to the audio attribute information (audio stream coding information) is extracted, and a clip information file in which these data is recorded is generated.
  • image attribute information image stream coding information
  • control information such as TLV-SI and MMT-SI included in the MMT format.
  • CPI information recorded in the clip information file will be described.
  • CPI information [CPI ()] 204 is recorded in the clip information file.
  • the CPI information [CPI ()] 204 is, for example, data for acquiring the data address of the playback start point, and EP_map and TU_map described above with reference to FIGS. 13 to 15 are recorded.
  • the CPI type (CPI_type) is recorded in the playlist file.
  • the CPI type (CPI_type) is information indicating a CPI type in a clip information file referred to by a play item (PlayItem) defined in the playlist file.
  • CPI Chargeristic Point Information
  • the CPI information [CPI ()] 204 is, for example, data for acquiring the data address of the playback start point, and EP_map and TU_map described above with reference to FIGS. 13 to 15 are recorded.
  • CPI Chargeristic Point Information
  • CPI is recording data of a clip information file, for example, data for obtaining a data address of a reproduction start point.
  • the reproduction target data is MMT format data
  • the EP map has access point information corresponding to the playback start position and playback end position where random playback can be started in the playback data stored in the clip AV stream file. It is the map which recorded. That is, the EP map includes a time stamp (PTS: presentation time stamp) representing the reproduction start position on the time axis and address information (SPN: source packet number) for packet acquisition corresponding to the packet position information. Corresponding data is recorded.
  • PTS presentation time stamp
  • SPN source packet number
  • the playback device uses a packet number (SPN) of a packet storing data corresponding to the data position based on a time stamp (PTS: presentation time stamp) corresponding to a randomly accessible data position. ) And the acquired SPN setting packet can be acquired and played back.
  • SPN packet number
  • PTS presentation time stamp
  • FIG. 57 is a diagram showing a data structure (syntax) of an EP map stored in the clip information file.
  • the clip AV stream is a video stream composed of source packets identified by the packet identifier: PID.
  • the video stream is distinguished for each source packet by the PID included in the header of the transport packet in the source packet.
  • the EP map is set for each stream identified by a packet identifier (PID).
  • a packet identifier (PID) for stream identification is recorded in the stream PID (stream_PID [k]) recording area 289 of the EP map shown in FIG.
  • one stream unit EP map is recorded in the EP map recording area 290 of FIG.
  • the reproduction target data by the EP map is MMT format data
  • the clip AV stream file includes a plurality of IPs.
  • packets corresponding to data flows may be mixed, and in this case, packet identifiers (PID) may be duplicated.
  • the packet identifier (PID) is set in units of IP data flows, and a plurality of IP data flows, for example, a plurality of data series shown in FIG. Distribution processing in which A) to (C) are set as different IP data flows may be performed.
  • the information processing apparatus 30 which is a receiving apparatus on the user side records all these data packets as one clip AV stream file on a medium such as BD, one packet with the same packet identifier (PID) is set. It exists in the clip AV stream file.
  • the reproduction target data by the EP map is MMT format data
  • information for identifying the IP data flow is recorded in the EP map.
  • An example of the data structure of the EP map corresponding to the MMT format data is shown in FIG.
  • the IP data flow identification information 291 is recorded, and then a recording area for the stream PID (stream_PID) is set.
  • the IP data flow identification information 291 is IP data flow identification information similar to the program information [ProgramInfo ()] data recorded in the clip information file described above with reference to FIG.
  • the IP data flow identification information 291 is information for identifying the IP data flow to which the packet selected by the stream PID (stream_PID) recorded immediately after the IP data flow identification information 291 belongs.
  • the IP data flow identification information 291 is configured by the following data set.
  • Next header information (next_header) are IP packet correspondence information corresponding to the IP packet stored in the TLV packet. Note that (5) next header information (next_header) is a recording area for protocol type information, and records a fixed value [00010001] indicating UDP.
  • the data set composed of the data (1) to (5) is information specific to the IP data flow. For example, when a plurality of IP data flows are mixedly transmitted from the same broadcast server, the data sets (1) to (5) are data having different settings for each IP data flow.
  • the information processing apparatus identifies the IP data flow to which the set packet of the stream PID (stream_PID) recorded following the IP data flow identification information 291 belongs. After this IP data flow identification, a stream PID (stream_PID) setting packet is selected, and a packet storing random access reproduction target data is detected.
  • FIG. 59 shows the data structure of the EP map when the clip AV stream file reproduced by applying this EP map is MMT format data stored in an IP packet having a compressed IP header.
  • the clip AV stream file reproduced by applying the clip information file is MMT format data stored in an IP packet having a compressed IP header, as shown in FIG.
  • a context identifier (CID) 292 is recorded, and then a recording area for a stream PID (stream_PID) is set.
  • the context identifier (CID) 292 is used as IP data flow identification information as described above with reference to FIG.
  • the information processing apparatus can determine the IP data flow by referring to the context identifier (CID).
  • the information processing apparatus refers to the context identifier (CID) 292 recorded in the EP map, and thereby the IP data flow to which the set packet of the stream PID (stream_PID) recorded following the context identifier (CID) 292 belongs. Identify. After this IP data flow identification, a stream PID (stream_PID) setting packet is selected, and a packet storing random access reproduction target data is detected.
  • EP map recording area 290 in the EP map shown in FIG. 57 recording data in the EP map recording area 290 in the EP map shown in FIG. 57 will be described.
  • specific EP map data EP_map_for_one_stream_PID
  • EP_map_for_one_stream_PID A data configuration example of the MMT format-compliant EP map data (EP_map_for_one_stream_PID) will be described with reference to FIG.
  • the conventional EP map corresponding to MPEG-2TS format data includes a playback start position and playback that can start random playback in playback data stored in a clip AV stream file. Access point information corresponding to the end position is recorded. That is, in the conventional EP map corresponding to TS packets, a time stamp (PTS: presentation time stamp) expressing the reproduction start position on the time axis, and address information (SPN) for acquiring a packet corresponding to the packet position information : Source packet number) is recorded.
  • PTS presentation time stamp
  • SPN address information
  • the playback device uses a packet number (SPN) of a packet storing data corresponding to the data position based on a time stamp (PTS: presentation time stamp) corresponding to a randomly accessible data position. ) And the acquired SPN setting packet can be acquired and played back.
  • SPN packet number
  • PTS presentation time stamp
  • FIG. 60 shows an example of an EP map corresponding to MMT format data.
  • FIG. 60 shows data recorded in the EP map recording area 290 in the EP map shown in FIG. 57 when the reproduction target data is MMT format data.
  • NTP_time In an NTP time recording area (NTP_time) 293, 64-bit NTP (Network Time Protocol) time is recorded.
  • This time information corresponds to, for example, a time stamp (PTS: presentation time stamp) that represents the reproduction start position of the random access destination included in the reproduction data reproduced by applying this EP map on the time axis.
  • PTS presentation time stamp
  • the time information according to NTP (network time protocol) recorded in the EP map is acquired from control information (SI) such as MPT (MMT package table) described above with reference to FIG.
  • SI control information
  • TLV_byte_address In the TLV byte address recording area (TLV_byte_address) 294, address information indicating the packet position of the TLV packet storing the reproduction target data reproduced by applying this EP map is recorded. Specifically, for example, as the position information of the reproduction target data storage packet (TLV packet) such as image (V), audio (A), or subtitle, the first packet (TLV packet) of the clip AV stream file in which this packet is stored ) Record the number of bytes from the beginning position. For example, the number of bytes is recorded with 64 bits.
  • the playback device MMT byte address recording area (MMT_byte_address) 294, Using this data, the packet position of the reproduction data storage packet can be detected immediately.
  • a clip AV stream file composed of a TLV packet sequence storing MMT format data is recorded on a recording medium such as a BD.
  • TLV_byte_address the TLV byte address recording area
  • a TLV packet storing reproduction data that can be accessed randomly can be determined based on the setting of a RAP (random access point) flag set in the packet header of the MMTP packet in the TLV packet.
  • RAP random access point
  • FIG. 62 is a diagram illustrating a data configuration (syntax) of an MMTP packet constituting MMT format data transmitted from the transmission device 20 such as a broadcasting station to the information processing device 30, for example.
  • the MMTP packet is composed of an MMTP header and an MMTP payload.
  • One type of data is stored in the MMTP payload of one MMTP packet. Specifically, for example, image (V), audio (A), caption (S), control information (MMT-SI) stored in the MMTP packet, any one of these data is stored in an individual MMTP packet. Is done.
  • FIG. 62 shows the data structure of one MMTP packet, which is composed of a header part 296 and a payload part 297. Information such as the type of data stored in the payload portion 297 is recorded in the header portion 296. A random access point information flag (RAP_flag) 298 is recorded as one of the recording data of the header part 296.
  • RAP_flag random access point information flag
  • the random access point information flag (RAP_flag) 298 is It is a flag indicating whether or not the MMTP packet is a packet storing data serving as a random access point, 1 if the packet is a random access point storing data, 0 if the packet is not a random access point storing data, A flag for this setting is recorded.
  • a playback device that plays back data recorded on a medium checks a random access point information flag (RAP_flag) recorded in an MMTP packet header of a packet sequence constituting a clip AV stream file, and It is possible to store reproduction data that can be detected and detect packets.
  • RAP_flag random access point information flag
  • the EP map corresponding to the MPEG-2TS format is This is a configuration in which correspondence data between PTS (presentation time stamp) and SPN (source packet number) is recorded.
  • PTS presentation time stamp
  • SPN source packet number
  • NTP Network Time Protocol
  • the reason for replacing the data in this way is that the data transmitted from the broadcasting station or the like according to the MMT format does not have data that matches the PTS or SPN defined in the MPEG-2TS format. This is because the size of the TS packet in the MPEG-2 TS format is fixed (188 bytes), whereas the MMTP packet according to the MMT format is an unfixed variable length packet.
  • the information processing apparatus records input data according to the MMT format as BDAV format data on an information recording medium such as a BD, HD, or flash memory. Further, in this data recording process, control information, attribute information, etc. corresponding to MMT format data are recorded in a database file such as a playlist or a clip information file.
  • TLV-SI which is control information included in input data according to the MMT format
  • various information recording tables constituting the MMT-SI.
  • the information processing apparatus acquires various information from the received data, and records information corresponding to the media recording content in a database file such as a playlist or a clip information file defined in the BDAV format.
  • FIG. 63 is a diagram illustrating a configuration of an information processing device 300 that executes data recording processing on an information recording medium such as a BD.
  • the information processing apparatus 300 records a clip AV stream file and a database file such as a playlist or a clip information file on an information recording medium (recording medium) 320.
  • the data input unit 301 inputs MMT format data 331 for the information recording medium 320, that is, MMT format data 331 including image data, audio data, caption data, and the like.
  • the data input unit 301 is a receiving unit that transmits MMT format data 331, for example, a receiving unit that receives transmission data from a broadcasting station, a content server, or the like, or a media reading unit that reads data from a medium on which MMT format data 331 is recorded. Composed of etc.
  • the MMT format data 331 input from the data input unit 301 is data in accordance with the data format described above with reference to FIG. 2, and includes high-definition image data such as HEVC images, for example.
  • the MMT format data 331 is stored in the storage unit 304 under the control of the control unit 303.
  • the user input unit 302 inputs, for example, a data recording start request for the information recording medium 320.
  • the demultiplexer (DeMUX) 305 is a packet that stores data such as images, audio, and captions from the MMT format data 331, control information (TLV-SI, MMT-SI) that stores notification information, control information, and the like.
  • the auxiliary information is acquired, classified into data type packets, and the subtitle data generation unit 311, the image data generation unit 312, the audio data generation unit 313, and the auxiliary data of the recording data generation unit 306 are classified according to the data type.
  • the information is input to the information generation unit 314.
  • the subtitle data generation unit 311 acquires subtitle data from the MMT format data 331 input by the data input unit 301 and stored in the storage unit 304, and generates stream file storage data defined in the BDAV format.
  • the image data generation unit 312 acquires image data from the MMT format data 331 input by the data input unit 301 and stored in the storage unit 304, and generates stream file storage data defined in the BDAV format.
  • the audio data generation unit 313 acquires audio data from the MMT format data 331 input by the data input unit 301 and stored in the storage unit 304, and generates stream file storage data defined in the BDAV format.
  • the auxiliary information generation unit 314 receives control information (TLV-SI, MMT-SI) and the like stored from the MMT format data 331 input by the data input unit 301 and stored in the storage unit 304, such as notification information and control information. Auxiliary information is acquired, and data to be stored in a playlist file, clip information file, or clip AV stream file as a database file defined in the BDAV format is generated.
  • control information TLV-SI, MMT-SI
  • the multiplexer (MUX) 315 includes a caption data generation unit 311, an image data generation unit 312, subtitle, image, and audio data converted by the audio data generation unit 313, and an auxiliary information generation unit 314 provides control information ( Various information acquired from TLV-SI, MMT-SI, etc. is input, and a stream file storing these data is generated.
  • the database file generation unit 316 stores a database file such as a playlist file or a clip information file in which various information acquired from the control information (TLV-SI, MMT-SI) of the MMT format data 331 by the auxiliary information generation unit 314 is recorded. Generate.
  • the recording file 332 including the stream file data generated by the recording data generation unit 306 and the database file such as the playlist file and the clip information file is transmitted via the drive 307 by the recording unit 306 under the control of the control unit 303.
  • the data is output to the recording medium 320 and recorded.
  • the processing according to the flow shown in FIG. 64 can be executed under the control of a data processing unit (control unit) including a CPU having a program execution function, for example, according to a program stored in the storage unit of the information processing device. it can.
  • a data processing unit control unit
  • CPU central processing unit
  • program execution function for example, according to a program stored in the storage unit of the information processing device.
  • Step S101 First, in step S101, the information processing apparatus 300 inputs MMT format data that is recording data via the data input unit 301.
  • the recording data includes image data, audio data, caption data, and control information (TLV-SI, MMT-SI) storing notification information and control information.
  • step S102 the information processing apparatus 300 performs demultiplex processing of the input MMT format data, that is, data separation processing in units of data types. Separation processing of image, sound, caption, control information, etc. is executed.
  • step S103 the information processing apparatus 300 stores the control information separated in step S102, for example, control information (TLV-SI, MMT-SI) in the memory.
  • control information TLV-SI, MMT-SI
  • Step S104 the information processing device 300 executes re-encoding processing of at least one of the image, audio, and caption core data separated in step S102. This process is performed when the encoding mode of data to be recorded on the information recording medium is changed. When the received data is recorded as it is, this re-encoding process is unnecessary.
  • Step S105 the information processing apparatus 300 executes a multiplexing process of data including the image, the audio, the caption, and the reproduction control information including the data encoded in step S103. That is, a clip AV stream file generation process is executed.
  • the playback control information stored in the clip AV stream file includes, for example, MPT (MMT package table) described with reference to FIG.
  • step S106 the information processing apparatus 300 generates a clip information file using the configuration data of the input MMT format data.
  • the clip information file described above with reference to FIGS. 24 to 62 that is, the clip information file corresponding to the clip AV stream file storing the MMT format data is generated.
  • step S106 The detailed sequence of the clip information file generation process in step S106 will be described in detail later with reference to the flow shown in FIG.
  • Step S107 the information processing apparatus 300 generates a playlist file using the configuration data of the input MMT format data.
  • a playlist file described above with reference to FIGS. 12 to 23, that is, a playlist file corresponding to a clip AV stream file storing MMT format data is generated. Details of the playlist file generation processing in step S107 will be described later with reference to FIG.
  • step S108 the information processing apparatus 300 generates another database file using the input MMT format data.
  • Step S109 the information processing apparatus 300 generates BDAV format data using the generated AV stream file and database file.
  • Step S110 the information processing apparatus 300 records the BDAV format data generated in step S109 on an information recording medium (medium).
  • step S106 a detailed sequence of the clip information file generation process executed in step S106 will be described with reference to the flowchart shown in FIG.
  • the flowchart shown in FIG. 65 is a clip information generation sequence used for controlling a clip AV stream file storing MMT format data. The processing of each step in the flow shown in FIG. 65 will be described sequentially.
  • Step S121 the information processing apparatus 300 checks a RAP (random access point) flag of an MMTP packet that is MMT format data stored in a clip AV stream file. This process is the process described above with reference to FIG.
  • the MMTP packet in which the RAP flag 1 is data including a random access point.
  • This process is a process for generating an EP map corresponding to the MMT format data described above with reference to FIGS.
  • the time information uses NTP (network type protocol) time.
  • step S123 the information processing apparatus 300 sets the value of the application type (Application_type) and clip stream type (Clip_stream_type) of the clip information file to [3].
  • This process is the process described above with reference to FIGS. 25 to 27, and makes it possible to identify that the storage data of the clip AV stream file that is the control target data of the clip information file is MMT format data. This is a process for recording the set value.
  • step S124 the information processing apparatus 300 records the recording rate (recording_rate) and the average rate (average_rate) of the clip information file.
  • This process is performed using the TS average rate (TS_average_rate) 214 described above with reference to FIG. TS recording rate (TS_recording_rate) 215, These data recording processes.
  • TS_average_rate TS average rate
  • TS_recording_rate TS recording rate
  • This bit rate information is assumed to be calculated based on the TS packet.
  • the reproduction target data is MMT format data having an MMT packet or a TLV packet
  • a bit rate corresponding to the MMT format is calculated and recorded.
  • an invalid value may be recorded in this field, and the bit rate information may not be used.
  • Step S125 the information processing apparatus 300 is the configuration data of the clip information file.
  • Clip information (ClipInfo), Sequence information (SequenceInfo), Program information (ProgramInfo), CPI information (CPI), Clip mark (ClipMark), Each of these data is generated.
  • NTP time information is used as time information
  • the packet position is the first TLV packet stored in a stream file (clip AV stream file). Get the byte count data from the beginning of and record it.
  • Each of the above information includes a plurality of packet identifier (PID) recording areas.
  • PID packet identifier
  • any one of the following data is recorded in the packet identifier (PID) recording area (program map PID recording area) of the program information (ProgramInfo).
  • PID packet identifier
  • ProgramInfo program information
  • IP data flow identification information in (a) is composed of the following data as described above with reference to FIG. 39 and others.
  • Source IP address src_IP_address
  • Destination IP address dest_IP_address
  • Destination port destination_port
  • Source port source_port
  • Next header information (next_header)
  • Context identifier May be recorded as IP data flow identification information.
  • the packet identifier (PID) recording area (stream PID recording area) of the EP map [EP_map ()] recording area in the CPI information (CPI) is as follows. Record the data.
  • IP data flow identification information in (a) is composed of the following data as described above with reference to FIG. (1) Source IP address (src_IP_address) (2) Destination IP address (dest_IP_address) (3) Destination port (destination_port) (4) Source port (source_port) (5) Next header information (next_header)
  • Context identifier May be recorded as IP data flow identification information.
  • a clip information file corresponding to MMT format data is generated by processing according to the flow shown in FIG.
  • the control target is a clip AV stream file storing MPEG-2TS format data
  • the same clip information file generation process as that of the prior art may be performed.
  • step S107 in the flow shown in FIG. 64 the flowchart shown in FIG. 64 is a playlist generation sequence used for controlling a clip AV stream file storing MMT format data. The processing of each step in the flow shown in FIG. 66 will be described sequentially.
  • step S131 the information processing apparatus 300 sets the value of the CPI type (PL_CPI_type) recorded in the playlist file to [3].
  • PL_CPI type (PL_CPI_type) 3 means that the CPI type in the clip information file referred to by the play item (PlayItem) defined in the playlist file is an MMT-compliant EP map.
  • Step S132 the information processing apparatus 300 records time information (IN_time, OUT_time) of each play item to be recorded in the playlist file as NTP time information.
  • the start time (IN_time) is playback start time information of a play item (PlayItem) playback start point.
  • NTP Network Time Protocol
  • the end time (OUT_time) is playback end time information of the play item (PlayItem) playback end point.
  • NTP Network Time Protocol
  • the time information according to NTP is transmitted together with MMT format data including broadcast content transmitted by the transmission device 20 such as the broadcast server (broadcast station) 21 shown in FIG.
  • the information processing apparatus 30 such as a television (TV) 32 acquires time information according to NTP (network time protocol) transmitted by the transmission apparatus 20 and records it in a playlist.
  • NTP Network Time Protocol
  • step S133 the information processing apparatus 300 is playlist file configuration data. Play item (PlayItem), Playlist mark (PlayListMark), Each of these data is generated.
  • the reproduction target data is MMT format data
  • NTP time information is used as time information
  • the packet position is the first TLV packet stored in a stream file (clip AV stream file). Get the byte count data from the beginning of and record it.
  • a playlist file corresponding to MMT format data is generated.
  • the control target is a clip AV stream file storing MPEG-2TS format data
  • a playlist file generation process similar to the conventional one may be performed.
  • the information processing apparatus 300 performs processing according to the flow described with reference to FIGS. 64 to 66, thereby converting the input MMT format data into a playlist file, clip information file, and clip AV stream file according to the BDAV format. Can be recorded and reproduced.
  • the information processing apparatus that executes the reproduction process reads the data recorded on the information recording medium attached to the apparatus and executes the reproduction process.
  • FIG. 67 is a diagram showing a configuration of an information processing apparatus 400 that executes a reproduction process of data recorded on an information recording medium 510 such as a BD.
  • the information processing apparatus 400 reads the data recorded on the information recording medium (recording medium) 510 shown in FIG. 67 and outputs it to the output device (display unit + speaker) 520.
  • the output device 520 is, for example, a television or the like, and is a display device that includes a display, a speaker, and the like.
  • the information processing apparatus 400 may be the same apparatus as the information processing apparatus 300 that performs the data recording described above with reference to FIG. That is, the information processing apparatus has both functions of data recording and reproduction.
  • the information recording medium (recording medium) 510 is a recording medium on which an AV stream file generated by the processing described with reference to FIGS. 64 to 66 and a database such as a playlist and a clip information file are recorded.
  • control unit 401 reads the recording data of the information recording medium 510 via the recording / reproducing unit 404 and the drive 403 based on the input of the reproduction instruction information from the user input unit 402, and the storage unit 405 as a data buffer. And the stored data is output to the reproduction processing unit 406.
  • the playback processing unit 406 obtains each data from the playback data read from the information recording medium 510 under the control of the control unit 401, that is, from the clip AV stream file storing each data such as image, sound, and subtitle. To generate playback data.
  • the demultiplexer (DeMUX) 411 acquires data storage packets storing data such as images, audio, subtitles, playlist files, clip information files, and the like, classifies them into data type packets, Depending on the type, the data is output to the caption data generation unit 412, the image data generation unit 413, the audio data generation unit 414, and the auxiliary information generation unit 415.
  • the caption data generation unit 412, the image data generation unit 413, and the audio data generation unit 414 execute a decoding process of the data stored in the packet and outputs the decoded data to the output data generation unit 416.
  • the output data generation unit 416 outputs the subtitle, image, and audio data to the output device (display unit + speaker) 520 via the input / output interface 407.
  • the information recording medium 510 is a stream file storing reproduction target data.
  • the information processing apparatus 400 applies a playlist file and a clip information file defined in the BDAV format, and reproduces a stream file storing MPEG-2TS format data and a stream file storing MMT format data. Processing will be executed.
  • the auxiliary information generation unit 415 acquires the recorded content list display data stored in the playlist file and the clip information file, generates the recorded content list, and the generated list is output to the output device (display unit + speaker) 520. Is output.
  • the output device (display unit + speaker) 520 outputs data such as subtitles, images, and audio input from the information processing device 400 via the output device (display unit + speaker) 520.
  • the information recording medium 510 stores data obtained by recording MMT format data according to the BDAV format, and the information processing apparatus 400 records a playlist file and a clip information file that are database files stipulated in the BDAV format. Information is acquired and playback control processing is executed.
  • 68 is executed under the control of a data processing unit (control unit) including a CPU having a program execution function, for example, according to a program stored in the storage unit of the information processing apparatus 400. Can do.
  • the information processing apparatus 400 shown in FIG. 67 is the information processing apparatus 400 shown in FIG. 67, and an information recording medium (recording medium) 510 is attached and recorded on the attached information recording medium 510.
  • the information processing apparatus 400 shown in FIG. The read data is read and output to the output device (display unit + speaker) 520.
  • the output device 520 is, for example, a television or the like, and is a display device that includes a display, a speaker, and the like.
  • An information recording medium (recording medium) 510 is a recording medium on which an AV stream generated by the processing described with reference to FIGS. 64 to 66 and a database such as a playlist and a clip information file are recorded.
  • a recording medium on which an AV stream generated by the processing described with reference to FIGS. 64 to 66 and a database such as a playlist and a clip information file are recorded.
  • Step S201 First, in step S201, the control unit 401 of the information processing apparatus 400 converts a playlist file storing reproduction control information corresponding to designated reproduction data into an information recording medium (media) according to, for example, reproduction data designation information input by the user. Read from.
  • Step S202 the control unit 401 of the information processing device 400 reads the PL_CPI type (PL_CPI_type) recorded in the playlist file.
  • the PL_CPI type (PL_CPI_type) is information indicating the CPI type in the clip information file referenced by the play item (PlayItem) defined in the playlist file. is there.
  • CPI Chargeristic Point Information
  • CPI is recording data of a clip information file, for example, data for acquiring a data address of a reproduction start point.
  • PL_CPI_type 1
  • the CPI type in the clip information file referred to by the play item (PlayItem) defined in this playlist file is an EP map that supports MPEG-2TS. It means that there is.
  • Step S203 the control unit 401 of the information processing apparatus 400 determines whether or not the set value of the PL_CPI type (PL_CPI_type) read in step S202 is [3]. That is, it is determined whether or not the CPI type in the clip information file referred to by the play item (PlayItem) defined in this playlist file is an MMT-compatible EP map.
  • Step S204 If the PL_CPI type (PL_CPI_type) is not 3, the process of step S204 is executed.
  • the PL_CPI type is other than 3
  • the CPI type in the clip information file referred to by the play item (PlayItem) specified in the playlist file is 1 or 2
  • the reproduction target data is MPEG-2TS format data.
  • the information processing apparatus 400 executes a reproduction process of MPEG-2TS format data by applying a conventional reproduction processing method.
  • Step S205 On the other hand, if the PL_CPI type (PL_CPI_type) is 3, it is determined in step S205 that the reproduction target data by this playlist file is MMT format data.
  • Step S206 the information processing apparatus 400 applies a playlist corresponding to MMT format data and a clip information file, and executes a reproduction process of the data stored in the clip information file in which the MMT format data is stored.
  • the EP map corresponding to the MMT format data is an EP map having the data structure described above with reference to FIGS. 58 to 61, for example, and includes time information and stream files (clips) corresponding to randomly accessible data positions.
  • This is an EP map composed of data corresponding to byte position information from the beginning of the first TLV packet stored in the (AV stream file). The process of each step of the flowchart shown in FIG. 69 will be described.
  • Step S211 First, in step S211, the information processing apparatus 400 reads a clip information file name (Clip_information_file_name) from play item information of a playlist applied to random access reproduction.
  • a clip information file name (Clip_information_file_name)
  • Step S212 the information processing apparatus 400 reads a clip information file having the clip information file name (Clip_information_file_name) read from the playlist file in step S211 from the information recording medium (media).
  • step S213 the information processing apparatus 400 specifies ATC and STC, which are clock information applied to reproduction, from the sequence information (SequenceInfo) of the clip information file. Note that these pieces of time information are recorded as NTP time information when the reproduction target data is MMT format data.
  • sequence information (SequenceInfo) of the clip information file has the data configuration described above with reference to FIG. 30, and information regarding the ATC (Arrival Time Clock) and STC (System Time Clock) is defined here. Has been. ATC (arrival time clock) and STC (system time clock) are as described above with reference to FIG. 30 and are clock information applied to data reproduction.
  • Step S214 the information processing apparatus 400 acquires a playback start position (SPN_STC_Start) and a playback start time (presentation_start_time) from the sequence information (SequenceInfo) of the clip information file.
  • SPN_STC_Start a playback start position
  • presentation_start_time a playback start time from the sequence information (SequenceInfo) of the clip information file.
  • the reproduction start position information is, for example, the number of bytes from the beginning of the first TLV packet stored in the stream file (clip AV stream file), and the reproduction start time is NTP It becomes time information.
  • sequenceInfo sequence information
  • Step S215 the information processing apparatus 400 identifies the packet storing the MMT package table (MPT) from the information recorded in the program information (ProgramInfo) of the clip information file, and from the MMT package table (MPT).
  • MPT MMT package table
  • Information necessary for reproduction processing of MMT format data for example, information such as a packet identifier and a decoding method is acquired.
  • the packet identifier (PID) recording area (program map PID recording area) of the program information (ProgramInfo) of the clip information file includes the following (a), ( Any information of b) is recorded.
  • MPT_PID IP data flow identification information and packet identifier
  • MPT MMT package table
  • MPT MMT package table
  • step S215 the information processing apparatus 400 specifies the packet storing the MMT package table (MPT) from the information (a) or (b) recorded in the program information (ProgramInfo) of the clip information file. To do. Further, information necessary for reproduction processing of MMT format data, such as a packet identifier and a decoding method, is obtained from the specific packet from the MMT package table (MPT).
  • MPT MMT package table
  • IP data flow identification information in (a) is composed of the following data as described above with reference to FIG. (1) Source IP address (src_IP_address) (2) Destination IP address (dest_IP_address) (3) Destination port (destination_port) (4) Source port (source_port) (5) Next header information (next_header)
  • Context identifier May be recorded as IP data flow identification information.
  • IP data flow identification information recorded in the clip information file, even when a plurality of IP data flows are mixed in the clip AV stream file and a packet having the same packet identifier is included, one IP It becomes possible to specify a data flow and reliably select a packet included in the IP data flow.
  • Step S216 the information processing apparatus 400 reads the EP map recording information recorded in the CPI information (CPI) of the clip information file, and acquires information necessary for random access reproduction. For example, a packet specifying process for storing random access destination data is executed.
  • CPI CPI information
  • the packet identifier (PID) recording area (stream PID recording area) of the EP map [EP_map ()] recording area in the CPI information (CPI) is as follows. Data is recorded. (A) IP data flow identification information and packet identifier (stream_PID)
  • IP data flow identification information in (a) is composed of the following data as described above with reference to FIG. (1) Source IP address (src_IP_address) (2) Destination IP address (dest_IP_address) (3) Destination port (destination_port) (4) Source port (source_port) (5) Next header information (next_header)
  • Context identifier May be recorded as IP data flow identification information.
  • one IP data flow is A packet can be reliably selected based on the packet identifier (stream_PID) specified and included in the IP data flow.
  • Step S217 the information processing apparatus 400 reads the MMT format data stored in the clip AV stream file according to the recording rate (recording_rate) recorded in the clip information (ClipInfo) of the clip information file.
  • ClipInfo In the clip information (ClipInfo) of the clip information file, as described above with reference to FIG. 25, recording rate (recording_rate) information is recorded, and the information is recorded on the information recording medium (media) according to this information.
  • the read control of the MMT format data stored in the clip AV stream file is executed.
  • TS_recording_rate is described as the recording rate information, but when the reproduction target data is an MMT format having an MMT packet, a bit rate corresponding to the MMT format is recorded here.
  • step S218 the information processing apparatus 400 executes demultiplex processing, decoding processing, and reproduction processing of MMT format data stored in the clip AV stream file read from the information recording medium (media).
  • a CPU (Central Processing Unit) 601 functions as a data processing unit that executes various processes according to a program stored in a ROM (Read Only Memory) 602 or a storage unit 608. For example, processing according to the sequence described in the above-described embodiment is executed.
  • a RAM (Random Access Memory) 603 stores programs executed by the CPU 601 and data. These CPU 601, ROM 602, and RAM 603 are connected to each other by a bus 604.
  • the CPU 601 is connected to an input / output interface 605 via a bus 604, and an input unit 606 including various switches, a keyboard, a mouse, and a microphone, and an output unit 607 including a display and a speaker are connected to the input / output interface 605. Yes.
  • the CPU 601 executes various processes in response to commands input from the input unit 606 and outputs the processing results to the output unit 607, for example.
  • the storage unit 608 connected to the input / output interface 605 includes, for example, a hard disk and stores programs executed by the CPU 601 and various data.
  • the communication unit 609 functions as a data communication transmission / reception unit via a network such as the Internet or a local area network, and further as a broadcast wave transmission / reception unit, and communicates with an external device.
  • the drive 610 connected to the input / output interface 605 drives a removable medium 611 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory such as a memory card, and executes data recording or reading.
  • a removable medium 611 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory such as a memory card
  • a data processing unit that inputs MMT (MPEG Media Transport) format data and generates recording data in accordance with the BDAV format or SPAV format, which is a data recording format for an information recording medium,
  • the data processing unit A clip AV stream file composed of a TLV packet sequence storing MMT format data as reproduction data;
  • An information processing apparatus that generates a playback control information file that records control information that enables acquisition of a specific TLV packet from the clip AV stream file.
  • the data processing unit The information processing apparatus according to (1) or (2), wherein an average rate and a recording rate in units of TLV packets, which are constituent packets of the clip AV stream file, are recorded in the reproduction control information file.
  • the data processing unit The information processing apparatus according to any one of (1) to (3), wherein a file size of the clip AV stream file configured by a TLV packet is recorded in the reproduction control information file.
  • NTP network time protocol
  • the data processing unit The information processing apparatus according to any one of (1) to (5), wherein the number of bytes from the beginning of the clip AV stream file including a TLV packet sequence is recorded as data position information to be recorded in the reproduction control information file.
  • the data processing unit When the packet identifier is recorded in the reproduction control information file, any one of (1) to (6) is recorded together with IP data flow identification information that can identify the IP data flow to which the packet specified by the packet identifier belongs.
  • IP data flow identification information that can identify the IP data flow to which the packet specified by the packet identifier belongs.
  • the IP data flow identification information is: (A) source IP address, (B) destination IP address, (C) destination port, (D) source port, (E) Protocol type information, The above five data, or The information processing apparatus according to (7), including at least one of a context identifier (CID).
  • CID context identifier
  • the packet identifier is an identifier of a packet storing an MMT package table (MPT) or an identifier of a packet storing random access reproduction target data. apparatus.
  • MPT MMT package table
  • the information recording medium includes a clip AV stream file composed of a TLV packet sequence storing MMT (MPEG Media Transport) format data, and a playback control information file storing playback control information of the clip AV stream file in a BDAV format. Or an information recording medium recorded according to SPAV format,
  • the data processing unit In the data reproduction process using the clip AV stream file constituted by the TLV packet sequence, An information processing apparatus that acquires reproduction target data from a TLV packet and executes reproduction control according to recorded information of the reproduction control information file.
  • the data processing unit The information processing apparatus according to (11), wherein reproduction control is executed by applying a playlist file and a clip information file which are the reproduction control information files.
  • the data processing unit From the recorded data of the playback control information file, An average rate and a recording rate in units of TLV packets that are constituent packets of the clip AV stream file are acquired, and reading control of MMT format data from the clip AV stream file is executed according to the acquisition rate (11) or The information processing apparatus according to (12).
  • the data processing unit Recorded as data position information in the reproduction control information file, The information processing apparatus according to any one of (11) to (13), wherein reproduction control is executed using byte information from the beginning of the clip AV stream file.
  • the data processing unit From the playback control information file, Read IP data flow identification information and packet identifier, Identifying an IP data flow according to the IP data flow identification information; The information processing apparatus according to any one of (11) to (14), wherein a packet having the packet identifier is selected from a group of packets belonging to the identified IP data flow to extract a target packet.
  • a clip AV stream file composed of a TLV packet sequence storing MMT (MPEG Media Transport) format data; Having a playback control information file storing playback control information of the clip AV stream file as recorded data;
  • the reproduction control information file is IP data flow identification information for extracting a target packet from a TLV packet included in the clip AV stream file, and a packet identifier, Information having a data recording configuration in which a playback device that plays back the data stored in the clip AV stream file can acquire playback target data from the TLV packet sequence with reference to the IP data flow identification information and the packet identifier recoding media.
  • the information processing apparatus includes: A data processing unit that inputs MMT (MPEG Media Transport) format data and generates recording data in accordance with the BDAV format, which is a data recording format for an information recording medium, or SPAV format;
  • the data processing unit is A clip AV stream file composed of a TLV packet sequence storing MMT format data as reproduction data;
  • the information processing apparatus includes: A data processing unit for executing a reproduction process of recorded data of the information recording medium;
  • the information recording medium includes a clip AV stream file composed of a TLV packet sequence storing MMT (MPEG Media Transport) format data, and a playback control information file storing playback control information of the clip AV stream file in a BDAV format.
  • MMT MPEG Media Transport
  • the data processing unit is In the data reproduction process using the clip AV stream file constituted by the TLV packet sequence, An information processing method for executing reproduction control by acquiring reproduction target data from a TLV packet according to recording information of the reproduction control information file.
  • the information processing apparatus includes: A data processing unit that inputs MMT (MPEG Media Transport) format data and generates recording data in accordance with the BDAV format, which is a data recording format for an information recording medium, or SPAV format; The program is stored in the data processing unit.
  • a clip AV stream file composed of a TLV packet sequence storing MMT format data as reproduction data;
  • a program for executing information processing in an information processing device includes: A data processing unit for executing a reproduction process of recorded data of the information recording medium;
  • the information recording medium includes a clip AV stream file composed of a TLV packet sequence storing MMT (MPEG Media Transport) format data, and a playback control information file storing playback control information of the clip AV stream file in a BDAV format. Or an information recording medium recorded according to SPAV format,
  • the program is stored in the data processing unit.
  • a program for acquiring reproduction target data from a TLV packet and executing reproduction control according to recorded information of the reproduction control information file is stored in the data processing unit.
  • the series of processes described in the specification can be executed by hardware, software, or a combined configuration of both.
  • the program recording the processing sequence is installed in a memory in a computer incorporated in dedicated hardware and executed, or the program is executed on a general-purpose computer capable of executing various processing. It can be installed and run.
  • the program can be recorded in advance on a recording medium.
  • the program can be received via a network such as a LAN (Local Area Network) or the Internet and installed on a recording medium such as a built-in hard disk.
  • the various processes described in the specification are not only executed in time series according to the description, but may be executed in parallel or individually according to the processing capability of the apparatus that executes the processes or as necessary.
  • the system is a logical set configuration of a plurality of devices, and the devices of each configuration are not limited to being in the same casing.
  • a configuration in which MMT format data can be recorded on a medium as BDAV or SPAV format data and can be played back is realized.
  • a stream file composed of a TLV packet sequence storing MMT format data and a playback control information file are generated and recorded on a medium.
  • the IP data flow identification information and the packet identifier are recorded together.
  • the IP data flow identification information uses data including a source IP address or the like, or a CID recorded in a compressed IP header.
  • a specific IP data flow is selected based on the IP data flow identification information, and a single packet with a packet identifier set can be selected from a group of packets belonging to the selected flow.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Television Signal Processing For Recording (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Management Or Editing Of Information On Record Carriers (AREA)

Abstract

La présente invention concerne un système qui permet à des données formatées MMT d'être enregistrées sur un support et lues sous la forme de données de format BDAV ou SPAV. Un fichier de flux constitué par une chaîne de paquets TLV qui stocke les données formatées MMT et un fichier d'informations de commande de lecture sont générés et enregistrés sur un support. Des informations d'identification de flux de données IP sont enregistrées dans le fichier d'informations de commande de lecture conjointement avec un identifiant de paquet. Les informations d'identification de flux de données IP utilisent des données constituées d'une adresse IP source ou analogue, ou d'un CID ou analogue enregistré dans un en-tête IP compressé. Les informations d'identification de flux de données IP sont utilisées pour sélectionner un flux de données IP particulier et un seul paquet comportant l'identifiant de paquet attribué à celui-ci peut être sélectionné dans le groupe de paquets appartenant au flux sélectionné.
PCT/JP2017/046703 2017-01-17 2017-12-26 Dispositif de traitement d'informations, support d'enregistrement d'informations, procédé de traitement d'informations, et programme WO2018135258A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2018563247A JP7070432B2 (ja) 2017-01-17 2017-12-26 情報処理装置、情報記録媒体、および情報処理方法、並びにプログラム

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017005805 2017-01-17
JP2017-005805 2017-01-17

Publications (1)

Publication Number Publication Date
WO2018135258A1 true WO2018135258A1 (fr) 2018-07-26

Family

ID=62908458

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/046703 WO2018135258A1 (fr) 2017-01-17 2017-12-26 Dispositif de traitement d'informations, support d'enregistrement d'informations, procédé de traitement d'informations, et programme

Country Status (2)

Country Link
JP (1) JP7070432B2 (fr)
WO (1) WO2018135258A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2018216424A1 (ja) * 2017-05-24 2020-03-26 ソニー株式会社 情報処理装置、情報記録媒体、および情報処理方法、並びにプログラム
CN114650445A (zh) * 2020-12-17 2022-06-21 深圳Tcl新技术有限公司 一种tlv数据包的过滤方法、存储介质及终端设备

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006030767A1 (fr) * 2004-09-13 2006-03-23 Matsushita Electric Industrial Co., Ltd. Dispositif de traitement de donnees
WO2014203871A1 (fr) * 2013-06-21 2014-12-24 ソニー株式会社 Appareil et procédé de transmission, appareil et procédé de reproduction et appareil de réception
JP2015023574A (ja) * 2013-07-22 2015-02-02 パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ 蓄積方法、再生方法、蓄積装置、および再生装置
JP2016103745A (ja) * 2014-11-28 2016-06-02 ソニー株式会社 送信装置及び送信方法、並びに、受信装置並びに受信方法

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6964436B2 (ja) 2016-07-08 2021-11-10 三菱電機株式会社 映像記録装置及び映像再生装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006030767A1 (fr) * 2004-09-13 2006-03-23 Matsushita Electric Industrial Co., Ltd. Dispositif de traitement de donnees
WO2014203871A1 (fr) * 2013-06-21 2014-12-24 ソニー株式会社 Appareil et procédé de transmission, appareil et procédé de reproduction et appareil de réception
JP2015023574A (ja) * 2013-07-22 2015-02-02 パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ 蓄積方法、再生方法、蓄積装置、および再生装置
JP2016103745A (ja) * 2014-11-28 2016-06-02 ソニー株式会社 送信装置及び送信方法、並びに、受信装置並びに受信方法

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2018216424A1 (ja) * 2017-05-24 2020-03-26 ソニー株式会社 情報処理装置、情報記録媒体、および情報処理方法、並びにプログラム
JP7070564B2 (ja) 2017-05-24 2022-05-18 ソニーグループ株式会社 情報処理装置、情報記録媒体、および情報処理方法、並びにプログラム
CN114650445A (zh) * 2020-12-17 2022-06-21 深圳Tcl新技术有限公司 一种tlv数据包的过滤方法、存储介质及终端设备
CN114650445B (zh) * 2020-12-17 2023-08-01 深圳Tcl新技术有限公司 一种tlv数据包的过滤方法、存储介质及终端设备

Also Published As

Publication number Publication date
JPWO2018135258A1 (ja) 2019-11-07
JP7070432B2 (ja) 2022-05-18

Similar Documents

Publication Publication Date Title
US7843994B2 (en) Moving picture stream generation apparatus, moving picture coding apparatus, moving picture multiplexing apparatus and moving picture decoding apparatus
JP7031589B2 (ja) 情報処理装置、および情報処理方法、並びにプログラム
JP7074068B2 (ja) 情報処理装置、情報記録媒体、および情報処理方法、並びにプログラム
JP7070432B2 (ja) 情報処理装置、情報記録媒体、および情報処理方法、並びにプログラム
JP7056566B2 (ja) 情報処理装置、および情報処理方法、並びにプログラム
JP7147755B2 (ja) 情報処理装置、情報記録媒体、および情報処理方法、並びにプログラム
JP7014157B2 (ja) 情報処理装置、情報記録媒体、および情報処理方法、並びにプログラム
JP7070433B2 (ja) 情報処理装置、情報記録媒体、および情報処理方法、並びにプログラム
JP7070564B2 (ja) 情報処理装置、情報記録媒体、および情報処理方法、並びにプログラム
WO2018173780A1 (fr) Dispositif de traitement d'informations, support d'enregistrement d'informations, procédé de traitement d'informations, et programme
JP2008199528A (ja) 情報処理装置および情報処理方法、プログラム、並びに、プログラム格納媒体
JP2008199527A (ja) 情報処理装置および情報処理方法、プログラム、並びに、プログラム格納媒体

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17893067

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2018563247

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17893067

Country of ref document: EP

Kind code of ref document: A1

点击 这是indexloc提供的php浏览器服务，不要输入任何密码和下载