WO2009093292A1 - 動画像送受信システム - Google Patents
動画像送受信システム Download PDFInfo
- Publication number
- WO2009093292A1 WO2009093292A1 PCT/JP2008/003539 JP2008003539W WO2009093292A1 WO 2009093292 A1 WO2009093292 A1 WO 2009093292A1 JP 2008003539 W JP2008003539 W JP 2008003539W WO 2009093292 A1 WO2009093292 A1 WO 2009093292A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- unit
- packet
- data
- image transmission
- reception system
- Prior art date
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 51
- 238000012545 processing Methods 0.000 claims abstract description 60
- 238000000926 separation method Methods 0.000 claims abstract description 11
- 238000000034 method Methods 0.000 description 23
- 238000012217 deletion Methods 0.000 description 3
- 230000037430 deletion Effects 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/23611—Insertion of stuffing data into a multiplex stream, e.g. to obtain a constant bitrate
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234327—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into layers, e.g. base layer and one or more enhancement layers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8451—Structuring of content, e.g. decomposing content into time segments using Advanced Video Coding [AVC]
Definitions
- the present invention relates to a transmission / reception system for transferring a moving image stream on a network with a low delay.
- TS Transport Stream
- PES Packetized Elementary Stream
- the reception unit needs to delete the stuffing data, and if decoding does not have code data for one frame, It cannot be decrypted, and it takes a processing time from reception to decryption.
- the monitoring processing load increases if the period is short, and if the period is long, the reduction in transmission delay cannot be sufficiently satisfied. Have difficulty.
- the moving image transmission / reception system of the present invention includes an image transmission device and an image reception device, and the image transmission device takes in and encodes image data, and outputs code data in one frame in a predetermined unit.
- a padding processing unit for adding padding to match the data size output from the encoding unit to a predetermined size, and a packet processing unit for performing packetization upon completion of padding addition by the padding processing unit
- a network transmission unit that transmits the data packetized by the packet processing unit and a memory that stores code data and packet data, and the image reception device receives a packet from the image transmission device Separation processing for separating a packet received by the receiving unit and the network receiving unit If decodes the compressed data in a predetermined unit, characterized in that it comprises a decoding unit for outputting the stream.
- the predetermined unit of the encoding unit is an H.264 NAL unit unit, an MPEG-4 restart marker unit (video packet unit), or an MPEG-2 slice. It is a unit.
- padding can be added in units smaller than one frame in accordance with a predetermined unit of packetization processing.
- packetization by the packet processing unit is processing of PES packets and TS packets, or network packet processing.
- stuffing processing at the time of packet processing can be omitted, and packet data that can be decoded before one frame of encoded data is generated can be transmitted.
- the image receiving device does not perform the deletion process of the padding data when separating and decoding the received packet, and performs the decoding with the padding data added.
- the predetermined unit of the decoding processing unit is an H.264 NAL unit unit, an MPEG-4 video packet unit, or an MPEG-2 slice unit.
- the padding deletion process can be omitted in the decoding process, and the data can be decoded in units smaller than one frame, so that the data can be reduced in delay.
- the moving image transmission / reception system of the present invention packetization processing is performed for each decodable unit smaller than one frame, and invalid padding data that can be decoded in the state added at the time of decoding is added before packetization.
- the stuffing deletion process can be omitted on the receiving unit side.
- decoding can be performed in units smaller than one frame, a low delay from transmission of code data to decoding of data received via the network can be achieved.
- FIG. 1 is a block diagram showing a configuration of a moving image transmission / reception system according to an embodiment of the present invention.
- FIG. 2 is a flowchart of the transmission process of the image transmission apparatus 101 shown in FIG.
- FIG. 3 is a flowchart of the reception process of the image receiving apparatus 201 shown in FIG.
- FIG. 1 is a block diagram showing a configuration of a moving image transmission / reception system according to an embodiment of the present invention.
- This system includes an image transmission device 101 and an image reception device 201.
- the image transmission apparatus 101 transmits media information to the image reception apparatus 201 via a network.
- the image receiving apparatus 201 receives media information transmitted from the image transmitting apparatus 101 via a network.
- the image transmission apparatus 101 captures video information, encodes it in H.264 in units of NAL units, adds padding data to the encoded data so that the encoded data size matches a predetermined size unit to be packetized, and outputs it.
- the encoding processing unit 102 includes an encoding unit 106 that takes in video information and outputs H.264 encoding in units of NAL units, and performs encoding so that the encoded data size matches a predetermined size unit for packetization. And a padding processing unit 107 for adding padding data to the data.
- the packetization processing unit 103 includes a PES packet processing unit 108 that performs PES packetization, a TS packet processing unit 109 that converts PES packets into TS packets, and a network packet processing unit 110 that performs network transmission packetization from a plurality of TS packets. Is provided.
- the image receiving apparatus 201 includes a network receiving unit 202 that outputs network packets received via a network, a packet separating unit 203 that separates network packets and separates TS packets, and performs decoding in units of separated NAL units. And a decrypting unit 204 for performing the processing.
- the packet separation unit 203 includes a network packet separation unit 205 that separates network packets and a TS packet separation unit 206 that separates TS packets.
- FIG. 2 is a flowchart showing a flow of media information transmission processing by the image transmission apparatus 101 shown in FIG.
- a description will be given with reference to FIG.
- step S101 video information is input from the outside. This video information is H.264 encoded in units of NAL units in the encoding processing unit 106 (S102).
- step S103 it is determined whether or not the encoding for one frame is completed. If the encoding for one frame is not completed, the process proceeds to step S104. If the encoding for one frame is completed, the process proceeds to step S105. In step S104, it is determined whether or not the encoding for one NAL unit has been completed. If completed, the process proceeds to step S105, and if not completed, the process returns to step S103. In step S105, it is determined whether packet alignment is necessary.
- step S107 if the encoded data amount matches the TS packet size unit, it is determined that packet alignment is unnecessary, and the process proceeds to step S107. If the encoded data amount does not match the TS packet size unit, packet alignment is necessary. It is judged and the process proceeds to step S106. In step S106, the padding processing unit 107 adds “00”, which is invalid H.264 data, as padding data so as to match the TS packet size unit.
- step S107 When receiving a notification of encoding completion for NAL units from the encoding processing unit 106, whether or not PES packetization is necessary is determined in step S107. In the case of the beginning of the frame, it is determined that PES packetization is necessary, and the process proceeds to step S108. In step S108, the PES packet processing unit 108 adds a PES packet (header). In step S109, the TS packet processing unit 109 performs TS packetization.
- step S110 Whether or not TS packetization processing is completed is determined in step S110, and if completed, the process proceeds to step S112, and if not completed, the process proceeds to step S111.
- step S111 it is determined whether or not the amount of data converted into TS packets is equal to or larger than the size of the network packet. If there is, the process proceeds to step S112. If not, the process returns to step S110.
- step S112 network packet processing is performed by the network packet processing unit 110, and the network packet data is distributed to the network by the network transmission unit 104 (S113).
- FIG. 3 is a flowchart showing a flow of media information reception processing by the image receiving apparatus 201 shown in FIG.
- a description will be given with reference to FIG.
- the network receiving unit 202 receives the network packet data distributed from the image transmitting apparatus 101 over the network (S201).
- the network separation unit 205 separates the received network packet (S202).
- step S203 it is determined whether or not the network packet separation for NAL units is completed. If completed, the process proceeds to step S204.
- step S204 the TS packet separator 206 separates the TS packets and extracts the code data.
- step S205 it is determined whether or not the code data is greater than or equal to the NAL unit unit.
- the encoded data is decoded by the decoding unit 204 and output.
- the code data includes the padding data added by the transmission apparatus 101.
- codec of the above embodiment is not limited to the HAL.264 NAL unit, but may be performed in units of MPEG-4 video packets, MPEG-2 slice units, or the like.
- the packetization processing of the above embodiment may be performed in units of network packets even when ES data is distributed over the network without performing PES packetization or TS packetization.
- processing of the above embodiment may be performed by software processing only with the CPU.
- the media information processing method shown in the above embodiment can be used for any of the devices and systems described above.
- the moving image transmission / reception system has an effect that moving image code data can be distributed via a network with low delay, and is useful as a network camera or the like.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
Description
102 符号化処理部
103 パケット処理部
104 ネットワーク送信部
105 蓄積部
106 符号化部
107 パディング処理部
108 PESパケット処理部
109 TSパケット処理部
110 ネットワークパケット処理部
201 画像受信装置
202 ネットワーク受信部
203 パケット分離部
204 復号化部
205 ネットワークパケット分離部
206 TSパケット分離部
207 蓄積部
Claims (10)
- 画像送信装置と画像受信装置とを備えた動画像送受信システムであって、
前記画像送信装置は、
画像データを取り込んで符号化し、1フレーム内の符号データを所定の単位で出力する符号化部と、
前記符号化部から出力されるデータサイズを所定のサイズに一致させるためにパディングを付加するパディング処理部と、
前記パディング処理部によるパディング付加の完了を受けてパケット化を行うパケット処理部と、
前記パケット処理部によりパケット化されたデータをネットワーク送信するネットワーク送信部と、
符号データやパケットデータを保持するメモリとを備え、
前記画像受信装置は、
前記画像送信装置からのパケットを受信するネットワーク受信部と、
前記ネットワーク受信部により受信されたパケットを分離する分離処理部と、
所定の単位で圧縮データを復号し、ストリームを出力する復号化処理部とを備える、
ことを特徴とする動画像送受信システム。 - 請求項1において、
前記符号化部の所定の単位はH.264のNALユニット単位である、
ことを特徴とする動画像送受信システム。 - 請求項1において、
前記符号化部の所定の単位はMPEG-4のビデオパケット単位である、
ことを特徴とする動画像送受信システム。 - 請求項1において、
前記符号化部の所定の単位はMPEG-2のスライス単位である、
ことを特徴とする動画像送受信システム。 - 請求項1において、
前記パケット処理部によるパケット化はPESパケットおよびTSパケットの処理である、
ことを特徴とする動画像送受信システム。 - 請求項1において、
前記パケット処理部によるパケット化はネットワークのパケット処理である、
ことを特徴とする動画像送受信システム。 - 請求項1において、
前記画像受信装置は、
受信したパケットを分離し復号化する際にパディングデータの削除処理を行わず、当該パディングデータが付加された状態で復合化する、
ことを特徴とする動画像送受信システム。 - 請求項1において、
前記復合化処理部の所定の単位はH.264のNALユニット単位である、
ことを特徴とする動画像送受信システム。 - 請求項1において、
前記復合化処理部の所定の単位はMPEG-4のビデオパケット単位である、
ことを特徴とする動画像送受信システム。 - 請求項1において、
前記復合化処理部の所定の単位はMPEG-2のスライス単位である、
ことを特徴とする動画像送受信システム。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN2008801253838A CN101926173A (zh) | 2008-01-24 | 2008-12-01 | 运动图像收发系统 |
US12/808,554 US20100290536A1 (en) | 2008-01-24 | 2008-12-01 | Moving image transmission/reception system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2008-013389 | 2008-01-24 | ||
JP2008013389A JP2009177447A (ja) | 2008-01-24 | 2008-01-24 | 動画像送受信システム |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2009093292A1 true WO2009093292A1 (ja) | 2009-07-30 |
Family
ID=40900813
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2008/003539 WO2009093292A1 (ja) | 2008-01-24 | 2008-12-01 | 動画像送受信システム |
Country Status (4)
Country | Link |
---|---|
US (1) | US20100290536A1 (ja) |
JP (1) | JP2009177447A (ja) |
CN (1) | CN101926173A (ja) |
WO (1) | WO2009093292A1 (ja) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110255841A1 (en) * | 2010-04-15 | 2011-10-20 | Leonid Remennik | Method and apparatus for presenting interactive multimedia using storage device interface |
Families Citing this family (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8335857B1 (en) * | 2009-05-21 | 2012-12-18 | Sprint Communications Company L.P. | System and methods of data transmission to devices |
JP5123340B2 (ja) * | 2010-02-23 | 2013-01-23 | 日本電信電話株式会社 | 映像データ送信装置,映像データ送信方法および映像データ送信プログラム |
JP4691193B1 (ja) * | 2010-04-13 | 2011-06-01 | 株式会社東芝 | 映像表示装置および映像処理方法 |
CN107197280B (zh) * | 2011-06-17 | 2020-06-16 | Jvc 建伍株式会社 | 图像编码装置、图像编码方法以及记录介质 |
US20130279597A1 (en) * | 2012-04-24 | 2013-10-24 | Magnum Semiconductor, Inc. | Apparatuses and methods for bitstream bitstuffing |
KR20140002447A (ko) * | 2012-06-29 | 2014-01-08 | 삼성전자주식회사 | 멀티미디어 시스템에서 적응적 미디어 구조 송수신 방법 및 장치 |
TWI686085B (zh) * | 2012-11-29 | 2020-02-21 | 日商索尼半導體解決方案公司 | 攝像裝置及圖像感測器之資料傳送方法、資訊處理裝置及資訊處理方法以及程式 |
JP2015104072A (ja) | 2013-11-27 | 2015-06-04 | 株式会社リコー | 通信装置、信号処理プログラム及び記録媒体 |
CN104038816B (zh) * | 2014-06-20 | 2017-06-23 | 深圳市九洲电器有限公司 | 一种视频同步方法及系统 |
US10230948B2 (en) | 2016-02-03 | 2019-03-12 | Mediatek Inc. | Video transmitting system with on-the-fly encoding and on-the-fly delivering and associated video receiving system |
JP2020022087A (ja) * | 2018-08-01 | 2020-02-06 | 日本放送協会 | 映像/パケット変換装置、パケット/映像変換装置、及びプログラム |
CN112040302B (zh) | 2019-06-03 | 2023-01-03 | 优视科技有限公司 | 视频缓冲方法、装置、电子设备及计算机可读存储介质 |
CN112929590B (zh) * | 2021-02-05 | 2022-10-04 | 广东欧谱曼迪科技有限公司 | 开机动画播放系统、压缩方法、装置及解压方法、装置 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005123907A (ja) * | 2003-10-16 | 2005-05-12 | Matsushita Electric Ind Co Ltd | データ再構成装置 |
JP2005142612A (ja) * | 2003-11-04 | 2005-06-02 | Victor Co Of Japan Ltd | 画像符号化装置及び画像符号化方法 |
JP2006513673A (ja) * | 2002-09-20 | 2006-04-20 | 株式会社エヌ・ティ・ティ・ドコモ | 算術符号化方法及び算術符号化装置 |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5974223A (en) * | 1995-04-08 | 1999-10-26 | Sony Corporation | Method of and apparatus for data recording, method of and apparatus for data reproduction, recording medium, and method of and apparatus for data transmission |
US6825782B2 (en) * | 2002-09-20 | 2004-11-30 | Ntt Docomo, Inc. | Method and apparatus for arithmetic coding and termination |
US7852961B2 (en) * | 2004-05-20 | 2010-12-14 | Samsung Electronics Co., Ltd. | Digital broadcasting transmission/reception devices capable of improving a receiving performance and signal processing method thereof |
US20060268989A1 (en) * | 2005-05-27 | 2006-11-30 | Matsushita Electric Industrial Co., Ltd. | Bit stream generation method and bit stream generatation apparatus |
US20070014346A1 (en) * | 2005-07-13 | 2007-01-18 | Nokia Corporation | Coding dependency indication in scalable video coding |
-
2008
- 2008-01-24 JP JP2008013389A patent/JP2009177447A/ja active Pending
- 2008-12-01 WO PCT/JP2008/003539 patent/WO2009093292A1/ja active Application Filing
- 2008-12-01 US US12/808,554 patent/US20100290536A1/en not_active Abandoned
- 2008-12-01 CN CN2008801253838A patent/CN101926173A/zh active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006513673A (ja) * | 2002-09-20 | 2006-04-20 | 株式会社エヌ・ティ・ティ・ドコモ | 算術符号化方法及び算術符号化装置 |
JP2005123907A (ja) * | 2003-10-16 | 2005-05-12 | Matsushita Electric Ind Co Ltd | データ再構成装置 |
JP2005142612A (ja) * | 2003-11-04 | 2005-06-02 | Victor Co Of Japan Ltd | 画像符号化装置及び画像符号化方法 |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110255841A1 (en) * | 2010-04-15 | 2011-10-20 | Leonid Remennik | Method and apparatus for presenting interactive multimedia using storage device interface |
US8606071B2 (en) * | 2010-04-15 | 2013-12-10 | Leonid Remennik | Method and apparatus for presenting interactive multimedia using storage device interface |
Also Published As
Publication number | Publication date |
---|---|
US20100290536A1 (en) | 2010-11-18 |
JP2009177447A (ja) | 2009-08-06 |
CN101926173A (zh) | 2010-12-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2009093292A1 (ja) | 動画像送受信システム | |
KR101835340B1 (ko) | 방송 신호 송신 장치, 방송 신호 수신 장치, 방송 신호 송신 방법, 및 방송 신호 수신 방법 | |
US20090177952A1 (en) | Transcoder and receiver | |
US8300959B2 (en) | Transport stream structure of image data having additional information inserted, and method and apparatus for transmission and reception thereof | |
JP2003023413A (ja) | システムデコーダ装置及びパケットデータの修正方法 | |
JP6617809B2 (ja) | 復号装置、復号方法、および復号用プログラム | |
WO2011079763A1 (zh) | 一种fec数据的处理方法、装置及系统 | |
JP2006508574A (ja) | 要求に応じたi画像の挿入 | |
US20100085963A1 (en) | Reconstruction of errored media streams in a communication system | |
US9497493B2 (en) | Video transmission device, video reception device, and video communication system | |
JP3927443B2 (ja) | 動画像送受信システムおよび動画像送受信方法 | |
JP2001308876A (ja) | 情報伝送方式、送信装置及び受信装置 | |
US7839925B2 (en) | Apparatus for receiving packet stream | |
JP2018067951A (ja) | 復号装置、受信機器、送信機器、送受信システム、復号方法、および復号用プログラムが記憶された記憶媒体 | |
US20020023269A1 (en) | Data distribution apparatus and method, and data distribution system | |
JP2010239433A (ja) | 映像符号化装置、方法及びプログラム | |
JP4491290B2 (ja) | パケットエラー監視型mpegデコーダ、mpeg映像伝送システム及びmpeg映像伝送方法 | |
JP4190428B2 (ja) | データ伝送方法およびデータ伝送機 | |
KR101696191B1 (ko) | Mpeg ts 전송프레임에서 가변 비트율 다중화 데이터 처리 방법 및 그 장치 | |
JP2010028642A (ja) | 画像伝送システム | |
JP7328039B2 (ja) | 送信装置及び受信装置 | |
JP4525697B2 (ja) | 伝送ヘッダ圧縮装置、動画像符号化装置及び動画像伝送システム | |
JP2023076538A (ja) | 送信方法、受信方法、送信装置及び受信装置 | |
KR20110066828A (ko) | 실감 통신 단말 장치 및 이를 이용한 실감 통신 방법 | |
JP2005064574A (ja) | ストリームパケット送出装置及びストリームパケット送出方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200880125383.8 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 08871200 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 12808554 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 08871200 Country of ref document: EP Kind code of ref document: A1 |