+

WO2018107338A1 - Procédé et dispositif de traitement de signal d'image - Google Patents

Procédé et dispositif de traitement de signal d'image Download PDF

Info

Publication number
WO2018107338A1
WO2018107338A1 PCT/CN2016/109528 CN2016109528W WO2018107338A1 WO 2018107338 A1 WO2018107338 A1 WO 2018107338A1 CN 2016109528 W CN2016109528 W CN 2016109528W WO 2018107338 A1 WO2018107338 A1 WO 2018107338A1
Authority
WO
WIPO (PCT)
Prior art keywords
slice
pixels
image
image frame
storage space
Prior art date
Application number
PCT/CN2016/109528
Other languages
English (en)
Chinese (zh)
Inventor
朱磊
王晓东
龚明
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to PCT/CN2016/109528 priority Critical patent/WO2018107338A1/fr
Priority to CN201680002556.1A priority patent/CN106717000A/zh
Publication of WO2018107338A1 publication Critical patent/WO2018107338A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel

Definitions

  • Embodiments of the present invention relate to the field of image processing technologies, and in particular, to an image signal processing method and apparatus.
  • Ultra-low latency video transmission is currently the key technology in wireless video live broadcast, remote machine vision and wireless image transmission of drones.
  • the processing modules at various levels generally use a frame-level interaction mode to transmit images, that is, the processing modules at various levels usually process after completing one frame of image processing, and complete processing of one frame of image. After that, the transmission starts.
  • the encoding device performs encoding after receiving a frame of image from the image signal processing device, and after transmitting the encoding of the frame image, transmits to the transmitter, and at the receiving end, the decoder is in the slave
  • the receiver performs encoding after receiving one frame of image, and sends it to the display controller after decoding one frame of image.
  • Such a video transmission method does not utilize the overall delay of reducing video transmission, which hinders the development of ultra-low delay video transmission technology.
  • Embodiments of the present invention provide an image signal processing method and apparatus capable of reducing transmission delay of video transmission.
  • an image signal processing method comprising: acquiring pixels in a slice of an image frame captured by a visual sensor, wherein the slice comprises pixels in an unprocessed pixel included in the image frame Part of processing the pixels in the slice; transmitting the slice in response to processing the pixels in the slice.
  • an image encoding method including: acquiring a slice of an image frame, wherein the slice includes a pixel that is a part of an uncoded pixel included in the image frame; and performing the slice Encoding; transmitting the slice in response to encoding the pixels in the slice.
  • an image processing method comprising: acquiring pixels in a slice of an image frame captured by a visual sensor, wherein the slice comprises pixels in an unprocessed pixel included in the image frame Part of: processing pixels in the slice; encoding the slice in response to processing the pixels in the slice; transmitting the slice in response to encoding the pixels in the slice .
  • a fourth aspect provides an image decoding method, including: acquiring a slice of an image frame, wherein the slice includes a pixel that is a part of an undecoded pixel included in the image frame; The slice is decoded; the slice is transmitted in response to decoding the pixels in the slice.
  • a fifth aspect provides a display control method, comprising: receiving a slice of an image frame, wherein the slice includes a pixel that is a part of an undisplayed pixel included in the image frame; The pixels in the slice are displayed and outputted.
  • a sixth aspect provides an image processing method, including: acquiring a slice of an image frame, wherein the slice includes a pixel that is a part of an undecoded pixel included in the image frame; Decoding; in response to decoding the pixels in the slice, the slice is displayed and output.
  • an image signal processing apparatus comprising: an acquisition module, configured to acquire pixels in a slice of an image frame captured by a visual sensor, wherein the slice includes pixels that are included in the image frame a portion of the unprocessed pixels; a processing module for processing pixels in the slice; and a transmission module for transmitting the slice in response to processing the pixels in the slice.
  • an image signal processing apparatus comprising: at least one memory for storing computer executable instructions; at least one processor, used alone or collectively, for accessing the at least one memory and performing the The computer executable instructions to perform the operations in the method of the first aspect.
  • a ninth aspect provides an encoding apparatus, including: an acquiring module, configured to acquire a fragment of an image frame, where the fragment includes a pixel that is part of an uncoded pixel included in the image frame; and an encoding module And the encoding module is configured to transmit the fragment in response to encoding the pixels in the fragment.
  • an encoding apparatus comprising: at least one memory for storing computer executable instructions; at least one processor, used alone or collectively, for: accessing the at least one memory, and executing the computer Executing instructions to perform the operations in the method of the second aspect Work.
  • an image processing apparatus comprising: an acquisition module, configured to acquire pixels in a slice of an image frame captured by a visual sensor, wherein the slice includes pixels that are included in the image frame a portion of the unprocessed pixels; a processing module for processing pixels in the slice; an encoding module, configured to encode the slice in response to processing the pixels in the slice; And a module for transmitting the slice in response to encoding the pixels in the slice.
  • an image processing apparatus comprising: at least one memory for storing computer executable instructions; and at least one processor, singly or collectively, for accessing the at least one memory and performing the The computer executable instructions to perform the operations in the method of the third aspect.
  • a decoding apparatus comprising: an obtaining module, configured to acquire a slice of an image frame, wherein the slice includes a pixel that is part of an undecoded pixel included in the image frame a decoding module, configured to decode the slice; and a transmission module, configured to transmit the slice in response to decoding the pixel in the slice.
  • a decoding apparatus comprising: at least one memory for storing computer executable instructions; and at least one processor, singly or collectively, for accessing the at least one memory and performing the The computer executable instructions to perform the operations in the method of the fourth aspect.
  • a display control apparatus includes: a receiving module, configured to receive a slice of an image frame, where the slice includes a pixel that is part of an undisplayed pixel included in the image frame; And a module, configured to display and output the slice in response to receiving pixels in the slice.
  • a display control apparatus comprising: at least one memory for storing computer executable instructions; and at least one processor, singly or collectively, for accessing the at least one memory and performing the The computer executable instructions to perform the operations in the method of the fifth aspect.
  • a seventeenth aspect provides an image processing apparatus, comprising: an obtaining module, configured to acquire a slice of an image frame, wherein the slice includes a pixel that is part of an undecoded pixel included in the image frame. a decoding module, configured to decode the slice; and a display module, configured to display and output the slice in response to decoding the pixel in the slice.
  • an image processing apparatus comprising: at least one memory for Storing computer executable instructions; at least one processor, alone or collectively, for accessing the at least one memory and executing the computer executable instructions to perform the operations of the method of the sixth aspect.
  • an image processing system comprising: a visual sensor for capturing pixels of an image frame; and the image signal processing device according to the seventh aspect or the eighth aspect, connected to the visual sensor; An encoding apparatus according to the ninth or tenth aspect, coupled to the image signal processing apparatus; a transmitter coupled to the encoding apparatus for responding to receiving pixels in the slice of the image frame, The slice is transmitted.
  • an image processing system comprising: a receiver for receiving a slice of an image frame.
  • the decoding device according to the thirteenth aspect or the fourteenth aspect, wherein the display device is connected to the receiver, the display control device according to the fifteenth or sixteenth aspect, and the decoding device And a display connected to the display control device for displaying according to an output of the display control device.
  • an image processing system comprising: a visual sensing device for capturing an image frame; the image processing device according to the eleventh or twelfth aspect, relating to the visual sensing device And a transmitter coupled to the image processing device for transmitting the slice in response to receiving pixels in the slice of the image frame.
  • an image processing system comprising: a receiver for receiving a slice of an image frame.
  • An image processing apparatus according to the seventeenth aspect or the eighteenth aspect, which is connected to the receiver; and a display connected to the image processing apparatus for displaying in accordance with an output of the image processing apparatus.
  • the embodiment of the present invention can transmit pixels of an image frame in units of slices without starting to transmit the image frame after processing one image frame, the transmission delay is reduced, and the user experience is improved.
  • FIG. 1 is a schematic structural diagram of a transmitting end of a video transmission according to an embodiment of the present invention.
  • FIG. 2 is a block diagram showing the structure of a receiving end of a video transmission according to an embodiment of the present invention.
  • FIG. 3 is a schematic flow chart of an image signal processing method according to an embodiment of the present invention.
  • FIG. 4 is a schematic flow chart of an image encoding method according to an embodiment of the present invention.
  • FIG. 5 is a schematic flow chart of an image processing method according to an embodiment of the present invention.
  • FIG. 6 is a schematic flowchart of an image encoding method according to an embodiment of the present invention.
  • FIG. 7 is a schematic flow chart of a display control method according to an embodiment of the present invention.
  • FIG. 8 is a schematic flow chart of an image processing method according to an embodiment of the present invention.
  • FIG. 9 is a schematic structural diagram of an image signal processing apparatus according to an embodiment of the present invention.
  • Figure 10 is a block diagram showing the structure of a computer device in accordance with an embodiment of the present invention.
  • FIG. 11 is a schematic structural diagram of an encoding apparatus according to an embodiment of the present invention.
  • FIG. 12 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present invention.
  • FIG. 13 is a schematic structural diagram of a decoding apparatus according to an embodiment of the present invention.
  • FIG. 14 is a schematic structural diagram of a display control apparatus according to an embodiment of the present invention.
  • FIG. 15 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present invention.
  • FIG. 1 is a schematic structural diagram of a transmitting end 100 of a video transmission according to an embodiment of the present invention.
  • the transmitting end 100 includes an image signal processor (ISP) 110, an encoder 120, a transmitter 130, a memory 140, a transmitting antenna 150, and a visual sensor 160.
  • ISP image signal processor
  • the ISP 110 is connected to the vision sensor 160, which can be connected to the vision sensor 160, for example, via a Mobile Industry Processor Interface (MIPI).
  • the ISP 110 is configured to receive image data from the vision sensor 160, such as pixels of an image frame, and pre-process pixels of the image frame, for example, linearly correct pixels of the image frame, noise removal, dead point removal, interpolation, white Balance, automatic exposure control and other processing.
  • the ISP 160 is also used to transmit pixels of an image frame in units of slices. For example, as shown in FIG. 1, ISP 110 can directly transmit fragments through a communication interface between ISP 110 and encoder 120. Alternatively, ISP 110 can also divide The slice is written to the memory 140 so that the encoder 120 reads the slice from the memory 140.
  • the ISP 110 may also be referred to as an image signal processing unit or an image signal processing device.
  • the ISP 110 can be implemented, for example, by a system on a chip.
  • the fragmentation of the image frame refers to a part of the image frame, that is, the fragment includes a smaller number of pixels than the image frame, and the fragment may include at least one row of pixels of the pixel frame or at least A column of pixels, for example, 16 rows of pixels or 16 columns of pixels.
  • the encoder 120 is configured to encode the ISP-processed pixels in units of slices, and transmit the pixels of the encoded image frames in units of slices. For example, encoder 120 may send the encoded slice to memory 140 such that transmitter 130 reads the encoded slice from memory 140. Alternatively, encoder 120 may also transmit the encoded segments directly to transmitter 130. Encoder 120 may also be referred to as a coding unit or an encoding device.
  • the transmitter 130 is configured to receive pixels of an image frame from the encoder 120 in units of slices, and transmit pixels of the image frame through the transmitting antenna 150 in units of slices.
  • the memory 140 is configured to buffer pixels of an image frame processed by the above module.
  • the memory 140 may be, for example, a dynamic random access memory (DRAM).
  • DRAM dynamic random access memory
  • the memory 140 may be configured as an entity, or may be configured as a plurality of entities respectively distributed between the different modules.
  • Vision sensor 160 can be any type of visual sensor for capturing image data, such as a complementary metal oxide semiconductor (CMOS) sensor on a camera, camera, or other device including a camera or camera.
  • CMOS complementary metal oxide semiconductor
  • FIG. 1 illustrates the example in which the ISP 110 and the visual sensor 110 directly transmit the slice
  • the embodiment of the present invention is not limited thereto.
  • the ISP 110 may also transmit the slice to the encoder 120 through the memory 140.
  • FIG. 1 illustrates the case where the encoder 120 and the transmitter 130 sense the slice through the memory 140
  • the embodiment of the present invention is not limited thereto.
  • the encoder 120 may also directly transmit the slice to the transmitter 130.
  • FIG. 1 is described by taking an image signal processor and an encoder as separate entities, the embodiment of the present invention is not limited thereto.
  • the encoding function and the image signal processing function may also be set in In an entity, for example, it is set in the image processor.
  • FIG. 2 is a block diagram showing the structure of a receiving end 200 of a video transmission according to an embodiment of the present invention.
  • the receiving end 200 includes a display controller 210, a decoder 220, a receiver 230, a memory 240, Receive antenna 250 and display 260.
  • the receiver 230 is configured to receive pixels of an image frame through the receiving antenna 250 in units of slices, and transmit pixels of the image frame in units of slices. For example, receiver 230 stores the shards in memory 240 so that decoder 220 reads the shards from memory 240. Alternatively, receiver 230 may also transmit the slice directly to decoder 220.
  • the decoder 220 is configured to decode the pixels of the image frame received from the receiver 230 in units of slices, and send the pixels of the decoded image frame to the display controller in units of slices. 210. For example, as shown in FIG. 2, decoder 220 can transmit slices directly to display controller 210. Alternatively, decoder 220 may also cache the slices in memory 240 for display controller 210 to read the slices from memory 240.
  • the display controller 210 is configured to receive pixels of the decoded image frame from the decoder 220 in units of slices, and display pixels of the image frame through the display 260.
  • the memory 240 is used to buffer pixels of an image frame processed by the above module.
  • the memory 240 may be, for example, a dynamic random access memory (DRAM).
  • DRAM dynamic random access memory
  • the memory 240 may be configured as an entity or may be configured as a plurality of entities distributed between the different modules.
  • FIG. 2 illustrates the case where the receiver 230 and the decoder 220 transmit the slice through the memory 240
  • the embodiment of the present invention is not limited thereto.
  • the receiver 230 may also directly transmit to the decoder 220. Transfer the slice.
  • FIG. 2 illustrates the example in which the decoder 220 directly transmits the slice to the display controller 210, the embodiment of the present invention is not limited thereto.
  • the decoder 220 and the display controller 210 sense the minute through the memory 240. sheet.
  • FIG. 2 illustrates the decoder and the display controller as independent entities
  • the embodiment of the present invention is not limited thereto.
  • the decoding function and the display control function may also be set in In one entity, for example, it is provided in an image processing apparatus.
  • FIG. 3 is a schematic flow chart of an image signal processing method according to an embodiment of the present invention.
  • the embodiment of Figure 3 can be performed by the image signal processing device, image signal processor or image processing unit of Figure 1.
  • an image signal processing device will be described as an example.
  • the image signal processing method of FIG. 3 includes the following.
  • an image frame may include a plurality of slices having the same number of pixels, but embodiments of the present invention are not limited thereto, and the image frame may also include a plurality of slices having different numbers of pixels, for example, may be preset Different slices in one pixel have a different number of pixels.
  • the fragments of different service types may also be set to have different numbers of pixels.
  • the slice may include any of the following: pixels of a predetermined number of rows in the image frame (eg, 16 rows); pixels of a predetermined number of columns in the image frame (eg, 16 columns); predetermined in the image frame The number of pixels (for example, the number of pixels included in 16 rows of pixels or the number of pixels included in 16 columns of pixels).
  • the pixels of the image frame are subjected to pre-processing such as linear correction, noise removal, dead point removal, interpolation, white balance, and automatic exposure control.
  • pre-processing such as linear correction, noise removal, dead point removal, interpolation, white balance, and automatic exposure control.
  • the vision sensor may transmit the pixels of the captured image frame to the image signal processing device for preprocessing one by one or one by one. For example, whether or not a sliced pixel is processed may be determined by determining whether the number of processed pixels reaches a slice size, and each time a slice-sized pixel is processed, the image signal processing device starts transmitting the slice. At the same time, the image signal processing device continues to process other unprocessed pixels, that is, the pixels of the next slice, and once the pixels of the next slice are processed, the pixels of the next slice are transmitted, and so on.
  • the threshold of the size of the slice may be set in advance, for example, M rows of pixels or N pixels, and M and N are both positive integers. Whenever the image signal processing apparatus determines that 16 lines of pixels or N pixels have been processed, the transmission of the M lines or N pixels is started.
  • the image signal processing apparatus may start transmitting the pixels of the slice every time the pixels of one slice of the image frame are processed. Since the embodiment of the present invention can transmit pixels of an image frame in units of slices without starting to transmit the image frame after processing one image frame, the transmission delay is reduced, and the user experience is improved.
  • the transmitting the slice may include: storing the slice into the storage space, and instructing the encoding device to acquire the slice from the storage space.
  • the storage space may be part of the memory in the embodiment of Figure 1, or it may be a separate memory.
  • the storage space may be any one of: a buffer in the image signal processing device; a buffer in the encoding device; a buffer between the image signal processing device and the encoding device.
  • the image signal processing device transmits instruction information to the encoding device for instructing the encoding device to acquire the slice from the storage space.
  • the encoding device After receiving the indication information, the encoding device confirms that the storage space has stored a sliced pixel, and reads the pixel of the slice from the storage space.
  • the indication information may include address information of the first storage space, for example, a specific storage address or an index of the storage address. The indication information may also not carry the address information, but pre-arrange or set the storage address on both sides of the encoding device and the image signal processing device.
  • fragmentation is accessed by setting a storage space such that fragmentation transmission can be achieved between image signal processing devices and encoding devices belonging to different vendors or having different capabilities (e.g., transmission rates).
  • the image signal processing device may also directly transmit the slice to the encoding device.
  • an image signal processing apparatus and an encoding apparatus capable of direct communication and performance matching can be designed such that each time a slice is processed, the image signal processing apparatus can directly encode to the communication interface between the image signal processing apparatus and the encoding apparatus. The device sends the slice.
  • the image signal processing apparatus since the image signal processing apparatus directly transmits the processed sliced pixels to the encoding device, the transmission delay is further reduced, and the storage space is saved.
  • FIG. 4 is a schematic flow chart of an image encoding method according to an embodiment of the present invention.
  • the embodiment of Figure 4 can be performed by the encoding device, encoder or encoding unit of Figure 1.
  • an encoding device will be described as an example.
  • the image encoding method of FIG. 4 corresponds to the image signal processing method of FIG. 3, and a detailed description thereof will be appropriately omitted herein.
  • the image encoding method of FIG. 4 includes the following.
  • a slice of an image frame where the slice includes a pixel that is part of an uncoded pixel included in the image frame.
  • a slice of an image frame transmitted by the image signal processing device can be received.
  • an image frame may include a plurality of slices having the same number of pixels, but embodiments of the present invention are not limited thereto, and the image frame may also include a plurality of slices having different numbers of pixels, for example, may be preset Different slices in one pixel have a different number of pixels.
  • the fragments of different service types may also be set to have different numbers of pixels.
  • the image signal processing apparatus may transmit the pixels of the image frame to the encoding apparatus in units of slices, and the embodiment of the present invention is not limited thereto, and the image signal processing apparatus may also transmit the image frame to the encoding apparatus in a conventional manner.
  • the encoding is performed by the encoding device in units of slices.
  • the slice may include any of the following: a pixel of a predetermined number of rows in the image frame (eg, For example, 16 lines); a predetermined number of columns of pixels in an image frame (eg, 16 columns); a predetermined number of pixels in an image frame (eg, the number of pixels included in 16 rows of pixels or 16 columns of pixels) The number of pixels).
  • a pixel of a predetermined number of rows in the image frame eg, For example, 16 lines
  • a predetermined number of columns of pixels in an image frame eg, 16 columns
  • a predetermined number of pixels in an image frame eg, the number of pixels included in 16 rows of pixels or 16 columns of pixels
  • the shard is encoded in response to receiving a shard.
  • whether or not a sliced pixel is received may be determined by determining whether the number of received pixels reaches a slice size, and the slice is encoded each time it is determined that a sliced pixel is received.
  • the embodiment of the present invention does not limit the manner of encoding, and may be any coding method used in video or image coding technology.
  • the encoding device may acquire pixels of one slice of the image frame transmitted by the image signal processing device, and may determine whether to encode a pixel of the slice by determining whether the number of the encoded pixels reaches a size of one slice. Whenever a sliced pixel is received, the sliced pixel is encoded, and each time a slice-sized pixel is encoded, the encoding device starts transmitting the slice, and the encoding device continues to encode the next pixel. That is, the next sliced pixel, and once the next sliced pixel is encoded, the next sliced pixel is transmitted, and so on.
  • a threshold of the size of the slice may be set in advance, for example, M rows or column pixels or N pixels, and both M and N are positive integers.
  • the M row or column of pixels or N pixels are transmitted whenever the encoding device determines that M rows or columns of pixels or N pixels have been encoded.
  • the encoding device may start encoding the pixels of the slice every time a pixel of the slice is received, and start transmitting the segment every time the pixel of one slice of the image frame is encoded.
  • the pixels of the slice Since the embodiment of the present invention can transmit pixels of an image frame in units of slices, it is not necessary to wait until the encoding of one image frame to start transmitting the image frame, thereby reducing transmission delay and improving user experience.
  • the obtaining the slice of the image frame may include: acquiring the slice from the first storage space according to the indication of the image signal processing device.
  • the first storage space is similar to the storage space in the embodiment of FIG. 3, and details are not described herein again.
  • transmitting the slice specifically includes: storing the slice to the second storage space, and instructing the transmitter to acquire the slice from the second storage space.
  • the second storage space may be part of the memory in the embodiment of FIG. 1, or it may be a separate memory.
  • the second storage space is any one of: a cache in the encoding device; a buffer in the transmitter; a cache between the encoding device and the transmitter.
  • the encoding device sends indication information to the transmitter for instructing the transmitter to acquire the slice from the second storage space.
  • the transmitter determines that the second storage space has stored a fragmented pixel, and reads the pixel of the fragment from the second storage space.
  • the indication information may include address information of the second storage space, for example, a specific storage address or an index of the storage address.
  • the indication information may not carry the address information, but the storage address is pre-agreed or set on both sides of the encoding device and the transmitter.
  • fragmentation is accessed by setting a storage space such that fragmentation transmission can be achieved between encoding devices and transmitters respectively belonging to different vendors or having different capabilities (e.g., transmission rates).
  • the encoding device may also send the slice directly to the transmitter.
  • an encoding device and a transmitter capable of direct communication and performance matching can be designed such that each time a slice is processed, the encoding device can directly transmit the slice to the transmitter through a communication interface between the encoding device and the transmitter.
  • the encoding device since the encoding device directly transmits the encoded sliced pixels to the transmitter, the transmission delay is further reduced, and the storage space is saved.
  • the image signal processing function and the encoding function are implemented in an independent entity as an example.
  • the following is an example in which the image signal processing function and the encoding function are implemented in the same entity.
  • FIG. 5 is a schematic flow chart of an image processing method according to an embodiment of the present invention.
  • the embodiment of Figure 5 is performed by an image processing device.
  • the method of Figure 5 includes the following.
  • 510 Acquire a pixel in a slice of an image frame captured by a visual sensor, where the slice includes a pixel that is part of an unprocessed pixel included in the image frame. 510 is similar to 310 in FIG. 3 and will not be further described herein.
  • Process the pixels in the slice. 520 is similar to 320 in FIG. 3 and will not be further described herein.
  • the vision sensor may transmit the pixels of the captured image frame to the image processing device for preprocessing one by one or one by one.
  • the image processing apparatus may determine whether to process a sliced pixel by determining whether the number of processed pixels reaches a slice size, and each time a slice size pixel is processed, the image processing apparatus starts encoding the pixel. Fragmentation while continuing to process The incoming pixel, that is, the next sliced pixel, and once the next sliced pixel is processed, begins to encode the next sliced pixel, and so on.
  • the image processing apparatus may determine whether the image processing apparatus starts transmitting the slice every time a pixel of a slice size is encoded, by determining whether the number of the encoded pixels reaches a size of one slice, At the same time, the next pixel, that is, the next sliced pixel, continues to be encoded, and once the next sliced pixel is encoded, the next sliced pixel is transmitted, and so on.
  • the image processing apparatus may start encoding a pixel of the slice every time the pixel of one slice of the image frame is processed, and start transmitting the pixel every time the pixel of the slice is encoded. Fragmentation. Since the embodiment of the present invention can transmit the pixels of the image frame in units of slices, it is not necessary to wait until the processing of one image frame to start encoding the image frame, and it is not necessary to wait until the image frame is encoded to start transmitting the image frame, thereby reducing The transmission delay increases the user experience.
  • the method of FIG. 5 further includes: storing the slice into the first storage space before encoding the slice, wherein the foregoing encoding the slice includes: pairing from the first storage
  • the fragments obtained in the space are encoded.
  • the first storage space may be a cache in the image processing device.
  • the transmitting the slice may include: storing the slice to the second storage space; instructing the transmitter to acquire the slice from the second storage space.
  • the second storage space includes any of the following: a cache in the image processing device; a cache in the transmitter; a cache between the image processing device and the transmitter.
  • the image processing device sends the indication information to the transmitter for instructing the transmitter to acquire the slice from the second storage space.
  • the transmitter determines that the second storage space has stored a fragmented pixel, and reads the pixel of the fragment from the second storage space.
  • the indication information may include address information of the second storage space, for example, a specific storage address or an index of the storage address.
  • the indication information may not carry the address information, but the storage address is pre-agreed or set on both sides of the image processing apparatus and the transmitter.
  • fragmentation is accessed by setting a storage space such that fragmentation transmission can be achieved between image processing apparatuses and transmitters respectively belonging to different vendors or having different capabilities (e.g., transmission rates).
  • the image processing apparatus may also transmit the slice directly to the transmitter.
  • an image processing device and a transmitter capable of direct communication and performance matching can be designed such that Each time a slice is processed and encoded, the image processing device can directly transmit the slice to the transmitter through a communication interface between the image processing device and the transmitter.
  • the image processing apparatus since the image processing apparatus directly transmits the processed and encoded sliced pixels to the transmitter, the transmission delay is further reduced, and the storage space is saved.
  • the image processing apparatus since the image processing apparatus directly transmits the processed and encoded sliced pixels to the transmitter, the transmission delay is further reduced, and the storage space is saved.
  • the entity of the transmitting end is described in detail above.
  • the entity of the receiving end is described in detail below with reference to the embodiments of FIG. 6 to FIG. 8.
  • FIG. 6 is a schematic flowchart of an image encoding method according to an embodiment of the present invention.
  • the embodiment of Figure 6 can be performed by the decoding device, decoder or decoding unit of Figure 2.
  • a decoding device will be described as an example.
  • the image decoding method of FIG. 6 includes the following.
  • a slice of an image frame transmitted by the receiver can be received.
  • the definition of image frames and fragments is similar to the definition of image frames and fragments at the transmitting end, and will not be described here.
  • the receiver may transmit the pixels of the image frame to the decoding device in units of slices.
  • the embodiment of the present invention is not limited thereto, and the receiver may also send the image frame to the decoding device in a conventional manner, and the image is translated by the receiver.
  • the code device decodes in units of slices.
  • whether or not a sliced pixel is received may be determined by determining whether the number of received pixels reaches a slice size, and the slice is decoded each time it is determined that a sliced pixel is received.
  • the embodiment of the present invention does not limit the manner of decoding, and may be any decoding method used in video or image decoding technology.
  • the decoding device may acquire pixels of one slice of the image frame transmitted by the receiver, and may determine whether to receive a sliced pixel by determining whether the number of received pixels reaches a size of one slice, When a sliced pixel is received, the sliced pixel is decoded. When decoding a slice-sized pixel, the decoding device starts transmitting the slice, and the decoding device continues to decode. The down pixel, that is, the next sliced pixel, and once the next sliced pixel is decoded, begins transmitting the next sliced pixel, and so on. Can be set in advance
  • the threshold of the size of the slice for example, M rows or column pixels or N pixels, M and N are both positive integers.
  • the M row or column of pixels or N pixels are transmitted whenever the decoding device determines that M rows or columns of pixels or N pixels have been decoded.
  • the decoding apparatus may start decoding a pixel of the slice every time a pixel of the slice is received, and start decoding each time a pixel of the slice of the image frame is decoded.
  • the pixels of the slice are transmitted. Since the embodiment of the present invention can transmit the pixels of the image frame in units of slices, it is not necessary to wait until the decoding of one image frame to start transmitting the image frame, thereby reducing the transmission delay and improving the user experience.
  • the obtaining the fragment of the image frame may include: acquiring the fragment from the first storage space according to the indication of the receiver.
  • the first storage space may be part of the memory in the embodiment of FIG. 2 or it may be a separate memory.
  • the first storage space may be any of the following: a buffer in the receiver; a buffer in the decoding device; a buffer between the receiver and the decoding device.
  • the receiver sends indication information to the decoding device for instructing the decoding device to acquire the slice from the first storage space.
  • the decoding device After receiving the indication information, the decoding device confirms that the first storage space has stored a fragmented pixel, and reads the pixel of the fragment from the storage space.
  • the indication information may include address information of the first storage space, for example, a specific storage address or an index of the storage address. The indication information may also not carry the address information, but pre-arrange or set the storage address on both sides of the decoding device and the receiver.
  • fragmentation is accessed by setting a storage space such that fragmentation transmission can be achieved between receivers and decoding devices belonging to different vendors or having different capabilities (e.g., transmission rates).
  • the receiver may also send the slice directly to the decoding device.
  • a decoding device and a receiver capable of direct communication and performance matching can be designed such that each time a slice is received, the receiver can directly transmit the code to the decoding device via a communication interface between the receiver and the decoding device. Fragmentation.
  • the receiver since the receiver directly transmits the processed sliced pixels to the decoding device, the transmission delay is further reduced, and the storage space is saved.
  • the transmitting the slice may include: storing the slice to the second storage space, and instructing the display control device to acquire the slice from the second storage space.
  • the second storage space includes any one of the following Item: a buffer in the decoding device; a buffer in the display control device; a cache between the decoding device and the display control device.
  • the decoding device sends the indication information to the display control device for instructing the display control device to acquire the slice from the second storage space.
  • the display control device determines that the second storage space has stored a sliced pixel, and reads the pixel of the slice from the second storage space.
  • the indication information may include address information of the second storage space, for example, a specific storage address or an index of the storage address. Alternatively, the indication information may not carry the address information, but the storage address is pre-agreed or set on both sides of the display control device and the decoding device.
  • fragmentation is accessed by setting a storage space such that transmission of slices can be achieved between display control devices and decoding devices belonging to different vendors or having different capabilities (e.g., transmission rates).
  • the decoding device may also directly transmit the slice to the display control device.
  • a display control device and a decoding device capable of direct communication and performance matching can be designed such that each time a slice is processed, the decoding device can directly control the display through a communication interface between the display control device and the decoding device. The device sends the slice.
  • the transmission delay is further reduced, and the storage space is saved.
  • FIG. 7 is a schematic flow chart of a display control method according to an embodiment of the present invention.
  • the embodiment of Figure 7 can be performed by the display control device, display controller or display control unit of Figure 2 .
  • the display control device will be described as an example.
  • the display control method of FIG. 7 corresponds to the image decoding method of FIG. 6, and the display control method of FIG. 7 includes the following.
  • slices of image frames transmitted by the decoding device can be acquired.
  • the definition of image frames and fragments is similar to the definition of image frames and fragments at the transmitting end, and will not be described here.
  • the decoding device may transmit pixels of the image frame to the display control device in units of slices.
  • the display control means may acquire pixels of one slice of the image frame transmitted by the decoding means, and may determine by determining whether the number of received pixels reaches a size of one slice. Whether a pixel of a slice is received, and when a pixel of one slice is received, the pixel of the slice is displayed and output, and the display control device continues to receive the next pixel, that is, the pixel of the next slice, and Once the pixels of the next slice are received, the pixels that output the next slice are displayed, and so on.
  • the threshold of the size of the slice may be set in advance, for example, M rows or column pixels or N pixels, and both M and N are positive integers. Each time the display control device determines that M rows or columns of pixels or N pixels have been received, the display outputs the M rows or columns of pixels or N pixels.
  • the display control means can start displaying the pixels outputting the slice every time a pixel of the slice is received. Since the embodiment of the present invention can display the pixels of the output image frame in units of slices, it is not necessary to wait for the reception of one image frame to start displaying and outputting the image frame, thereby reducing the transmission delay and improving the user experience.
  • the obtaining the slice of the image frame may include: acquiring the slice from the storage space according to the indication of the decoding device.
  • FIG. 8 is a schematic flow chart of an image processing method according to an embodiment of the present invention.
  • the embodiment of Figure 8 is performed by an image processing device.
  • the method of Figure 8 includes the following.
  • 810 Acquire a slice of an image frame, where the slice includes a pixel that is part of an undecoded pixel included in the image frame. 810 is similar to 610 in FIG. 6, and details are not described herein again.
  • Decode the slice. 820 is similar to 620 in FIG. 6, and details are not described herein again.
  • the image processing apparatus may determine whether to decode a sliced pixel by determining whether the number of decoded pixels reaches a slice size, and image processing each time a slice size pixel is decoded.
  • the device begins to display and output the slice while continuing to decode the next pixel, that is, the next sliced pixel, and once the next sliced pixel is decoded, the next sliced pixel is displayed. analogy.
  • the image processing apparatus may start displaying the pixels outputting the slice every time the pixels of one slice of the image frame are decoded. Since the embodiment of the present invention can transmit the pixels of the image frame in units of slices, it is not necessary to wait until the processing of one image frame to start encoding the image frame, and it is not necessary to wait until the image frame is encoded to start transmitting the image frame, thereby reducing The transmission delay increases the user experience.
  • the obtaining the fragment of the image frame may include: acquiring the fragment from the storage space according to the indication of the receiver.
  • the storage space is any of the following: a buffer in the receiver; in the image processing device Cache; cache between the receiver and the image processing device.
  • FIG. 9 is a schematic structural diagram of an image signal processing apparatus 900 according to an embodiment of the present invention.
  • the image signal processing apparatus 900 includes an acquisition module 910, a processing module 920, and a transmission module 930.
  • the acquisition module 910 is configured to acquire pixels in a slice of an image frame captured by the visual sensor, wherein the slice includes pixels that are part of an unprocessed pixel included in the image frame.
  • the processing module 920 is configured to process pixels in the slice.
  • the transmission module 930 is configured to transmit the slice in response to processing the pixels in the slice.
  • the image signal processing apparatus may start transmitting the pixels of the slice every time the pixels of one slice of the image frame are processed. Since the embodiment of the present invention can transmit pixels of an image frame in units of slices without starting to transmit the image frame after processing one image frame, the transmission delay is reduced, and the user experience is improved.
  • the transmission module 930 is configured to store the slice to the storage space and instruct the encoding device to acquire the slice from the storage space.
  • the storage space may be any one of: a buffer in the image signal processing device; a buffer in the encoding device; a buffer between the image signal processing device and the encoding device.
  • the slice may comprise any of the following: pixels of a predetermined number of rows in the image frame; pixels of a predetermined number of columns in the image frame; a predetermined number of pixels in the image frame.
  • the slice comprises sixteen rows of pixels in the image frame.
  • the image frame comprises a plurality of tiles having the same number of pixels.
  • FIG. 10 is a block diagram showing the structure of a computer device 1000 in accordance with an embodiment of the present invention.
  • the computer device 100 can include at least one memory 1020 for storing computer executable instructions; at least one processor 1010, alone or collectively, for accessing at least one memory 1020 and executing computer executable instructions for performing FIG. 3 through The operation in the method described in the embodiment of 8.
  • Another embodiment of the present invention further provides an image signal processing apparatus that can be implemented by the computer apparatus of FIG. 10 for performing the method of the embodiment of FIG. The operation in .
  • FIG. 11 is a schematic structural diagram of an encoding apparatus 1100 according to an embodiment of the present invention.
  • the encoding device 1100 includes an obtaining module 1110, an encoding module 1120, and a transmission module 1130.
  • the obtaining module 1110 is configured to acquire a slice of the image frame, wherein the slice comprises a pixel that is part of an uncoded pixel included in the image frame.
  • the encoding module 1120 is configured to encode the slice.
  • the transmission module 1130 is configured to transmit the slice in response to the pixels in the encoded slice.
  • the encoding device may start encoding the pixels of the slice every time a pixel of the slice is received, and start transmitting the segment every time the pixel of one slice of the image frame is encoded.
  • the pixels of the slice Since the embodiment of the present invention can transmit pixels of an image frame in units of slices, it is not necessary to wait until the encoding of one image frame to start transmitting the image frame, thereby reducing transmission delay and improving user experience.
  • the acquisition module 1110 is configured to acquire slices of image frames transmitted by the image signal processing device.
  • the obtaining module 1110 is configured to acquire a slice from the first storage space according to an indication of the image signal processing apparatus.
  • the first storage space is any one of: a buffer in the image signal processing device; a buffer in the encoding device; a buffer between the image signal processing device and the encoding device.
  • the slice comprises any one of: a pixel of a predetermined number of rows in the image frame; a pixel of a predetermined number of columns in the image frame; a predetermined number of pixels in the image frame.
  • the slice comprises sixteen rows of pixels in the image frame.
  • the image frame comprises a plurality of tiles having the same number of pixels.
  • the transmission module 1130 is configured to store the slice to the second storage space and instruct the transmitter to acquire the slice from the second storage space.
  • the second storage space comprises any one of: a buffer in the encoding device; a buffer in the transmitter; a buffer between the encoding device and the transmitter.
  • Another embodiment of the present invention also provides an encoding apparatus that can be implemented by the computer apparatus of FIG. 10 for performing the operations in the method of the embodiment of FIG.
  • FIG. 12 is a schematic structural diagram of an image processing apparatus 1200 according to an embodiment of the present invention.
  • the image processing apparatus 1200 includes an acquisition module 1210, a processing module 1220, an encoding module 1230, and a transmission module 1240.
  • the acquisition module 1210 is configured to acquire pixels in a slice of an image frame captured by the visual sensor, wherein the slice includes pixels that are part of an unprocessed pixel included in the image frame.
  • the processing module 1220 is configured to process pixels in the slice.
  • Encoding module 1230 is for encoding the tiles in response to processing the pixels in the slice.
  • the transmission module 1240 is configured to transmit the slice in response to the pixels in the encoded slice.
  • the image processing apparatus may start encoding a pixel of the slice every time the pixel of one slice of the image frame is processed, and start transmitting the pixel every time the pixel of the slice is encoded. Fragmentation. Since the embodiment of the present invention can transmit the pixels of the image frame in units of slices, it is not necessary to wait until the processing of one image frame to start encoding the image frame, and it is not necessary to wait until the image frame is encoded to start transmitting the image frame, thereby reducing The transmission delay increases the user experience.
  • the encoding module 1230 is further configured to store the fragment into the first storage space before encoding the fragment, where the encoding module 1230 is configured to obtain the score obtained from the first storage space.
  • the slice is encoded.
  • the first storage space is a cache in the image processing device.
  • the slice comprises any one of: a pixel of a predetermined number of rows in the image frame; a pixel of a predetermined number of columns in the image frame; a predetermined number of pixels in the image frame.
  • the slice comprises sixteen rows of pixels in the image frame.
  • the image frame comprises a plurality of tiles having the same number of pixels.
  • the transmission module 1240 is configured to store the slice to the second storage space; and instruct the transmitter to acquire the slice from the second storage space.
  • the second storage space comprises any one of: a cache in the image processing device; a buffer in the transmitter; a cache between the image processing device and the transmitter.
  • Another embodiment of the present invention also provides an image processing apparatus that can be implemented by the computer apparatus of FIG. 10 for performing the operations in the method of the embodiment of FIG.
  • FIG. 13 is a schematic structural diagram of a decoding apparatus 1300 according to an embodiment of the present invention.
  • the decoding device 1300 includes an acquisition module 1310, a decoding module 1320, and a transmission module 1330.
  • the obtaining module 1310 is configured to acquire a slice of the image frame, wherein the slice comprises a pixel that is part of an uncoded pixel included in the image frame.
  • the decoding module 1320 is configured to decode the slice.
  • the transmission module 1330 is configured to transmit the slice in response to decoding the pixels in the slice.
  • the decoding apparatus may start decoding a pixel of the slice every time a pixel of the slice is received, and start decoding each time a pixel of the slice of the image frame is decoded.
  • the pixels of the slice are transmitted. Since the embodiment of the present invention can transmit the pixels of the image frame in units of slices, it is not necessary to wait until the decoding of one image frame to start transmitting the image frame, thereby reducing the transmission delay and improving the user experience.
  • the acquisition module 1310 acquires slices of image frames transmitted by the receiver.
  • the acquisition module 1310 acquires the slice from the first storage space according to the indication of the receiver.
  • the first storage space is any one of: a buffer in the receiver; a buffer in the decoding device; a buffer between the receiver and the decoding device.
  • the slice comprises any one of: a pixel of a predetermined number of rows in the image frame; a pixel of a predetermined number of columns in the image frame; a predetermined number of pixels in the image frame.
  • the slice comprises sixteen rows of pixels in the image frame.
  • the image frame comprises a plurality of tiles having the same number of pixels.
  • the transmission module 1330 stores the slice to the second storage space and instructs the display control device to acquire the slice from the second storage space.
  • the second storage space comprises any one of: a buffer in the decoding device; a buffer in the display control device; a buffer between the decoding device and the display control device.
  • Another embodiment of the present invention also provides an image processing apparatus that can be implemented by the computer apparatus of FIG. 10 for performing the operations in the method of the embodiment of FIG.
  • FIG. 14 is a schematic structural diagram of a display control device 1400 according to an embodiment of the present invention.
  • the display control device 1400 includes a receiving module 1410 and a display module 1420.
  • the receiving module 1410 is configured to receive a slice of the image frame, where the slice includes a pixel that is part of an undisplayed pixel included in the image frame.
  • the display module 1420 is configured to display and output the slice in response to receiving the pixels in the slice.
  • the display control means can start displaying the pixels outputting the slice every time a pixel of the slice is received. Since the embodiment of the present invention can display the pixels of the output image frame in units of slices, it is not necessary to wait for the reception of one image frame to start displaying and outputting the image frame, thereby reducing the transmission delay and improving the user experience.
  • receiving module 1410 receives the slices of the image frames transmitted by the decoding device.
  • the receiving module 1410 obtains slices from the storage space in accordance with an indication from the decoding device.
  • the storage space is any one of: a buffer in the decoding device; a buffer in the display control device; a buffer between the display control device and the decoding device.
  • the slice comprises any one of: a pixel of a predetermined number of rows in the image frame; a pixel of a predetermined number of columns in the image frame; a predetermined number of pixels in the image frame.
  • the slice comprises sixteen rows of pixels in the image frame.
  • the image frame comprises a plurality of tiles having the same number of pixels.
  • Another embodiment of the present invention also provides a display control device that can be implemented by the computer device of FIG. 10 for performing the operations in the method of the embodiment of FIG.
  • FIG. 15 is a schematic structural diagram of an image processing apparatus 1500 according to an embodiment of the present invention.
  • the obtaining module 1510 is configured to acquire a slice of the image frame, where the slice includes a pixel that is part of an undecoded pixel included in the image frame.
  • the decoding module 1520 is configured to decode the fragment.
  • the display module 1530 is configured to display and output the slice in response to decoding the pixels in the slice.
  • the image processing apparatus may start displaying the pixels outputting the slice every time the pixels of one slice of the image frame are decoded. Since the embodiment of the present invention can transmit the pixels of the image frame in units of slices, it is not necessary to wait until the processing of one image frame to start encoding the image frame, and it is not necessary to wait until the image frame is encoded to start transmitting the image frame, thereby reducing The transmission delay increases the user experience.
  • the acquisition module 1510 acquires slices of image frames transmitted by the receiver.
  • the acquisition module 1510 acquires the slice from the storage space according to the indication of the receiver.
  • the storage space is any one of: a buffer in the receiver; a buffer in the image processing device; a cache between the receiver and the image processing device.
  • the slice comprises any one of: a pixel of a predetermined number of rows in the image frame; a pixel of a predetermined number of columns in the image frame; a predetermined number of pixels in the image frame.
  • the slice comprises sixteen rows of pixels in the image frame.
  • the image frame comprises a plurality of tiles having the same number of pixels.
  • Another embodiment of the present invention also provides an image processing apparatus that can be implemented by the computer apparatus of FIG. 10 for performing the operations in the method of the embodiment of FIG.
  • Embodiments of the present invention also provide an image processing system.
  • the image processing system can include the transmitting end of FIG.
  • the image processing system includes: a visual sensor for capturing pixels of an image frame; an image signal processing device as in the above embodiment, connected to the visual sensor; an encoding device as in the above embodiment, connected to the image signal processing device; And coupled to the encoding device for transmitting the slice in response to receiving pixels in the slice of the image frame.
  • Embodiments of the present invention also provide another image processing system.
  • the image processing system can include the receiving end of FIG.
  • the image processing system includes a receiver for receiving a slice of an image frame.
  • the decoding device of the above embodiment is connected to the receiver; the display control device of the above embodiment is connected to the decoding device; and the display is connected to the display control device for displaying according to the output of the display control device .
  • Embodiments of the present invention also provide another image processing system.
  • the image processing system can include the transmitting end of FIG.
  • the image processing system may include a visual sensing device for capturing an image frame; the image processing device of the above embodiment, coupled to the visual sensing device; and a transmitter coupled to the image processing device for receiving in response to receiving The pixels in the slice of the image frame are transmitted, and the slice is transmitted.
  • Embodiments of the present invention also provide another image processing system.
  • the image processing system can include the receiving end of FIG.
  • the image processing system may include: a receiver for receiving a slice of the image frame; an image processing device as described in the above embodiment, connected to the receiver; and a display coupled to the image processing device for the image according to the image The output of the processing device is displayed.
  • the disclosed systems, devices, and methods may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the functions may be stored in a computer readable storage medium if implemented in the form of a software functional unit and sold or used as a standalone product.
  • the technical solution of the present invention which is essential or contributes to the prior art, or a part of the technical solution, may be embodied in the form of a software product, which is stored in a storage medium, including
  • the instructions are used to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

La présente invention concerne un procédé et un dispositif de traitement de signal d'image. Le procédé consiste à : acquérir des pixels dans une mosaïque d'une trame d'image capturée par un capteur visuel, les pixels contenus dans la mosaïque étant une partie de pixels non traités contenus dans la trame d'image ; traiter les pixels de la mosaïque ; et transmettre la mosaïque en réponse à l'accomplissement du traitement des pixels de la mosaïque. La solution technique de la présente invention réduit la latence de transmission d'une transmission vidéo.
PCT/CN2016/109528 2016-12-12 2016-12-12 Procédé et dispositif de traitement de signal d'image WO2018107338A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2016/109528 WO2018107338A1 (fr) 2016-12-12 2016-12-12 Procédé et dispositif de traitement de signal d'image
CN201680002556.1A CN106717000A (zh) 2016-12-12 2016-12-12 图像信号处理方法和装置

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/109528 WO2018107338A1 (fr) 2016-12-12 2016-12-12 Procédé et dispositif de traitement de signal d'image

Publications (1)

Publication Number Publication Date
WO2018107338A1 true WO2018107338A1 (fr) 2018-06-21

Family

ID=58903789

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/109528 WO2018107338A1 (fr) 2016-12-12 2016-12-12 Procédé et dispositif de traitement de signal d'image

Country Status (2)

Country Link
CN (1) CN106717000A (fr)
WO (1) WO2018107338A1 (fr)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108513642B (zh) * 2017-07-31 2021-08-27 深圳市大疆创新科技有限公司 一种图像处理方法、无人机、地面控制台及其图像处理系统
WO2019037121A1 (fr) * 2017-08-25 2019-02-28 SZ DJI Technology Co., Ltd. Systèmes et procédés permettant de synchroniser une synchronisation de trames entre une trame de couche physique et une trame vidéo
CN109587504A (zh) * 2017-09-29 2019-04-05 北京传送科技有限公司 Vr影像数据压缩方法
CN109785347A (zh) 2018-04-27 2019-05-21 京东方科技集团股份有限公司 图像处理方法、图像处理系统及存储介质
CN113160026B (zh) * 2020-01-07 2024-03-05 北京地平线机器人技术研发有限公司 图像处理方法、装置、介质以及电子设备

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1126410A (zh) * 1995-01-06 1996-07-10 大宇电子株式会社 数字视频信号的并行解码装置
US6167442A (en) * 1997-02-18 2000-12-26 Truespectra Inc. Method and system for accessing and of rendering an image for transmission over a network
CN101282478A (zh) * 2008-04-24 2008-10-08 上海华平信息技术股份有限公司 实现高清视频并行编码的方法及系统
CN102625149A (zh) * 2004-09-27 2012-08-01 英特尔公司 使用基于片的再现系统的低等待时间远程显示再现

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101543037B (zh) * 2007-05-17 2012-05-30 索尼株式会社 信息处理设备和方法
JP5914962B2 (ja) * 2010-04-09 2016-05-11 ソニー株式会社 画像処理装置および方法、プログラム、並びに、記録媒体
CN105791353B (zh) * 2014-12-23 2020-03-17 深圳市腾讯计算机系统有限公司 基于纠删码的分布式数据存储方法及系统

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1126410A (zh) * 1995-01-06 1996-07-10 大宇电子株式会社 数字视频信号的并行解码装置
US6167442A (en) * 1997-02-18 2000-12-26 Truespectra Inc. Method and system for accessing and of rendering an image for transmission over a network
CN102625149A (zh) * 2004-09-27 2012-08-01 英特尔公司 使用基于片的再现系统的低等待时间远程显示再现
CN101282478A (zh) * 2008-04-24 2008-10-08 上海华平信息技术股份有限公司 实现高清视频并行编码的方法及系统

Also Published As

Publication number Publication date
CN106717000A (zh) 2017-05-24

Similar Documents

Publication Publication Date Title
WO2018107338A1 (fr) Procédé et dispositif de traitement de signal d'image
TWI569629B (zh) 用於在壓縮視訊資料中包括感興趣區域指示之技術
US20160007026A1 (en) Techniques for image encoding based on region of interest
WO2017192207A1 (fr) Architecture de domaine hybride graphique et de pixels pour vidéo à 360 degrés
WO2015144084A1 (fr) Procédé, appareil et système de lecture vidéo synchrone
US10026146B2 (en) Image processing device including a progress notifier which outputs a progress signal
US11831888B2 (en) Reducing latency in wireless virtual and augmented reality systems
US20200259880A1 (en) Data processing method and apparatus
TWI610553B (zh) 影像資料傳送裝置
WO2018058575A1 (fr) Procédé et système de traitement de données d'images de vol et dispositif au sol
WO2019011053A1 (fr) Procédé de traitement de données d'image et dispositif
US20120106650A1 (en) Method and System for Block and DVC Compression
KR101410837B1 (ko) 비디오 메모리의 모니터링을 이용한 영상 처리 장치
US10880555B2 (en) Information processing system and information processing apparatus
EP4340376A2 (fr) Procédé et appareil de traitement d'image et dispositif terminal
US9819958B2 (en) Drawing system, information processing apparatus and drawing control method which switch drawing from still image data to video image data
CN107241601B (zh) 图像数据传输方法、装置及终端
CN115623217B (zh) 一种图像预处理方法、装置及系统
CN115299033B (zh) 拍摄装置和拍摄处理方法
CN117376607A (zh) 一种视频码流处理方法、装置、设备及介质
CN116489380A (zh) 一种微控制处理器及视频码流的解码方法
JP2016065958A (ja) 表示制御システム、表示制御装置、及びプログラム
WO2012027354A1 (fr) Procédé et système de compression vidéo de bloc et dvc
JP2017118207A (ja) 無線通信装置およびプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16923676

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16923676

Country of ref document: EP

Kind code of ref document: A1

点击 这是indexloc提供的php浏览器服务，不要输入任何密码和下载