+

WO2018137236A1 - Procédé, appareil, et dispositif de communication par caméra - Google Patents

Procédé, appareil, et dispositif de communication par caméra Download PDF

Info

Publication number
WO2018137236A1
WO2018137236A1 PCT/CN2017/072733 CN2017072733W WO2018137236A1 WO 2018137236 A1 WO2018137236 A1 WO 2018137236A1 CN 2017072733 W CN2017072733 W CN 2017072733W WO 2018137236 A1 WO2018137236 A1 WO 2018137236A1
Authority
WO
WIPO (PCT)
Prior art keywords
symbol
sub
symbols
amplitude
sequence
Prior art date
Application number
PCT/CN2017/072733
Other languages
English (en)
Chinese (zh)
Inventor
李强
姜彤
董晨
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN201780076496.2A priority Critical patent/CN110073611B/zh
Priority to PCT/CN2017/072733 priority patent/WO2018137236A1/fr
Publication of WO2018137236A1 publication Critical patent/WO2018137236A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B10/00—Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
    • H04B10/11—Arrangements specific to free-space transmission, i.e. transmission through air or vacuum
    • H04B10/114—Indoor or close-range type systems
    • H04B10/116—Visible light communication

Definitions

  • the present application relates to communication technologies, and in particular, to a method, device and device for camera communication
  • LED light-emitting diode
  • LED light-emitting diode
  • the signal can be sent out by high-speed light and dark flicker that is not visible to the naked eye, so that it can be used as a signal transmitter of the optical communication system; in addition, the photodiode (PD) will receive all the received signals during the reception of the optical signal.
  • the optical power is converted into a current signal, so the PD can serve as a signal receiver for the optical communication system.
  • VLC visible light communication
  • VLC system Communication rate and communication distance of the system
  • a PD-based VLC system In order to increase the received optical power of a PD-based VLC system, one usually uses an optical lens (combination) before the PD and places the PD at the focus of the optical lens (combination), but because the lens will space the received optical signal. Separation, in which case it is difficult for a single PD to simultaneously receive optical signals of a plurality of LEDs, thereby affecting signal switching during movement of the receiving device.
  • an image sensor uses a PD array as a photoreceiver, and each PD is a pixel of IS that can receive signals independently.
  • the IS works with the imaging lens, light from different directions will be focused at different positions on the IS, enabling reception of pictures or video.
  • LED light source and camera are integrated between the mobile phone and the mobile phone, between the car and the car, or any other two.
  • Camera communication can be achieved between devices through LED light sources and cameras.
  • one of the hotspots in the field of OCC research is how to achieve flicker-free communication when using a normal frame rate camera (for example, the camera's frame rate is less than 60 fps) for signal transmission and reception.
  • a normal frame rate camera for example, the camera's frame rate is less than 60 fps
  • CFF critical flicker frequency
  • OOK on-off keying
  • the signal transmission frequency needs to be set to less than half of the camera frame rate to achieve complete reception of the signal, but such a low transmission frequency of the transmitting device can cause the LED to blink.
  • the prior art adopts the Undersampled Frequency Shift ON-OFF keying (UFSOOK) modulation method, that is, the white LED of the transmitting device transmits a white light signal, and the UFSOOK system allows the receiving device (ie, the camera) to operate in the owu In the sampling mode, due to the special relationship between the carrier frequency fs (fs> CFF) and the camera frame rate, it can realize the complete signal transmitted by the camera to receive the original signal, thereby achieving flicker-free communication.
  • UFSOOK Undersampled Frequency Shift ON-OFF keying
  • the method, device and device for camera communication provided by the embodiments of the present application are used to solve the problem that when the corresponding communication information is transmitted by white light, the same communication information is sent by all the color components of the white light, resulting in low spectrum utilization. technical problem.
  • an embodiment of the present application provides a method for camera communication, including:
  • Subcarrier amplitude modulation SAM is performed on the initial signal of each channel to obtain a subcarrier modulation signal of each channel;
  • the transmitting device performs multiple modulations on the data to be transmitted, and obtains multiple parallel amplitude modulated signals, which are parallel and independent signals, so that they can carry different data information. Therefore, the embodiment of the present application increases the spectrum utilization rate of the camera communication system from the number of parallel branches of the transmitted optical signal, and further, since the optical signal of each channel is modulated by multiple amplitudes, the obtained amplitude modulated signal is obtained. A symbol having a plurality of amplitudes is included, and symbols of different amplitudes can carry different data information. Therefore, the embodiment of the present application further increases the spectrum utilization ratio of the camera communication system from the number of amplitudes; meanwhile, the transmitting device is based on each channel.
  • the amplitude modulation signal and the preset sequence can obtain multiple initial signals, thereby performing subcarrier amplitude modulation on each channel initial signal to avoid signal flickering when the receiving end device performs optical signal reception, and ensuring that the receiving end device is at the receiving and transmitting end.
  • the stability of the signal sent by the device to avoid signal flashing . That is to say, the embodiment of the present application further improves the spectrum utilization rate of the camera communication system on the basis of ensuring flicker-free communication.
  • the method further includes:
  • the possible design provides a method of camera communication, which greatly simplifies the operation of the receiving device and saves the processing overhead of the receiving device.
  • an embodiment of the present application provides a method for camera communication, including:
  • the transmitting end device Receiving, by the transmitting end device, a plurality of subcarrier modulation signals, wherein the multiple subcarrier modulation signals are signals obtained by performing subcarrier amplitude modulation SAM on an initial signal of each path of the transmitting end device, where the initial signal is
  • the transmitting end device is generated according to a preset sequence and an amplitude modulated signal obtained by performing multiple modulations on the data to be transmitted, and the sequence is used to indicate state information of the amplitude modulated signal;
  • the sequence is specifically used to indicate at least one of the following state information of the amplitude modulated signal:
  • Parameter information for determining a gamma gamma curve and a channel matrix of the amplitude modulated signal is indicated.
  • the sequence when the plurality of modulations are CIM modulation, the sequence includes: a first portion, a second portion, and a third portion;
  • the first portion includes a first symbol, the first symbol is used to indicate a starting position of the sequence in the initial signal; and the first symbol includes three parallel first first sub-symbols having an amplitude of K+l
  • the K is a maximum amplitude after CIM modulation of the data to be transmitted, and the l is an arbitrary positive integer;
  • the second portion includes N second symbols, Each of the second symbols includes three second sub-symbols in parallel and having a preset first association relationship, and each of the N second sub-symbols
  • the second sub-symbol has a magnitude of -K, and the remaining
  • the difference between the amplitudes of any two sub-symbols in the second sub-symbol is a multiple of the step size m, the multiple is a positive integer, and the second portion is used to indicate to the receiving end device for determining the Gamma curve of the amplitude modulated signal and parameter information of the channel matrix;
  • the third part includes N third symbols, and the third symbol includes three third sub-symbols whose amplitudes have a preset second association relationship, and the amplitudes of the N third symbols are And performing, after the amplitude of the second symbol of the second part, performing a reverse operation, for indicating a gamma for determining the amplitude modulation signal to the receiving end device when a phase error occurs in the subcarrier modulation signal Parameter information of the Gamma curve and the channel matrix.
  • the second portion includes an increasing sub-symbol string, and the increasing sub-symbol string of each path includes Sub-symbols, the amplitudes of the sub-symbols in the increasing sub-symbol string are successively incremented from K at equal intervals of m in steps of m;
  • the third portion includes three decrementing sub-symbol strings, decrementing sub-symbols of each path String includes a sub-symbol, the amplitude of the sub-symbol in the descending sub-symbol string is continuously decremented to -K at intervals of m in steps of m;
  • the first association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are continuously incremented from -K in steps of m to the K to form the increasing sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are -K;
  • the second association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are successively decremented from -K in steps of m to -K to form the descending sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are K.
  • Each of the above possible designs provides a method in which the first portion, the second portion, and the third portion of the sequence enable the receiving device to determine a starting position of a sequence in each subcarrier modulation signal and to learn the received secondary Whether the carrier modulated signal or the amplitude modulated signal has a phase inversion, and the channel matrix and the gamma curve of each channel are obtained according to the second part or the third part, thereby nonlinearly receiving the received multiple subcarrier modulated signals.
  • the compensation of the damage and the corresponding color correction improve the accuracy of the data recovery by the receiving device and ensure the reliability of the data to be transmitted restored by the receiving device.
  • the sequence when the plurality of modulations are color shift keying CSK modulation, the sequence includes: a first portion and a second portion;
  • the first portion includes N first symbols, Each first symbol includes three first parallel sub-symbols whose amplitudes have a preset first association relationship, and N of each of the first sub-symbols
  • the first sub-symbol has a magnitude of -K, and the remaining
  • the difference between the amplitudes of any two sub-symbols in the first sub-symbol is a multiple of the step size m, and the multiple is a positive integer;
  • the second part includes N second symbols, and the second symbol includes three second sub-symbols in parallel and having a second associated relationship, and the amplitudes of the N second symbols are The amplitude of the first symbol of the first part performs the value after the inverse operation;
  • the first part and the second part are used together to indicate a starting position of the sequence, and a gamma gamma curve and a channel matrix for indicating to the receiving end device for determining the amplitude modulated signal Parameter information.
  • the first portion includes three increasing sub-symbol strings, and the increasing sub-symbol string of each path includes a sub-symbol, the amplitude of the sub-symbol in the increasing sub-symbol string is continuously incremented to K from -K at equal intervals in m steps;
  • the second portion includes three-way descending sub-symbol strings, decrementing sub-symbols of each path String includes a sub-symbol, the amplitude of the sub-symbol in the descending sub-symbol string is continuously decremented to -K at intervals of m in steps of m;
  • the first association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are continuously incremented from -K in steps of m to the K to form the increasing sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are -K;
  • the second association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are successively decremented from -K in steps of m to -K to form the descending sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are K.
  • Each of the above possible designs provides a method in which the first portion and the second portion of the sequence enable the receiving device to determine the starting position of the sequence in each of the subcarrier modulation signals and to obtain the received subcarrier modulation signal or Whether the amplitude modulation signal has a phase inversion, and the channel matrix and the Gamma curve of each channel are obtained according to the first part and the second part, thereby compensating for the nonlinear damage of the received multi-subcarrier modulation signal and correspondingly
  • the color correction and the like improve the accuracy of the data recovery by the receiving device, and ensure the reliability of the data to be transmitted restored by the receiving device.
  • the sequence includes a first portion and a second portion
  • the first portion includes a plurality of symbols outside the modulation constellation point for indicating a starting position of the sequence in the initial signal
  • the second part includes all the symbols in the plurality of modulation constellation points, and is used to indicate that the receiving end device trains the decider according to the training part, and the decider is configured to acquire the signal according to the signal received by the receiving end device.
  • the data to be transmitted is mentioned.
  • the possible design provides a method that cancels the nonlinear compensation, color correction, and phase error cancellation of the receiving device, but trains the decider based on the second part of the sequence, and uses the determiner to restore the data to be transmitted, simplifying The complexity of the receiving device.
  • the multi-channel subcarrier modulation signal is processed to obtain the data to be transmitted, which specifically includes:
  • the starting position of the sequence is determined according to the symbol transmission order of the preset sequence and the symbol;
  • the acquiring the gamma curve according to the second part includes:
  • the sub-symbols corresponding to the second sub-symbols perform a Gamma signal extraction operation to determine the gamma curve of each path.
  • the acquiring the channel matrix according to the second part includes:
  • the processing the multiple subcarrier modulation signals to obtain the data to be transmitted further includes:
  • the transmitting device uses the CIM to perform multiple modulations on the data to be transmitted, the transmitting device adopts a sequence including the first part, the second part, and the third part, and then based on the sequence.
  • the receiving device can know, by the first part of the sequence, whether the received subcarrier modulation signal or the amplitude modulation signal is phase inverted, and determine the starting position of the sequence in the subcarrier modulation signal, and combine the starting position
  • the length of the sequence and the symbol transmission order of the sequence determine the second part and the third part of the sequence, and then, in conjunction with whether the phase is inverted, whether the second part is used or the third part is used to determine the channel matrix and each
  • the accuracy of the data recovery by the end device ensures that the receiving device restores The reliability of the data to be transmitted; in addition, when the subcarrier modulation signal is nonlinearly compensated, the information of the Gamma curve determined by the receiving device can also be sent to the transmitting device, and the transmitting device can perform the subcarrier modulation signal.
  • the nonlinear compensation greatly simplifies the operation of the device at the receiving end and saves the processing overhead of the device at the receiving end.
  • the embodiment of the present application can also determine the channel matrix and the third part of the sequence when the phase is in error. The gamma curve of each way further ensures the accuracy of data restoration.
  • the performing the multiple subcarrier modulation signals Processing, obtaining the data to be transmitted specifically:
  • the Gamma curve and the channel matrix are acquired according to the second part, and the multi-channel subcarrier modulation signal is processed according to the Gamma curve and the channel matrix to obtain the to-be-transmitted data.
  • the acquiring the gamma curve according to the first part includes:
  • the sub-symbols corresponding to the first sub-symbols perform a Gamma signal extraction operation to determine the gamma curve of each path.
  • the acquiring the channel matrix according to the first part includes:
  • the processing the multi-channel subcarrier modulation signal according to the gamma curve and the channel matrix to obtain the data to be transmitted specifically includes:
  • the processing the multi-channel subcarrier modulation signal according to the gamma curve and the channel matrix to obtain the data to be transmitted specifically includes:
  • the above various possible design provides a method, when the transmitting device uses the CSK to perform multiple modulations on the data to be transmitted, the transmitting device adopts the sequence of the second possible implementation manner described above, and then receives according to the sequence form.
  • the end device can determine whether the received subcarrier modulation signal or the amplitude modulation signal is phase inverted by the first part and the second part of the sequence, and determine the starting position of the sequence in the subcarrier modulation signal, and combine the start The position, the length of the sequence, and the symbol transmission order of the sequence determine the first portion and the second portion of the sequence, and then, in conjunction with whether the phase is inverted, whether the first portion or the second portion is used to determine the channel matrix and each path The gamma curve, and then adopting the channel matrix and the Gamma curve of each channel, performing nonlinear compensation, color correction, demodulation and the like on the received multi-channel subcarrier modulation signals to obtain data to be transmitted, thereby greatly improving the receiving end.
  • the embodiment of the present application can also determine the channel matrix by using the second part of the sequence when the phase occurs. And the gamma curve of each way further ensures the accuracy of data restoration; further, the embodiment of the present application solves the problem that the CSK signal cannot be transmitted in the OCC system using the low speed camera, and the application range of the camera communication is expanded. .
  • the embodiment of the present application provides a device for camera communication, and the device for the camera communication has a function of a method for implementing the camera communication described above.
  • the functions may be implemented by hardware or by corresponding software implemented by hardware.
  • the hardware or software includes one or more modules corresponding to the functions described above.
  • the device for communicating by the camera includes a plurality of functional modules or units, and the method for implementing the camera communication of any one of the foregoing first aspects.
  • the structure of the device for communicating by the camera may include a processor, a receiver, and a transmitter.
  • the processor is configured to support a corresponding function of the apparatus for performing the method of any of the above-described first aspects of camera communication.
  • the transmitter is configured to support communication between the device and other network devices or terminal devices, for example, can be capable of transmitting multiple optical signals and integrated VLC module LED lights, and the receiver can be a camera device or a video recording device.
  • the apparatus can also include a memory for coupling with the processor that retains program instructions and data necessary for the method by which the camera communication device performs the camera communication described above.
  • the embodiment of the present application provides a device for camera communication, and the device for the camera communication has a function of a method for implementing the camera communication described above.
  • the functions may be implemented by hardware or by corresponding software implemented by hardware.
  • the hardware or software includes one or more modules corresponding to the functions described above.
  • the device for communicating by the camera includes a plurality of functional modules or units, and the method for implementing the camera communication of any one of the foregoing second aspects.
  • the structure of the device for communicating by the camera may include a processor, a receiver, and a transmitter.
  • the processor is configured to support a corresponding function of the method in which the apparatus performs the camera communication of any of the above second aspects.
  • the transmitter is configured to support communication between the device and other network devices or terminal devices, for example, can be capable of transmitting multiple optical signals and integrated VLC module LED lights, and the receiver can be a camera device or a video recording device.
  • the apparatus can also include a memory for coupling with the processor that retains program instructions and data necessary for the method by which the camera communication device performs the camera communication described above.
  • an embodiment of the present application provides a computer storage medium for storing computer software instructions for a device for communicating by the camera, which includes a program designed to execute the first aspect.
  • an embodiment of the present application provides a computer storage medium for storing computer software instructions for a device for communicating by the camera, which includes a program designed to execute the second aspect.
  • an embodiment of the present application provides a computer program product, comprising instructions for causing a computer to perform a function performed by a device for camera communication in the above method when the computer program is executed by a computer.
  • an embodiment of the present application provides a computer program product, comprising instructions for causing a computer to perform functions performed by a device for camera communication in the above method when the computer program is executed by a computer.
  • the transmitting device performs multiple modulations on the data to be transmitted, and obtains multiple parallel amplitude modulated signals, which are parallel and independent of each other.
  • a signal so that it can carry different data information
  • the embodiment of the present application increases the spectrum utilization of the camera communication system from the number of parallel branches of the transmitted optical signal, and additionally, because of the optical signal for each channel Amplitude modulation, therefore, the obtained amplitude modulation signal contains symbols having multiple amplitudes, and symbols of different amplitudes can carry different data information. Therefore, the embodiment of the present application further increases the spectrum utilization rate of the camera communication system from the number of amplitudes.
  • the transmitting device can obtain multiple initial signals based on the amplitude modulation signal and the preset sequence of each channel, thereby performing subcarrier amplitude modulation on the initial signal of each channel to avoid the signal flickering when the receiving end device performs optical signal reception. , to ensure that the receiving device receives the signal sent by the transmitting device. Nature, avoid the occurrence of flicker signal. That is to say, the embodiment of the present application further improves the spectrum utilization rate of the camera communication system on the basis of ensuring flicker-free communication.
  • FIG. 1 is a schematic structural diagram of a camera communication system according to an embodiment of the present application
  • FIG. 2 is a signaling flowchart of a method for camera communication provided by an embodiment of the present application
  • FIG. 3 is a waveform diagram of a sequence provided by an embodiment of the present application.
  • FIG. 4 is a schematic flowchart of a method for camera communication according to an embodiment of the present application.
  • FIG. 5 is a schematic flowchart of acquiring a Gamma curve according to an embodiment of the present application.
  • FIG. 6 is a schematic flowchart of acquiring a channel matrix according to an embodiment of the present application.
  • Figure 7 is a waveform diagram of a sequence provided by an embodiment of the present application.
  • FIG. 8 is a schematic flowchart diagram of a method for camera communication according to an embodiment of the present disclosure.
  • FIG. 9 is a schematic flowchart diagram of a method for camera communication according to an embodiment of the present application.
  • FIG. 10 is a schematic structural diagram of an apparatus for camera communication according to an embodiment of the present application.
  • FIG. 11 is a schematic structural diagram of an apparatus for camera communication according to an embodiment of the present application.
  • FIG. 12 is a schematic structural diagram of an apparatus for camera communication according to an embodiment of the present application.
  • FIG. 13 is a schematic structural diagram of an apparatus for camera communication according to an embodiment of the present disclosure.
  • FIG. 14 is a schematic structural diagram of an apparatus for camera communication according to an embodiment of the present application.
  • the camera communication system includes: a transmitting end device and a receiving end device, both of which are devices capable of implementing camera communication, and the transmitting end device may be an integrated LED light capable of transmitting multiple different colors of light.
  • the light of different colors carries the corresponding communication information, and the light may be referred to as an optical signal at this time
  • the receiving end The device can be a device that contains a built-in camera or video recording device.
  • a built-in camera or video recording device can be used, for example, for communication between a vehicle and a vehicle.
  • a front headlight or other light on one vehicle can be used as a transmitting device, a camera on another vehicle, or other camera device.
  • the application scenario of the camera communication system is not limited in the embodiment of the present application.
  • the prior art adopts an undersampling UFSOOK modulation mode, that is, a white LED of a transmitting device transmits a white light signal
  • the UFSOOK system allows a receiving device (which may be a camera or a device with a built-in camera) to operate in an undersampling mode.
  • a receiving device which may be a camera or a device with a built-in camera
  • the carrier frequency fs fs>CFF
  • the camera frame rate due to the special relationship between the carrier frequency fs (fs>CFF) and the camera frame rate, it can realize the complete signal transmitted by the camera to receive the original signal, thereby achieving flicker-free communication.
  • FIG. 2 is a signaling flowchart of a method for camera communication provided by an embodiment of the present application.
  • the embodiment relates to that the transmitting end device performs multiple modulations on the data to be transmitted into a multi-channel amplitude modulation signal, so as to improve the spectrum utilization rate of the camera communication system, and obtain an initial signal of each channel according to the amplitude modulation signal of each channel, thereby The initial signal of each channel is subjected to subcarrier amplitude modulation to avoid the specific process of the signal flickering when the receiving end device performs optical signal reception.
  • the method includes:
  • the transmitting end device performs multiple modulations on the data to be transmitted, and obtains multiple amplitude modulated signals, where each The amplitude modulation signal of the path has multiple amplitudes.
  • the transmitting end device of the embodiment of the present application may be an LED lamp integrated with light capable of transmitting multiple different colors, for example, an RGB LED lamp integrated with a VLC module may be integrated, and the RGB LED lamp may send three channels. Parallel and independent optical signals.
  • the transmitting device needs to send the data to be transmitted to the receiving device, the transmitting device performs multiple modulations on the data to be transmitted, and actually performs multiple modulation on the parallel multiple optical signals sent by the transmitting device to obtain multiple channels.
  • each channel of the amplitude modulation signal has a plurality of amplitudes, that is to say, each channel of the amplitude modulation signal includes a plurality of symbols, the plurality of symbols having a plurality of level values, and different levels of symbols can be carried Different data information in the data is transmitted.
  • the transmitting end device can transmit multiple parallel optical signals, after the multiple parallel optical signals are separately modulated, the obtained multi-channel amplitude modulated signals are multi-channel parallel.
  • the amplitude modulation signal, the amplitude modulation signal of different paths can carry different data information in the data to be transmitted.
  • a white LED that transmits a white light by a transmitting end device transmits all the color components of the transmitted white light (such as red orange, yellow, green, blue, purple, etc.) when the data to be transmitted is transmitted to the receiving device.
  • the same data information is sent in the component, and the white light signal has only two amplitudes, so the frequency utilization of the prior art is low; however, in the embodiment of the present application, the transmitting device can transmit multiple lights of different colors.
  • the signal therefore, after performing multiple modulations on each of the optical signals, a multi-channel amplitude modulated signal is obtained, and the multi-channel amplitude modulated signals are parallel and independent signals, so that they can carry different data information from the transmitted
  • the number of parallel branches of the optical signal increases the spectrum utilization of the camera communication system.
  • the obtained amplitude modulated signal includes symbols having a plurality of amplitudes, different The symbol of the amplitude can carry different data information. Therefore, the embodiment of the present application further increases the amount of the amplitude.
  • the spectrum utilization camera communication systems since a plurality of modulations are performed on each of the optical signals, the obtained amplitude modulated signal includes symbols having a plurality of amplitudes, different The symbol of the amplitude can carry different data information. Therefore, the embodiment of the present application further increases the amount of the amplitude.
  • the transmitting device adds a preset sequence before each of the amplitude modulation signals to obtain an initial signal of each channel, where the sequence is used to indicate state information of the amplitude modulation signal.
  • the sequence in this embodiment may include one symbol, and may further include multiple symbols, and the symbols included in the sequence do not carry valid data information of the data to be transmitted.
  • the sequence may include an indication of a phase by which the receiving end device may be instructed whether the phase modulation signal has undergone phase inversion.
  • the embodiment of the present application does not limit the specific form of the sequence, as long as it can indicate the state information of the multipath amplitude modulation signal.
  • the state information of the amplitude modulation signal may include whether the amplitude modulation signal has a phase reversal. Turn, or the starting position of the sequence, etc.
  • the preset sequence may also include multiple parallel sequence sub-symbols, the number of branches of the sequence is equal to the number of branches of the amplitude modulation signal, and the amplitude modulation signal of each channel for each channel is for each channel.
  • the amplitude modulation signal adds a sequence sub-symbol of the corresponding one of the sequences.
  • the transmitting device After the transmitting device adds a preset sequence to each channel's amplitude modulation signal, an initial signal for each channel is obtained. In the initial signal, before the sequence, the valid data information is followed.
  • S103 The source device performs Subcarrier Amplitude Modulation (SAM) on the initial signal of each channel to obtain a subcarrier modulation signal of each channel.
  • SAM Subcarrier Amplitude Modulation
  • S104 The transmitting end device sends multiple subcarrier modulation signals to the receiving end device.
  • each channel's subcarrier modulation signal is obtained, so that each channel's subcarrier modulation signal is sent to the receiving device in parallel.
  • the transmitting device can also select an appropriate amplification factor for each subcarrier modulation signal and add an appropriate DC bias voltage (the DC bias voltage ensures undistorted transmission of the signal), thereby adding and adding DC
  • the multi-channel subcarrier modulation signal of the bias voltage is sent to the receiving device in parallel. Based on the modulation characteristics of the SAM, when the receiving device receives multiple subcarrier modulation signals, it does not cause signal flicker, thereby ensuring signal stability between the transmitting device and the receiving device.
  • the receiving end device receives the multiple subcarrier modulation signals sent by the sending end device.
  • the receiving end device processes the multiple subcarrier modulation signals to obtain the to-be-transmitted data.
  • the receiving end device may demodulate or parse the multiple subcarrier modulation signals, optionally, Determining the starting position of the sequence by combining the signal format of each subcarrier modulation signal, or determining whether the amplitude modulation signal has phase inversion or the like, and based on the obtained information, the receiving end device can receive the multipath
  • the subcarrier modulation signal performs compensation for nonlinear damage or phase reversal, color correction, and the like, thereby obtaining original data to be transmitted.
  • the specific manner in which the receiving end device processes the multi-channel subcarrier modulation signal is not limited, as long as it can obtain the data to be transmitted of the transmitting end device.
  • the transmitting end device performs multiple modulations on the data to be transmitted, and obtains multiple parallel amplitude modulated signals, which are parallel and mutually independent signals, so they can carry different Data information, and thus the embodiment of the present application increases the spectrum utilization rate of the camera communication system from the number of parallel branches of the transmitted optical signal, and further, since multiple optical signals are applied to each channel, the obtained
  • the amplitude modulation signal includes symbols having multiple amplitudes, and the symbols of different amplitudes can carry different data information.
  • the embodiment of the present application further increases the spectrum utilization ratio of the camera communication system from the number of amplitudes; meanwhile, the transmitting device is based on The amplitude modulation signal and the preset sequence of each channel can obtain multiple initial signals, thereby performing subcarrier amplitude modulation on the initial signal of each channel to avoid signal flickering when the receiving end device performs optical signal reception, thereby ensuring that the receiving end device is Receive the stability of the signal sent by the sender device to avoid its transmission Signal flashing. That is to say, the embodiment of the present application further improves the spectrum utilization rate of the camera communication system on the basis of ensuring flicker-free communication.
  • the preset sequence is specifically used for at least one of the following state information of the amplitude modulated signal: indicating a starting position of the sequence; indicating the subcarrier modulation signal Whether there is a phase error; indicating parameter information for determining a gamma gamma curve and a channel matrix of the amplitude modulated signal.
  • the sequence may include various implementations, with particular reference to the first possible implementation, the second possible implementation, and the third possible implementation described below.
  • the implementation manner relates to the specific content of the foregoing preset sequence.
  • the sequence may specifically include: a first part, a second part, and a third part.
  • the first portion includes a first symbol, the first symbol is used to indicate a starting position of the sequence in the initial signal; and the first symbol includes a plurality of parallel parallel amplitudes of K+l a first sub-symbol, where K is a maximum amplitude after CIM modulation of the data to be transmitted, the l is an arbitrary positive integer;
  • the second part includes N second symbols, Each second symbol includes a second sub-symbol that is multiplexed in parallel and has a preset first association relationship, and each of the N second sub-symbols of each path The second sub-symbol has a magnitude of -K, and the remaining
  • the difference between the amplitudes of any two sub-symbols in the second sub-symbol is a multiple of the step size m, the multiple is a positive integer, n is the number of branches of the optical signal transmitted by the transmitting device, and the second Partially for indicating to the receiving end device parameter information for determining a
  • the preset sequence includes three parts of different functions, and each part includes multiple parallel symbols.
  • the first part comprises a first symbol
  • the first symbol comprises a plurality of parallel first sub-symbols having an amplitude of K+l
  • the term “parallel” as used herein refers to that the sub-symbols of the plurality of branches at the same time are simultaneously Sent.
  • the transmitting device integrates an RGB LED, it can transmit three optical signals. Therefore, the sequence here also includes three sub-symbols, and the amplitude of the first symbol of the first portion can be [K+l, K+l, K +l], the first part is used to indicate the starting position of the sequence in the initial signal of each way.
  • the receiving end device may determine the starting position of the sequence in the multiple subcarrier modulation signal in combination with the first part and the symbol sending order when the transmitting end device that the receiving end device knows in advance sends the sequence. For specific determination methods, refer to the following description of the embodiments.
  • the second part may comprise N second symbols, n is the number of branches of the optical signal transmitted by the transmitting device, and each second symbol includes a plurality of parallel second sub-symbols having a first correlation relationship between the amplitudes, that is, a certain time is sent
  • the second symbol is actually a parallel multiplexed second sub-symbol, and the amplitude between the multiplexed second sub-symbols transmitted at that moment is correlated.
  • the RGB LED is integrated with the transmitting device, and the second part includes N second symbols.
  • a second symbol includes three second sub-symbols in parallel and having a first correlation relationship, for example, assuming that the amplitude of the second symbol transmitted at the first moment is [-K, -K, -K], that is, when RGB When the amplitude of the red sub-symbol on the red branch sent by the LED at the first moment is -K, the amplitude of the green branch and the blue branch at the first moment can only be -K, assuming the second time sent at the second moment.
  • the amplitude of the symbol is [K, -K, -K], that is, when the amplitude of the red sub-symbol on the red branch sent by the RGB LED at the first moment is K, the green branch and the blue branch are at the first moment.
  • the amplitude can only be -K, that is, at each moment, there is a corresponding correlation between the amplitudes of the three second sub-symbols, that is, the amplitudes of the three second sub-symbols belonging to the same second symbol. There is an association between them.
  • the second sub-symbol has a magnitude of -K, and the remaining The difference between the amplitudes of any two sub-symbols in the second sub-symbol is a multiple of the step size m.
  • the second sub-symbol may be a series of symbol strings continuously incremented to K from -K in steps of m, or may be a symbol string continuously decremented to -K in steps of m from K, or may be any Sequential Second sub-symbol.
  • the second part is configured to indicate to the receiving end device parameter information for determining a gamma gamma curve and a channel matrix of the amplitude modulated signal, and the receiving end device can determine the gamma curve and the channel matrix of each path in combination with the second part, thereby
  • the received multiple subcarrier modulation signals perform nonlinear damage compensation and corresponding color correction.
  • the specific gamma curve and the determination of the channel matrix can be found in the following embodiments.
  • the third part comprises N third symbols
  • the third symbol comprises a third sub-symbol with multiple parallels and a second associated relationship of amplitudes
  • the amplitude of the N third symbols is a value obtained by performing an inverse operation on the amplitude of the second symbol of the second portion, that is, the third portion is actually all the first parts of the second part.
  • the amplitude of the two symbols is the sequence obtained after the inverse operation. It should be noted that the “inversion” here is only for the inverse of the amplitude, and does not limit the order of the third symbol of the third part, that is, the third part may be the amplitude of the second symbol of the second part.
  • the partial sequence obtained after the direct inversion may be the partial sequence obtained by rearranging all the obtained third symbols again after the amplitude of the second symbol of the second part is directly inverted, and the embodiment of the present application is This is not a limitation.
  • the third portion is configured to, when the phase error of the subcarrier modulation signal occurs, indicate parameter information for determining a gamma gamma curve and a channel matrix of the amplitude modulation signal to the receiving end device.
  • the RGB LED is integrated with the transmitting device, and the third part includes N third symbols.
  • a third symbol includes a third sub-symbol that is three-way parallel and has a second correlation.
  • the order between the first part, the second part and the third part in the above sequence may be that the first part is in the front, the second part is in the middle, the third part is in the end, or the second part is in the front.
  • the first part is in the middle, the third part is in the end, and the third part is in the front, the first part is in the middle, the second part is in the end, and other arrangements are possible.
  • the order of the three parts in the embodiment of the present application Not limited.
  • the second symbol in the second part may be arranged in a certain order, or may be disordered in order
  • the arrangement of the third symbol in the third part may also be arranged in a certain order, or may be arranged in a disorderly manner. This embodiment of the present application does not limit this.
  • the RGB LED is integrated with the transmitting device (for example, the transmission of the three-way optical signal is continued as an example), and further, as one of the first possible implementations, the second and third portions are used.
  • the second part may include a three-way incremental sub-symbol string, and the incremental sub-symbol string of each path includes a sub-symbol, the amplitude of the sub-symbol in the increasing sub-symbol string is continuously incremented to K from -K at equal intervals in m steps;
  • the third portion may include a three-way decreasing sub-symbol string, decrementing sub-symbols of each path String includes a sub-symbol, the amplitude of the sub-symbol in the descending sub-symbol string is successively decremented to -K at intervals of m in steps of m; and the first correlation relationship includes: when the amplitude of the sub-symbol of any one of the paths is
  • the optional manner is directed to a possible form of the second part and the third part.
  • the sequence in FIG. 3 includes three sub-symbols.
  • the path sub-symbol is divided into a first part, a second part and a third part, and the first part marked in FIG. 3 includes a first symbol having an amplitude of [K+l, K+l, K+l], the first symbol It is composed of three first sub-symbols, which are a first sub-symbol of amplitude K+l of the red branch, a first sub-symbol of amplitude K+l of the green branch, and an amplitude of the blue branch.
  • the second part of Figure 3 includes three incremental substrings, each of which includes an incrementing subsymbol string.
  • Second sub-symbol the The amplitudes of the second sub-symbols are successively incremented to K from -K at equal intervals in m steps.
  • the three-way incremental sub-symbol strings are not transmitted in parallel, but according to "the amplitude of the sub-symbols of any one of the sub-symbols is continuously incremented to K at equal intervals of m from -K to form the incrementer.
  • the other parallel two-way sub-symbols are transmitted with the first correlation of -K", that is, see the waveform in FIG. 3, when the red branch transmits the incremental symbol string, the green branch and the blue The amplitude of the second sub-symbol on the color branch is -K.
  • the amplitude of the second sub-symbol of the red branch and the blue branch is -K
  • the amplitude of the second sub-symbol of the green branch and the red branch is -K.
  • the third portion includes a three-way decreasing sub-symbol string
  • the decrementing sub-symbol string of each path includes Third sub-symbol
  • the The amplitudes of the third sub-symbols are successively decremented to -K at equal intervals of m in steps of K.
  • the three-way decrementing sub-symbol strings are not transmitted in parallel, but according to "the decrement is formed when the amplitudes of the sub-symbols of any one of the sub-symbols are successively decremented to -K at equal intervals in m steps.
  • the other parallel two-way sub-symbols are transmitted with the second correlation of K", that is, see the waveform in FIG. 3, when the red branch transmits the descending symbol string, the green branch and the blue
  • the amplitude of the third sub-symbol on the branch is K.
  • the amplitude of the third sub-symbol of the red branch and the blue branch is K, when the blue branch transmits the decreasing symbol.
  • the amplitude of the third sub-symbol of the green branch and the red branch is K.
  • the incremental sub-symbol string and the other second sub-symbol in the second part are interchangeable with the descending sub-symbol string and the other third sub-symbol in the third part, that is, the second part includes the decrementing sub-symbol and a third sub-symbol, the third portion comprising an increasing sub-symbol string and a second sub-symbol.
  • the gamma curve and the channel matrix may be determined based on the second portion.
  • the determination of the Gamma curve and the channel matrix can be performed based on the third portion.
  • the first part, the second part, and the third part of the sequence may enable the receiving end device to determine the starting position of the sequence in each subcarrier modulation signal. And knowing whether the received subcarrier modulation signal or the amplitude modulation signal has phase inversion, and also obtaining the channel matrix and the Gamma curve of each channel according to the second part or the third part, thereby receiving the multipath
  • the subcarrier modulation signal compensates for nonlinear damage and corresponding color correction, etc., improves the accuracy of the data recovery by the receiving end device, and ensures the reliability of the data to be transmitted restored by the receiving end device.
  • another embodiment of the present application provides a schematic flowchart of a method for camera communication.
  • the embodiment relates to the foregoing
  • a possible implementation manner is that when the transmitting end device uses multiple modulations to be transmitted by the CIM to be transmitted, the receiving end device processes the received multiple subcarrier modulation signals to obtain a specific process of the data to be transmitted.
  • the RGB LED is integrated with the transmitting end device as an example, that is, the sequence includes three sub-symbols as an example for description.
  • the foregoing S107 may specifically include:
  • the possibility between the amplitude of the symbol transmitted by the transmitting device and the amplitude of the symbol received by the receiving device is first described.
  • the sender device sends a symbol of [K+l, K+l, K+l]
  • the amplitude of the symbol received by the receiving device may be [K+l, K+l, K+l].
  • It may also be a symbol that is closer to the amplitude of [K+l, K+l, K+l], that is, the symbol sent by the transmitting device and the symbol received by the receiving device may be inconsistent due to the influence of the propagation medium and the surrounding environment.
  • the receiving end device receives the multipath amplitude modulation signal sent by the transmitting end device, and the receiving end device actually receives the symbol according to one symbol and then one symbol.
  • the receiving device determines whether the amplitude of the three-way sub-symbol of the symbol is the maximum amplitude of the branch on which it is located. If so, the following S202 to S204 are performed, and if not, S205 and S206 are executed.
  • S202 If the amplitude of the three-way sub-symbol of the symbol is the maximum amplitude of the branch road, according to the preset order The symbol transmission order of the columns and the symbols determine the starting position of the sequence. S203 and S204 are performed.
  • the receiving end device determines that the amplitude of the three sub-symbols of the currently received symbol is the maximum amplitude of the branch, the receiving end device determines that the currently received sub-carrier modulation signal or the amplitude modulation signal does not have a phase. Inversion (here, it should be noted that the sign of the three-way sub-symbols whose amplitude is the maximum amplitude of the branch will only appear in the first part, and the second part and the third part will not appear such symbols).
  • the receiving device can determine the amplitude of the current three-way sub-symbol as the maximum amplitude of the branch on the branch in combination with the symbol transmission sequence of the sequence.
  • the symbol is located at the first position, and then the starting position of the sequence in the subcarrier modulation signal is determined according to the position of the current symbol, and then according to the length of the sequence and the starting position, it is known from which position is valid data. The location of the symbol.
  • the transmitting device transmits a first symbol of amplitude [K+l, K+l, K+l] at the Yth position, when the receiving device receives a symbol, and the symbol
  • the amplitude of the three sub-symbols is the maximum amplitude of the branch, and the receiving device determines that the symbol is the Yth symbol, so that the receiving device can learn to push Y-1 from the Y position according to the length of the sequence.
  • the position after the symbol is the starting position of the sequence. If the receiving device detects the next symbol again, the symbol is the valid data symbol, that is, the first symbol of the X symbols in FIG.
  • the amplitude of the above three sub-symbols whose maximum amplitude is on the branch may be the first symbol.
  • S203 Determine a second part and a third part of the sequence according to the starting position, the length of the sequence, and the symbol transmission order of the sequence.
  • the receiving end device may combine the starting position, the length of the sequence, and the symbol sending order of the sequence, that is, the receiving end device may The starting position and the symbol transmission order of the sequence determine the lengths of the second part and the third part, respectively. For example, if the length of the sequence is Y symbols, the lengths of the second part and the third part are both (Y-1) /2 symbols, then the receiving device can combine the sequence of symbol transmissions of the sequence, knowing that the received symbol is located at the first position of the sequence, and combining the amplitudes of the three sub-symbols of the symbol to determine the currently received Whether the symbol belongs to the second part or the third part.
  • the receiving device can combine the amplitude of the symbol and the symbol transmission sequence of the sequence to know that the symbol is located at the first position. It is determined that the amplitude of the symbol will only appear in the second portion, and therefore, the symbol determining the position is the symbol of the second portion.
  • the length of the sequence, and the waveform of the symbol in the sequence ie, the association relationship of the three sub-symbols
  • which symbols belong to the second part, and which symbols belong to the third part that is, The second and third parts of the sequence.
  • the receiving end device determines the second part and the third part of the sequence in the subcarrier modulation signal, since the receiving end device determines that the subcarrier modulation signal does not undergo phase inversion, the receiving end device determines to adopt subcarrier modulation.
  • the second part of the sequence in the signal determines the Gamma curve and the channel matrix. For the specific determination manner, refer to the embodiment shown in FIG. 5 and the embodiment shown in FIG. 6.
  • each subcarrier modulation signal corresponds to a Gamma curve, that is, the receiving end device needs to determine the gamma curve of each channel according to the three-way sub-symbol of the sequence, but the multi-channel sub-carrier modulation signal corresponds to one channel matrix at the same time. .
  • S205 If the amplitude of the three-way sub-symbol of the symbol is the minimum amplitude of the branch, determining that the sub-carrier modulation signal has a phase error, and determining a starting position of the sequence according to the symbol. Thereafter, S206 and S207 are executed.
  • the receiving end device determines that the amplitude of the three-way sub-symbol of the currently received symbol is the minimum amplitude of the branch
  • the receiving end device determines that the currently received sub-carrier modulation signal or the amplitude modulation signal has a phase inverse.
  • the sign of the three-way sub-symbols whose amplitude is the minimum amplitude of the branch will only appear in the first part, and the second part and the third part will not appear such symbols).
  • the receiving device can determine the amplitude of the current three-way sub-symbol as the minimum amplitude of the branch on the branch in combination with the symbol transmission sequence of the sequence.
  • the symbol is located at the first position, and then the starting position of the sequence in the subcarrier modulation signal is determined according to the position of the current symbol, and then according to the length of the sequence and the starting position, it is known from which position is valid data. The location of the symbol.
  • the transmitting device transmits a symbol of amplitude [-Kl, -Kl, -Kl] at the Yth position, when the receiving device receives a symbol, and the amplitude of the three sub-symbols of the symbol
  • the minimum amplitude is on the branch, and the receiving device determines that the symbol is the Yth symbol, so that the receiving device can know that the position after pushing the Y-1 symbols from the Y position is based on the length of the sequence.
  • the starting position of the sequence if the receiving device detects the next symbol again, the symbol is the valid data symbol, that is, the first symbol of the X symbols in FIG.
  • the amplitude of the above three sub-symbols whose minimum amplitude is on the branch may be the symbol of the amplitude [-K-l, -K-l, -K-l] transmitted by the transmitting device.
  • the receiving end device determines to adopt the third part.
  • Obtaining a Gamma curve and a channel matrix The acquisition method can be referred to the following steps 5 and 6 in which the receiving end device uses the second part to acquire the Gamma curve and the channel matrix, and only needs to replace the second part with the third part.
  • the manner of obtaining is similar, and details are not described herein again.
  • each subcarrier modulation signal corresponds to a Gamma curve, that is, the receiving end device needs to determine the gamma curve of each channel according to the three-way sub-symbol of the sequence, but the multi-channel sub-carrier modulation signal corresponds to one channel matrix at the same time. .
  • the channel matrix and the gamma curve of each channel can still be obtained according to the third part of the sequence.
  • S207 Process the multiple subcarrier modulation signals according to the gamma curve and the channel matrix to obtain the to-be-transmitted data.
  • the received multi-subcarrier modulation signal is processed by using the channel matrix and the Gamma curve of each path, where the subcarrier modulation is performed for one way.
  • the processing method of the subcarrier modulation signal of each of the other channels is the same, and the path is assumed to be the subcarrier modulation signal of the A channel, and the specific processing manner is as follows: the receiving device is based on the Gamma curve of the A channel.
  • the subcarrier modulation signal of channel A is nonlinearly compensated, and the compensated modulated signal is color-corrected according to the obtained channel matrix to obtain the corrected signal of each channel, and then the receiving device according to the corrected signal of the path And the length of the amplitude modulation signal of the original A way, delete the sequence in the corrected signal of the path (here the sequence refers to Is the sequence sub-symbol located in the path in the above sequence), and obtains the amplitude modulation signal of the A path.
  • the sequence in the corrected signal here the sequence refers to Is the sequence sub-symbol located in the path in the above sequence
  • it may be deleted every X valid data information or valid data symbols.
  • Y sequence subsymbols when deleting the sequence in the corrected signal, it may be deleted every X valid data information or valid data symbols.
  • the receiving end device uses the CIM to demodulate the amplitude modulated signal of the A channel to obtain valid data information of the data to be transmitted transmitted on the road. Since the receiving end device processes the subcarrier modulation signals of each channel in parallel, finally, the complete data to be transmitted can be obtained.
  • the receiving end device may further send, according to the obtained Gamma curve of each path, the information of the Gamma curve of each path to the transmitting end device, where the information of the Gamma curve is used to indicate that the transmitting end device uses the Gamma curve to the subcarrier.
  • the modulated signal is nonlinearly compensated to obtain a compensated modulated signal; after receiving the information of the Gamma curve of each channel transmitted by the receiving device, the transmitting device combines the Gamma curve of each channel to perform the non-subcarrier modulated signal of each channel.
  • the transmitting device transmits the obtained compensated modulated signal to each of the receiving devices in parallel, so that the receiving device can perform all the channels according to the obtained channel matrix.
  • the compensated modulated signal is color-corrected to obtain a corrected signal, and then the sequence in the corrected signal is deleted according to the length of the corrected signal and the amplitude modulated signal, and an amplitude modulated signal is obtained and demodulated Get the data to be transmitted. This optional method greatly simplifies the operation of the receiving device and saves the processing overhead of the receiving device.
  • FIG. 5 is a schematic flowchart of obtaining a Gamma curve according to an embodiment of the present application
  • FIG. 6 is a schematic flowchart of acquiring a channel matrix according to an embodiment of the present application.
  • the method for acquiring a Gamma curve according to the second part includes:
  • the second part acquires a Gamma curve of each path, specifically: the receiving end device according to any two subpaths in each path in the second part.
  • the difference between the amplitudes of the symbols is a multiple of the step size m Second sub-symbol, obtaining a step relationship with the amplitude
  • the sub-symbol corresponding to the second sub-symbol (the number of sub-symbols is also ()
  • these sub-symbols are non-equal-increasing sub-symbols. Based on the non-equal interval incrementing sub-symbols, the receiving end device performs a Gamma signal extraction operation to determine a Gamma curve for each path.
  • An embodiment of obtaining a channel matrix by using the second part in FIG. 6 may specifically include the following steps:
  • S401 Obtain, from the received symbol, a first received symbol corresponding to a symbol sent by the transmitting end device with an amplitude of [K, -K, -K]; wherein, [K, -K, -K] is characterized
  • the first received symbol is a symbol corresponding to when the amplitude of the second sub-symbol of the first branch is K, and the amplitude of the second sub-symbol of the second branch and the third branch is -K.
  • S402 Acquire, from the received symbol, a second received symbol corresponding to a symbol sent by the sending end device with a range of [-K, K, -K]; wherein, [-K, K, -K] is characterized
  • the second received symbol is when the amplitude of the second sub-symbol of the first branch is K, the amplitude of the second sub-symbol of the second branch is K, and the amplitude of the second sub-symbol of the third branch is -K
  • S403 Acquire, from the received symbol, a third received symbol corresponding to a symbol sent by the sending end device with a range of [-K, -K, K]; wherein, [-K, -K, K] is characterized
  • the third received symbol is a symbol corresponding to when the amplitude of the second sub-symbol of the first branch and the second branch is -K and the amplitude of the second sub-symbol of the third branch is K.
  • the symbol received by the receiving end device includes a sequence of multiple sub-symbols.
  • the receiving end device determines the channel matrix according to the received symbol
  • the sending mechanism may be the sending mechanism in the foregoing S401 to S403 (the foregoing S401 to S403 are not strictly time-limited, and the three may be executed in parallel, and may be executed one after the other. This is not limited.
  • the RGB LED is integrated with the sending device.
  • the above sending mechanism may be: the receiving device can obtain the symbol corresponding to the transmitting device with the amplitude of [K, -K, -K] from the received symbol.
  • the first receiving symbol at the same time, the receiving end device can also obtain, from the received symbol, the second receiving symbol corresponding to the sending end device transmitting the symbol of amplitude [-K, K, -K], and
  • the third received symbol corresponding to the symbol sent by the transmitting device with the amplitude of [-K, -K, K] is obtained from the received symbols.
  • [K, -K, -K] characterizes the first received symbol as the amplitude of the second sub-symbol of the first branch is K
  • the amplitude of the second sub-symbol of the second branch and the third branch The symbol corresponding to -K, [-K, K, -K] characterizes the second received symbol as the amplitude of the second sub-symbol of the first branch is K
  • the second sub-symbol of the second branch The amplitude of the second sub-symbol of the third branch is the symbol corresponding to -K
  • [-K, -K, K] characterizes the third received symbol as the first branch and the second
  • the amplitude of the second sub-symbol of the branch is -K
  • the amplitude of the second sub-symbol of the third branch is K.
  • the first received symbol, the second received symbol, and the third received symbol are symbols having three sub-symbols, each of the sub-symbols having respective amplitudes and receiving
  • the end device performs corresponding arrangement of the first received symbol, the second received symbol and the third received symbol to obtain a channel matrix having 9 elements in the channel matrix.
  • the receiving end device obtains the channel matrix and the gamma curve for each path. Then, the receiving end device processes the received multi-channel subcarrier modulation signal based on the channel matrix and the gamma curve of each channel to obtain the data to be transmitted.
  • the transmitting device uses the CIM to perform multiple modulations on the data to be transmitted, the transmitting device adopts the sequence of the sequence in the first possible implementation manner, and then based on the sequence of the sequence.
  • the receiving end device can learn, by using the first part of the sequence, whether the received subcarrier modulation signal or the amplitude modulation signal is phase inverted, and determining the starting position of the sequence in the subcarrier modulation signal, and combining the starting position,
  • the length of the sequence and the symbol transmission order of the sequence determine the second part and the third part of the sequence, and then, in conjunction with whether the phase is inverted, whether the second part is used or the third part is used to determine the channel matrix and each path
  • the gamma curve and then adopting the channel matrix and the Gamma curve of each channel, performing nonlinear compensation, color correction, demodulation and the like on the received multi-channel subcarrier modulation signals to obtain data to be transmitted, thereby greatly improving the receiving end.
  • the third part of the sequence may be used to determine the channel matrix and the gamma curve of each channel when the phase is in error. Further ensure the accuracy of data restoration.
  • the implementation manner relates to another specific content of the foregoing preset sequence.
  • the sequence may specifically include: a first part and a second part; the first part includes N first symbol, Each first symbol includes a first sub-symbol that is multiplexed in parallel and has a preset first association relationship, and each of the N first sub-symbols of each path The first sub-symbol has a magnitude of -K, and the remaining The difference between the amplitudes of any two sub-symbols in the first sub-symbol is a multiple of the step size m, the multiple is a positive integer, n is the number of branches of the optical signal transmitted by the transmitting device; the second The portion includes N second symbols, the second symbol includes three second sub-symbols having parallel and amplitudes having a preset second association, the amplitude
  • the first part and the second part are used together to indicate a starting position of the sequence, and a gamma gamma curve and a channel matrix for indicating to the receiving end device for determining the amplitude modulated signal Parameter information.
  • the preset sequence includes two parts of different functions, and each part includes multiple parallel symbols.
  • the first part may include N first symbols, n is the number of branches of the optical signal sent by the transmitting device, and each first symbol includes a plurality of parallel first sub-symbols having a first association relationship between the amplitudes, that is, a certain time is sent
  • the first symbol is actually sent the parallel multi-channel first sub-symbol, and the amplitude between the multiple parallel first sub-symbols transmitted at this moment is correlated.
  • the RGB LED is integrated with the transmitting device, and the first part includes N first symbols.
  • a first symbol includes three first parallel sub-symbols having the first correlation relationship, for example, assuming that the amplitude of the first symbol transmitted at the first moment is [-K, -K, -K], that is, when RGB When the amplitude of the red sub-symbol on the red branch sent by the LED at the first moment is -K, the amplitude of the green branch and the blue branch at the first moment can only be -K, assuming the first time sent at the first moment.
  • the amplitude of the symbol is [K, -K, -K], that is, when the amplitude of the red sub-symbol on the red branch sent by the RGB LED at the first moment is K, the green branch and the blue branch are at the first moment.
  • the amplitude can only be -K, that is, at each moment, there is a corresponding correlation between the amplitudes of the three first sub-symbols, that is, the amplitudes of the three first sub-symbols belonging to the same first symbol. There is an association between them.
  • the first sub-symbol has a magnitude of -K, and the remaining The difference between the amplitudes of any two sub-symbols in the first sub-symbol is a multiple of the step size m.
  • the remaining The first sub-symbol may be a series of symbol strings continuously incremented to K from -K in steps of m, or may be a symbol string continuously decremented to -K in steps of m from K, or may be arbitrary Sequential The first sub-symbol.
  • the second part comprises N second symbols
  • the second symbol comprises a second sub-symbol with multiple parallel and amplitudes having a preset second association relationship
  • the amplitude of the N second symbols is a value obtained by performing an inverse operation on the amplitude of the first symbol of the first portion, that is, the second portion is actually the second possible implementation manner described above.
  • the amplitude of all the first symbols of the first part of the sequence is performed after the inverse operation.
  • the “inversion” here is only for the inverse of the amplitude, and does not limit the order of the second symbol of the second part, that is, the second part may be the amplitude of the first symbol of the first part directly
  • the partial sequence obtained after the negation may be a partial sequence obtained by rearranging all the obtained second symbols again after the amplitude of the first symbol of the first part is directly inverted, which is the embodiment of the present application.
  • the RGB LED is integrated with the transmitting device, and the second part includes N second symbols.
  • a second symbol includes a third sub-symbol having three parallels and a second correlation.
  • the first part and the second part are used together to indicate a starting position of the sequence, and parameter information for indicating to the receiving end device a gamma gamma curve and a channel matrix for determining the amplitude modulated signal.
  • the start position of the sequence in the multiple subcarrier modulation signals may be determined based on the first portion and the second portion of the sequence (ie, as described above, the sequence includes multiple sub-symbols) And determining a channel matrix corresponding to the multi-channel subcarrier modulation signal based on the sequence, and a Gamma curve corresponding to each sub-carrier modulation signal.
  • the specific Gamma curve and the channel matrix refer to the description of the following embodiments.
  • first part and the second part in the above sequence may be that the first part is in front and the second part is in the back, or the second part is in front and the first part is in the back.
  • the order of the two parts is not limited.
  • the first symbol in the first part may be arranged in a certain order, or may be a disordered manner.
  • the second symbol in the second part may also be arranged in a certain order, or may be arranged in a disordered manner. This embodiment of the present application does not limit this.
  • the first part may include three increasing sub-symbol strings, and the increasing sub-symbol string of each path includes a sub-symbol, the amplitude of the sub-symbol in the increasing sub-symbol string is continuously incremented to K from -K at equal intervals in m steps;
  • the second portion includes three decrementing sub-symbol strings, decrementing sub-symbol strings of each way include a sub-symbol, the amplitude of the sub-symbol in the descending sub-symbol string is continuously decremented to -K at intervals of m in steps of m;
  • the first association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are continuously incremented from -K in steps of m to the K to form the increasing sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are -K;
  • the second association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are successively decremented from -K in steps of m to -K to form the descending sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are K.
  • the optional manner is directed to a possible form of the first part and the second part.
  • the sequence in FIG. 7 includes three sub-symbols, and the three-way sub-symbol The symbol is divided into a first part and a second part.
  • the first part of Figure 7 includes three increasing sub-symbol strings, each of which increments the sub-symbol string including First sub-symbol, the The amplitudes of the first sub-symbols are successively incremented to K from -K starting at intervals of m.
  • the three-way incremental sub-symbol strings are not transmitted in parallel, but according to "the amplitude of the sub-symbols of any one of the sub-symbols is continuously incremented to K at equal intervals of m from -K to form the incrementer.
  • the other parallel two-way sub-symbols are transmitted with the first correlation of -K", that is, see the waveform in FIG. 7, when the red branch transmits the incremental symbol string, the green branch and the blue
  • the amplitude of the first sub-symbol on the color branch is -K.
  • the amplitude of the first sub-symbol of the red branch and the blue branch is -K
  • the amplitude of the first sub-symbol on the green branch and the red branch is -K.
  • the waveform of the second portion in FIG. 7 is opposite in amplitude to the waveform of the first portion, the second portion includes a three-way decreasing sub-symbol string, and the decrementing sub-symbol string of each path includes Third sub-symbol, the The amplitudes of the second sub-symbols are successively decremented to -K at equal intervals of m in steps of K.
  • the three-way decrementing sub-symbol strings are not transmitted in parallel, but according to "the decrement is formed when the amplitudes of the sub-symbols of any one of the sub-symbols are successively decremented to -K at equal intervals in m steps.
  • the other parallel two-way sub-symbols are transmitted in a second relationship of K", that is, see the waveform in FIG. 7, when the red branch transmits the descending symbol string, the green branch and the blue
  • the amplitude of the second sub-symbol on the branch is K.
  • the amplitude of the second sub-symbol of the red branch and the blue branch is K
  • the blue branch transmits the decreasing symbol
  • the amplitude of the second sub-symbol of the green branch and the red branch is K.
  • the first part and the second part of the sequence may enable the receiving end device to determine the starting position of the sequence in each subcarrier modulation signal, and obtain the receiving Whether the subcarrier modulation signal or the amplitude modulation signal to the phase inversion occurs, and the channel matrix and the Gamma curve of each channel are obtained according to the first part and the second part, thereby performing the received multiple subcarrier modulation signals.
  • the compensation of the nonlinear damage and the corresponding color correction improve the accuracy of the data recovery at the receiving end device and ensure the reliability of the data to be transmitted restored by the receiving device.
  • another embodiment of the present application provides a schematic flowchart of a method for camera communication.
  • the embodiment relates to the foregoing.
  • the transmitting end device uses multiple modulations to be transmitted by the CSK to be transmitted data
  • the receiving end device processes the received multiple subcarrier modulation signals to obtain a specific process of the data to be transmitted.
  • the RGB LED is integrated with the transmitting end device as an example, that is, the sequence includes three sub-symbols as an example for description.
  • the foregoing S107 may specifically include:
  • the receiving end device when receiving the multiple subcarrier modulation signals, the receiving end device receives one symbol and then one symbol, but because the symbol is continuously transmitted, the receiving end device does not know the currently received symbol when receiving. It is the first symbol, and it is necessary to combine the order of symbol transmission of the preset sequence and the amplitude of the detected symbol to know that the currently received symbol is the first symbol.
  • the receiving end device detects one symbol of the sequence, and detects another symbol of the sequence again after the preset number of symbols, the order of sending the two symbols to each other satisfies the symbol sending order of the sequence. Then, the receiving device determines that the "one symbol" received before is the starting position of the sequence. To illustrate this step more clearly, here is a simple example to illustrate:
  • the sequence of symbol transmission in its sequence is C symbol (amplitude K1), A symbol (amplitude is K2), B symbol (amplitude is K3), F symbol (amplitude is -K3), E symbol (Amplitude is -K2), D symbol (amplitude is -K1), wherein the A symbol, the B symbol, the C symbol are the first symbol of the first part, the F symbol, the E symbol, and the D symbol are the second symbol of the second part, 6
  • Each symbol includes a three-way sub-symbol.
  • the amplitudes of K1, K2, K3, -K1, -K2, and -K3 are all a generation. It is actually composed of the amplitudes of three sub-symbols. Simplify the description, and set the preset number of intervals to three.
  • the receiving end device When the receiving end device detects the C symbol of amplitude K1 and then detects the E symbol of amplitude -K2 again after three symbols, the receiving device knows the order between the C symbol and the E symbol. That is, the receiving device knows that the transmitting device is the first to transmit the C symbol and the fifth to transmit the E symbol when transmitting the sequence. Therefore, the receiving device determines that the order between the C symbol and the E symbol is currently satisfied.
  • the symbol transmission order the receiving device can determine the current C symbol according to the C symbol, that is, the sequence start position.
  • the receiving end device detects the A symbol and then detects a D symbol again after three symbols are separated, since the receiving end device knows that the transmitting end device is the second transmitting A symbol when transmitting the sequence, the sixth sending The D symbol, therefore, the receiving end device determines that the order between the A symbol and the D symbol is currently detected to satisfy the symbol transmission order of the sequence, so the receiving end device learns that the A symbol is the second position of the sequence, adjacent to the A symbol. The previous symbol is the starting position of the sequence.
  • S502 Determine whether the subcarrier modulation signal has a phase error according to a symbol transmission order of the sequence and an amplitude of the one symbol and an amplitude of the another symbol; if not, execute S503, and if yes, execute S504.
  • the receiving end device when the receiving end device detects the C symbol with the amplitude K1, and then intervals the three symbols, the E symbol with the amplitude of -K2 is detected again, because the receiving end device has Knowing the order between the C symbol and the E symbol sent by the transmitting device (ie, the receiving device knows that the transmitting device is the first to transmit the C symbol and the fifth to transmit the E symbol) and the known two The respective amplitudes of the symbols, therefore, the receiving end device determines that the order between the C symbol of the current detected K1 and the E symbol of the amplitude -K2 satisfies the symbol transmission order of the sequence, and the amplitude order of the two symbols is also related to the sequence.
  • the amplitudes of the symbols in the symbol transmission order are identical, so the receiving device can determine that the subcarrier modulation signal does not have a phase error. It should be noted here that the amplitude of the C symbol and the amplitude of the E symbol detected by the receiving end device may have some error with the amplitude of the C symbol sent by the transmitting end device and the amplitude of the E symbol, but the error does not cause the receiving end device. Identify errors, such as identifying C symbols as other symbols.
  • the receiving device detects a symbol with the amplitude -K1 and detects a symbol with the amplitude K2 again after the interval of 3 symbols, the receiving device knows that the transmitting device transmits the symbol and amplitude with the amplitude K1.
  • the order between the symbols of -K2 and the respective amplitudes of the two symbols are known. Therefore, the receiving end device determines the order in which the symbol having the amplitude of -K1 and the symbol of the amplitude K2 are currently detected and the symbol transmission order of the sequence.
  • the amplitudes of the symbols in the phase are opposite, so the receiving device can determine that the subcarrier modulation signal has a phase error, and determine that the detected position of the symbol of -K1 is the starting position of the sequence.
  • the receiving end device may determine the first part and the second part of the sequence by combining the length of the sequence and the symbol transmission order of the sequence or the waveform of the sequence.
  • S503 if there is no phase error, acquiring a gamma curve and a channel matrix according to the first part, and processing the multiple subcarrier modulation signals according to the gamma curve and the channel matrix to obtain the to-be-transmitted data. .
  • the receiving end device uses the first part of the sequence to obtain a Gamma curve corresponding to the channel matrix and each subcarrier modulation signal, and the specific Gamma curve acquisition manner.
  • the receiving end device uses the first part of the sequence to obtain a Gamma curve corresponding to the channel matrix and each subcarrier modulation signal, and the specific Gamma curve acquisition manner.
  • the symbol can be, that is, according to the difference between the amplitudes of any two first sub-symbols on each road in the first part is a multiple of the step size m First sub-symbol, obtained and described Sub-symbols corresponding to the second sub-symbol; The sub-symbols corresponding to the first sub-symbols perform a Gamma signal extraction operation to determine the gamma curve of each path. The specific process will not be described in detail here.
  • the specific channel matrix can be obtained by referring to the embodiment shown in FIG. 6 , and only the second sub-symbol needs to be replaced with the first sub-symbol in the embodiment, that is, from the receiving.
  • the first received symbol corresponding to the symbol sent by the transmitting device with the amplitude of [K, -K, -K] is obtained from the received symbol; and the transmitted amplitude of the received device is obtained from the transmitting device as [-K a second received symbol corresponding to the symbol of , K, -K]; obtaining a third corresponding to the symbol transmitted by the transmitting device from the receiving device with the amplitude of [-K, -K, K] Receiving a symbol; wherein [K, -K, -K] characterizes the first received symbol as when the first sub-symbol of the first branch has an amplitude of K, the first branch of the second branch and the third branch The symbol corresponds to the sign corresponding to -K; [-K, K, -K
  • the multi-subcarrier modulation signal may be processed based on the channel matrix and the gamma curve of each channel to obtain the
  • the demodulation mode is different.
  • the SIM uses CIM demodulation.
  • the CSK is performed. Demodulation.
  • S504 if there is a phase error, acquiring a Gamma curve and a channel matrix according to the second part, and processing the multiple subcarrier modulation signals according to the Gamma curve and the channel matrix to obtain the to-be-transmitted data. .
  • the receiving end device uses the second part of the sequence to obtain a Gamma curve corresponding to the channel matrix and each subcarrier modulation signal, and the specific Gamma curve acquisition manner.
  • the second portion in FIG. 5 it is only necessary to replace the second portion in FIG. 5 with the second portion in the present embodiment (the second portion in FIG. 5 and the second portion in the present embodiment).
  • the meaning of the reference is different.
  • the second sub-symbol in FIG. 5 may be replaced by the second sub-symbol in the embodiment, that is, according to the amplitude of any two second sub-symbols on each road in the second part.
  • the difference between the steps is a multiple of the step size m Second sub-symbol, obtained and described Sub-symbols corresponding to the second sub-symbol;
  • the sub-symbols corresponding to the second sub-symbols perform a Gamma signal extraction operation to determine the gamma curve of each path. The specific process will not be described in detail here.
  • the specific mode of the channel matrix can be referred to the embodiment shown in FIG. 6 , and only the second sub-symbol in FIG. 6 needs to be replaced with the second sub-symbol in the embodiment, that is, from the receiving.
  • Get and send to the symbol The first receiving symbol corresponding to the end device transmitting the symbol of the amplitude [K, -K, -K]; obtaining the transmission amplitude from the received symbol with the transmitting device is [-K, K, -K] a second received symbol corresponding to the symbol; obtaining, from the received symbol, a third received symbol corresponding to a symbol transmitted by the transmitting device with an amplitude of [-K, -K, K]; wherein, [ K, -K, -K] characterizes that the first received symbol is when the amplitude of the second sub-symbol of the first branch is K, and the amplitude of the second sub-symbol of the second branch and the third branch is -K
  • the multi-subcarrier modulation signal may be processed based on the channel matrix and the gamma curve of each channel to obtain the For the specific data processing, refer to the description about S207 in the foregoing embodiment.
  • the method for camera communication when the transmitting device uses CSK to perform multiple modulations on the data to be transmitted, the transmitting device adopts the sequence of the sequence in the second possible implementation manner, and then based on the sequence of the sequence.
  • the receiving end device can jointly determine whether the received subcarrier modulation signal or the amplitude modulation signal is phase inverted by using the first part and the second part of the sequence, and determining a starting position of the sequence in the subcarrier modulation signal, and combining the The starting position, the length of the sequence, and the symbol transmission order of the sequence determine the first portion and the second portion of the sequence, and then, in conjunction with whether the phase is inverted, whether the first portion or the second portion is used to determine the channel matrix and The Gamma curve of each channel, and then the channel matrix and the Gamma curve of each channel are used to perform nonlinear compensation, color correction, demodulation and the like on the received multi-channel subcarrier modulation signals, thereby obtaining data to be transmitted, which greatly improves the data
  • the embodiment of the present application can also determine the second part of the sequence when the phase occurs.
  • the channel matrix and the gamma curve of each channel further ensure the accuracy of data restoration; further, the embodiment of the present application solves the problem that the CSK signal cannot be transmitted in the OCC system using the low speed camera, and the camera communication is expanded. Scope of application.
  • the implementation manner relates to another specific content of the foregoing preset sequence.
  • the sequence may include a first portion and a second portion; the first portion includes a plurality of symbols outside the modulation constellation point for indicating a starting position of the sequence in the initial signal;
  • the two parts include all the symbols in the plurality of modulation constellation points for instructing the receiving end device to train the decider according to the second part, and the determiner is configured to acquire the to-be-acquired according to the signal received by the receiving end device transfer data.
  • the receiving end device can use the sequence to determine the starting position of the sequence, and use the second part to train the decider, and obtain the blocked subcarrier modulation signal from the received blocker through the determiner. Data to be transmitted.
  • the foregoing S107 may specifically include:
  • the receiving end device when receiving the multi-channel subcarrier modulation signal, the receiving end device receives one symbol and then one symbol, and when the receiving end device detects any symbol, if the symbol is located outside the multiple modulation constellation points
  • the receiving device can determine the starting position of the sequence in combination with the symbol and the symbol sequence of the known sequence. For the specific determining manner, refer to the determining manner of S501 in the foregoing embodiment, and details are not described herein again.
  • S602 Train the decider according to the starting position, the symbol order in the preset sequence, and the length of the sequence.
  • S603 Acquire, according to the determiner, the data to be transmitted from the multiple subcarrier modulation signals.
  • the embodiment does not need to perform the RGB three-way sub-symbol received by the camera, and does not need nonlinear compensation, color correction, phase error determination, etc., but introduces machine learning.
  • a method for determining a second portion of the sequence by using the determined starting position, the symbol order in the preset sequence, and the length of the sequence, and then using the second portion to train the determiner of the receiving device, After the judging device learns successfully, the determiner can be used to obtain the data to be transmitted from the multi-channel subcarrier modulation signal.
  • the embodiment of the present application does not limit how to obtain the judging device.
  • the method for camera communication provided by the embodiment of the present application cancels operations such as nonlinear compensation, color correction, and phase error elimination of the receiving device, but trains the decider based on the second part of the sequence, and uses the determiner to restore the to-be-transmitted
  • the data simplifies the complexity of the receiving device.
  • the foregoing program may be stored in a computer readable storage medium, and the program is executed when executed.
  • the foregoing steps include the steps of the foregoing method embodiments; and the foregoing storage medium includes: a medium that can store program codes, such as a ROM, a RAM, a magnetic disk, or an optical disk.
  • FIG. 10 is a schematic structural diagram of an apparatus for camera communication according to an embodiment of the present application.
  • the device may be the sender device device in the foregoing embodiment, or may be integrated in the sender device device in the foregoing method embodiment.
  • the apparatus includes: a first modulation module 10, a sequence addition module 11, a second modulation module 12, and a transmission module 13.
  • the first modulation module 10 is configured to perform multiple modulations on the data to be transmitted to obtain a multi-channel amplitude modulation signal, where each channel of the amplitude modulation signal has multiple amplitudes;
  • the sequence adding module 11 is configured to add a preset sequence before each of the amplitude modulation signals to obtain an initial signal of each channel; wherein the sequence is used to indicate state information of the amplitude modulation signal;
  • the second modulation module 12 is configured to perform subcarrier amplitude modulation SAM on the initial signal of each channel to obtain a subcarrier modulation signal of each channel;
  • the sending module 13 is configured to send multiple subcarrier modulation signals to the receiving end device.
  • the first modulation module 10 and the second modulation module 12 and the sequence adding module 11 may correspond to components having processing and control functions, such as a processor or a microprocessor unit in the transmitting device, or The other components of the VLC module are integrated.
  • the transmitting module 13 may be an optical communication unit in the transmitting device, for example, an LED capable of transmitting multiple optical signals.
  • the apparatus for the camera communication provided by the embodiment of the present application may perform the foregoing method embodiments, and the implementation principle and technical effects thereof are similar, and details are not described herein again.
  • the sequence is specifically used to indicate at least one of the following status information of the amplitude modulated signal:
  • Parameter information for determining a gamma gamma curve and a channel matrix of the amplitude modulated signal is indicated.
  • the sequence when the multiple modulation is a color intensity modulation CIM, the sequence includes: a first portion, a second portion, and a third portion;
  • the first portion includes a first symbol, the first symbol is used to indicate a starting position of the sequence in the initial signal; and the first symbol includes three parallel first first sub-symbols having an amplitude of K+l
  • the K is a maximum amplitude after CIM modulation of the data to be transmitted, and the l is an arbitrary positive integer;
  • the second portion includes N second symbols, Each of the second symbols includes three second sub-symbols in parallel and having a preset first association relationship, and each of the N second sub-symbols
  • the second sub-symbol has a magnitude of -K, and the remaining
  • the difference between the amplitudes of any two sub-symbols in the second sub-symbol is a multiple of the step size m, the multiple is a positive integer, and the second portion is used to indicate to the receiving end device for determining the The gamma gamma curve of the amplitude modulated signal and the parameter information of the channel matrix;
  • the third part includes N third symbols, and the third symbol includes three third sub-symbols whose amplitudes have a preset second association relationship, and the amplitudes of the N third symbols are And performing, after the amplitude of the second symbol of the second part, performing a reverse operation, for indicating a gamma for determining the amplitude modulation signal to the receiving end device when a phase error occurs in the subcarrier modulation signal Parameter information of the Gamma curve and the channel matrix.
  • the second part includes three increasing sub-symbol strings, and the increasing sub-symbol string of each path includes Sub-symbols, the amplitudes of the sub-symbols in the increasing sub-symbol string are successively incremented from K at equal intervals of m in steps of m;
  • the third portion includes three decrementing sub-symbol strings, decrementing sub-symbols of each path String includes a sub-symbol, the amplitude of the sub-symbol in the descending sub-symbol string is continuously decremented to -K at intervals of m in steps of m;
  • the first association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are continuously incremented from -K in steps of m to the K to form the increasing sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are -K;
  • the second association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are successively decremented from -K in steps of m to -K to form the descending sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are K.
  • the sequence when the multiple modulation is color shift keying CSK modulation, the sequence includes: a first part and a second part;
  • the first portion includes N first symbols, Each of the first symbols includes three second sub-symbols in parallel and having a preset first association relationship, and each of the N first sub-symbols of each path
  • the first sub-symbol has a magnitude of -K, and the remaining
  • the difference between the amplitudes of any two sub-symbols in the first sub-symbol is a multiple of the step size m, and the multiple is a positive integer;
  • the second part includes N second symbols, and the second symbol includes three second sub-symbols in parallel and having a second associated relationship, and the amplitudes of the N second symbols are The amplitude of the first symbol of the first part performs the value after the inverse operation;
  • the first portion and the second portion are used together to indicate a starting position of the sequence, and to The receiving end device indicates parameter information for determining a gamma gamma curve and a channel matrix of the amplitude modulated signal.
  • the first part includes a three-way incremental sub-symbol string, and the incremental sub-symbol string of each path includes a sub-symbol, the amplitude of the sub-symbol in the increasing sub-symbol string is continuously incremented to K from -K at equal intervals in m steps;
  • the second portion includes three-way descending sub-symbol strings, decrementing sub-symbols of each path String includes a sub-symbol, the amplitude of the sub-symbol in the descending sub-symbol string is continuously decremented to -K at intervals of m in steps of m;
  • the first association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are continuously incremented from -K in steps of m to the K to form the increasing sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are -K;
  • the second association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are successively decremented from -K in steps of m to -K to form the descending sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are K.
  • the sequence includes a first part and a second part
  • the first portion includes a plurality of symbols outside the modulation constellation point for indicating a starting position of the sequence in the initial signal
  • the second part includes all the symbols in the plurality of modulation constellation points, and is used to indicate that the receiving end device trains the decider according to the training part, and the decider is configured to acquire the signal according to the signal received by the receiving end device.
  • the data to be transmitted is mentioned.
  • FIG. 11 is a schematic structural diagram of an apparatus for camera communication according to an embodiment of the present application.
  • the device may further include: a receiving module 14 and a compensation module 15.
  • the receiving module 14 can be a camera device or a video recording device or the like on the above-mentioned transmitting device device.
  • the receiving module 14 is configured to receive information about a gamma gamma curve determined by the receiving end device according to the sequence;
  • the compensation module 15 is configured to perform Gamma nonlinear compensation on each subcarrier modulation signal according to the information of the Gamma curve to obtain a multipath compensated modulation signal;
  • the sending module 13 is further configured to send the multiplexed modulated signal to the receiving end device.
  • the apparatus for the camera communication provided by the embodiment of the present application may perform the foregoing method embodiments, and the implementation principle and technical effects thereof are similar, and details are not described herein again.
  • FIG. 12 is a schematic structural diagram of an apparatus for camera communication according to an embodiment of the present application.
  • the device may be the receiving device in the foregoing method embodiment, and may also be integrated in the receiving device device in the foregoing method embodiment.
  • the apparatus includes: a receiving module 20 and a processing module 21; optionally, the apparatus may further include a transmitting module 22.
  • the receiving module 20 is configured to receive the multiple subcarrier modulation signals sent by the sending end device, where the multiple subcarrier modulation signals are signals obtained by subcarrier amplitude modulation SAM for the initial signal of each path of the transmitting end device,
  • the initial signal is generated by the transmitting end device according to a preset sequence and an amplitude modulated signal obtained by performing multiple modulations on the data to be transmitted, and the sequence is used to indicate state information of the amplitude modulated signal;
  • the processing module 21 is configured to process the multiple subcarrier modulation signals to obtain the data to be transmitted.
  • the sending module 22 may be an optical communication unit in the receiving device, for example, an LED capable of transmitting multiple optical signals
  • the receiving module 20 may be a camera device or a video recording device in the receiving device.
  • the processing module 21 may correspond to a processor or a microprocessor unit or the like in the receiving device device.
  • the components that handle and control functions can also be other components that integrate the VLC module.
  • the apparatus for the camera communication provided by the embodiment of the present application may perform the foregoing method embodiments, and the implementation principle and technical effects thereof are similar, and details are not described herein again.
  • the sequence is specifically used to indicate at least one of the following status information of the amplitude modulated signal:
  • Parameter information for determining a gamma gamma curve and a channel matrix of the amplitude modulated signal is indicated.
  • the sequence when the multiple modulation is a color intensity modulation CIM, the sequence includes: a first part, a second part, and a third part;
  • the first portion includes a first symbol, the first symbol is used to indicate a starting position of the sequence in the initial signal; and the first symbol includes three parallel first first sub-symbols having an amplitude of K+l
  • the K is a maximum amplitude after CIM modulation of the data to be transmitted, and the l is an arbitrary positive integer;
  • the second portion includes N second symbols, Each of the second symbols includes three second sub-symbols in parallel and having a preset first association relationship, and each of the N second sub-symbols
  • the second sub-symbol has a magnitude of -K, and the remaining
  • the difference between the amplitudes of any two sub-symbols in the second sub-symbol is a multiple of the step size m, the multiple is a positive integer, and the second portion is used to indicate to the receiving end device for determining the The gamma gamma curve of the amplitude modulated signal and the parameter information of the channel matrix;
  • the third part includes N third symbols, and the third symbol includes three third sub-symbols whose amplitudes have a preset second association relationship, and the amplitudes of the N third symbols are And performing, after the amplitude of the second symbol of the second part, performing a reverse operation, for indicating a gamma for determining the amplitude modulation signal to the receiving end device when a phase error occurs in the subcarrier modulation signal Parameter information of the Gamma curve and the channel matrix.
  • the second part includes a three-way incremental sub-symbol string, and the incremental sub-symbol string of each path includes Sub-symbols, the amplitudes of the sub-symbols in the increasing sub-symbol string are successively incremented from K at equal intervals of m in steps of m;
  • the third portion includes three decrementing sub-symbol strings, decrementing sub-symbols of each path String includes a sub-symbol, the amplitude of the sub-symbol in the descending sub-symbol string is continuously decremented to -K at intervals of m in steps of m;
  • the first association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are continuously incremented from -K in steps of m to the K to form the increasing sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are -K;
  • the second association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are successively decremented from -K in steps of m to -K to form the descending sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are K.
  • the sequence when the multiple modulation is color shift keying CSK modulation, the sequence includes: a first part and a second part;
  • the first portion includes N first symbols, Each of the first symbols includes three second sub-symbols in parallel and having a preset first association relationship, and each of the N first sub-symbols of each path
  • the first sub-symbol has a magnitude of -K, and the remaining
  • the difference between the amplitudes of any two sub-symbols in the first sub-symbol is a multiple of the step size m, and the multiple is a positive integer;
  • the second portion includes N second symbols, the second symbol includes three parallel channels, and the amplitude has a preset number a second sub-symbol of the second association, the amplitude of the N second symbols being a value obtained by performing an inverse operation on the amplitude of the first symbol of the first portion;
  • the first part and the second part are used together to indicate a starting position of the sequence, and a gamma gamma curve and a channel matrix for indicating to the receiving end device for determining the amplitude modulated signal Parameter information.
  • the first part includes three increasing sub-symbol strings, and the increasing sub-symbol string of each path includes a sub-symbol, the amplitude of the sub-symbol in the increasing sub-symbol string is continuously incremented to K from -K at equal intervals in m steps;
  • the second portion includes three-way descending sub-symbol strings, decrementing sub-symbols of each path String includes a sub-symbol, the amplitude of the sub-symbol in the descending sub-symbol string is continuously decremented to -K at intervals of m in steps of m;
  • the first association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are continuously incremented from -K in steps of m to the K to form the increasing sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are -K;
  • the second association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are successively decremented from -K in steps of m to -K to form the descending sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are K.
  • the sequence includes a first part and a second part
  • the first portion includes a plurality of symbols outside the modulation constellation point for indicating a starting position of the sequence in the initial signal
  • the second part includes all the symbols in the plurality of modulation constellation points, and is used to indicate that the receiving end device trains the decider according to the training part, and the decider is configured to acquire the signal according to the signal received by the receiving end device.
  • the data to be transmitted is mentioned.
  • the processing module 21 is specifically configured to: when a symbol is detected, and the amplitude of the three-way sub-symbol of the symbol is the maximum amplitude of the branch, according to a symbol transmission order of the preset sequence and the symbol determining a starting position of the sequence, and determining a second portion of the sequence according to the starting position, the length of the sequence, and the symbol transmission order of the sequence And a third part; and, acquiring a gamma curve and a channel matrix according to the second part, and processing the multiple subcarrier modulation signals according to the gamma curve and the channel matrix to obtain the data to be transmitted.
  • processing module 21 is specifically configured to acquire a gamma curve according to the second part, and specifically includes:
  • the processing module 21 is specifically configured to use, according to the difference between the amplitudes of any two sub-symbols on each path in the second portion, a multiple of the step size m Second sub-symbol, obtained and described Sub-symbols corresponding to the second sub-symbol, and for each of the roads The sub-symbols corresponding to the second sub-symbols perform a Gamma signal extraction operation to determine the gamma curve of each path.
  • processing module 21 is specifically configured to acquire a channel matrix according to the second part, and specifically includes:
  • the processing module 21 is specifically configured to: acquire, from the received symbol, a first received symbol corresponding to a symbol sent by the sending end device with a range of [K, -K, -K]; wherein, [K, -K, -K] characterizing the first received symbol when the amplitude of the second sub-symbol of the first branch is K, and the amplitude of the second sub-symbol of the second branch and the third branch is -K Corresponding symbols; and obtaining, from the received symbols, a second received symbol corresponding to a symbol sent by the transmitting device with an amplitude of [-K, K, -K]; wherein, [-K, K, -K] characterizing the second received symbol as the second of the first branch
  • the amplitude of the sub-symbol is K
  • the amplitude of the second sub-symbol of the second branch is K
  • the sign of the second sub-symbol of the third branch is -K
  • the processing module 21 is further configured to: when a symbol is detected, and the amplitude of the three-way sub-symbol of the symbol is the minimum amplitude of the branch on the branch, Determining a phase error of the subcarrier modulation signal, and determining a starting position of the sequence according to the symbol; and obtaining a Gamma curve and a channel matrix according to the third portion; and, according to the Gamma curve and the channel matrix pair
  • the multi-channel subcarrier modulation signal is processed to obtain the data to be transmitted.
  • the processing module 21 is specifically configured to: when detecting a symbol in the sequence, and detect the sequence again after a preset number of symbols are separated Another symbol, determining a starting position of the sequence according to the one symbol; an order of the one symbol and the another symbol satisfies a symbol transmission order of a preset sequence; and, according to the symbol of the sequence Transmitting order and amplitude of said one symbol and amplitude of said another symbol determining whether said subcarrier modulation signal has a phase error; if there is no phase error, acquiring a Gamma curve and a channel matrix according to said first portion, and according to The gamma curve and the channel matrix process the multi-channel subcarrier modulation signal to obtain the data to be transmitted; if there is a phase error, acquire a gamma curve and a channel matrix according to the second part, and according to the The gamma curve and the channel matrix process the multi-channel subcarrier modulation signal to obtain the data
  • the processing module 21 is configured to process the multiple subcarrier modulation signals to obtain the data to be transmitted, and specifically includes:
  • the processing module 21 is specifically configured to: when detecting any one of the plurality of modulation constellation points, determine a starting position of the sequence according to the symbol transmission order of the any one of the symbols and the preset sequence; The starting position, the symbol order in the preset sequence, and the length of the sequence training the decider; and acquiring the data to be transmitted from the multiple subcarrier modulation signals according to the decider.
  • the processing module 21 is specifically configured to modulate the multiple subcarriers according to the gamma curve and the channel matrix.
  • the processing is performed to obtain the data to be transmitted, which specifically includes:
  • the processing module 21 is configured to perform nonlinear compensation on the subcarrier modulation signal according to the Gamma curve, and perform color correction on the compensated modulation signal according to the channel matrix to obtain a corrected signal, and according to the Decoding the corrected signal and the amplitude of the amplitude modulated signal, deleting the sequence in the corrected signal to obtain the amplitude modulated signal; and demodulating the amplitude modulated signal to obtain the data to be transmitted
  • the sending module 22 is configured to send information about the Gamma curve to the sending end device, where the information of the Gamma curve is
  • the receiving module 20 is further configured to receive the compensation sent by the sending end device by using the gamma curve to perform nonlinear compensation on the subcarrier modulation signal to obtain a compensated modulated signal.
  • the processing module 21 is specifically configured to perform, according to the corrected signal and the amplitude modulated signal Length, deleting the sequence in the corrected signal, obtaining the amplitude modulated signal, and demodulating the amplitude modulated signal to obtain the to-be-transmitted Lose data.
  • the apparatus for the camera communication provided by the embodiment of the present application may perform the foregoing method embodiments, and the implementation principle and technical effects thereof are similar, and details are not described herein again.
  • FIG. 13 is a schematic structural diagram of an apparatus for camera communication according to an embodiment of the present application.
  • the device in which the camera communicates may include a processor 30, a memory 31, at least one communication bus 32, and a transmitter 33.
  • the device communicated by the camera may further include a receiver 34.
  • Communication bus 32 is used to implement a communication connection between components.
  • the memory 31 may include a high speed RAM memory, and may also include a non-volatile memory NVM, such as at least one disk memory, in which various programs may be stored for performing various processing functions and implementing the method steps of the present embodiment.
  • the transmitter 33 in this embodiment may be an LED light integrated with a VLC module in the sending device
  • the receiver 34 in this embodiment may be a camera device or a video recording device on the sending device device. Wait.
  • the processor 30 is configured to perform multiple modulations on the data to be transmitted to obtain a multi-channel amplitude modulated signal, wherein each of the amplitude modulated signals has multiple amplitudes; and adding a pre-amplitude before each of the amplitude modulated signals
  • the sequence is set to obtain an initial signal of each channel, and subcarrier amplitude modulation SAM is performed on each channel initial signal to obtain a subcarrier modulation signal of each channel; wherein the sequence is used to indicate state information of the amplitude modulation signal ;
  • the transmitter 33 is configured to send multiple subcarrier modulation signals to the receiving end device.
  • the sequence is specifically used to indicate at least one of the following status information of the amplitude modulated signal:
  • Parameter information for determining a gamma gamma curve and a channel matrix of the amplitude modulated signal is indicated.
  • the sequence when the multiple modulation is a color intensity modulation CIM, the sequence includes: a first portion, a second portion, and a third portion;
  • the first portion includes a first symbol, the first symbol is used to indicate a starting position of the sequence in the initial signal; and the first symbol includes three parallel first first sub-symbols having an amplitude of K+l
  • the K is a maximum amplitude after CIM modulation of the data to be transmitted, and the l is an arbitrary positive integer;
  • the second portion includes N second symbols, Each of the second symbols includes three second sub-symbols in parallel and having a preset first association relationship, and each of the N second sub-symbols
  • the second sub-symbol has a magnitude of -K, and the remaining
  • the difference between the amplitudes of any two sub-symbols in the second sub-symbol is a multiple of the step size m, the multiple is a positive integer, and the second portion is used to indicate to the receiving end device for determining the The gamma gamma curve of the amplitude modulated signal and the parameter information of the channel matrix;
  • the third part includes N third symbols, and the third symbol includes three third sub-symbols whose amplitudes have a preset second association relationship, and the amplitudes of the N third symbols are And performing, after the amplitude of the second symbol of the second part, performing a reverse operation, for indicating a gamma for determining the amplitude modulation signal to the receiving end device when a phase error occurs in the subcarrier modulation signal Parameter information of the Gamma curve and the channel matrix.
  • the second part includes three increasing sub-symbol strings, and the increasing sub-symbol string of each path includes Sub-symbols, the amplitudes of the sub-symbols in the increasing sub-symbol string are successively incremented from K at equal intervals of m in steps of m;
  • the third portion includes three decrementing sub-symbol strings, decrementing sub-symbols of each path String includes a sub-symbol, the amplitude of the sub-symbol in the descending sub-symbol string is continuously decremented to -K at intervals of m in steps of m;
  • the first association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are continuously incremented from -K in steps of m to the K to form the increasing sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are -K;
  • the second association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are successively decremented from -K in steps of m to -K to form the descending sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are K.
  • the sequence when the multiple modulation is color shift keying CSK modulation, the sequence includes: a first part and a second part;
  • the first portion includes N first symbols, Each of the first symbols includes three second sub-symbols in parallel and having a preset first association relationship, and each of the N first sub-symbols of each path
  • the first sub-symbol has a magnitude of -K, and the remaining
  • the difference between the amplitudes of any two sub-symbols in the first sub-symbol is a multiple of the step size m, and the multiple is a positive integer;
  • the second part includes N second symbols, and the second symbol includes three second sub-symbols in parallel and having a second associated relationship, and the amplitudes of the N second symbols are The amplitude of the first symbol of the first part performs the value after the inverse operation;
  • the first part and the second part are used together to indicate a starting position of the sequence, and a gamma gamma curve and a channel matrix for indicating to the receiving end device for determining the amplitude modulated signal Parameter information.
  • the first part includes a three-way incremental sub-symbol string, and the incremental sub-symbol string of each path includes a sub-symbol, the amplitude of the sub-symbol in the increasing sub-symbol string is continuously incremented to K from -K at equal intervals in m steps;
  • the second portion includes three-way descending sub-symbol strings, decrementing sub-symbols of each path String includes a sub-symbol, the amplitude of the sub-symbol in the descending sub-symbol string is continuously decremented to -K at intervals of m in steps of m;
  • the first association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are continuously incremented from -K in steps of m to the K to form the increasing sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are -K;
  • the second association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are successively decremented from -K in steps of m to -K to form the descending sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are K.
  • the sequence includes a first part and a second part
  • the first portion includes a plurality of symbols outside the modulation constellation point for indicating a starting position of the sequence in the initial signal
  • the second part includes all the symbols in the plurality of modulation constellation points, and is used to indicate that the receiving end device trains the decider according to the training part, and the decider is configured to acquire the signal according to the signal received by the receiving end device.
  • the data to be transmitted is mentioned.
  • the receiver 34 is configured to receive information about a gamma gamma curve determined by the receiving end device according to the sequence;
  • the processor 30 is further configured to perform Gamma nonlinear compensation on each subcarrier modulation signal according to the information of the Gamma curve to obtain a multipath compensated modulation signal;
  • the transmitter 33 is further configured to send the multiplexed modulated signal to the receiving end device.
  • the apparatus for the camera communication provided by the embodiment of the present application may perform the foregoing method embodiments, and the implementation principle and technical effects thereof are similar, and details are not described herein again.
  • FIG. 14 is a schematic structural diagram of an apparatus for camera communication according to an embodiment of the present application.
  • the device in which the camera communicates may include a processor 40, a memory 41, at least one communication bus 42 and a receiver 43.
  • the device communicated by the camera may further include a transmitter 44.
  • Communication bus 42 is used to implement a communication connection between components.
  • the memory 41 may include a high speed RAM memory, and may also include a non-volatile memory NVM, such as at least one disk memory, in which various programs may be stored for performing various processing functions and implementing the method steps of the present embodiment.
  • the receiver 43 in this embodiment may be a camera device or a video recording device on the receiving device device.
  • the transmitter 44 in this embodiment may be an LED integrated with the VLC module in the receiving device device. light.
  • the sequence is specifically used to indicate at least one of the following status information of the amplitude modulated signal:
  • Parameter information for determining a gamma gamma curve and a channel matrix of the amplitude modulated signal is indicated.
  • the sequence when the multiple modulation is a color intensity modulation CIM, the sequence includes: a first part, a second part, and a third part;
  • the first portion includes a first symbol, the first symbol is used to indicate a starting position of the sequence in the initial signal; and the first symbol includes three parallel first first sub-symbols having an amplitude of K+l
  • the K is a maximum amplitude after CIM modulation of the data to be transmitted, and the l is an arbitrary positive integer;
  • the second portion includes N second symbols, Each of the second symbols includes three second sub-symbols in parallel and having a preset first association relationship, and each of the N second sub-symbols
  • the second sub-symbol has a magnitude of -K, and the remaining
  • the difference between the amplitudes of any two sub-symbols in the second sub-symbol is a multiple of the step size m, the multiple is a positive integer, and the second portion is used to indicate to the receiving end device for determining the The gamma gamma curve of the amplitude modulated signal and the parameter information of the channel matrix;
  • the third part includes N third symbols, and the third symbol includes three third sub-symbols whose amplitudes have a preset second association relationship, and the amplitudes of the N third symbols are And performing, after the amplitude of the second symbol of the second part, performing a reverse operation, for indicating a gamma for determining the amplitude modulation signal to the receiving end device when a phase error occurs in the subcarrier modulation signal Parameter information of the Gamma curve and the channel matrix.
  • the second part includes a three-way incremental sub-symbol string, and the incremental sub-symbol string of each path includes Sub-symbols, the amplitudes of the sub-symbols in the increasing sub-symbol string are successively incremented from K at equal intervals of m in steps of m;
  • the third portion includes three decrementing sub-symbol strings, decrementing sub-symbols of each path String includes a sub-symbol, the amplitude of the sub-symbol in the descending sub-symbol string is continuously decremented to -K at intervals of m in steps of m;
  • the first association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are continuously incremented from -K in steps of m to the K to form the increasing sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are -K;
  • the second association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are successively decremented from -K in steps of m to -K to form the descending sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are K.
  • the sequence includes: a first portion and a second portion;
  • the first portion includes N first symbols, Each of the first symbols includes three second sub-symbols in parallel and having a preset first association relationship, and each of the N first sub-symbols of each path
  • the first sub-symbol has a magnitude of -K, and the remaining
  • the difference between the amplitudes of any two sub-symbols in the first sub-symbol is a multiple of the step size m, and the multiple is a positive integer;
  • the second part includes N second symbols, and the second symbol includes three second sub-symbols in parallel and having a second associated relationship, and the amplitudes of the N second symbols are The amplitude of the first symbol of the first part performs the value after the inverse operation;
  • the first part and the second part are used together to indicate a starting position of the sequence, and a gamma gamma curve and a channel matrix for indicating to the receiving end device for determining the amplitude modulated signal Parameter information.
  • the first part includes three increasing sub-symbol strings, and the increasing sub-symbol string of each path includes a sub-symbol, the amplitude of the sub-symbol in the increasing sub-symbol string is continuously incremented to K from -K at equal intervals in m steps;
  • the second portion includes three-way descending sub-symbol strings, decrementing sub-symbols of each path String includes a sub-symbol, the amplitude of the sub-symbol in the descending sub-symbol string is continuously decremented to -K at intervals of m in steps of m;
  • the first association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are continuously incremented from -K in steps of m to the K to form the increasing sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are -K;
  • the second association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are successively decremented from -K in steps of m to -K to form the descending sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are K.
  • the sequence includes a first part and a second part
  • the first portion includes a plurality of symbols outside the modulation constellation point for indicating a starting position of the sequence in the initial signal
  • the second part includes all the symbols in the plurality of modulation constellation points, and is used to indicate that the receiving end device trains the decider according to the training part, and the decider is configured to acquire the signal according to the signal received by the receiving end device.
  • the data to be transmitted is mentioned.
  • the processor 40 is specifically configured to: when a symbol is detected, and the amplitude of the three sub-symbols of the symbol is the maximum amplitude of the branch, according to a symbol transmission order of the preset sequence and the symbol determining a starting position of the sequence, and determining a second portion of the sequence according to the starting position, the length of the sequence, and the symbol transmission order of the sequence And a third part; and, acquiring a gamma curve and a channel matrix according to the second part, and processing the multiple subcarrier modulation signals according to the gamma curve and the channel matrix to obtain the data to be transmitted.
  • the processor 40 is specifically configured to acquire a gamma curve according to the second part, and specifically includes:
  • the processor 40 is specifically configured to use, according to the difference between the amplitudes of any two sub-symbols on each path in the second portion, a multiple of the step size m Second sub-symbol, obtained and described Sub-symbols corresponding to the second sub-symbol, and for each of the roads The sub-symbols corresponding to the second sub-symbols perform a Gamma signal extraction operation to determine the gamma curve of each path.
  • the processor 40 is specifically configured to acquire a channel matrix according to the second part, and specifically includes:
  • the processor 40 is specifically configured to: acquire, from the received symbols, a first received symbol corresponding to a symbol sent by the sending end device with a range of [K, -K, -K]; wherein, [K, -K, -K] characterizing the first received symbol when the amplitude of the second sub-symbol of the first branch is K, and the amplitude of the second sub-symbol of the second branch and the third branch is -K Corresponding symbols; and obtaining, from the received symbols, a second received symbol corresponding to a symbol sent by the transmitting device with an amplitude of [-K, K, -K]; wherein, [-K, K, - K] characterizing the second received symbol when the amplitude of the second sub-symbol of the first branch is K, the amplitude of the second sub-symbol of the second branch is K, and the second sub-symbol of the third branch a symbol corresponding to the amplitude of -K; and,
  • the processor 40 is further configured to: when a symbol is detected, and the amplitude of the three-way sub-symbol of the symbol is the minimum amplitude of the branch on the branch, Determining a phase error of the subcarrier modulation signal, and determining a starting position of the sequence according to the symbol; and obtaining a Gamma curve and a channel matrix according to the third portion; and, according to the Gamma curve and the channel matrix pair
  • the multi-channel subcarrier modulation signal is processed to obtain the data to be transmitted.
  • the processor 40 is specifically configured to: when detecting a symbol in the sequence, and detect the sequence again after a preset number of symbols are separated Another symbol, determining a starting position of the sequence according to the one symbol; an order of the one symbol and the another symbol satisfies a symbol transmission order of a preset sequence; and, according to the symbol of the sequence Transmitting order and amplitude of said one symbol and amplitude of said another symbol determining whether said subcarrier modulation signal has a phase error; if there is no phase error, acquiring a Gamma curve and a channel matrix according to said first portion, and according to The gamma curve and the channel matrix process the multi-channel subcarrier modulation signal to obtain the data to be transmitted; if there is a phase error, acquire a gamma curve and a channel matrix according to the second part, and according to the The gamma curve and the channel matrix process the multi-channel subcarrier modulation signal to obtain the data to
  • the processor 40 is configured to process the multiple subcarrier modulation signals to obtain the data to be transmitted, and specifically includes:
  • the processor 40 is configured to: when detecting any one of the plurality of modulation constellation points, determine a starting position of the sequence according to the symbol transmission order of the any one of the symbols and the preset sequence; The starting position, the symbol order in the preset sequence, and the length of the sequence training the decider; and acquiring the data to be transmitted from the multiple subcarrier modulation signals according to the decider.
  • the processor 40 is specifically configured to modulate the multiple subcarriers according to the gamma curve and the channel matrix.
  • the processing is performed to obtain the data to be transmitted, which specifically includes:
  • the processor 40 is configured to perform nonlinear compensation on the subcarrier modulation signal according to the gamma curve, and perform color correction on the compensated modulation signal according to the channel matrix to obtain a corrected signal, and according to the Decoding the corrected signal and the amplitude of the amplitude modulated signal, deleting the sequence in the corrected signal to obtain the amplitude modulated signal; and demodulating the amplitude modulated signal to obtain the data to be transmitted
  • the transmitter 44 is configured to send information about the Gamma curve to the sending end device, where the information of the Gamma curve is
  • the receiver 43 is further configured to receive the compensation sent by the sending end device by using the gamma curve to perform nonlinear compensation on the subcarrier modulation signal to obtain a compensated modulated signal.
  • the processor 40 is specifically configured to perform, according to the corrected signal and the amplitude modulated signal Length, deleting the sequence in the corrected signal, obtaining the amplitude modulated signal, and demodulating the amplitude modulated signal to obtain the data to be transmitted.
  • the apparatus for the camera communication provided by the embodiment of the present application may perform the foregoing method embodiments, and the implementation principle and technical effects thereof are similar, and details are not described herein again.
  • the steps of the method or algorithm described in connection with the disclosure of the present application may be implemented in a hardware manner, or may be implemented by a processor executing a software instruction, or may be implemented by a computer program product.
  • the software instructions may be comprised of corresponding software modules that may be stored in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable hard disk, CD-ROM, or any other form of storage well known in the art.
  • An exemplary storage medium is coupled to the processor to enable the processor to read information from, and write information to, the storage medium.
  • the storage medium can also be an integral part of the processor.
  • the processor and the storage medium can be located in an ASIC. Additionally, the ASIC can be located in the user equipment. Of course, the processor and the storage medium may also reside as discrete components in the user equipment.
  • the functions described herein can be implemented in hardware, software, firmware, or any combination thereof.
  • the functions may be stored in a computer readable medium or transmitted as one or more instructions or code on a computer readable medium.
  • Computer readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one location to another.
  • a storage medium may be any available media that can be accessed by a general purpose or special purpose computer.
  • the disclosed systems, devices, and methods may be implemented in other manners without departing from the scope of the present application.
  • the embodiments described above are merely illustrative.
  • the division of the modules or units is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined. Or it can be integrated into another system, or some features can be ignored or not executed.
  • the units described as separate components may or may not be physically separated, and the components displayed as the unit may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. .
  • Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without any creative effort.
  • the described systems, devices, and methods, and the schematic diagrams of various embodiments may be combined or integrated with other systems, modules, techniques or methods without departing from the scope of the present application.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in electronic, mechanical or other form.

Landscapes

  • Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Optical Communication System (AREA)
  • Digital Transmission Methods That Use Modulated Carrier Waves (AREA)

Abstract

La présente invention concerne un procédé, un appareil, et un dispositif de communication par caméra. Le procédé consiste à : exécuter une modulation multi-amplitude sur des données devant être transmises, de sorte à obtenir une pluralité de trajets de signaux de modulation d'amplitude; ajouter une séquence prédéfinie avant chaque trajet de signaux de modulation d'amplitude, de sorte à obtenir un signal initial de chaque trajet; exécuter une SAM sur le signal initial de chaque trajet, de sorte à obtenir un signal de modulation de sous-porteuse de chaque trajet; et envoyer une pluralité de trajets de signaux de modulation de sous-porteuse à un dispositif d'extrémité de réception. Le procédé améliore l'utilisation du spectre d'un système de communication par caméra.
PCT/CN2017/072733 2017-01-26 2017-01-26 Procédé, appareil, et dispositif de communication par caméra WO2018137236A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201780076496.2A CN110073611B (zh) 2017-01-26 2017-01-26 相机通信的方法、装置和设备
PCT/CN2017/072733 WO2018137236A1 (fr) 2017-01-26 2017-01-26 Procédé, appareil, et dispositif de communication par caméra

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/072733 WO2018137236A1 (fr) 2017-01-26 2017-01-26 Procédé, appareil, et dispositif de communication par caméra

Publications (1)

Publication Number Publication Date
WO2018137236A1 true WO2018137236A1 (fr) 2018-08-02

Family

ID=62978839

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/072733 WO2018137236A1 (fr) 2017-01-26 2017-01-26 Procédé, appareil, et dispositif de communication par caméra

Country Status (2)

Country Link
CN (1) CN110073611B (fr)
WO (1) WO2018137236A1 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110492939A (zh) * 2019-08-30 2019-11-22 湖南工业大学 一种基于卷帘效应相机的可见光通信的间隔色移键控装置
WO2021127854A1 (fr) * 2019-12-23 2021-07-01 华为技术有限公司 Procédé et dispositif de télémétrie radar, radar et système embarqué

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103763029A (zh) * 2014-01-06 2014-04-30 南京复实通讯科技有限公司 可见光通信中的偏振复用系统、数据发送和接收方法
CN104038284A (zh) * 2014-06-10 2014-09-10 南京复实通讯科技有限公司 一种可见光通信的系统及方法
US20150372753A1 (en) * 2014-06-18 2015-12-24 Qualcomm Incorporated Transmission of identifiers using visible light communication
CN105281833A (zh) * 2014-06-13 2016-01-27 南京复实通讯科技有限公司 可见光信号传输方法及其系统

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3827082B2 (ja) * 2002-10-24 2006-09-27 株式会社中川研究所 放送システム及び電球、照明装置
KR20140092712A (ko) * 2013-01-16 2014-07-24 삼성전자주식회사 센싱 픽셀 및 이를 포함하는 이미지 센서
US9240837B2 (en) * 2013-03-12 2016-01-19 Google Inc. Systems and methods using optical communication for commissioning of network nodes
US20150011258A1 (en) * 2013-07-08 2015-01-08 Research In Motion Limited Imaging cover for a mobile communication device
CN106357331B (zh) * 2015-07-16 2019-04-23 北京全电智领科技有限公司 一种基于光强感知的可见光通信方法与系统
CN106253983A (zh) * 2016-08-08 2016-12-21 镇江明辉光信息科技有限公司 基于led的近距离点对点高速双向数据传输移动终端
CN106301555B (zh) * 2016-08-11 2019-01-15 北京大学 一种用于光定位的信号发射方法及发射机

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103763029A (zh) * 2014-01-06 2014-04-30 南京复实通讯科技有限公司 可见光通信中的偏振复用系统、数据发送和接收方法
CN104038284A (zh) * 2014-06-10 2014-09-10 南京复实通讯科技有限公司 一种可见光通信的系统及方法
CN105281833A (zh) * 2014-06-13 2016-01-27 南京复实通讯科技有限公司 可见光信号传输方法及其系统
US20150372753A1 (en) * 2014-06-18 2015-12-24 Qualcomm Incorporated Transmission of identifiers using visible light communication

Also Published As

Publication number Publication date
CN110073611A (zh) 2019-07-30
CN110073611B (zh) 2020-10-16

Similar Documents

Publication Publication Date Title
Luo et al. Undersampled-based modulation schemes for optical camera communications
US9203514B2 (en) Transmission system, transmitter and receiver
Lee et al. Rollinglight: Enabling line-of-sight light-to-camera communications
Ji et al. Vehicular visible light communications with LED taillight and rolling shutter camera
Luo et al. Undersampled phase shift ON-OFF keying for camera communication
KR102136914B1 (ko) 로우-레이트 가시광 통신 신호들을 디코딩하는 방법 및 장치
Luo et al. Experimental demonstration of a 1024-QAM optical camera communication system
KR100617679B1 (ko) 카메라 장치를 이용하여 가시광선 근거리 통신을 수행하는무선 단말기
KR102238006B1 (ko) 가시광 무선통신 장치 및 방법
Luo et al. Undersampled-PAM with subcarrier modulation for camera communications
CN104730536A (zh) 在飞行时间测距装置之间交换信息
KR102095668B1 (ko) Dsm-psk 광학 무선 송신 방법 및 장치
KR20130116483A (ko) 가시광 무선 통신 송수신 장치 및 방법
US11974078B2 (en) Digital signage by optical communication and supplemental downlink device and method using LED illumination
WO2018137236A1 (fr) Procédé, appareil, et dispositif de communication par caméra
Onodera et al. Adaptive N+ 1 color shift keying for optical camera communication
US11044017B2 (en) MIMO-OFDM of optical wireless system using screen
KR20170085953A (ko) 2d 컬러 코드 광학 무선 통신 방법 및 장치
Le et al. Frequency shift on-off keying for optical camera communication
KR101219663B1 (ko) 다중 반송파를 이용한 가시광 무선통신 시스템 및 그 방법
Niu et al. NECAS: Near field communication system for smartphones based on visible light
US20230336250A1 (en) Apparatus and method for optical wireless communication based on color m-ary frequency shift keying
Liu et al. Undersampled differential phase shift on-off keying for optical camera communications with phase error detection
WO2020166732A1 (fr) Procédé de transmission de signaux dans des communications en lumière visible et terminal pour cela
Tian et al. Design and experimental demonstration of a real-time 95kbps optical camera communication system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17893978

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17893978

Country of ref document: EP

Kind code of ref document: A1

点击 这是indexloc提供的php浏览器服务，不要输入任何密码和下载