+

US20220303677A1 - Beamforming techniques for acoustic interference cancellation - Google Patents

Beamforming techniques for acoustic interference cancellation Download PDF

Info

Publication number
US20220303677A1
US20220303677A1 US17/203,905 US202117203905A US2022303677A1 US 20220303677 A1 US20220303677 A1 US 20220303677A1 US 202117203905 A US202117203905 A US 202117203905A US 2022303677 A1 US2022303677 A1 US 2022303677A1
Authority
US
United States
Prior art keywords
signal
undesired
combined
generate
desired signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US17/203,905
Other versions
US11438695B1 (en
Inventor
Amos Schreibman
Anna Barnov
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GM Global Technology Operations LLC
Original Assignee
GM Global Technology Operations LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by GM Global Technology Operations LLC filed Critical GM Global Technology Operations LLC
Priority to US17/203,905 priority Critical patent/US11438695B1/en
Priority to DE102021129890.3A priority patent/DE102021129890B4/en
Priority to CN202111520500.4A priority patent/CN115116463A/en
Application granted granted Critical
Publication of US11438695B1 publication Critical patent/US11438695B1/en
Publication of US20220303677A1 publication Critical patent/US20220303677A1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • H04R3/005Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • G10L21/0216Noise filtering characterised by the method used for estimating noise
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/20Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/326Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only for microphones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/20Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/40Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers
    • H04R1/406Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers microphones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • G10L21/0216Noise filtering characterised by the method used for estimating noise
    • G10L2021/02161Number of inputs available containing the signal or the noise to be suppressed
    • G10L2021/02166Microphone arrays; Beamforming
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/40Details of arrangements for obtaining desired directional characteristic by combining a number of identical transducers covered by H04R1/40 but not provided for in any of its subgroups
    • H04R2201/4012D or 3D arrays of transducers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2430/00Signal processing covered by H04R, not provided for in its groups
    • H04R2430/20Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2430/00Signal processing covered by H04R, not provided for in its groups
    • H04R2430/20Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic
    • H04R2430/25Array processing for suppression of unwanted side-lobes in directivity characteristics, e.g. a blocking matrix
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2499/00Aspects covered by H04R or H04S not otherwise provided for in their subgroups
    • H04R2499/10General applications
    • H04R2499/13Acoustic transducers and sound field adaptation in vehicles

Definitions

  • the present disclosure relates generally to programming motor vehicle audio and sound suppression systems. More specifically, aspects of this disclosure relate to systems, methods and devices for robust interference tracking and cancellation to maintain desired source undistorted response for a multi microphone processing by utilizing an alternative scheme to the optimally tuned linearly constrained minimum variance (LCMV) beamformer for tracking and cancelling undesired noise sources.
  • LCMV linearly constrained minimum variance
  • Hands free calling has been widely implemented in modern vehicle so that the driver may conduct a two way voice conversation via a mobile phone, while not distracting the driver's hands and focus of attention.
  • Hands free calling uses a wireless connection to transfer audio data between the mobile phone and the vehicle infotainment system.
  • the driver's voice is captured by a microphone within the vehicle cabin and the remote party's voice is played via speakers within the vehicle cabin.
  • a problem arises in that sound from the speakers as well as the voices of other vehicle occupants and other ambient noises may be picked up by the microphone causing feedback and/or making the driver's voice unintelligible.
  • beamforming has been employed using multiple microphones to increase the sensitivity of the system towards the driver and attenuating sounds not originating from the driver position.
  • Linear constrained minimum variance (LCMV) beamforming is a multichannel signal processing technique used to enhance acoustic signals coming from a known direction and attenuating unwanted acoustic signals coming from other directions.
  • Beamforming techniques are widely used to enhance desired speech signals. They utilize spatial diversity of multiple microphones to enhance the desired speaker voice. For example, hands free calling systems in a vehicle cabin employs multiple microphones to enhance the driver voice under cabin noise and competing speakers within the environment. For that, the LCMV beamforming technique is commonly used.
  • the LCMV spatial notch pointing at the interference is usually very sharp, resulting in poor interference cancellation even for small movements of the interfering source. This fact calls for rapid tracking of the interfering source and frequent updates of the LCMV solution.
  • a user interface system for isolating a desired acoustic signal received by the vehicle microphones, performing a beamformer operation to isolate the desired acoustic signal, cancelling the desired signal from the undesired acoustic signal path, filtering the undesired acoustic signal path and cancelling an undesired signal within the desired signal path with the filtered undesired acoustic signal.
  • an apparatus including 2 or more microphones to receive an incoming acoustic signal including a desired acoustic signal and an undesired acoustic signal, a signal processor configured to perform a first beamforming operation on the incoming acoustic signal to isolate the desired signal from the incoming acoustic signal, to perform a second beamforming operation to isolate the undesired signal from the incoming acoustic signal, filtering the desired signal to generate a filtered desired signal, combining an inverse of the filtered desired signal with the undesired signal to generate a combined undesired signal, filtering the combined undesired signal to generate a filtered combined undesired signal and combining an inverse of the filtered combined undesired signal and the desired signal to generate an output signal, and a communications processor to generate a data signal in response to the output signal for transmission via a wireless network.
  • the microphone array includes a plurality of microphones within a vehicle passenger cabin.
  • the first beamforming operation on the incoming acoustic signal is further configured to apply a linear weight to a phase angle of the undesired signal.
  • the filtering of the desired signal is an adaptive filtering with a frequency centered on the frequency of the desired signal.
  • the second beamforming operation on the incoming acoustic signal is further configured to apply a linear weight to a phase angle of the desired signal.
  • the desired signal includes an outgoing portion of a bidirectional voice communications and wherein the wireless network includes a cellular network.
  • the undesired signal originates from a first source at a first location within a vehicle cabin and the desired signal originates from a second source at a second location within the vehicle cabin.
  • a method including receiving, via a plurality of microphones, an incoming acoustic signal including a desired signal and an undesired signal, perform a first beamforming operation, by a signal processor, on the incoming to isolate the desired signal from the incoming acoustic signal, performing a second beamforming operation, by the signal processor, to isolate the undesired signal from the incoming acoustic signal, filtering, by the signal processor, the desired signal to generate a filtered desired signal, combining an inverse of the filtered desired signal with the undesired signal to generate a combined undesired signal, filtering, by the signal processor, the combined undesired signal to generate a filtered combined undesired signal, combining, by the signal processor, an inverse of the filtered combined undesired signal and the desired signal to generate an output signal, and generating, by a communications processor, a data signal in response to the output signal for transmission via a wireless network.
  • microphone array includes a plurality of microphones within a vehicle passenger cabin.
  • the second beamforming operation on the incoming acoustic signal is further configured to apply a linear weight to a phase angle of the desired signal.
  • the filtering of the desired signal is an adaptive filtering with a frequency centered on the frequency of the desired signal.
  • the first beamforming operation on the incoming acoustic signal is further configured to apply a linear weight to a phase angle of the undesired signal.
  • the undesired signal originates from a first source at a first location within a vehicle cabin and the desired signal originates from a second source at a second location within the vehicle cabin.
  • the desired signal an outgoing portion of a bidirectional voice communications and wherein the wireless network is a cellular network.
  • a hands-free telecommunications system within a vehicle cabin including a plurality of microphones to receive an incoming acoustic signal including a desired signal and an undesired signal, an analog to digital converter to convert the incoming acoustic signal to a digital signal including the desired voice signal and the undesired voice signal, a digital signal processor to perform a first beamforming operation on the digital signal to isolate the desired signal from the digital signal, to perform a second beamforming operation to isolate the undesired signal from the digital signal, filtering the desired signal to generate a filtered desired signal, combining an inverse of the filtered desired signal with the undesired signal to generate a combined undesired signal, filtering the combined undesired signal to generate a filtered combined undesired signal and combining an inverse of the filtered combined undesired signal and the desired signal to generate an output signal, and a communications processor to generate a data signal in response to the output signal for transmission via a wireless network
  • the first beamforming operation on the incoming acoustic signal is further configured to apply a linear weight to a phase angle of the undesired signal.
  • FIG. 1 shows an operating environment for providing beamforming techniques for acoustic interference cancellation in a bidirectional vehicle communications system according to an exemplary embodiment.
  • FIG. 2 shows a block diagram illustrating an exemplary system for providing beamforming techniques for acoustic interference cancellation in a bidirectional vehicle communications system according to an exemplary embodiment.
  • FIG. 3 shows a flow chart illustrating an exemplary method for providing beamforming techniques for acoustic interference cancellation in a bidirectional vehicle communications system according to another exemplary embodiment.
  • FIG. 5 shows a flow chart illustrating another exemplary method for providing beamforming techniques for acoustic interference cancellation in a bidirectional vehicle communications system according to another exemplary embodiment.
  • FIG. 1 shows an operating environment for providing beamforming techniques for acoustic interference cancellation in a bidirectional vehicle communications system according to an exemplary embodiment.
  • the exemplary environment 100 shows a vehicle cabin 110 with a plurality of speakers 120 and a microphone array 130 coupled to a communications system 140 . Within the vehicle cabin 110 there are also a plurality of vehicle occupant seating positions 125 .
  • Each of the plurality of speakers 120 may be configured to receive an incoming portion of an audio conversation from a communications system 140 and to broadcast the incoming portion within the vehicle cabin 110 .
  • Each of the plurality of microphones within the microphone array 130 is operative to receive an outgoing portion of an audio conversation and to transmit this outgoing portion to the communications system 140 for transmission via a wireless network, such as a cellular telephone network or the like.
  • the communications system 140 may include a signal processor for performing a beamforming operation, such as a minimum variance distortionless response (MVDR) beamforming operation.
  • MVDR minimum variance distortionless response
  • An MVDR beamformer produces a distortionless response in the direction of the signal of interest due to a linear weight at the phase angle of the signal of interest while attenuating other signals from different directions.
  • the exemplary system may track and cancel undesired signals from other sources, while keeping the desired source intact.
  • the exemplary system may achieve the optimal performance that can be achieved by a perfectly tuned LCMV beamformer while introducing high robustness and low complexity implementation, which will ensure superior performance in the end product.
  • the illustrated embodiment has been simplified for ease of understanding, and that the bidirectional communications system 100 may include additional devices, processing modules, and elements that support additional features and functions that need not be described in detail here.
  • the vehicle cabin 110 will include many conventional features, subsystems, and components that are commonly found in modern vehicles. Such conventional aspects of the vehicle cabin 110 will not be described here.
  • FIG. 2 a block diagram illustrating an exemplary implementation of a system 200 for providing beamforming techniques for acoustic interference cancellation in a bidirectional vehicle communications system is shown.
  • the system exemplary 200 may include a plurality of microphones 210 arranged into a microphone array, a desired source S 0 , an undesired source S 1 , a first acoustic transfer function h 0 , a second acoustic transfer function h 1 , a desired signal beamformer 212 , an undesired signal beamformer 215 , a first mixer 225 a second mixer 235 a first adaptive filter 220 and a second adaptive filter 230 .
  • the plurality of microphones 210 may include two or more microphones located as an array at a location within a vehicle cabin, or may include a plurality of microphones positioned at different positions within a vehicle cabin.
  • the objective of the system 200 is threefold: 1) maintain a distortion less response toward the desired speaker, 2) cancel the undesired source, 3) minimize the noise power at the output signal. This is performed in two stages; the first stage will generate two distortion-less responses with respect to each of the sources in order to minimize the noise in the output signal. The second stage will employ Adaptive Filter (AF) techniques in order to cancel the undesired source from the desired signal.
  • AF Adaptive Filter
  • the particular two stage approach is similar to a Linearly Constrained Minimum Variance (LCMV) beam-former performance with a distortion less constraint towards the desired source and complete cancellation constraint toward the un-desired source.
  • the desired source S 0 emits a desired signal to be enhanced and transmitted by the system 200 .
  • the desired source S 0 may be a vehicle occupant emitting a desired voice signal.
  • the acoustic transfer function h 0 between the desired source S 0 and the plurality of microphones 210 is dependent on the source direction with respect to the microphone array, the transmission medium, reflective surfaces within the environment and defines the relationship between the sound level of the source and the sound level received at the plurality of microphones 210 .
  • the undesirable signal S 1 may be a voice of a second occupant, vehicle engine noise or other point source of undesirable noise or the like.
  • the plurality of microphones 210 are configured to receive both the signal of interest from the desired source S 0 and the undesired signal from the undesirable source S 1 via the acoustic transfer function h 1 between the undesired source S 1 and the plurality of microphones 210 .
  • the plurality of microphones may also include an analog to digital converter for converting the received acoustic signals, such as the desired signal and the undesired signal, into digital acoustic signals.
  • a combined signal X including both the desired signal and the undesired signal is coupled the first stages of the interference cancelling system, and is defined by:
  • the signal X is coupled to a desired signal first stage beamformer 212 for application of a first beamformer weight W 0 of the interference canceller on a desired signal path and an undesired signal first stage beamformer 215 for application of a second beamformer weight W 1 of the interference canceller on the undesired signal path.
  • the beamformer weights W 0 , W 1 can be configured by applying an MVDR criterion resulting in two beamformer weights W 0 , W 1 as defined by
  • the signals output from each of the first stage MVDRs are defined by:
  • v is a variable noise component
  • adaptive filters may be employed to further reduce the undesired signal components.
  • the undesired signal S 1 would be removed from X thereby leaving only the desired signal S 0 .
  • the LCMV directional notch filter pointing toward the undesired source is very sharp calling for the LCMV filter to be updated for every movement of S 1 which is a computational heavy process.
  • An adaptive filter can track the changes in the location of S 1 therefore making the LCMV tracking problem irrelevant.
  • the current proposed system employs a first adaptive filter 220 to first remove components of S 0 from Y 1 .
  • the desired signal canceller weight a 0 of the first adaptive filter 220 may be defined by:
  • a 0 h 0 H ⁇ ⁇ V - 1 ⁇ h 1 h 1 H ⁇ ⁇ V - 1 ⁇ h 1
  • y 2 sin 2 ( ⁇ ) ⁇ s 1 + h 1 H ⁇ ⁇ V - 1 ⁇ T 0 H h 1 H ⁇ ⁇ V - 1 ⁇ h 1 ⁇ v
  • sin 2 ( ⁇ ) ( 1 - ⁇ " ⁇ [LeftBracketingBar]" h 0 H ⁇ ⁇ V - 1 ⁇ h 1 ⁇ " ⁇ [RightBracketingBar]" 2 h 0 H ⁇ ⁇ V - 1 ⁇ h 0 ⁇ h 1 H ⁇ ⁇ V - 1 ⁇ h 1 )
  • the clean reference signal Y 2 may then be applied to the second adaptive filter 230 defined by:
  • a 1 h 1 H ⁇ ⁇ V - 1 ⁇ h 0 h 0 H ⁇ ⁇ V - 1 ⁇ h 0 ⁇ sin 2 ( ⁇ )
  • the embodiment 200 produces a distortion less response toward S 0 , and achieves complete cancellation toward the undesired signal S 1 .
  • the noise output energy is identical to the performance of an LCMV beamformer under the same constraints, thereby making the performance of the suggested embodiment identical to that of an LCMV beamformer.
  • FIG. 3 a flow chart illustrating an exemplary implementation of a method 300 for providing beamforming techniques for acoustic interference cancellation in a bidirectional vehicle communications system is shown.
  • the method is operative for receiving 310 an acoustic signal at a microphone array where the acoustic signal includes a desired audio signal and an undesired audio signal.
  • the desired audio signal may include a voice of a driver and the undesired signal may include a backseat conversation or a mechanical noise.
  • the microphone array may be comprised of a plurality of microphones arranged at various positions around a vehicle cabin.
  • a first beamforming weight is next applied 320 to the acoustic signal to isolate the desired signal and to attenuate the undesired signal.
  • the results of the beamformer is a preserved desired signal with a filtered undesired signal.
  • the method further applies 330 an acoustic signal to a second beamforming weight to generate a reference signal.
  • the reference signal may isolate the undesired signal and filter the desired signal.
  • the method next applies 340 a first adaptive filter to the preserved desired signal to further isolate the desired signal and suppress the undesired signal.
  • the filtered desired signal is then inverted and combined 350 with the reference signal to suppress the desired signal within the reference signal and to further isolate the undesired signal.
  • a second adaptive filter is then applied 360 to the reference signal to approximate the undesired signal.
  • the filtered reference signal is then inverted and combined 370 with the desired signal to generate an output signal.
  • the output signal is then coupled 380 to a communications processor or the like for further processing.
  • FIG. 4 a block diagram illustrating another exemplary implementation of a system 400 for providing beamforming techniques for acoustic interference cancellation in a bidirectional vehicle communications system is shown.
  • the exemplary system 400 may form a portion of a vehicle cabin hands free telecommunications system including a communications processor 410 , a signal processor 420 , a first microphone 430 and a second microphone 440 , wherein first microphone 430 and the second microphone 440 form a portion of an antenna array 450 .
  • the communications processor 410 is operative to process signals received via a wireless network, such as from a cellular telephone or data network, and to prepare signals for transmission via a wireless network.
  • the communications processor 410 may be configured to receive audio signals from the signal processor 420 , to format the audio signal into a format suitable for transmission via a communications network or the like and to couple this formatted audio signal to a network interface, a universal serial port, an antenna or other transmission means.
  • the communications processor 410 may be further configured for generating a speaker signal representative of an audio signal, for coupling to a speaker or the like for broadcasting within a vehicle cabin.
  • the exemplary system 400 may further include a microphone array 450 including a first microphone 430 and a second microphone 440 , for receiving acoustic signals.
  • the microphone array 450 may be mounted within a vehicle cabin for receive a desired acoustic voice signal from a participant in a hand free calling session.
  • the participant may be a vehicle operator engaging in a hand free telephone call via a mobile device connected to a vehicle infotainment system where received voice acoustic signals are broadcast within the vehicle cabin by infotainment system speakers and the outgoing voice acoustic signals, such as the operator's voice, is detected by the microphone array 450 and coupled to the signal processor 420 for further processing before transmission via a wireless network.
  • the transmission and reception of the wireless network signals may be made by the mobile device.
  • the vehicle may include a wireless communications system for transmitting and receiving data via the wireless network.
  • the microphone array 450 is configured to receive an incoming acoustic signal including a desired acoustic signal and an undesired acoustic signal.
  • the desired acoustic signal may be a conversation participants voice and the undesired signal may be another occupant's voice, vehicle system noise, or other noise from a source within the vehicle cabin.
  • the microphone array 450 may couple the incoming acoustic signal to a signal processor 420 or the like.
  • the microphone array 450 may include an analog to digital converter, a tuner and/or downconverter for altering the frequency of the incoming acoustic signal.
  • the signal processor 420 may be configured to perform a first beamforming operation on the incoming acoustic signal to isolate the desired signal from the incoming acoustic signal in a first signal path.
  • the first signal path may be a desired signal path.
  • the first beamforming operation on the incoming acoustic signal may include applying a linear weight to a phase angle of the undesired signal.
  • the signal processor 420 may be further configured to perform a second beamforming operation to isolate the undesired signal from the incoming acoustic signal in a second signal path.
  • the second signal path may be an undesired signal path.
  • the second beamforming operation on the incoming acoustic signal may include applying a linear weight to a phase angle of the desired signal.
  • the signal processor 420 may be configured to perform a plurality of beamforming operations to isolate multiple desired signals and/or multiple undesired signals and generate an output signal including the multiple desired signals according to the described systems and methods.
  • the signal processor 420 may next filter the desired signal to generate a filtered desired signal.
  • the filtering may be performed using an adaptive filtering algorithm or the like.
  • the filtering of the desired signal may be an adaptive filtering operation with a frequency centered on the frequency of the desired signal.
  • the filtered desired signal may include the desired signal with other signals attenuated by the filtering process.
  • the adaptive filtering algorithm may attenuate any remaining undesired signal from the incoming acoustic signal that may remain after the first beamforming operation.
  • the signal processor 420 is next operative to combines an inverse of the filtered desired signal with the undesired signal to generate a combined undesired signal. This may have the desirable effect of cancelling or further attenuating any desired signal remaining within the undesired signal path after the second beamforming operation.
  • the processor 420 is next operative for filtering the combined undesired signal to generate a filtered combined undesired signal. This filtering process may be an adaptive filtering processor to further reduce any desired signal that may remain in the undesired signal path.
  • the signal processor 420 may then combine an inverse of the combined undesired signal and the desired signal to generate an output signal, thereby cancelling all, or a portion, of any remaining undesired signal within the desired signal path.
  • the signal processor 420 may then couple the output signal to the communications processor 410 to generate a data signal in response to the output signal for transmission via a wireless network.
  • the system 400 may be a hands-free telecommunications system within a vehicle cabin including a microphone array 450 to receive an incoming acoustic signal including a desired signal and an undesired signal and an analog to digital converter to convert the incoming acoustic signal to a digital signal including the desired voice signal and the undesired voice signal.
  • the system may further include a processor 420 , such as a digital signal processor, to perform a first beamforming operation on the digital signal to isolate the desired signal from the digital signal, to perform a second beamforming operation to isolate the undesired signal from the digital signal, filtering the desired signal to generate a filtered desired signal, combining an inverse of the filtered desired signal with the undesired signal to generate a combined undesired signal, filtering the combined undesired signal to generate a filtered combined undesired signal and combining an inverse of the combined undesired signal and the desired signal to generate an output signal.
  • the first operation and/or the second beamforming operation may apply a linear weight to a phase angle of the undesired signal.
  • Some exemplary systems 400 may further include a communications processor to generate a data signal in response to the output signal for transmission via a wireless network.
  • the exemplary method 500 is first operative for receiving 510 , via a microphone array, an incoming acoustic signal including a desired signal and an undesired signal.
  • the microphone array may include a plurality of microphones within a vehicle passenger cabin.
  • the undesired signal originates from a first source at a first location within a vehicle cabin and the desired signal originates from a second source at a second location within the vehicle cabin.
  • the desired signal an outgoing portion of a bidirectional voice communications and wherein the wireless network is a cellular network.
  • the method is next operative to perform 520 a first beamforming operation, by a signal processor, on the incoming to isolate the desired signal from the incoming acoustic signal; the first beamforming operation on the incoming acoustic signal is further configured to apply a linear weight to a phase angle of the undesired signal.
  • a second beamforming operation is performed 530 by the signal processor, to isolate the undesired signal from the incoming acoustic signal; the second beamforming operation on the incoming acoustic signal is further configured to apply a linear weight to a phase angle of the desired signal.
  • the desired signal that was partially isolated by the first beamforming operation is then filtered 540 by the signal processor to further attenuate any remaining undesired signal to generate a filtered desired signal.
  • the filtering of the desired signal may be an adaptive filtering with a frequency centered on the frequency of the desired signal.
  • the filtered desired signal is next inverted and combined 545 with the undesired signal to generate a combined undesired signal.
  • Adding the inverse of the desired signal to the undesired signal within the undesired signal path has the advantageous of cancelling or reducing the amplitude of any desired signal remaining in the undesired signal path after the second beamforming operation.
  • the combined undesired signal is next filtered 550 , by the signal processor, to further suppress any remaining desired signal or other noise to generate a filtered combined undesired signal.
  • the filtering of the combined undesired signal may estimate the undesired signal component as received by the desired signal path.
  • the method next combines 560 , by the signal processor, an inverse of the combined undesired signal and the desired signal to generate an output signal.
  • This combining of the signals advantageously attenuates the undesired signal present on the desired signal path after the first beamforming operation. Furthermore, since the desired signal has been greatly attenuated on the undesired signal path, the desired signal on the desired signal is not significantly impacted by a combination of the inverse of the desired signal on the undesired signal path.
  • a communications processor may be configured for generating 570 a data signal in response to the output signal for transmission via a wireless network.
  • the output signal may be coupled to the communications processor by the signal processor or other device.
  • the wireless network may be a cellular communications or wireless data communications network or may be a vehicle to vehicle, vehicle to infrastructure, or vehicle to all communications.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Acoustics & Sound (AREA)
  • Otolaryngology (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Multimedia (AREA)
  • Quality & Reliability (AREA)
  • Computational Linguistics (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

The present application relates to a system and method for receiving, via a microphone array, an incoming acoustic signal including a desired signal and an undesired signal, performing a first minimum variance distortionless response beamforming operation on the incoming acoustic signal to isolate the desired signal, performing a second minimum variance distortionless response beamforming operation, by the signal processor, on the incoming acoust signal to isolate the undesired signal, filtering the desired signal to generate a filtered desired signal, combining an inverse of the filtered desired signal with the undesired signal to generate a combined undesired signal, filtering the combined undesired signal to generate a filtered combined undesired signal, combining an inverse of the combined undesired signal and the desired signal to generate an output signal, and generating a data signal in response to the output signal for transmission via a wireless network.

Description

    BACKGROUND
  • The present disclosure relates generally to programming motor vehicle audio and sound suppression systems. More specifically, aspects of this disclosure relate to systems, methods and devices for robust interference tracking and cancellation to maintain desired source undistorted response for a multi microphone processing by utilizing an alternative scheme to the optimally tuned linearly constrained minimum variance (LCMV) beamformer for tracking and cancelling undesired noise sources.
  • Driver attentiveness is a primary factor in safe vehicle operation. With the increased use of mobile devices and vehicle automation, the opportunities for driver distraction continue to increase. Hands free calling has been widely implemented in modern vehicle so that the driver may conduct a two way voice conversation via a mobile phone, while not distracting the driver's hands and focus of attention. Hands free calling uses a wireless connection to transfer audio data between the mobile phone and the vehicle infotainment system. The driver's voice is captured by a microphone within the vehicle cabin and the remote party's voice is played via speakers within the vehicle cabin. A problem arises in that sound from the speakers as well as the voices of other vehicle occupants and other ambient noises may be picked up by the microphone causing feedback and/or making the driver's voice unintelligible. To address this problem, beamforming has been employed using multiple microphones to increase the sensitivity of the system towards the driver and attenuating sounds not originating from the driver position.
  • Linear constrained minimum variance (LCMV) beamforming is a multichannel signal processing technique used to enhance acoustic signals coming from a known direction and attenuating unwanted acoustic signals coming from other directions. Beamforming techniques are widely used to enhance desired speech signals. They utilize spatial diversity of multiple microphones to enhance the desired speaker voice. For example, hands free calling systems in a vehicle cabin employs multiple microphones to enhance the driver voice under cabin noise and competing speakers within the environment. For that, the LCMV beamforming technique is commonly used. The LCMV spatial notch pointing at the interference is usually very sharp, resulting in poor interference cancellation even for small movements of the interfering source. This fact calls for rapid tracking of the interfering source and frequent updates of the LCMV solution. High cadence updates of the LCMV beamformer are computationally expensive and can lead to poor noise cancellation especially for GSC based LCMV implementation. It is desirable to address these problems to provide improved beamforming techniques for acoustic interference cancellation. The above information disclosed in this background section is only for enhancement of understanding of the background of the invention and therefore it may contain information that does not form the prior art that is already known in this country to a person of ordinary skill in the art.
  • SUMMARY
  • Disclosed herein are vehicle communications systems, vehicle user interface systems and related control logic for provisioning vehicle user interface systems, methods for making and methods for operating such systems, and motor vehicles equipped with user interface systems. By way of example, and not limitation, there is presented a user interface system for isolating a desired acoustic signal received by the vehicle microphones, performing a beamformer operation to isolate the desired acoustic signal, cancelling the desired signal from the undesired acoustic signal path, filtering the undesired acoustic signal path and cancelling an undesired signal within the desired signal path with the filtered undesired acoustic signal.
  • In accordance with an aspect of the present disclosure, an apparatus including 2 or more microphones to receive an incoming acoustic signal including a desired acoustic signal and an undesired acoustic signal, a signal processor configured to perform a first beamforming operation on the incoming acoustic signal to isolate the desired signal from the incoming acoustic signal, to perform a second beamforming operation to isolate the undesired signal from the incoming acoustic signal, filtering the desired signal to generate a filtered desired signal, combining an inverse of the filtered desired signal with the undesired signal to generate a combined undesired signal, filtering the combined undesired signal to generate a filtered combined undesired signal and combining an inverse of the filtered combined undesired signal and the desired signal to generate an output signal, and a communications processor to generate a data signal in response to the output signal for transmission via a wireless network.
  • In accordance with another aspect of the present disclosure, wherein the microphone array includes a plurality of microphones within a vehicle passenger cabin.
  • In accordance with another aspect of the present disclosure, wherein the first beamforming operation on the incoming acoustic signal is further configured to apply a linear weight to a phase angle of the undesired signal.
  • In accordance with another aspect of the present disclosure, wherein the filtering of the desired signal is an adaptive filtering with a frequency centered on the frequency of the desired signal.
  • In accordance with another aspect of the present disclosure, wherein the second beamforming operation on the incoming acoustic signal is further configured to apply a linear weight to a phase angle of the desired signal.
  • In accordance with another aspect of the present disclosure, wherein the desired signal includes an outgoing portion of a bidirectional voice communications and wherein the wireless network includes a cellular network.
  • In accordance with another aspect of the present disclosure, wherein the filtering of the desired signal attenuates the undesired signal with the desired signal.
  • In accordance with another aspect of the present disclosure, wherein the filtering of the combined undesired signal attenuates the desired signal with the combined undesired signal.
  • In accordance with another aspect of the present disclosure, wherein the undesired signal originates from a first source at a first location within a vehicle cabin and the desired signal originates from a second source at a second location within the vehicle cabin.
  • In accordance with another aspect of the present disclosure, a method including receiving, via a plurality of microphones, an incoming acoustic signal including a desired signal and an undesired signal, perform a first beamforming operation, by a signal processor, on the incoming to isolate the desired signal from the incoming acoustic signal, performing a second beamforming operation, by the signal processor, to isolate the undesired signal from the incoming acoustic signal, filtering, by the signal processor, the desired signal to generate a filtered desired signal, combining an inverse of the filtered desired signal with the undesired signal to generate a combined undesired signal, filtering, by the signal processor, the combined undesired signal to generate a filtered combined undesired signal, combining, by the signal processor, an inverse of the filtered combined undesired signal and the desired signal to generate an output signal, and generating, by a communications processor, a data signal in response to the output signal for transmission via a wireless network.
  • In accordance with another aspect of the present disclosure, wherein microphone array includes a plurality of microphones within a vehicle passenger cabin.
  • In accordance with another aspect of the present disclosure, wherein the second beamforming operation on the incoming acoustic signal is further configured to apply a linear weight to a phase angle of the desired signal.
  • In accordance with another aspect of the present disclosure, wherein the filtering of the desired signal is an adaptive filtering with a frequency centered on the frequency of the desired signal.
  • In accordance with another aspect of the present disclosure, wherein the first beamforming operation on the incoming acoustic signal is further configured to apply a linear weight to a phase angle of the undesired signal.
  • In accordance with another aspect of the present disclosure, wherein the filtering of the desired signal attenuates the undesired signal with the desired signal.
  • In accordance with another aspect of the present disclosure, wherein the filtering of the combined undesired signal attenuates the desired signal with the combined undesired signal.
  • In accordance with another aspect of the present disclosure, wherein the undesired signal originates from a first source at a first location within a vehicle cabin and the desired signal originates from a second source at a second location within the vehicle cabin.
  • In accordance with another aspect of the present disclosure, wherein the desired signal an outgoing portion of a bidirectional voice communications and wherein the wireless network is a cellular network.
  • In accordance with another aspect of the present disclosure, a hands-free telecommunications system within a vehicle cabin including a plurality of microphones to receive an incoming acoustic signal including a desired signal and an undesired signal, an analog to digital converter to convert the incoming acoustic signal to a digital signal including the desired voice signal and the undesired voice signal, a digital signal processor to perform a first beamforming operation on the digital signal to isolate the desired signal from the digital signal, to perform a second beamforming operation to isolate the undesired signal from the digital signal, filtering the desired signal to generate a filtered desired signal, combining an inverse of the filtered desired signal with the undesired signal to generate a combined undesired signal, filtering the combined undesired signal to generate a filtered combined undesired signal and combining an inverse of the filtered combined undesired signal and the desired signal to generate an output signal, and a communications processor to generate a data signal in response to the output signal for transmission via a wireless network.
  • In accordance with another aspect of the present disclosure, wherein the first beamforming operation on the incoming acoustic signal is further configured to apply a linear weight to a phase angle of the undesired signal.
  • The above advantage and other advantages and features of the present disclosure will be apparent from the following detailed description of the preferred embodiments when taken in connection with the accompanying drawings.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The above-mentioned and other features and advantages of this invention, and the manner of attaining them, will become more apparent and the invention will be better understood by reference to the following description of embodiments of the invention taken in conjunction with the accompanying drawings.
  • FIG. 1 shows an operating environment for providing beamforming techniques for acoustic interference cancellation in a bidirectional vehicle communications system according to an exemplary embodiment.
  • FIG. 2 shows a block diagram illustrating an exemplary system for providing beamforming techniques for acoustic interference cancellation in a bidirectional vehicle communications system according to an exemplary embodiment.
  • FIG. 3 shows a flow chart illustrating an exemplary method for providing beamforming techniques for acoustic interference cancellation in a bidirectional vehicle communications system according to another exemplary embodiment.
  • FIG. 4 shows a block diagram illustrating another exemplary system for providing beamforming techniques for acoustic interference cancellation in a bidirectional vehicle communications system according to another exemplary embodiment.
  • FIG. 5 shows a flow chart illustrating another exemplary method for providing beamforming techniques for acoustic interference cancellation in a bidirectional vehicle communications system according to another exemplary embodiment.
  • The exemplifications set out herein illustrate preferred embodiments of the invention, and such exemplifications are not to be construed as limiting the scope of the invention in any manner.
  • DETAILED DESCRIPTION
  • Embodiments of the present disclosure are described herein. It is to be understood, however, that the disclosed embodiments are merely examples and other embodiments can take various and alternative forms. The figures are not necessarily to scale; some features could be exaggerated or minimized to show details of particular components. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting but are merely representative. The various features illustrated and described with reference to any one of the figures can be combined with features illustrated in one or more other figures to produce embodiments that are not explicitly illustrated or described. The combinations of features illustrated provide representative embodiments for typical applications. Various combinations and modifications of the features consistent with the teachings of this disclosure, however, could be desired for particular applications or implementations.
  • FIG. 1 shows an operating environment for providing beamforming techniques for acoustic interference cancellation in a bidirectional vehicle communications system according to an exemplary embodiment. The exemplary environment 100 shows a vehicle cabin 110 with a plurality of speakers 120 and a microphone array 130 coupled to a communications system 140. Within the vehicle cabin 110 there are also a plurality of vehicle occupant seating positions 125. Each of the plurality of speakers 120 may be configured to receive an incoming portion of an audio conversation from a communications system 140 and to broadcast the incoming portion within the vehicle cabin 110. Each of the plurality of microphones within the microphone array 130 is operative to receive an outgoing portion of an audio conversation and to transmit this outgoing portion to the communications system 140 for transmission via a wireless network, such as a cellular telephone network or the like.
  • An array of microphones 130 are employed to allow for beamforming the directivity of the array in order to enhance the sound detection sensitivity in some directions while reducing the sensitivity in other directions. For example, in an automotive application it is desirable to have greater sensitivity in direction of the driver's head while reducing sensitivity in the direction of the speakers. The communications system 140 may include a signal processor for performing a beamforming operation, such as a minimum variance distortionless response (MVDR) beamforming operation. An MVDR beamformer produces a distortionless response in the direction of the signal of interest due to a linear weight at the phase angle of the signal of interest while attenuating other signals from different directions. The exemplary system may track and cancel undesired signals from other sources, while keeping the desired source intact. The exemplary system may achieve the optimal performance that can be achieved by a perfectly tuned LCMV beamformer while introducing high robustness and low complexity implementation, which will ensure superior performance in the end product.
  • It should be appreciated that the illustrated embodiment has been simplified for ease of understanding, and that the bidirectional communications system 100 may include additional devices, processing modules, and elements that support additional features and functions that need not be described in detail here. Likewise, those skilled in the art will recognize that an embodiment of the vehicle cabin 110 will include many conventional features, subsystems, and components that are commonly found in modern vehicles. Such conventional aspects of the vehicle cabin 110 will not be described here.
  • Turning now to FIG. 2, a block diagram illustrating an exemplary implementation of a system 200 for providing beamforming techniques for acoustic interference cancellation in a bidirectional vehicle communications system is shown. The system exemplary 200 may include a plurality of microphones 210 arranged into a microphone array, a desired source S0, an undesired source S1, a first acoustic transfer function h0, a second acoustic transfer function h1, a desired signal beamformer 212, an undesired signal beamformer 215, a first mixer 225 a second mixer 235 a first adaptive filter 220 and a second adaptive filter 230. In some embodiments, some of these components may be functions performed by a signal processor 255, such as a digital signal processor or the like. The plurality of microphones 210 may include two or more microphones located as an array at a location within a vehicle cabin, or may include a plurality of microphones positioned at different positions within a vehicle cabin.
  • Consider an enclosure with 2 sources, a desired source So and an undesired source S1. The sources are impinging on the plurality of microphones 210. There exists a first acoustic transfer function h0, and a second acoustic transfer function h1 between each source S0, S1 and the plurality of microphones 210. A noise signal (v) consisting of any combination of white, diffused and directional noises is picked up by the microphone array 210. The noise coherence matrix is denoted as ΦV and assumed to be Hermitian ΦDV=ΦH V. The objective of the system 200 is threefold: 1) maintain a distortion less response toward the desired speaker, 2) cancel the undesired source, 3) minimize the noise power at the output signal. This is performed in two stages; the first stage will generate two distortion-less responses with respect to each of the sources in order to minimize the noise in the output signal. The second stage will employ Adaptive Filter (AF) techniques in order to cancel the undesired source from the desired signal.
  • The particular two stage approach is similar to a Linearly Constrained Minimum Variance (LCMV) beam-former performance with a distortion less constraint towards the desired source and complete cancellation constraint toward the un-desired source. The desired source S0 emits a desired signal to be enhanced and transmitted by the system 200. For example, the desired source S0 may be a vehicle occupant emitting a desired voice signal. The acoustic transfer function h0 between the desired source S0 and the plurality of microphones 210 is dependent on the source direction with respect to the microphone array, the transmission medium, reflective surfaces within the environment and defines the relationship between the sound level of the source and the sound level received at the plurality of microphones 210. The undesirable signal S1 may be a voice of a second occupant, vehicle engine noise or other point source of undesirable noise or the like. The plurality of microphones 210 are configured to receive both the signal of interest from the desired source S0 and the undesired signal from the undesirable source S1 via the acoustic transfer function h1 between the undesired source S1 and the plurality of microphones 210. The plurality of microphones may also include an analog to digital converter for converting the received acoustic signals, such as the desired signal and the undesired signal, into digital acoustic signals.
  • After the desired signal and the undesired signal are received at the plurality of microphones, a combined signal X including both the desired signal and the undesired signal is coupled the first stages of the interference cancelling system, and is defined by:

  • x=h 0 s 0 +h 1 s 1 +v
  • In a first signal path, the signal X is coupled to a desired signal first stage beamformer 212 for application of a first beamformer weight W0 of the interference canceller on a desired signal path and an undesired signal first stage beamformer 215 for application of a second beamformer weight W1 of the interference canceller on the undesired signal path. The beamformer weights W0, W1 can be configured by applying an MVDR criterion resulting in two beamformer weights W0, W1 as defined by
  • w i = Φ V - 1 h i h i H Φ V - 1 h i , i = [ 0 , 1 ]
  • The signals output from each of the first stage MVDRs are defined by:
  • y 0 = w 0 H x = s 0 + h 0 H Φ V - 1 h i h 0 H Φ V - 1 h 0 s 1 + h 0 H Φ V - 1 h 0 H Φ V - 1 h 0 v y 1 = w 1 H x = s 1 + h 1 H Φ V - 1 h 0 h 1 H Φ V - 1 h 1 s 0 + h 1 H Φ V - 1 h 1 H Φ V - 1 h 1 v
  • where v is a variable noise component.
  • After the first stages of the MVDR, adaptive filters may be employed to further reduce the undesired signal components. Typically in an LCMV application, the undesired signal S1 would be removed from X thereby leaving only the desired signal S0. However, the LCMV directional notch filter pointing toward the undesired source is very sharp calling for the LCMV filter to be updated for every movement of S1 which is a computational heavy process. Instead the use of adaptive filtering technique as portrayed by system 200 is suggested. An adaptive filter can track the changes in the location of S1therefore making the LCMV tracking problem irrelevant. A problem arises when using a simple adaptive filter between Y0 and Y1 in that the undesired signal Y1 may still include attenuated components of S0, so when Y1 is removed from Y0 some of the desired signal S0 may be removed from Y0 resulting in some self cancellation. The current proposed system employs a first adaptive filter 220 to first remove components of S0 from Y1. The desired signal canceller weight a0 of the first adaptive filter 220 may be defined by:
  • a 0 = h 0 H Φ V - 1 h 1 h 1 H Φ V - 1 h 1
  • After the desired signal is filtered using weight a0 and is deducted from the signal Y1, using the first mixer 225 to generate the clean reference channel Y2 defined by:
  • y 2 = sin 2 ( θ ) s 1 + h 1 H Φ V - 1 T 0 H h 1 H Φ V - 1 h 1 v where sin 2 ( θ ) = ( 1 - "\[LeftBracketingBar]" h 0 H Φ V - 1 h 1 "\[RightBracketingBar]" 2 h 0 H Φ V - 1 h 0 h 1 H Φ V - 1 h 1 )
  • The clean reference signal Y2 may then be applied to the second adaptive filter 230 defined by:
  • a 1 = h 1 H Φ V - 1 h 0 h 0 H Φ V - 1 h 0 sin 2 ( θ )
  • and then deducted from the signal Y0 using the second mixer 235 to generate the clean output signal Z wherein:
  • Z s 0 = s 0 z s 1 = ( h 0 H Φ V - 1 h 1 h 0 H Φ V - 1 h 0 - h 0 H Φ V - 1 h 1 sin 2 ( θ ) h 0 H Φ V - 1 h 0 sin 2 ( θ ) ) s 1 = 0 E { "\[LeftBracketingBar]" z v "\[RightBracketingBar]" 2 } = 1 h 0 H Φ V - 1 h 0 sin 2 ( θ )
  • with ZSo being the desired signal component, ZS1 being the undesired signal component, and Zv being the noise component. As the above formulae describe, the embodiment 200 produces a distortion less response toward S0, and achieves complete cancellation toward the undesired signal S1. the noise output energy is identical to the performance of an LCMV beamformer under the same constraints, thereby making the performance of the suggested embodiment identical to that of an LCMV beamformer.
  • Turning now to FIG. 3, a flow chart illustrating an exemplary implementation of a method 300 for providing beamforming techniques for acoustic interference cancellation in a bidirectional vehicle communications system is shown. Initially, the method is operative for receiving 310 an acoustic signal at a microphone array where the acoustic signal includes a desired audio signal and an undesired audio signal. For example, the desired audio signal may include a voice of a driver and the undesired signal may include a backseat conversation or a mechanical noise. The microphone array may be comprised of a plurality of microphones arranged at various positions around a vehicle cabin.
  • A first beamforming weight is next applied 320 to the acoustic signal to isolate the desired signal and to attenuate the undesired signal. The results of the beamformer is a preserved desired signal with a filtered undesired signal. The method further applies 330 an acoustic signal to a second beamforming weight to generate a reference signal. The reference signal may isolate the undesired signal and filter the desired signal.
  • The method next applies 340 a first adaptive filter to the preserved desired signal to further isolate the desired signal and suppress the undesired signal. The filtered desired signal is then inverted and combined 350 with the reference signal to suppress the desired signal within the reference signal and to further isolate the undesired signal.
  • A second adaptive filter is then applied 360 to the reference signal to approximate the undesired signal. The filtered reference signal is then inverted and combined 370 with the desired signal to generate an output signal. The output signal is then coupled 380 to a communications processor or the like for further processing.
  • Turning now to FIG. 4, a block diagram illustrating another exemplary implementation of a system 400 for providing beamforming techniques for acoustic interference cancellation in a bidirectional vehicle communications system is shown. The exemplary system 400 may form a portion of a vehicle cabin hands free telecommunications system including a communications processor 410, a signal processor 420, a first microphone 430 and a second microphone 440, wherein first microphone 430 and the second microphone 440 form a portion of an antenna array 450.
  • The communications processor 410 is operative to process signals received via a wireless network, such as from a cellular telephone or data network, and to prepare signals for transmission via a wireless network. The communications processor 410 may be configured to receive audio signals from the signal processor 420, to format the audio signal into a format suitable for transmission via a communications network or the like and to couple this formatted audio signal to a network interface, a universal serial port, an antenna or other transmission means. The communications processor 410 may be further configured for generating a speaker signal representative of an audio signal, for coupling to a speaker or the like for broadcasting within a vehicle cabin.
  • The exemplary system 400 may further include a microphone array 450 including a first microphone 430 and a second microphone 440, for receiving acoustic signals. The microphone array 450 may be mounted within a vehicle cabin for receive a desired acoustic voice signal from a participant in a hand free calling session. For example, the participant may be a vehicle operator engaging in a hand free telephone call via a mobile device connected to a vehicle infotainment system where received voice acoustic signals are broadcast within the vehicle cabin by infotainment system speakers and the outgoing voice acoustic signals, such as the operator's voice, is detected by the microphone array 450 and coupled to the signal processor 420 for further processing before transmission via a wireless network. In some examples, the transmission and reception of the wireless network signals may be made by the mobile device. In other examples, the vehicle may include a wireless communications system for transmitting and receiving data via the wireless network.
  • The microphone array 450 is configured to receive an incoming acoustic signal including a desired acoustic signal and an undesired acoustic signal. In some examples, the desired acoustic signal may be a conversation participants voice and the undesired signal may be another occupant's voice, vehicle system noise, or other noise from a source within the vehicle cabin. The microphone array 450 may couple the incoming acoustic signal to a signal processor 420 or the like. In some examples, the microphone array 450 may include an analog to digital converter, a tuner and/or downconverter for altering the frequency of the incoming acoustic signal.
  • The signal processor 420 may be configured to perform a first beamforming operation on the incoming acoustic signal to isolate the desired signal from the incoming acoustic signal in a first signal path. The first signal path may be a desired signal path. The first beamforming operation on the incoming acoustic signal may include applying a linear weight to a phase angle of the undesired signal. The signal processor 420 may be further configured to perform a second beamforming operation to isolate the undesired signal from the incoming acoustic signal in a second signal path. The second signal path may be an undesired signal path. The second beamforming operation on the incoming acoustic signal may include applying a linear weight to a phase angle of the desired signal. While this exemplary embodiment describes a first beamforming operation to isolate a desired signal and a second beamforming operation to isolate an undesired signal, the signal processor 420 may be configured to perform a plurality of beamforming operations to isolate multiple desired signals and/or multiple undesired signals and generate an output signal including the multiple desired signals according to the described systems and methods.
  • The signal processor 420 may next filter the desired signal to generate a filtered desired signal. The filtering may be performed using an adaptive filtering algorithm or the like. The filtering of the desired signal may be an adaptive filtering operation with a frequency centered on the frequency of the desired signal. The filtered desired signal may include the desired signal with other signals attenuated by the filtering process. For example, the adaptive filtering algorithm may attenuate any remaining undesired signal from the incoming acoustic signal that may remain after the first beamforming operation.
  • The signal processor 420 is next operative to combines an inverse of the filtered desired signal with the undesired signal to generate a combined undesired signal. This may have the desirable effect of cancelling or further attenuating any desired signal remaining within the undesired signal path after the second beamforming operation. The processor 420 is next operative for filtering the combined undesired signal to generate a filtered combined undesired signal. This filtering process may be an adaptive filtering processor to further reduce any desired signal that may remain in the undesired signal path. The signal processor 420 may then combine an inverse of the combined undesired signal and the desired signal to generate an output signal, thereby cancelling all, or a portion, of any remaining undesired signal within the desired signal path. The signal processor 420 may then couple the output signal to the communications processor 410 to generate a data signal in response to the output signal for transmission via a wireless network.
  • In some exemplary embodiments, the system 400 may be a hands-free telecommunications system within a vehicle cabin including a microphone array 450 to receive an incoming acoustic signal including a desired signal and an undesired signal and an analog to digital converter to convert the incoming acoustic signal to a digital signal including the desired voice signal and the undesired voice signal. The system may further include a processor 420, such as a digital signal processor, to perform a first beamforming operation on the digital signal to isolate the desired signal from the digital signal, to perform a second beamforming operation to isolate the undesired signal from the digital signal, filtering the desired signal to generate a filtered desired signal, combining an inverse of the filtered desired signal with the undesired signal to generate a combined undesired signal, filtering the combined undesired signal to generate a filtered combined undesired signal and combining an inverse of the combined undesired signal and the desired signal to generate an output signal. In some embodiments, the first operation and/or the second beamforming operation may apply a linear weight to a phase angle of the undesired signal. Some exemplary systems 400 may further include a communications processor to generate a data signal in response to the output signal for transmission via a wireless network.
  • Turning now to FIG. 5, a flow chart illustrating an exemplary implementation of a system 500 for providing beamforming techniques for acoustic interference cancellation in a bidirectional vehicle communications system is shown. The exemplary method 500 is first operative for receiving 510, via a microphone array, an incoming acoustic signal including a desired signal and an undesired signal. The microphone array may include a plurality of microphones within a vehicle passenger cabin. the undesired signal originates from a first source at a first location within a vehicle cabin and the desired signal originates from a second source at a second location within the vehicle cabin. the desired signal an outgoing portion of a bidirectional voice communications and wherein the wireless network is a cellular network.
  • The method is next operative to perform 520 a first beamforming operation, by a signal processor, on the incoming to isolate the desired signal from the incoming acoustic signal; the first beamforming operation on the incoming acoustic signal is further configured to apply a linear weight to a phase angle of the undesired signal.
  • Next, a second beamforming operation, is performed 530 by the signal processor, to isolate the undesired signal from the incoming acoustic signal; the second beamforming operation on the incoming acoustic signal is further configured to apply a linear weight to a phase angle of the desired signal.
  • The desired signal that was partially isolated by the first beamforming operation is then filtered 540 by the signal processor to further attenuate any remaining undesired signal to generate a filtered desired signal. In some exemplary embodiments, the filtering of the desired signal may be an adaptive filtering with a frequency centered on the frequency of the desired signal.
  • The filtered desired signal is next inverted and combined 545 with the undesired signal to generate a combined undesired signal. Adding the inverse of the desired signal to the undesired signal within the undesired signal path has the advantageous of cancelling or reducing the amplitude of any desired signal remaining in the undesired signal path after the second beamforming operation. The combined undesired signal is next filtered 550, by the signal processor, to further suppress any remaining desired signal or other noise to generate a filtered combined undesired signal. The filtering of the combined undesired signal may estimate the undesired signal component as received by the desired signal path.
  • The method next combines 560, by the signal processor, an inverse of the combined undesired signal and the desired signal to generate an output signal. This combining of the signals advantageously attenuates the undesired signal present on the desired signal path after the first beamforming operation. Furthermore, since the desired signal has been greatly attenuated on the undesired signal path, the desired signal on the desired signal is not significantly impacted by a combination of the inverse of the desired signal on the undesired signal path.
  • Finally, a communications processor may be configured for generating 570 a data signal in response to the output signal for transmission via a wireless network. The output signal may be coupled to the communications processor by the signal processor or other device. The wireless network may be a cellular communications or wireless data communications network or may be a vehicle to vehicle, vehicle to infrastructure, or vehicle to all communications.
  • While at least one exemplary embodiment has been presented in the foregoing detailed description, it should be appreciated that a vast number of variations exist. It should also be appreciated that the exemplary embodiment or exemplary embodiments are only examples, and are not intended to limit the scope, applicability, or configuration of the disclosure in any way. Rather, the foregoing detailed description will provide those skilled in the art with a convenient road map for implementing the exemplary embodiment or exemplary embodiments. It should be understood that various changes can be made in the function and arrangement of elements without departing from the scope of the disclosure as set forth in the appended claims and the legal equivalents thereof.

Claims (20)

1. An apparatus comprising:
a microphone array configured to receive an incoming acoustic signal including a desired signal and an undesired signal;
a signal processor configured to perform a first beamforming operation on the incoming acoustic signal to isolate the desired signal from the incoming acoustic signal, to perform a second beamforming operation to isolate the undesired signal from the incoming acoustic signal, filtering the desired signal to generate a filtered desired signal, combining an inverse of the filtered desired signal with the undesired signal to generate a combined undesired signal, filtering the combined undesired signal to generate a filtered combined undesired signal and combining an inverse of the filtered combined undesired signal and the desired signal to generate an output signal; and
a communications processor to generate a data signal in response to the output signal for transmission via a wireless network.
2. The apparatus of claim 1, wherein the microphone array includes a plurality of microphones within a vehicle passenger cabin.
3. The apparatus of claim 1, wherein the first beamforming operation on the incoming acoustic signal is further configured to apply a linear weight to a phase angle of the undesired signal.
4. The apparatus of claim 1, wherein the filtering of the desired signal includes an adaptive filtering with a frequency centered on the frequency of the desired signal.
5. The apparatus of claim 1, wherein the second beamforming operation on the incoming acoustic signal is further configured to apply a linear weight to a phase angle of the desired signal.
6. The apparatus of claim 1, wherein the desired signal includes an outgoing portion of a bidirectional voice communications and wherein the wireless network is a cellular network.
7. (canceled)
8. The apparatus of claim 1, wherein the filtering of the combined undesired signal attenuates the desired signal with the combined undesired signal.
9. The apparatus of claim 1, wherein the undesired signal originates from a first source at a first location within a vehicle cabin and the desired signal originates from a second source at a second location within the vehicle cabin.
10. A method comprising:
receiving, via a microphone array, an incoming acoustic signal including a desired signal and an undesired signal;
performing a first beamforming operation, by a signal processor, on the incoming acoustic signal to isolate the desired signal;
performing a second beamforming operation, by the signal processor, on the incoming acoustic signal to isolate the undesired signal;
filtering, by the signal processor, the desired signal to generate a filtered desired signal, combining an inverse of the filtered desired signal with the undesired signal to generate a combined undesired signal;
filtering, by the signal processor, the combined undesired signal to generate a filtered combined undesired signal;
combining, by the signal processor, an inverse of the filtered combined undesired signal and the desired signal to generate an output signal; and
generating, by a communications processor, a data signal in response to the output signal for transmission via a wireless network.
11. The method of claim 10, wherein the microphone array includes a plurality of microphones within a vehicle passenger cabin.
12. The method of claim 10, wherein the second beamforming operation on the incoming acoustic signal is further configured to apply a linear weight to a phase angle of the desired signal.
13. The method of claim 10, wherein the filtering of the desired signal includes an adaptive filtering with a frequency centered on the frequency of the desired signal.
14. The method of claim 10, wherein the first beamforming operation on the incoming acoustic signal is further configured to apply a linear weight to a phase angle of the undesired signal.
15. The method of claim 10, further comprising performing a third beamforming operation, by the signal processor, on the incoming acoustic signal to isolate a second undesired signal, combining a second inverse of the filtered desired signal with the second undesired signal to generate a second combined undesired signal, filtering, by the signal processor, the second combined undesired signal to generate a second filtered combined undesired signal and combining, by the signal processor, an inverse of the second combined undesired signal and the desired signal to form a portion of the output signal.
16. The method of claim 10, wherein the filtering of the combined undesired signal attenuates the desired signal with the combined undesired signal.
17. The method of claim 10, wherein the undesired signal originates from a first source at a first location within a vehicle cabin and the desired signal originates from a second source at a second location within the vehicle cabin.
18. The method of claim 10, wherein the desired signal an outgoing portion of a bidirectional voice communications and wherein the wireless network is a cellular network.
19. A hands-free telecommunications system within a vehicle cabin comprising:
a microphone array to receive an incoming acoustic signal including a desired signal and an undesired signal;
an analog to digital converter to convert the incoming acoustic signal to a digital signal including the desired signal and the undesired signal;
a digital signal processor to perform a first beamforming operation on the digital signal to isolate the desired signal from the digital signal, to perform a second beamforming operation to isolate the undesired signal from the digital signal, to filter the desired signal to generate a filtered desired signal, to combine an inverse of the filtered desired signal with the undesired signal to generate a combined undesired signal, to filter the combined undesired signal to generate a filtered combined undesired signal and to combine an inverse of the filtered combined undesired signal and the desired signal to generate an output signal; and
a communications processor to generate a data signal in response to the output signal for transmission via a wireless network.
20. The hands-free telecommunications system within a vehicle cabin of claim 19, wherein the first beamforming operation on the incoming acoustic signal is further configured to apply a linear weight to a phase angle of the undesired signal.
US17/203,905 2021-03-17 2021-03-17 Beamforming techniques for acoustic interference cancellation Active US11438695B1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US17/203,905 US11438695B1 (en) 2021-03-17 2021-03-17 Beamforming techniques for acoustic interference cancellation
DE102021129890.3A DE102021129890B4 (en) 2021-03-17 2021-11-16 Apparatus and method for suppressing acoustic interference
CN202111520500.4A CN115116463A (en) 2021-03-17 2021-12-13 A Beamforming Technique for Acoustic Interference Cancellation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US17/203,905 US11438695B1 (en) 2021-03-17 2021-03-17 Beamforming techniques for acoustic interference cancellation

Publications (2)

Publication Number Publication Date
US11438695B1 US11438695B1 (en) 2022-09-06
US20220303677A1 true US20220303677A1 (en) 2022-09-22

Family

ID=83115206

Family Applications (1)

Application Number Title Priority Date Filing Date
US17/203,905 Active US11438695B1 (en) 2021-03-17 2021-03-17 Beamforming techniques for acoustic interference cancellation

Country Status (3)

Country Link
US (1) US11438695B1 (en)
CN (1) CN115116463A (en)
DE (1) DE102021129890B4 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070093714A1 (en) * 2005-10-20 2007-04-26 Mitel Networks Corporation Adaptive coupling equalization in beamforming-based communication systems
US20070165871A1 (en) * 2004-01-07 2007-07-19 Koninklijke Philips Electronic, N.V. Audio system having reverberation reducing filter
US20080298602A1 (en) * 2007-05-22 2008-12-04 Tobias Wolff System for processing microphone signals to provide an output signal with reduced interference
US20090055170A1 (en) * 2005-08-11 2009-02-26 Katsumasa Nagahama Sound Source Separation Device, Speech Recognition Device, Mobile Telephone, Sound Source Separation Method, and Program

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1992012512A1 (en) * 1991-01-11 1992-07-23 Booz-Allen & Hamilton, Inc. A system for enhancing an analog signal
JP3269969B2 (en) * 1996-05-21 2002-04-02 沖電気工業株式会社 Background noise canceller
EP2237270B1 (en) 2009-03-30 2012-07-04 Nuance Communications, Inc. A method for determining a noise reference signal for noise compensation and/or noise reduction
JP5814070B2 (en) * 2010-10-22 2015-11-17 日本放送協会 Interference wave extraction device
CN105229737B (en) * 2013-03-13 2019-05-17 寇平公司 Noise cancelling microphone device
DE102018117558A1 (en) 2017-07-31 2019-01-31 Harman Becker Automotive Systems Gmbh ADAPTIVE AFTER-FILTERING
CN111551892B (en) * 2020-04-22 2022-03-15 武汉工程大学 Steady self-adaptive beam forming method and device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070165871A1 (en) * 2004-01-07 2007-07-19 Koninklijke Philips Electronic, N.V. Audio system having reverberation reducing filter
US20090055170A1 (en) * 2005-08-11 2009-02-26 Katsumasa Nagahama Sound Source Separation Device, Speech Recognition Device, Mobile Telephone, Sound Source Separation Method, and Program
US20070093714A1 (en) * 2005-10-20 2007-04-26 Mitel Networks Corporation Adaptive coupling equalization in beamforming-based communication systems
US20080298602A1 (en) * 2007-05-22 2008-12-04 Tobias Wolff System for processing microphone signals to provide an output signal with reduced interference

Also Published As

Publication number Publication date
DE102021129890B4 (en) 2024-06-20
US11438695B1 (en) 2022-09-06
DE102021129890A1 (en) 2022-09-22
CN115116463A (en) 2022-09-27

Similar Documents

Publication Publication Date Title
CN1750573B (en) Adopt the noise decrease of combination and the Speech processing of echo cancellation
US8351618B2 (en) Dereverberation and noise reduction method for microphone array and apparatus using the same
EP2211564B1 (en) Passenger compartment communication system
JP2004537233A (en) Acoustic reinforcement system with echo suppression circuit and loudspeaker beamformer
US7783478B2 (en) Two stage frequency subband decomposition
JP3795070B2 (en) Mobile radio device with hands-free call device
EP1858295B1 (en) Equalization in acoustic signal processing
US20140355775A1 (en) Wired and wireless microphone arrays
US20200372926A1 (en) Acoustical in-cabin noise cancellation system for far-end telecommunications
CA2290486A1 (en) Cabin communication system
JP2007235943A (en) Hands-free system for speech signal acquisition
US20080025527A1 (en) Feedback reduction system
US20170171396A1 (en) Joint acoustic echo control and adaptive array processing
US11146887B2 (en) Acoustical in-cabin noise cancellation system for far-end telecommunications
JP2003249996A (en) Sound signal input/output device
US8774398B2 (en) Transceiver
US11438695B1 (en) Beamforming techniques for acoustic interference cancellation
US11523217B2 (en) Audio system for headrest with integrated microphone(s), related headrest and vehicle
JPH09204195A (en) Transmission system for correlation signal
Linhard et al. Passenger in-car communication enhancement
JP3909532B2 (en) Car phone equipment
JP2919422B2 (en) Echo canceller
Kellermann Echoes and noise with seamless acoustic man-machine interfaces–the challenge persists
KR19980043169A (en) Voice input signal correction device
JPH1141341A (en) Automobile telephone system

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCF Information on status: patent grant

Free format text: PATENTED CASE

点击 这是indexloc提供的php浏览器服务,不要输入任何密码和下载