CN115830563A - Method, device, equipment and storage medium for determining vehicle wading state - Google Patents
Method, device, equipment and storage medium for determining vehicle wading state Download PDFInfo
- Publication number
- CN115830563A CN115830563A CN202211611668.0A CN202211611668A CN115830563A CN 115830563 A CN115830563 A CN 115830563A CN 202211611668 A CN202211611668 A CN 202211611668A CN 115830563 A CN115830563 A CN 115830563A
- Authority
- CN
- China
- Prior art keywords
- wading
- vehicle
- target vehicle
- target
- depth
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Image Analysis (AREA)
Abstract
Description
技术领域technical field
本发明涉及汽车领域,尤其涉及一种车辆涉水状态确定方法、装置、设备及存储介质。The invention relates to the field of automobiles, in particular to a method, device, equipment and storage medium for determining a vehicle wading state.
背景技术Background technique
随着气候极端化及城市建设进程加深,驾驶员越来越多的遇到车辆涉水状态,由于驾驶员多因对水深预估不足,导致的车辆进水甚至人员伤亡的悲剧也越来越多。因此,实现对车辆涉水状态和涉水深度的实时监测,并为驾驶员提供涉水状态及涉水水深信息,辅助驾驶员提前采取脱险措施,是面对气候极端化及城市建设进程加深的有效解决方案。With the extreme climate and the deepening of the urban construction process, more and more drivers encounter vehicles wading. Because the drivers often underestimate the water depth, the tragedy of vehicle flooding and even casualties is becoming more and more serious. many. Therefore, realizing real-time monitoring of vehicle wading status and wading depth, providing drivers with information on wading status and wading depth, and assisting drivers in taking escape measures in advance is the key to facing extreme climate and deepening urban construction process. effective solution.
目前,对车辆涉水状态及涉水深度的感应多通过超声波雷达实现。具体讲,是基于雷达波发出与接收的时间差结合雷达传输速度计算出涉水深度。其问题在于:需要在车身单独安装下向的超声波雷达,增加了硬件成本;车辆系统无法主动感知到涉水状态,只能由驾驶员主动触发涉水深度感应系统。At present, the sensing of vehicle wading status and wading depth is mostly realized by ultrasonic radar. Specifically, the wading depth is calculated based on the time difference between the sending and receiving of radar waves combined with the radar transmission speed. The problem is that a downward ultrasonic radar needs to be installed separately on the body, which increases the hardware cost; the vehicle system cannot actively sense the wading state, and only the driver can actively trigger the wading depth sensing system.
发明内容Contents of the invention
鉴于以上所述现有技术的缺点,本发明提供一种车辆涉水状态确定方法、装置、设备及存储介质,以解决上述技术问题。In view of the above-mentioned shortcomings of the prior art, the present invention provides a vehicle wading state determination method, device, equipment and storage medium to solve the above technical problems.
本发明提供的一种车辆涉水状态确定方法,所述方法包括:获取目标车辆的目标环境图像,所述目标环境图像包括所述目标车辆的至少一面车身的车身图像;基于所述目标环境图像,确定所述目标车辆的目标车辆涉水水位线;基于所述目标车辆涉水水位线与所述目标车辆的车辆标志位的位置关系,确定所述目标车辆的目标车辆涉水深度;基于所述目标车辆涉水深度,确定所述目标车辆的涉水状态。A method for determining a vehicle wading state provided by the present invention, the method includes: acquiring a target environment image of a target vehicle, the target environment image including a body image of at least one body of the target vehicle; based on the target environment image , determine the target vehicle wading water level line of the target vehicle; determine the target vehicle wading depth of the target vehicle based on the positional relationship between the target vehicle wading water level line and the vehicle marker position of the target vehicle; The wading depth of the target vehicle is determined to determine the wading state of the target vehicle.
车辆涉水水位线包括:获取目标车辆的多个样本图像,所述样本图像包括目标车辆的至少一面车身的车身图像;对所述样本图像的车辆涉水水位线进行标注,得到训练样本数据集;通过所述样本数据集对图像识别模型进行训练,并将训练后的图像识别模型作为车辆涉水水位线识别模型;将所述目标车辆的目标环境图像输入至所述车辆涉水水位线识别模型,以得到所述目标车辆的涉水水位线。The vehicle wading water level line includes: acquiring a plurality of sample images of the target vehicle, the sample images including at least one body image of the target vehicle body; marking the vehicle wading water level line of the sample images to obtain a training sample data set ; The image recognition model is trained through the sample data set, and the trained image recognition model is used as the vehicle wading water level recognition model; the target environment image of the target vehicle is input to the vehicle wading water level recognition model to obtain the wading water level of the target vehicle.
在本发明的一个实施例中,获取所述目标车辆的目标车辆涉水水位线之后,确定所述目标车辆的目标车辆涉水深度包括以下至少之一:获取所述目标环境图像中多个车辆标志位,并基于所述目标车辆涉水水位线和所述车辆标志位确定目标标志位,根据所述目标车辆涉水水位线和所述目标标志位的位置关系,确定所述目标车辆的涉水深度;获取目标车辆的轮胎完整面积,并将轮胎高于所述目标车辆涉水水位线部分面积视为轮胎露出面积,基于所述轮胎露水面积和轮胎完整面积的关系,确定所述目标车辆的涉水深度。In an embodiment of the present invention, after acquiring the target vehicle wading water level line of the target vehicle, determining the target vehicle wading depth of the target vehicle includes at least one of the following: acquiring multiple vehicles in the target environment image mark position, and determine the target mark position based on the wading water level line of the target vehicle and the vehicle mark position, and determine the wading position of the target vehicle according to the positional relationship between the wading water level line of the target vehicle and the target mark position Water depth: obtain the complete area of the tire of the target vehicle, and regard the area of the tire above the wading water level of the target vehicle as the exposed area of the tire, and determine the target vehicle based on the relationship between the exposed area of the tire and the complete area of the tire wading depth.
在本发明的一个实施例中,获取所述目标环境图像中多个车辆标志位,并基于所述目标车辆涉水水位线和所述车辆标志位确定目标标志位,根据所述目标车辆涉水水位线和所述目标标志位的位置关系,确定所述目标车辆的涉水深度包括:获取所述目标环境图像中多个车辆标志位;基于所述目标车辆涉水水位线,将高于所述目标车辆涉水水位线的多个车辆标志位确定为多个期待标志位;将所述多个期待标志位中离目标车辆最近的一个车辆标志位,确定为目标标志位;基于所述目标标志位和所述目标标志位与目标车辆涉水水位线,确定所述目标车辆的涉水深度。In one embodiment of the present invention, a plurality of vehicle marker positions in the target environment image are obtained, and the target marker positions are determined based on the target vehicle wading water level line and the vehicle marker positions, and according to the target vehicle wading The positional relationship between the water level line and the target marker position, determining the wading depth of the target vehicle includes: acquiring a plurality of vehicle marker positions in the target environment image; A plurality of vehicle flags of the target vehicle wading water level line is determined as a plurality of expected flags; a vehicle flag closest to the target vehicle in the plurality of expected flags is determined as a target flag; based on the target The flag position, the target flag position and the wading water level line of the target vehicle determine the wading depth of the target vehicle.
在本发明的一个实施例中,基于所述目标标志位和所述目标标志位与目标车辆涉水水位线的位置关系,确定所述目标车辆的涉水深度包括:获取所述目标标志位的实际高度值,将所述目标标志位和所述目标车辆涉水水位线之间的距离,确定为间隔距离;基于所述间隔距离和预设图像距离-预设实际距离库,确定所述间隔距离的实际间隔,得到实际间隔值;基于所述目标标志位的实际高度值和所述实际间隔值的差值,确定所述目标车辆的涉水深度。In an embodiment of the present invention, determining the wading depth of the target vehicle based on the target marker position and the positional relationship between the target marker position and the wading water level line of the target vehicle includes: obtaining the target marker position For the actual height value, the distance between the target mark position and the wading water level line of the target vehicle is determined as the separation distance; based on the separation distance and the preset image distance-preset actual distance library, the distance is determined The actual interval of the distance is obtained to obtain an actual interval value; based on the difference between the actual height value of the target marker and the actual interval value, the wading depth of the target vehicle is determined.
在本发明的一个实施例中,获取目标车辆的轮胎完整面积,并将轮胎高于所述目标车辆涉水水位线部分面积视为轮胎露出面积,基于所述轮胎露水面积和轮胎完整面积的关系,确定所述目标车辆的涉水深度包括:获取所述目标车辆轮胎露出水面的轮胎露出面积,并基于所述目标车辆的车辆型号确定所述轮胎完整面积;基于所述轮胎露出面积和所述轮胎完整面积确定所述目标车辆的轮胎露出面积比例;基于所述轮胎露出面积比例和预设轮胎露出面积比例-预设目标车辆涉水深度库,确定所述目标车辆的目标车辆涉水深度。In one embodiment of the present invention, the complete area of the tire of the target vehicle is obtained, and the area of the tire above the wading water level of the target vehicle is regarded as the exposed area of the tire, based on the relationship between the exposed area of the tire and the complete area of the tire , determining the wading depth of the target vehicle includes: obtaining the tire exposed area of the target vehicle tire above the water surface, and determining the complete area of the tire based on the vehicle model of the target vehicle; based on the exposed area of the tire and the The complete tire area determines the tire exposed area ratio of the target vehicle; based on the tire exposed area ratio and the preset tire exposed area ratio-preset target vehicle wading depth library, the target vehicle wading depth of the target vehicle is determined.
在本发明的一个实施例中,确定所述目标车辆的涉水深度还包括:获取目标车辆所处环境的积水深度、积水清澈度以及车辆轮胎的模糊面积,确定所述目标车辆所处环境的环境指数;基于车辆涉水水位线和目标标志位的相对位置关系计算得到的第一涉水深度,并基于轮胎露出面积和轮胎完整面积的比例关系计算得到的第二涉水深度;基于所述涉水环境指数,赋予所述第一涉水深度第一计算权重,赋予所述第二涉水深度第二计算权重,当所述涉水环境指数大于或等于标准环境指数,所述第一计算权重大于所述第二计算权重,当所述涉水环境指数小于标准环境指数,所述第一计算权重小于所述第二计算权重;基于所述第一涉水深度,第一计算权重,第二涉水深度,第二计算权重,确定所述目标车辆的涉水深度。In one embodiment of the present invention, determining the wading depth of the target vehicle further includes: obtaining the water depth, clarity of the water and the blurred area of the vehicle tires in the environment where the target vehicle is located, and determining the water depth of the target vehicle. The environmental index of the environment; the first wading depth calculated based on the relative positional relationship between the vehicle wading water level line and the target mark position, and the second wading depth calculated based on the proportional relationship between the exposed area of the tire and the complete area of the tire; based on The wading environment index is assigned a first calculation weight to the first wading depth, and a second calculation weight is assigned to the second wading depth. When the wading environment index is greater than or equal to the standard environment index, the first wading depth A calculation weight greater than the second calculation weight, when the wading environment index is less than the standard environment index, the first calculation weight is less than the second calculation weight; based on the first wading depth, the first calculation weight , the second wading depth, and the second calculation weight determine the wading depth of the target vehicle.
在本发明的一个实施例中,确定所述目标车辆的目标车辆涉水深度还包括:获取所述目标车辆的多个涉水水位线,并将所述多个涉水水位线确定为预期涉水水位线;基于所述预期涉水水位线确定所述目标车辆的预期涉水深度,得到所述预期涉水深度最大值;将所述预期涉水深度最大值确定为所述目标车辆涉水深度。In an embodiment of the present invention, determining the target vehicle wading depth of the target vehicle further includes: acquiring a plurality of wading water levels of the target vehicle, and determining the plurality of wading water levels as expected wading depths. water level line; determine the expected wading depth of the target vehicle based on the expected wading water level line, and obtain the maximum value of the expected wading depth; determine the maximum value of the expected wading depth as the wading depth of the target vehicle depth.
在本发明的一个实施例中,得到所述目标车辆的涉水水位线包括:获取多帧所述目标车辆的目标环境图像,将多帧所述目标环境图像输入至所述车辆涉水水位线识别模型,得到多条车辆涉水水位线;将所述多条车辆涉水水位线赋予计算权重,基于所述计算权重得到所述多条车辆涉水水位线的理论涉水水位线,并将所述理论涉水水位线视为目标车辆的车辆涉水水位线。In one embodiment of the present invention, obtaining the wading water level of the target vehicle includes: acquiring multiple frames of target environment images of the target vehicle, and inputting multiple frames of the target environment images into the vehicle wading water level Identifying the model to obtain a plurality of vehicle wading water levels; assigning calculation weights to the plurality of vehicle wading water levels, and obtaining theoretical wading water levels of the plurality of vehicle wading water levels based on the calculation weights, and The theoretical wading water level is regarded as the vehicle wading water level of the target vehicle.
在本发明的一个实施例中,获取目标车辆的多个样本图像包括:采集所述目标车辆的初始环境图像,并识别所述初始环境图像中的水花高度和水浪高度;将所述初始环境图像中水花高度和水浪高度的最大值作为所述初始环境图像的水面波动值;当所述水面波动值小于标准水面波动值,保留所述初始环境图像,并将保留下的初始环境图像作为所述目标环境图像。In one embodiment of the present invention, acquiring a plurality of sample images of the target vehicle includes: acquiring an initial environment image of the target vehicle, and identifying the height of splashes and waves in the initial environment image; The maximum value of the splash height and water wave height in the image is used as the water surface fluctuation value of the initial environment image; when the water surface fluctuation value is less than the standard water surface fluctuation value, the initial environment image is retained, and the retained initial environment image is used as The target environment image.
在本发明的一个实施例中,获取目标车辆的多个样本图像还包括:获取所述目标车辆所处环境的环境光照强度;当环境光照强度低于标准光照强度,则启动车辆备用光源补光,所述车辆备用光源包括倒车镜位置方向向下的迎宾灯。In one embodiment of the present invention, obtaining multiple sample images of the target vehicle further includes: obtaining the ambient light intensity of the environment where the target vehicle is located; when the ambient light intensity is lower than the standard light intensity, starting the vehicle backup light source to supplement light , the vehicle backup light source includes a welcome light facing downwards at the position of the reversing mirror.
在本发明的一个实施例中,得到所述目标车辆的目标车辆涉水水位线之前还包括:基于所述目标环境图像,确定所述目标环境图像中积水区域的积水位置信息和所述目标环境图像中目标车辆轮胎的轮胎位置信息;基于所述积水位置信息和所述轮胎位置信息确定所述积水区域的积水位置和所述目标车辆轮胎的轮胎位置;若所述积水区域和所述轮胎区域存在重合,则判定所述目标车辆已涉水。In an embodiment of the present invention, before obtaining the target vehicle wading water level line of the target vehicle, it further includes: based on the target environment image, determining the water accumulation position information of the water accumulation area in the target environment image and the The tire position information of the target vehicle tire in the target environment image; determine the water accumulation position of the water accumulation area and the tire position of the target vehicle tire based on the water accumulation position information and the tire position information; if the accumulation of water If the area overlaps with the tire area, it is determined that the target vehicle has waded.
在本发明的一个实施例中,基于所述目标车辆涉水深度,确定所述目标车辆的涉水状态包括:基于所述目标车辆涉水深度,确定所述目标车辆涉水深度值,当目标车辆涉水深度大于或等于预设第一阈值,则判定所述目标车辆的涉水状态为一级涉水;当目标车辆涉水深度大于或等于预设第二阈值,则判定所述目标车辆的涉水状态为二级涉水;所述预设第一阈值小于所述预设第二阈值。In an embodiment of the present invention, determining the wading state of the target vehicle based on the wading depth of the target vehicle includes: determining a wading depth value of the target vehicle based on the wading depth of the target vehicle, when the target vehicle If the wading depth of the vehicle is greater than or equal to the preset first threshold, it is determined that the wading state of the target vehicle is a first-level wading; when the wading depth of the target vehicle is greater than or equal to the preset second threshold, it is determined that the target vehicle The wading state is a secondary wading state; the preset first threshold is smaller than the preset second threshold.
在本发明的一个实施例中,基于所述目标车辆涉水深度,确定所述目标车辆的涉水状态之后还包括:当所述目标车辆涉水状态为一级涉水,发出一级报警,以提醒驾驶员当前车辆已涉水;当所述目标车辆涉水状态为二级涉水,发出二级报警,以提醒驾驶员当前车辆零件已涉水。In an embodiment of the present invention, after determining the wading state of the target vehicle based on the wading depth of the target vehicle, it further includes: when the wading state of the target vehicle is a first-level wading, issuing a first-level alarm, To remind the driver that the current vehicle is wading; when the target vehicle is in the second-level wading state, a second-level alarm is issued to remind the driver that the current vehicle parts have been wading.
本发明提供一种车辆涉水状态确定装置,所述装置包括:图像获取模块,用于获取目标车辆的目标环境图像,所述目标环境图像包括所述目标车辆的至少一面车身的车身图像;涉水确定模块,用于基于所述目标环境图像,得到所述目标车辆的目标车辆涉水水位线;涉水深度确定模块,用于基于所述目标车辆涉水水位线与所述目标车辆的车辆标志位的位置关系,确定所述目标车辆的目标车辆涉水深度;涉水状态确定模块,用于基于所述目标车辆涉水深度,确定所述目标车辆的涉水状态。The present invention provides a device for determining a vehicle wading state, the device comprising: an image acquisition module, configured to acquire a target environment image of a target vehicle, the target environment image including a body image of at least one body of the target vehicle; The water determination module is used to obtain the target vehicle wading water level of the target vehicle based on the target environment image; the wading depth determination module is used to obtain the target vehicle wading water level based on the target vehicle wading water level and the target vehicle The positional relationship of the flags determines the target vehicle wading depth of the target vehicle; the wading state determination module is used to determine the wading state of the target vehicle based on the target vehicle wading depth.
在本发明的一个实施例中,所述车辆涉水状态确定装置还包括报警模块,所述报警模块包括:显示模块,所述显示模块包括至少一个显示屏,用于基于目标车辆涉水状态发出文字报警信息;指示灯模块,所述指示灯模块包括至少两种颜色指示灯,用于目标车辆涉水状态启动不同颜色的指示灯,发出灯光报警信息;扬声器模块,所述扬声器模块包括至少一个蜂鸣器,用于基于目标车辆的涉水状态,发出语音报警信息。In an embodiment of the present invention, the vehicle wading state determination device further includes an alarm module, the alarm module includes: a display module, the display module includes at least one display screen, and is used to issue a message based on the target vehicle wading state. Text alarm information; indicator light module, the indicator light module includes at least two color indicator lights, which are used to start the indicator lights of different colors in the wading state of the target vehicle, and send out light alarm information; speaker module, the speaker module includes at least one The buzzer is used to send out voice alarm information based on the wading state of the target vehicle.
本发明提供的一种电子设备,所述电子设备包括:一个或多个处理器;存储装置,用于存储一个或多个程序,当所述一个或多个程序被所述一个或多个处理器执行时,使得所述电子设备实现如上所述的车辆涉水状态确定方法。An electronic device provided by the present invention, the electronic device includes: one or more processors; a storage device for storing one or more programs, when the one or more programs are processed by the one or more When the controller is executed, the electronic device is made to implement the method for determining the vehicle wading state as described above.
本发明提供的一种计算机可读存储介质,其上存储有计算机程序,当所述计算机程序被计算机的处理器执行时,使计算机执行如上所述的车辆涉水状态确定方法。The present invention provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor of a computer, the computer is made to execute the method for determining the vehicle wading state as described above.
有益效果:本发明利用设置在车辆周身的全景影像系统进行涉水感应检测,通过采集车辆周身的环境图像,通过对图形进行处理,得到图像中的距离和实际距离之间的关系,通过车辆标志位或车辆轮胎面积和车辆涉水水位线的关系,确定车辆涉水状态及深度,并由此触发报警;此方法充分发挥了全景影像系统的能力,而无需增加额外的外设系统,避免了增加成本,另外还解决了单纯依靠超声波雷达的被动监测问题,实现对车辆涉水的主动监测,提高驾驶员对涉水的态势感知,避免涉水状况下的车辆损失和安全事故。Beneficial effects: the present invention utilizes the panoramic image system installed around the vehicle for wading sensing detection, collects the environmental image around the vehicle, and processes the graphics to obtain the relationship between the distance in the image and the actual distance. Position or the relationship between the vehicle tire area and the vehicle wading water level line, determine the vehicle wading status and depth, and trigger an alarm; this method gives full play to the capabilities of the panoramic imaging system without adding additional peripheral systems, avoiding the In addition to increasing the cost, it also solves the problem of passive monitoring relying solely on ultrasonic radar, realizes active monitoring of vehicle wading, improves the driver's situational awareness of wading, and avoids vehicle losses and safety accidents under wading conditions.
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本申请。It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
附图说明Description of drawings
此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本申请的实施例,并与说明书一起用于解释本申请的原理。显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术者来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。在附图中:The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description serve to explain the principles of the application. Apparently, the drawings in the following description are only some embodiments of the present application, and those skilled in the art can obtain other drawings based on these drawings without creative efforts. In the attached picture:
图1是本申请的一示例性实施例示出的车辆涉水状态确定方法的实施环境示意图;FIG. 1 is a schematic diagram of an implementation environment of a method for determining a vehicle wading state shown in an exemplary embodiment of the present application;
图2是本申请的一示例性实施例示出的车辆涉水状态确定方法流程图;Fig. 2 is a flowchart of a method for determining a vehicle wading state shown in an exemplary embodiment of the present application;
图3是本申请的一示例性实施例示出的车辆涉水示意图;Fig. 3 is a schematic diagram of vehicle wading shown in an exemplary embodiment of the present application;
图4是本申请的另一示例性实施例示出的车辆涉水示意图;Fig. 4 is a schematic diagram of vehicle wading shown in another exemplary embodiment of the present application;
图5是本申请的一示例性实施例示出的车辆涉水状态确定流程图;Fig. 5 is a flow chart of vehicle wading state determination shown in an exemplary embodiment of the present application;
图6是本申请的一示例性实施例示出的车辆涉水状态确定装置框图;Fig. 6 is a block diagram of a vehicle wading state determination device shown in an exemplary embodiment of the present application;
图7是本申请的一示例性实施例示出的车辆涉水报警装置框图;Fig. 7 is a block diagram of a vehicle wading alarm device shown in an exemplary embodiment of the present application;
图8是本申请的一示例性实施例示出的车辆涉水感应系统架构示意图;Fig. 8 is a schematic diagram of the architecture of a vehicle wading sensing system shown in an exemplary embodiment of the present application;
图9是本申请的一示例性实施例示出的车身高度工程标定系统的连接关系示意图;Fig. 9 is a schematic diagram of the connection relationship of the vehicle body height engineering calibration system shown in an exemplary embodiment of the present application;
图10是本申请的一示例性实施例示出的车辆涉水报警反应全流程图;Fig. 10 is a full flowchart of vehicle wading alarm response shown in an exemplary embodiment of the present application;
图11示出了适于用来实现本申请实施例的电子设备的计算机系统的结构示意图。FIG. 11 shows a schematic structural diagram of a computer system suitable for implementing the electronic device of the embodiment of the present application.
具体实施方式Detailed ways
以下将参照附图和优选实施例来说明本发明的实施方式,本领域技术人员可由本说明书中所揭露的内容轻易地了解本发明的其他优点与功效。本发明还可以通过另外不同的具体实施方式加以实施或应用,本说明书中的各项细节也可以基于不同观点与应用,在没有背离本发明的精神下进行各种修饰或改变。应当理解,优选实施例仅为了说明本发明,而不是为了限制本发明的保护范围。Embodiments of the present invention will be described below with reference to the accompanying drawings and preferred embodiments, and those skilled in the art can easily understand other advantages and effects of the present invention from the content disclosed in this specification. The present invention can also be implemented or applied through other different specific implementation modes, and various modifications or changes can be made to the details in this specification based on different viewpoints and applications without departing from the spirit of the present invention. It should be understood that the preferred embodiments are only for illustrating the present invention, but not for limiting the protection scope of the present invention.
需要说明的是,以下实施例中所提供的图示仅以示意方式说明本发明的基本构想,遂图式中仅显示与本发明中有关的组件而非按照实际实施时的组件数目、形状及尺寸绘制,其实际实施时各组件的型态、数量及比例可为一种随意的改变,且其组件布局型态也可能更为复杂。It should be noted that the diagrams provided in the following embodiments are only schematically illustrating the basic ideas of the present invention, and only the components related to the present invention are shown in the diagrams rather than the number, shape and shape of the components in actual implementation. Dimensional drawing, the type, quantity and proportion of each component can be changed arbitrarily during actual implementation, and the component layout type may also be more complicated.
在下文描述中,探讨了大量细节,以提供对本发明实施例的更透彻的解释,然而,对本领域技术人员来说,可以在没有这些具体细节的情况下实施本发明的实施例是显而易见的,在其他实施例中,以方框图的形式而不是以细节的形式来示出公知的结构和设备,以避免使本发明的实施例难以理解。In the following description, numerous details are discussed in order to provide a more thorough explanation of embodiments of the invention, however, it will be apparent to those skilled in the art that embodiments of the invention can be practiced without these specific details, In other embodiments, well-known structures and devices are shown in block diagram form rather than in detail in order to avoid obscuring the embodiments of the invention.
首先需要说明的是,在汽车领域,现阶段的车辆涉水探测是通过超声波雷达完成的,然而该技术存在2个方面的较大缺陷,一方面是,由于技术受限超声波雷达需要约0.8秒才能得到一个水深的测量值,考虑到车辆涉水过程中的行驶速度,当车辆接收到涉水测量值是,其所处环境已发生改变,导致涉水测量值与车辆所处环境存在较大的延迟。例如,当车辆室外驾驶速度为25km/h是,经过0.8秒的时间,其行驶距离为5.56米,若该路段并非水位相等的平直线,则车辆的实际涉水深度可能已经发生较大的变化,该测量值的实际使用价值就显得十分有限。另一方面是,车辆在正常行驶过程中,其路面可能存在涌起的水浪或溅起的水花,若超声波发出的时间恰好碰上水浪或水花,则可能造成较大误差,根据实际情况测得该误差能达到40cm,而40cm相较于普通轿车车身高度(140cm~160cm)而言,已接近20%,足以严重影响车辆对涉水深度的判断。First of all, it needs to be explained that in the automotive field, the current vehicle wading detection is done by ultrasonic radar. However, there are two major defects in this technology. On the one hand, due to technical limitations, ultrasonic radar needs about 0.8 seconds In order to get a measured value of water depth, considering the driving speed of the vehicle during the wading process, when the vehicle receives the wading measurement value, its environment has changed, resulting in a large gap between the wading measurement value and the vehicle's environment. Delay. For example, when the outdoor driving speed of the vehicle is 25km/h, after 0.8 seconds, its driving distance is 5.56 meters. If the road section is not a straight line with equal water levels, the actual wading depth of the vehicle may have changed greatly , the practical value of the measured value is very limited. On the other hand, during the normal driving process of the vehicle, there may be surging water waves or splashing water splashes on the road surface. If the time when the ultrasonic wave is sent out happens to meet the water waves or splashes, it may cause a large error. According to the actual situation It is measured that the error can reach 40cm, and 40cm is close to 20% compared with the body height of ordinary cars (140cm-160cm), which is enough to seriously affect the vehicle's judgment of the wading depth.
因此,本发明通过利用车载摄像设备采集车辆涉水图片,然后通过图像处理得到车辆的涉水深度。本方法的优势在于,一方面,图像采集的效率非常高,假定摄像头的视频流帧率为30帧,则每33毫秒即可采集到一个信号,加上算法的计算处理时间,则在约50毫秒的时间内即可采集得到一个水深测量值,若假定目标车辆的行驶速度为25km/h,则在此50毫秒的时间内,车辆行驶距离仅为0.35米,在积水路段中,0.35米范围内通常不会有较大的水深变化,则该水深测量值对车辆的当前涉水状态有效。另一方面,本方法通过图像处理的方式确定车辆涉水深度,在图像处理过程中,可对采集得到的图像进行筛选,以去除水花、水浪的影响。故本发明提出的车辆涉水状态确定方法有效规避了传统方法的缺陷。Therefore, the present invention collects vehicle wading pictures by using the vehicle-mounted camera equipment, and then obtains the wading depth of the vehicle through image processing. The advantage of this method is that, on the one hand, the efficiency of image acquisition is very high. Assuming that the frame rate of the video stream of the camera is 30 frames, a signal can be collected every 33 milliseconds. A water depth measurement value can be collected within milliseconds. Assuming that the target vehicle is traveling at a speed of 25km/h, within 50 milliseconds, the vehicle’s driving distance is only 0.35 meters. There is usually no large water depth change within the range, so the water depth measurement value is valid for the current wading state of the vehicle. On the other hand, the method determines the wading depth of the vehicle through image processing. During the image processing process, the collected images can be screened to remove the influence of water splashes and water waves. Therefore, the method for determining the vehicle wading state proposed by the present invention effectively avoids the defects of the traditional method.
图1是本申请的一示例性实施例示出的车辆涉水状态确定方法的实施环境示意图。如图1所示,系统架构可以包括摄像设备101、目标车辆102和计算机设备103。其中,计算机设备103可以是台式图形处理器(GraphicProcessingUnit,GPU)计算机、GPU计算集群、神经网络计算机等中的至少一种。相关技术人员可以使用该计算机设备103实现对当前车辆和目标车辆之间的行驶风险做判断,并控制当前车辆的驾驶行为动作。Fig. 1 is a schematic diagram of an implementation environment of a method for determining a vehicle wading state according to an exemplary embodiment of the present application. As shown in FIG. 1 , the system architecture may include a
示意性的,摄像设备101首先获取目标车辆的周身环境图像,并将相关信息发送给计算机设备103处理,计算机设备103基于摄像设备101提供的图像信息中的涉水险确认目标车辆的涉水深度、判断其报警级别,并将该结果发送给目标车辆102执行相关报警动作。Schematically, the
图2是本申请的一示例性实施例示出的车辆涉水状态确定方法流程图。Fig. 2 is a flowchart of a method for determining a vehicle wading state according to an exemplary embodiment of the present application.
请参阅图2,图2是本申请的一示例性实施例示出的车辆涉水状态确定方法的流程图。该方法可以应用于图1所示的实施环境,并由该实施环境中的智能终端103具体执行。应理解的是,该方法也可以适用于其它的示例性实施环境,并由其它实施环境中的设备具体执行,本实施例不对该方法所适用的实施环境进行限制。参照图2所示,该图像处理方法至少包括步骤S210至步骤S240,详细介绍如下:Please refer to FIG. 2 . FIG. 2 is a flowchart of a method for determining a vehicle wading state according to an exemplary embodiment of the present application. The method can be applied to the implementation environment shown in FIG. 1 , and is specifically executed by the
步骤S210,获取目标车辆的目标环境图像,该目标环境图像包括目标车辆的至少一面车身的车身图像。Step S210, acquiring a target environment image of the target vehicle, where the target environment image includes a body image of at least one body of the target vehicle.
应当理解的是,在车辆行驶过程中,可根据车辆自身的车载摄像机系统,采集得到车辆的周边环境信息,该环境信息包括车身和地面积水的接触线,通过车载摄像机包含的边缘计算模块,可将采集得到的初始环境信息进行初步处理,筛选出符合计算要求的图像,并发送给车辆涉水检测模块,以得到该车辆的涉水情况。It should be understood that during the driving process of the vehicle, the surrounding environment information of the vehicle can be collected according to the vehicle's own on-board camera system. The environmental information includes the contact line between the body and ground water. The collected initial environmental information can be preliminarily processed, and the images that meet the calculation requirements can be screened out and sent to the vehicle wading detection module to obtain the wading situation of the vehicle.
在本申请的一个实施例中,利用车辆本身已有的用于驾驶员观察车辆周身状况的全景影像摄像机,包括前视摄像机和布置在车辆两侧倒车镜位置的摄像机,分别监测车身前方及左右两侧的涉水状态,得到车辆在行驶过程中的环境图像信息;然后通过部署在摄像机端的人工智能算法系统,即边缘计算模块,直接在摄像机端对视频数据处理;得到包括目标车辆的至少一面车身的车身图像,并通过CAN(控制器局域网络ControllerAreaNetwork,简称CAN)发送给整车控制器,由部署在整车控制器上的人工智能算法对得到的图像信息做进一步的数据处理。In one embodiment of the present application, the existing panoramic image cameras for the driver to observe the surrounding conditions of the vehicle are used, including the forward-looking camera and the cameras arranged at the positions of the rear view mirrors on both sides of the vehicle to monitor the front and left and right sides of the vehicle body respectively. For the wading state on both sides, the environmental image information of the vehicle during driving is obtained; then, through the artificial intelligence algorithm system deployed on the camera side, that is, the edge computing module, the video data is directly processed on the camera side; at least one side including the target vehicle is obtained. The body image of the vehicle body is sent to the vehicle controller through CAN (Controller Area Network, CAN for short), and the artificial intelligence algorithm deployed on the vehicle controller performs further data processing on the obtained image information.
应当理解的是,由于本发明依赖于摄像设备采集目标车辆环境图像,则环境光照强度将对图像的清晰度存在一定程度的影响,当目标车辆于深夜行驶,由于天色已晚且路灯昏暗,则需要相关措施以避免摄像设备无法采集得到清晰的目标环境图像。It should be understood that since the present invention relies on the camera equipment to collect the environmental image of the target vehicle, the intensity of ambient light will have a certain degree of impact on the clarity of the image. Relevant measures are needed to prevent the camera equipment from being unable to collect clear images of the target environment.
获取目标车辆的多个样本图像还包括:获取所述目标车辆所处环境的环境光照强度;当环境光照强度低于标准光照强度,则启动车辆备用光源补光,所述车辆备用光源包括倒车镜位置方向向下的迎宾灯。Acquiring a plurality of sample images of the target vehicle also includes: obtaining the ambient light intensity of the environment where the target vehicle is located; when the ambient light intensity is lower than the standard light intensity, then starting the vehicle backup light source to supplement the light, the vehicle backup light source includes a rear view mirror A welcome light positioned downwards.
在本发明的一个实施例中,目标车辆在深夜行驶在相对偏僻的道路上,天气昏暗且路灯照明能力有限,通过设备确定该环境的光照强度为A,预设的标准光照强度为B,比较得到A小于B,及目标车辆所处环境的光照强度低于标准光照强度,则开启倒车镜位置方向向下的迎宾灯,以对环境进行补光,以使车载摄像机采集得到可用的目标环境图像。In one embodiment of the present invention, the target vehicle is driving on a relatively remote road in the middle of the night, the weather is dark and the lighting capacity of the street lights is limited, the light intensity of the environment is determined by the device as A, and the preset standard light intensity is B, compared If A is less than B, and the light intensity of the environment where the target vehicle is located is lower than the standard light intensity, then turn on the welcome light in the direction of the rear view mirror to fill in the light of the environment, so that the vehicle camera can capture the available target environment image.
步骤S220,基于目标环境图像,确定目标车辆的目标车辆涉水水位线。Step S220, based on the target environment image, determine the target vehicle wading water level line of the target vehicle.
基于目标环境图像,得到目标车辆的目标车辆涉水水位线包括:获取目标车辆的多个样本图像,样本图像包括目标车辆的至少一面车身的车身图像;对样本图像的车辆涉水水位线进行标注,得到训练样本数据集;通过样本数据集对图像识别模型进行训练,并将训练后的图像识别模型作为车辆涉水水位线识别模型;将目标车辆的目标环境图像输入至车辆涉水水位线识别模型,以得到目标车辆的涉水水位线。Obtaining the target vehicle wading water level of the target vehicle based on the target environment image includes: acquiring multiple sample images of the target vehicle, the sample images including at least one body image of the target vehicle; marking the vehicle wading water level of the sample images , to obtain the training sample data set; the image recognition model is trained through the sample data set, and the trained image recognition model is used as the vehicle wading water level recognition model; the target environment image of the target vehicle is input into the vehicle wading water level recognition model model to obtain the wading water level of the target vehicle.
得到目标车辆的涉水水位线包括:获取多帧目标车辆的目标环境图像,将多帧目标环境图像输入至车辆涉水水位线识别模型,得到多条车辆涉水水位线;将多条车辆涉水水位线赋予计算权重,基于计算权重得到多条车辆涉水水位线的理论涉水水位线,并将理论涉水水位线视为目标车辆的车辆涉水水位线。Obtaining the wading water level line of the target vehicle includes: obtaining multiple frames of the target environment image of the target vehicle, inputting the multiple frames of the target environment image into the vehicle wading water level recognition model to obtain multiple vehicle wading water lines; The water level is assigned a calculation weight, based on the calculation weight, the theoretical wading water level of multiple vehicle wading water levels is obtained, and the theoretical wading water level is regarded as the vehicle wading water level of the target vehicle.
应当理解的是,首先需要采集得到大量的目标环境图像对图像处理模型进行训练,该目标环境图像中包括大量存在水浪或水花的非标准环境图像,在模型训练过程对该部分非标准环境图像进行相应的处理,包括但不限于,将明显不存在参考价值的图像(如存在巨大水花的图像)进行剔除,以增加水位线判断的准确性;在存在水花的目标图像中采集得到非直线的实际涉水线,并在该实际涉水线上取多个涉水监测点,以确定该多个涉水监测点的涉水点线性回归线,以得到的涉水点线性回归线为目标车辆涉水水位线。It should be understood that it is first necessary to collect a large number of target environment images to train the image processing model. The target environment images include a large number of non-standard environment images with water waves or splashes. During the model training process, this part of the non-standard environment images Carry out corresponding processing, including but not limited to, eliminating images that obviously have no reference value (such as images with huge water splashes) to increase the accuracy of water level line judgment; non-linear images are collected in target images with water splashes The actual wading line, and take multiple wading monitoring points on the actual wading line to determine the wading point linear regression line of the multiple wading monitoring points, and take the obtained wading point linear regression line as the target vehicle wading water line.
获取目标车辆的多个样本图像包括:采集目标车辆的初始环境图像,并识别初始环境图像中的水花高度和水浪高度;将初始环境图像中水花高度和水浪高度的最大值作为初始环境图像的水面波动值;当水面波动值小于标准水面波动值,保留初始环境图像,并将保留下的初始环境图像作为所述目标环境图像。Obtaining multiple sample images of the target vehicle includes: collecting the initial environment image of the target vehicle, and identifying the height of the splash and the height of the water wave in the initial environment image; taking the maximum value of the height of the splash and the height of the water wave in the initial environment image as the initial environment image The water surface fluctuation value; when the water surface fluctuation value is less than the standard water surface fluctuation value, the initial environment image is retained, and the retained initial environment image is used as the target environment image.
在本发明的一个实施例中,通过车载摄像装置采集得到大量车辆环境图像,其中一部分图像中存在较大的水花和水浪,以标准水面波动值为5cm为例,基于采集得到的车辆环境图像确定该图像中水花或水浪最高点的位置,并将该位置与水面的高度差作为该环境图像的水面波动值,比较任意环境图像和水面波动值和标准水面波动值,当环境图像的水面波动值大于标准水面波动值时,剔除该环境图像,保留水面波动值小于5cm的环境图像进行模型训练。In one embodiment of the present invention, a large number of vehicle environment images are collected by the vehicle-mounted camera device, and there are relatively large water splashes and water waves in some of the images. Taking the standard water surface fluctuation value of 5 cm as an example, based on the collected vehicle environment images Determine the position of the highest point of the water splash or water wave in the image, and use the height difference between the position and the water surface as the water surface fluctuation value of the environmental image, compare any environmental image and the water surface fluctuation value with the standard water surface fluctuation value, when the water surface of the environmental image When the fluctuation value is greater than the standard water surface fluctuation value, the environmental image is eliminated, and the environmental image with the water surface fluctuation value less than 5cm is retained for model training.
得到目标车辆的涉水水位线包括:获取多帧目标车辆的目标环境图像,将多帧目标环境图像输入至车辆涉水水位线识别模型,得到多条车辆涉水水位线;将多条车辆涉水水位线赋予计算权重,基于计算权重得到多条车辆涉水水位线的理论涉水水位线,并将该理论涉水水位线视为目标车辆的车辆涉水水位线。Obtaining the wading water level line of the target vehicle includes: obtaining multiple frames of the target environment image of the target vehicle, inputting the multiple frames of the target environment image into the vehicle wading water level recognition model to obtain multiple vehicle wading water lines; The water level is given calculation weights, based on the calculation weights, the theoretical wading water levels of multiple vehicle wading water levels are obtained, and the theoretical wading water levels are regarded as the vehicle wading water levels of the target vehicle.
在本发明的一个实施例中,以视频流帧率为30帧为例,即没30毫秒可采集得到一个信号,则将0.3秒内采集得到的10个车辆环境图像输入至车辆涉水水位线识别模型,得到10个不同的车辆涉水水位线,又基于各环境图像的清晰度给该10个车辆涉水水位线赋予不同的权重,然后基于各车辆涉水水位线的权重,融合得到一个理论涉水水位线,并将该理论涉水水位线视为目标车辆涉水水位线。In one embodiment of the present invention, taking the video stream with a frame rate of 30 frames as an example, that is, one signal can be collected every 30 milliseconds, then 10 vehicle environment images collected within 0.3 seconds are input to the vehicle wading water level Identify the model to obtain 10 different vehicle wading water levels, and assign different weights to the 10 vehicle wading water levels based on the clarity of each environmental image, and then based on the weight of each vehicle wading water level, fuse to obtain a Theoretical wading water level, and the theoretical wading water level is regarded as the wading water level of the target vehicle.
在本发明的一个实施例中,首先采集大量车辆行驶过程中的环境图像,通过训练,建立卷积神经网络模型,以用于确定目标车辆涉水水位线。In one embodiment of the present invention, a large number of environmental images during driving of the vehicle are firstly collected, and through training, a convolutional neural network model is established to determine the wading water level of the target vehicle.
在本发明的一个实施例中,将目标车辆的一个实时环境图像输入至训练后的车辆涉水状态识别模型中,确认该目标车辆未涉水,则控制该车辆正常运行,并持续检测其涉水情况。In one embodiment of the present invention, a real-time environment image of the target vehicle is input into the vehicle wading state recognition model after training, and it is confirmed that the target vehicle is not wading, then the vehicle is controlled to run normally, and its wading state is continuously detected. water condition.
在本发明的一个实施例中,将目标车辆的一个实时环境图像输入至训练后的车辆涉水状态识别模型中,确认该目标车辆涉水,则将该目标车辆涉水的信息发送至整车控制器,并由部署在整车控制器上的人工智能算法对得到的图像信息做进一步的数据处理。In one embodiment of the present invention, a real-time environment image of the target vehicle is input into the vehicle wading state recognition model after training, and if it is confirmed that the target vehicle is wading, the information of the target vehicle wading is sent to the whole vehicle The controller, and the artificial intelligence algorithm deployed on the vehicle controller performs further data processing on the obtained image information.
在本发明的一个实施例中,首先采集得到大量的车辆行驶过程中的车身环境图像,并认为的对相关车身环境图像中的车辆涉水水位线进行标注,形成数据集,然后基于该数据集对图像进行识别训练,从而得到车辆涉水水位线识别模型。In one embodiment of the present invention, a large number of vehicle body environment images in the process of vehicle driving are first collected, and the vehicle wading water level line in the relevant vehicle body environment images is considered to be marked to form a data set, and then based on the data set Recognition training is carried out on the image to obtain the vehicle wading water level recognition model.
在本发明的一个实施例中,采集得到目标车辆的目标环境图像,将该目标环境图像输入至车辆涉水水位线识别模型中,则得到该目标环境图像所对应的目标车辆的涉水水位线。In one embodiment of the present invention, the target environment image of the target vehicle is collected, and the target environment image is input into the vehicle wading water level recognition model, then the wading water level line of the target vehicle corresponding to the target environment image is obtained .
步骤S230,基于目标车辆涉水水位线与目标车辆的车辆标志位的位置关系,确定目标车辆的目标车辆涉水深度。Step S230: Determine the target vehicle wading depth of the target vehicle based on the positional relationship between the wading water level line of the target vehicle and the vehicle marker position of the target vehicle.
得到目标车辆的目标车辆涉水水位线之前还包括:基于目标环境图像,确定目标环境图像中积水区域的积水位置信息和目标环境图像中目标车辆轮胎的轮胎位置信息;基于积水位置信息和轮胎位置信息确定积水区域的积水位置和目标车辆轮胎的轮胎位置;若积水区域和轮胎区域存在重合,则判定目标车辆已涉水。Before obtaining the target vehicle wading water level line of the target vehicle, it also includes: based on the target environment image, determining the water accumulation position information of the water accumulation area in the target environment image and the tire position information of the target vehicle tire in the target environment image; and the tire position information to determine the water accumulation position of the water accumulation area and the tire position of the tire of the target vehicle; if the accumulation water area and the tire area overlap, it is determined that the target vehicle has waded.
在本发明的一个实施例中,首先采集大量车辆行驶过程中的环境图像,并基于环境图像信息确定目标车辆的轮胎位置区域和积水的位置区域,得到轮胎所在的区域为M1,而积水所在的区域为N1,其中区域M1和区域N1存在重合,则判定该目标车辆已涉水。In one embodiment of the present invention, a large number of environmental images in the driving process of the vehicle are first collected, and the tire location area and the water accumulation area of the target vehicle are determined based on the environmental image information, and the area where the tire is located is M1, and the water accumulation area is M1. If the area is N1, and the area M1 overlaps with the area N1, then it is determined that the target vehicle has waded.
在本发明的一个实施例中,首先采集大量车辆行驶过程中的环境图像,并基于环境图像信息确定目标车辆的轮胎位置区域和积水的位置区域,得到轮胎所在的区域为M2,而积水所在的区域为N2,其中区域M2和区域N2彼此独立,无重合区域,则判定该目标车辆未涉水。In one embodiment of the present invention, a large number of environmental images in the driving process of the vehicle are first collected, and the tire location area and the water accumulation area of the target vehicle are determined based on the environmental image information, so that the area where the tire is located is M2, and the water accumulation area is M2. If the area is N2, where the area M2 and the area N2 are independent of each other and there is no overlapping area, then it is determined that the target vehicle is not wading.
应当理解的是,在车辆行驶过程中,因为环境因素的改变,其环境图像的可靠性或清晰度都会随之改变,因此可以基于不同的环境采用不同的这水仙确定方法,其中包括基于标志位的相对位置关系或轮胎露出面积的占比关系共同确定车辆涉水深度。It should be understood that during the driving process of the vehicle, due to changes in environmental factors, the reliability or clarity of the environmental image will change accordingly, so different determination methods can be used based on different environments, including The relative positional relationship of the tires or the proportion relationship of the exposed area of the tires jointly determine the wading depth of the vehicle.
确定所述目标车辆的涉水深度还包括:获取目标车辆所处环境的积水深度、积水清澈度以及车辆轮胎的模糊面积,确定所述目标车辆所处环境的环境指数;基于车辆涉水水位线和目标标志位的相对位置关系计算得到的第一涉水深度,并基于轮胎露出面积和轮胎完整面积的比例关系计算得到的第二涉水深度;基于所述涉水环境指数,赋予所述第一涉水深度第一计算权重,赋予所述第二涉水深度第二计算权重,当所述涉水环境指数大于或等于标准环境指数,所述第一计算权重大于所述第二计算权重,当所述涉水环境指数小于标准环境指数,所述第一计算权重小于所述第二计算权重;基于所述第一涉水深度,第一计算权重,第二涉水深度,第二计算权重,确定所述目标车辆的涉水深度。在本发明的一个实施例中,当目标车辆在暴雨天气行驶在泥泞道路时,基于车辆所处的实际环境对车辆涉水Determining the wading depth of the target vehicle also includes: acquiring the depth of water in the environment where the target vehicle is located, the clarity of the water, and the blurred area of the vehicle tires, and determining the environmental index of the environment in which the target vehicle is located; The first wading depth obtained by calculating the relative positional relationship between the water level line and the target mark position, and the second wading depth calculated based on the proportional relationship between the exposed area of the tire and the complete area of the tire; based on the wading environment index, the given The first calculation weight of the first wading depth is assigned the second calculation weight of the second wading depth. When the wading environment index is greater than or equal to the standard environment index, the first calculation weight is greater than the second calculation weight Weight, when the wading environment index is less than the standard environment index, the first calculation weight is less than the second calculation weight; based on the first wading depth, the first calculation weight, the second wading depth, the second Calculate the weight to determine the wading depth of the target vehicle. In one embodiment of the present invention, when the target vehicle is driving on a muddy road in rainy weather, the vehicle is waded based on the actual environment where the vehicle is located.
首先采集得到目标车辆所处环境的积水情况和车辆轮胎的模糊面积情况,该模糊面积一般由车轮上的泥土对车轮面积存在遮挡导致。以积水深度不超过轮胎的3/4记1分,积水清晰可见记1分,车辆轮胎面积模糊记1分,反之记0分为例,得到该目标车辆的涉水环境指数。又以标准环境指数为3为例,当该目标车辆的环境指数小于3时,第一计算权重大于第二计算权重,假设较大的权重为70%,反之较小的权重为30%。Firstly, the water accumulation in the environment where the target vehicle is located and the blurred area of the vehicle tires are collected. The blurred area is generally caused by the mud on the wheel blocking the wheel area. If the depth of the accumulated water does not exceed 3/4 of the tire, 1 point will be awarded, 1 point will be awarded if the accumulated water is clearly visible, 1 point will be awarded if the tire area of the vehicle is blurred, and 0 points will be awarded otherwise, to obtain the wading environment index of the target vehicle. Taking the standard environmental index of 3 as an example, when the environmental index of the target vehicle is less than 3, the first calculation weight is greater than the second calculation weight, assuming that the larger weight is 70%, otherwise the smaller weight is 30%.
在本发明的一个实施例中,经过检测确定目标车辆所处的环境指数为3,标准环境指数为3,则设置第一计算权重为70%,第二计算权重为30%。通过计算得到第一涉水深度为45cm,第二涉水深度为43cm,则根据第一计算权重和第二计算权重得到理论涉水深度为44.4cm,则认为该目标车辆的涉水深度为44.4cm。In one embodiment of the present invention, after detection, it is determined that the environment index of the target vehicle is 3, and the standard environment index is 3, then the first calculation weight is set to 70%, and the second calculation weight is set to 30%. Through the calculation, the first wading depth is 45cm, and the second wading depth is 43cm, then according to the first calculation weight and the second calculation weight, the theoretical wading depth is 44.4cm, and the wading depth of the target vehicle is considered to be 44.4 cm.
在本发明的另一实施例中,经过检测确定目标车辆所述的环境指数为2,标准环境指数为3,则设置第一计算权重为30%,第二计算权重为70%。通过计算得到第一涉水深度为45cm,第二涉水深度为43cm,则根据第一计算权重和第二计算权重得到理论涉水深度为43.6cm,则认为该目标车辆的涉水深度为43.6cm。In another embodiment of the present invention, after detection, it is determined that the environmental index of the target vehicle is 2 and the standard environmental index is 3, then the first calculation weight is set to 30%, and the second calculation weight is set to 70%. Through calculation, the first wading depth is 45cm, and the second wading depth is 43cm. Then, according to the first calculation weight and the second calculation weight, the theoretical wading depth is 43.6cm, and the wading depth of the target vehicle is considered to be 43.6 cm.
图3是本申请的一示例性实施例示出的车辆涉水示意图。如图3所示,基于车辆的摄像机系统采集得到车辆一面车身的图像信息,该图像信息表明车辆与地面积水之间存在车辆涉水水位线,其中A点是涉水水位线与垂直坐标之间的交点,B点是轮胎的其中一个标志位的水平线与垂直坐标之间的交点,h为A点到B点之间的距离。Fig. 3 is a schematic diagram of vehicle wading shown in an exemplary embodiment of the present application. As shown in Figure 3, the vehicle-based camera system collects the image information of one side of the vehicle body. The image information indicates that there is a vehicle wading water level line between the vehicle and the ground water, and point A is the distance between the wading water level line and the vertical coordinate. The point of intersection between points B is the point of intersection between the horizontal line and the vertical coordinate of one of the tire marks, and h is the distance between point A and point B.
获取目标车辆的目标车辆涉水水位线之后,确定目标车辆的目标车辆涉水深度包括以下至少之一:获取目标环境图像中多个车辆标志位,并基于目标车辆涉水水位线和车辆标志位确定目标标志位,根据目标车辆涉水水位线和目标标志位的位置关系,确定目标车辆的涉水深度;获取目标车辆的轮胎完整面积,并将轮胎高于所述目标车辆涉水水位线部分面积视为轮胎露出面积,基于轮胎露水面积和轮胎完整面积的关系,确定目标车辆的涉水深度。After obtaining the target vehicle wading water level line of the target vehicle, determining the target vehicle wading depth of the target vehicle includes at least one of the following: acquiring multiple vehicle marker positions in the target environment image, and based on the target vehicle wading water level line and the vehicle marker position Determine the target mark position, determine the wading depth of the target vehicle according to the positional relationship between the wading water level line of the target vehicle and the target mark position; obtain the complete area of the tire of the target vehicle, and place the part of the tire higher than the wading water level line of the target vehicle The area is regarded as the exposed area of the tire, and the wading depth of the target vehicle is determined based on the relationship between the exposed area of the tire and the complete area of the tire.
获取目标环境图像中多个车辆标志位,并基于目标车辆涉水水位线和车辆标志位确定目标标志位,根据目标车辆涉水水位线和目标标志位的位置关系,确定目标车辆的涉水深度包括:获取目标环境图像中多个车辆标志位;基于目标车辆涉水水位线,将高于目标车辆涉水水位线的多个车辆标志位确定为多个期待标志位;将多个期待标志位中离目标车辆最近的一个车辆标志位,确定为目标标志位;基于目标标志位和目标标志位与目标车辆涉水水位线的位置关系,确定目标车辆的涉水深度。Obtain multiple vehicle markers in the target environment image, and determine the target marker based on the target vehicle's wading water level and the vehicle marker, and determine the wading depth of the target vehicle according to the positional relationship between the target vehicle's wading water level and the target marker Including: obtaining multiple vehicle markers in the target environment image; based on the target vehicle wading water level, determining multiple vehicle markers higher than the target vehicle wading water level as multiple expected markers; The vehicle marker closest to the target vehicle is determined as the target marker; based on the target marker and the positional relationship between the target marker and the wading water level line of the target vehicle, the wading depth of the target vehicle is determined.
基于目标标志位和目标标志位与目标车辆涉水水位线的位置关系,确定目标车辆的涉水深度包括:获取目标标志位的实际高度值,将目标标志位和目标车辆涉水水位线之间的距离,确定为间隔距离;基于间隔距离和预设图像距离-预设实际距离库,确定间隔距离的实际间隔,得到实际间隔值;基于目标标志位的实际高度值和实际间隔值的差值,确定目标车辆的涉水深度。Based on the target marker position and the positional relationship between the target marker position and the wading water level line of the target vehicle, determining the wading depth of the target vehicle includes: obtaining the actual height value of the target marker position, and dividing the distance between the target marker position and the wading water level line of the target vehicle. The distance is determined as the interval distance; based on the interval distance and the preset image distance-preset actual distance library, the actual interval of the interval distance is determined to obtain the actual interval value; the difference between the actual height value and the actual interval value based on the target mark , to determine the wading depth of the target vehicle.
在本发明的一个实施例中,根据图3所示车辆涉水情况,得到该目标车辆涉水水位线的位置为A点,得到一个高于A点且离A点最近的标志位为B点,则将B点确定为目标标志位,得到B点的实际高度为X1,又基于该图像得到涉水水位线A点到目标标志位的间隔为h。另外,通过摄像头的内外参数确定图像距离和实际距离的关系,得到预设图像距离-预设实际距离库,从而基于图像上的间隔距离h得到实际的间隔距离X2,根据B点的实际高度X1和B点与A点的间隔距离X2的差值,得到A点的实际高度,即目标车辆涉水深度。In one embodiment of the present invention, according to the wading situation of the vehicle shown in Figure 3, the position of the wading water level line of the target vehicle is obtained as point A, and a marker position higher than point A and closest to point A is obtained as point B , then determine point B as the target mark position, and obtain the actual height of point B as X1, and based on the image, obtain the interval from point A of the wading water level line to the target mark position as h. In addition, the relationship between the image distance and the actual distance is determined through the internal and external parameters of the camera, and the preset image distance-preset actual distance library is obtained, so that the actual separation distance X2 is obtained based on the separation distance h on the image, and the actual height X1 of point B is obtained. and the difference between the distance X2 between point B and point A to obtain the actual height of point A, that is, the wading depth of the target vehicle.
在本发明的一个实施例中,根据其车辆轮胎类别“260/70R16”得到轮胎直径为770毫米,其目标标志位的实际高度为385毫米,又通过预设图像距离-预设实际距离库得到间隔距离h的实际距离为30毫米,则得到该目标车辆的涉水深度为355毫米。In one embodiment of the present invention, according to its vehicle tire category "260/70R16", the tire diameter is 770 mm, and the actual height of the target mark is 385 mm, which is obtained through the preset image distance-preset actual distance library The actual distance of the separation distance h is 30 mm, then the wading depth of the target vehicle is obtained as 355 mm.
获取目标车辆的轮胎完整面积,并将轮胎高于目标车辆涉水水位线部分面积视为轮胎露出面积,基于轮胎露水面积和轮胎完整面积的关系,确定目标车辆的涉水深度包括:获取目标车辆轮胎露出水面的轮胎露出面积,并基于目标车辆的车辆型号确定轮胎完整面积;基于轮胎露出面积和轮胎完整面积确定目标车辆的轮胎露出面积比例;基于轮胎露出面积比例和预设轮胎露出面积比例-预设目标车辆涉水深度库,确定目标车辆的目标车辆涉水深度。Obtain the complete area of the tire of the target vehicle, and regard the area of the tire above the wading water level of the target vehicle as the exposed area of the tire. Based on the relationship between the exposed area of the tire and the complete area of the tire, determining the wading depth of the target vehicle includes: obtaining the target vehicle The tire exposed area of the tire exposed to the water surface, and determine the complete tire area based on the vehicle model of the target vehicle; determine the tire exposed area ratio of the target vehicle based on the tire exposed area and the complete tire area; based on the tire exposed area ratio and the preset tire exposed area ratio- The target vehicle wading depth library is preset to determine the target vehicle wading depth of the target vehicle.
在本发明的一个实施例中,如图3所示,A点即为该目标车辆的目标车辆涉水水位线,基于图像得到车辆轮胎露出水面部分的面积即A点以上部分面积为s,又通过摄像头的内外参数确定图像面积和实际面积的关系,从而得到该车辆轮胎露出水面部分的实际面积为S1,又基于车辆轮胎的型号,得到该车辆轮胎的完整面积为S0,从而得到该轮胎的轮胎露出面积比例K。根据车辆轮胎数据参数,得到其面积与高度的关系,从而确定预设轮胎露出面积比例-预设目标车辆涉水深度库,基于上述得到的轮胎露出比例,得到该目标车辆的涉水面积。In one embodiment of the present invention, as shown in Figure 3, point A is the target vehicle wading water level line of the target vehicle, and the area of the vehicle tire above the water surface is obtained based on the image, that is, the area above point A is s, and The relationship between the image area and the actual area is determined by the internal and external parameters of the camera, so that the actual area of the vehicle tire exposed to the water surface is S1, and based on the model of the vehicle tire, the complete area of the vehicle tire is obtained as S0, so that the tire is obtained. Tire exposed area ratio K. According to the vehicle tire data parameters, the relationship between its area and height is obtained, thereby determining the preset tire exposed area ratio-the preset target vehicle wading depth library, and based on the tire exposed ratio obtained above, the wading area of the target vehicle is obtained.
在本发明的一个实施例中,根据车轮型号,得到车辆轮胎完整面积S0为0.47平方米,并基于图像中的轮胎露出面积得到轮胎实际露出面积S1为0.235平方米,即得到该轮胎的轮胎露出面积比例K为1/2,根据预设的预设车轮涉水面积比值-预设涉水深度库得到该目标车辆的涉水深度为385毫米。In one embodiment of the present invention, according to the wheel model, the complete area S0 of the vehicle tire is obtained as 0.47 square meters, and based on the exposed area of the tire in the image, the actual exposed area S1 of the tire is obtained as 0.235 square meters, that is, the tire exposed area of the tire is obtained. The area ratio K is 1/2, and the wading depth of the target vehicle is obtained according to the preset wheel wading area ratio-the preset wading depth library to be 385 mm.
步骤S240,基于目标车辆涉水深度,确定目标车辆的涉水状态。Step S240, based on the wading depth of the target vehicle, determine the wading state of the target vehicle.
基于目标车辆涉水深度,确定目标车辆的涉水状态包括:基于目标车辆涉水深度,确定目标车辆涉水深度值,当目标车辆涉水深度大于或等于预设第一阈值,则判定目标车辆的涉水状态为一级涉水;当目标车辆涉水深度大于或等于预设第二阈值,则判定目标车辆的涉水状态为二级涉水;预设第一阈值小于预设第二阈值。Determining the wading state of the target vehicle based on the wading depth of the target vehicle includes: determining the wading depth value of the target vehicle based on the wading depth of the target vehicle, and determining the target vehicle when the wading depth of the target vehicle is greater than or equal to a preset first threshold The wading state of the target vehicle is a first-level wading; when the wading depth of the target vehicle is greater than or equal to the preset second threshold, it is determined that the wading state of the target vehicle is a second-level wading; the preset first threshold is less than the preset second threshold .
图4是本申请的一示例性实施例示出的车辆涉水示意图,如图4所示,其中,图中S1为地平线,S2为斜坡道路,S3为目标车辆涉水水位线,由此可见当目标车辆行驶在存在一定坡度的道路上时,其前后轮胎的涉水深度存在差异,根据国家标准《公路工程技术标准》(JTGB01-2003),可得到道路的最大坡比为9%,因此,计算可得,道路极限坡度的情况下其前后车轮的涉水深度仅存在厘米级差值,故在实际应用环境中采用包括但不限于降低预警标准或取信更高涉水深度做预警的方式以实现车轮涉水预警。Fig. 4 is a schematic diagram of vehicle wading shown in an exemplary embodiment of the present application. When the target vehicle is driving on a road with a certain slope, the wading depth of the front and rear tires is different. According to the national standard "Technical Standards for Highway Engineering" (JTGB01-2003), the maximum slope ratio of the road can be obtained as 9%. Therefore, It can be calculated that there is only a centimeter-level difference in the wading depth of the front and rear wheels under the condition of the extreme slope of the road. Therefore, in the actual application environment, methods including but not limited to lowering the warning standard or taking a higher wading depth as an early warning are adopted. Realize wheel wading warning.
确定所述目标车辆的目标车辆涉水深度还包括:获取所述目标车辆的多个涉水水位线,并将所述多个涉水水位线确定为预期涉水水位线;基于所述预期涉水水位线确定所述目标车辆的预期涉水深度,得到所述预期涉水深度最大值;将所述预期涉水深度最大值确定为所述目标车辆涉水深度。Determining the target vehicle wading depth of the target vehicle further includes: acquiring a plurality of wading water levels of the target vehicle, and determining the plurality of wading water levels as expected wading water levels; The water level line determines the expected wading depth of the target vehicle, and obtains the maximum value of the expected wading depth; the maximum value of the expected wading depth is determined as the wading depth of the target vehicle.
在本发明的一个实施例中,由于目标车辆行驶在斜坡路段,其前后轮胎的涉水深度存在差异,则取涉水深度值更大的一个值为车辆涉水深度,以完成车辆涉水预警,以车辆前轮胎涉水深度为40cm,车辆后轮胎涉水深度为48cm,h预警为45cm为例,则以车辆后轮胎的涉水深度为整车涉水深度,因为整车涉水深度48cm大于h预警45cm,则控制车辆发出相应的报警。In one embodiment of the present invention, since the target vehicle is driving on a slope section, there is a difference in the wading depth of the front and rear tires, the greater value of the wading depth is taken as the vehicle wading depth to complete the vehicle wading warning , taking the wading depth of the front tires of the vehicle as 40cm, the wading depth of the rear tires as 48cm, and the h warning as 45cm as an example, the wading depth of the rear tires is taken as the wading depth of the vehicle, because the wading depth of the vehicle is 48cm If it is greater than h warning 45cm, then control the vehicle to issue a corresponding alarm.
应当理解的是,还可以通过降低涉水预警的标准阈值以达到与上述方案相同的效果。It should be understood that the same effect as the above solution can also be achieved by lowering the standard threshold of water wading warning.
在本发明的一个实施例中,由于目标车辆行驶在斜坡路段,故其前后轮胎的涉水深度存在差异。以预设标准预警深度h预警=45cm为例,由于车辆行驶在斜坡路段,则降低其预警深度,以降低5cm为例,则在车辆涉水深度为40cm时,即向目标车辆发出预警。In one embodiment of the present invention, since the target vehicle is driving on a slope section, there are differences in the wading depths of the front and rear tires. Taking the preset standard early warning depth h early warning = 45cm as an example, since the vehicle is driving on a sloping road section, the early warning depth is lowered. Taking the reduction of 5 cm as an example, when the wading depth of the vehicle is 40 cm, an early warning is issued to the target vehicle.
图5是本申请的一示例性实施例示出的车辆涉水状态确定流程图。Fig. 5 is a flowchart showing a vehicle wading state determination according to an exemplary embodiment of the present application.
如图5所示,首先回去目标车辆的目标环境图像,然后基于环境图像确定该目标车辆是否涉水,若该目标车辆未涉水,则持续检测其涉水状态,若该目标车辆已涉水,则确定该目标车辆涉水水位线,基于该目标车辆涉水水位线确定目标车车辆的涉水深度,基于得到的涉水深度和预设的阈值确定该目标车辆的涉水状态。As shown in Figure 5, first go back to the target environment image of the target vehicle, and then determine whether the target vehicle is wading based on the environment image, if the target vehicle is not wading, continue to detect its wading state, if the target vehicle has , then determine the wading water level of the target vehicle, determine the wading depth of the target vehicle based on the wading water level of the target vehicle, and determine the wading state of the target vehicle based on the obtained wading depth and a preset threshold.
在本发明的一个实施例中,基于采集得到的目标环境图像,确定该目标车辆并未涉水,则不作任何响应,正常运行并持续检测该目标车辆的涉水情况。In one embodiment of the present invention, if it is determined that the target vehicle is not wading based on the collected target environment image, no response is made, and the vehicle operates normally and continuously detects the wading situation of the target vehicle.
在本发明的一个实施例中,预设第一阈值为h预警,第二阈值为h极限,且h预警<h极限,又基于上述车辆涉水水位线识别模型得到目标车辆的涉水深度为h涉水,比较h涉水和h预警的关系,得到h涉水<h预警,则目标车辆已涉水,但不作任何响应,正常运行并持续检测该目标车辆的涉水情况。In one embodiment of the present invention, the preset first threshold is h early warning , the second threshold is h limit , and h early warning < h limit , and based on the above vehicle wading water level line identification model, the wading depth of the target vehicle is h wading , compare the relationship between h wading and h early warning , if h wading < h early warning , then the target vehicle has waded, but does not make any response, operates normally and continuously detects the wading situation of the target vehicle.
在本发明的一个实施例中,预设第一阈值为h预警,第二阈值为h极限,且h预警<h极限,有基于上述车辆涉水水位线识别模型得到目标车辆的涉水深度为h涉水,比较h涉水和h预警的关系,得到h涉水≥h预警,则判定该目标车辆的涉水状态为一级涉水。In one embodiment of the present invention, the preset first threshold is h early warning , the second threshold is h limit , and h early warning < h limit , and the wading depth of the target vehicle is obtained based on the vehicle wading water level line identification model above h wading , compare the relationship between h wading and h early warning , if h wading ≥ h early warning , then it is determined that the wading state of the target vehicle is a first-level wading.
在本发明的一个实施例中,预设第一阈值为h预警,第二阈值为h极限,且h预警<h极限,有基于上述车辆涉水水位线识别模型得到目标车辆的涉水深度为h涉水,比较h涉水和h预警的关系,得到h涉水≥h极限,则判定该目标车辆的涉水状态为二级涉水。In one embodiment of the present invention, the preset first threshold is h early warning , the second threshold is h limit , and h early warning < h limit , and the wading depth of the target vehicle is obtained based on the vehicle wading water level line identification model above h wading , compare the relationship between h wading and h early warning , and get h wading ≥ h limit , then it is determined that the wading state of the target vehicle is a second-level wading.
图6是本申请的一示例性实施例示出的车辆涉水状态确定装置的框图。该装置可以应用于图1所示的实施环境,并具体配置在智能终端103中。该装置也可以适用于其它的示例性实施环境,并具体配置在其它设备中,本实施例不对该装置所适用的实施环境进行限制。Fig. 6 is a block diagram of an apparatus for determining a vehicle wading state according to an exemplary embodiment of the present application. The device can be applied to the implementation environment shown in FIG. 1 and is specifically configured in the
如图6所示,该示例性的车辆涉水状态确定装置包括:图像获取模块610,涉水确定模块620,涉水深度确定模块630,涉水状态确定模块640。As shown in FIG. 6 , the exemplary vehicle wading state determination device includes: an
其中,图像获取模块610,用于获取目标车辆的目标环境图像,目标环境图像包括目标车辆的至少一面车身的车身图像;涉水确定模块620,用于基于目标环境图像,得到目标车辆的目标车辆涉水水位线;涉水深度确定模块630,用于基于目标车辆涉水水位线与目标车辆预设标志位的位置关系,确定目标车辆的目标车辆涉水深度;涉水状态确定模块640,用于基于目标车辆涉水深度,确定目标车辆的涉水状态。Wherein, the
上述图像获取模块610所包括的摄像机均为车辆本身已有的用于驾驶员观察车辆周身状况的全景影像摄像机,故无需增加额外的外设设备,以节约成本。另外,在车辆运行过程中,车载摄像机一直处于启动状态,即可自动监测车辆涉水情况,并在涉水深度超过预设的阈值时发出提醒,而无需由驾驶员主动触发涉水深度感应系统。The cameras included in the above-mentioned
需要说明的是,上述实施例所提供的车辆涉水状态确定装置与上述实施例所提供的车辆涉水状态确定方法属于同一构思,其中各个模块和单元执行操作的具体方式已经在方法实施例中进行了详细描述,此处不再赘述。上述实施例所提供的路况刷新装置在实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能,本处也不对此进行限制。It should be noted that the device for determining the vehicle wading state provided in the above-mentioned embodiments and the method for determining the vehicle wading state provided in the above-mentioned embodiments belong to the same concept, and the specific operation methods of each module and unit have been described in the method embodiment has been described in detail, and will not be repeated here. In the actual application of the road condition refreshing device provided by the above-mentioned embodiments, the above-mentioned function allocation can be completed by different functional modules according to the needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. , which is not limited here.
基于目标车辆涉水深度,确定目标车辆的涉水状态之后还包括:当目标车辆涉水状态为一级涉水,发出一级报警,以提醒驾驶员当前车辆已涉水;当目标车辆涉水状态为二级涉水,发出二级报警,以提醒驾驶员当前车辆零件已涉水。Based on the wading depth of the target vehicle, after determining the wading state of the target vehicle, it also includes: when the wading state of the target vehicle is a first-level wading, a first-level alarm is issued to remind the driver that the current vehicle has waded; when the target vehicle is wading The state is level 2 wading, and a level 2 alarm is issued to remind the driver that the current vehicle parts have been wading.
图7是本申请的一示例性实施例示出的车辆涉水报警装置框图。Fig. 7 is a block diagram of a vehicle wading alarm device according to an exemplary embodiment of the present application.
如图7所示,该车辆涉水报警装置包括:显示模块710,指示灯模块720和扬声器模块730。As shown in FIG. 7 , the vehicle wading warning device includes: a
其中,显示模块710,显示模块包括至少一个显示屏,用于基于目标车辆涉水状态发出文字报警信息;指示灯模块720,指示灯模块包括至少2种颜色指示灯,用于于目标车辆涉水状态启动不同颜色的指示灯,发出灯光报警信息;扬声器模块730,扬声器模块包括至少一个蜂鸣器,用于基于目标车辆的涉水状态,发出语音报警信息。Among them, the
在本发明的一个实施例中,基于上述判断条件,确定目标车辆的涉水状态为一级涉水,则控制目标车辆发出一级报警,该一级警报包括但不限于通过仪表盘或中控屏显示当前的涉水深度,同时启动黄色指示灯,并通过蜂鸣器或喇叭发出“当前水深已超过预警深度,继续行驶将可能导致熄火的风险”的语音播报,以提醒驾驶员及时更改行车路线。In one embodiment of the present invention, based on the above judgment conditions, it is determined that the wading state of the target vehicle is a first-level wading, and then the target vehicle is controlled to issue a first-level alarm, which includes but is not limited to through the instrument panel or the central control system. The screen displays the current wading depth, and at the same time activates the yellow indicator light, and sends out a voice broadcast through the buzzer or horn that "the current water depth has exceeded the warning depth, and continuing to drive may cause the risk of flameout" to remind the driver to change the driving in time route.
在本发明的一个实施例中,基于上述判断条件,确定目标车辆的涉水状态为二级涉水,则控制目标车辆发出二级报警,该二级警报包括但不限于通过仪表盘或中控屏显示当前的涉水深度,同时启动红色指示灯,并通过蜂鸣器或喇叭发出“车辆某某重要部件已开始进水,请立即退出当前水域”的语音播报,以提醒驾驶员即刻停止前行并检查车辆状态。In one embodiment of the present invention, based on the above judgment conditions, it is determined that the wading state of the target vehicle is a secondary wading state, and then the target vehicle is controlled to issue a secondary alarm, which includes but is not limited to the instrument panel or central control The screen displays the current wading depth, and at the same time starts the red indicator light, and sends out the voice broadcast of "a certain important part of the vehicle has begun to enter the water, please exit the current water area immediately" through the buzzer or horn to remind the driver to stop immediately OK and check the vehicle status.
图8是本申请的一示例性实施例示出的车辆涉水状态确定装置架构示意图;图9是本申请的一示例性实施例示出的车辆涉水状态确定装置连接关系示意图。Fig. 8 is a schematic structural diagram of a device for determining a vehicle wading state shown in an exemplary embodiment of the present application; Fig. 9 is a schematic diagram of the connection relationship of a device for determining a vehicle wading state shown in an exemplary embodiment of the present application.
如图8和图9所示,车辆涉水状态确定装置包括:车载摄像机模块910(等同于上述图像获取模块610),车辆涉水检测模块920(等同于上述涉水状态确定模块620),车身高度工程标定模块930(等同于上述涉水深度确定模块630),整车控制器模块940(等同于上述涉水状态确定模块640),预警报警模块950(等同于上述图7所示的车辆涉水报警装置)。As shown in Fig. 8 and Fig. 9, the vehicle wading state determination device includes: a vehicle-mounted camera module 910 (equivalent to the above-mentioned image acquisition module 610), a vehicle wading detection module 920 (equivalent to the above-mentioned wading state determination module 620), a vehicle body Altitude engineering calibration module 930 (equivalent to the above-mentioned wading depth determination module 630), vehicle controller module 940 (equivalent to the above-mentioned wading state determination module 640), early warning and alarm module 950 (equivalent to the above-mentioned vehicle wading shown in FIG. water alarm device).
其中车载摄像机模块包括前视摄像机和两个侧视摄像机,可通过环绕车身的影像系统,确保对车辆四周涉水状态的全方位监测。基于图8和图9所示的车载摄像机模块,车辆涉水检测模块,车身高度工程标定模块,整车控制器模块,预警报警模块之间的连接关系为:车载摄像机模块与车辆涉水检测模块相连,车辆涉水检测模块与整车控制器模块相连,整车控制器模块与预警报警模块相连,另外车身高度工程标定模块与整车控制器模块相连。The on-board camera module includes a front-view camera and two side-view cameras, which can ensure all-round monitoring of the wading state around the vehicle through the imaging system surrounding the vehicle body. Based on the vehicle-mounted camera module shown in Figure 8 and Figure 9, the vehicle wading detection module, the vehicle body height engineering calibration module, the vehicle controller module, and the connection relationship between the early warning and alarm module are: the vehicle-mounted camera module and the vehicle wading detection module The vehicle wading detection module is connected to the vehicle controller module, the vehicle controller module is connected to the early warning and alarm module, and the body height engineering calibration module is connected to the vehicle controller module.
图10是本申请的一示例性实施例示出的车辆涉水报警反应全流程图。Fig. 10 is a full flowchart of vehicle wading alarm response shown in an exemplary embodiment of the present application.
如图10所示,通过摄像头识别车辆涉水状态,并根据情况决定是否触发车辆涉水深度感应。同时,整车控制器结合摄像头和车身高度工程标定系统计算出车辆涉水深度信息,判断当前预警等级。涉水深度大于预警深度,小于极限涉水深度时,通过仪表盘或中控屏显示当前的涉水深度,并通过蜂鸣器或喇叭发出“当前水深已超过预警深度,继续行驶将可能导致熄火的风险”的语音播报,以提醒驾驶员及时更改行车路线。涉水深度大于极限涉水深度时,通过仪表盘或中控屏显示当前的涉水深度,并通过蜂鸣器或喇叭发出“车辆某某重要部件已开始进水,请立即退出当前水域”的语音播报,以提醒驾驶员即刻停止前行并检查车辆状态。另外,上述安全预警播放会一直存在,直至车辆已脱离涉水环境或涉水深度已不处于上述预警范围。As shown in Figure 10, the camera recognizes the vehicle wading state, and decides whether to trigger the vehicle wading depth sensing according to the situation. At the same time, the vehicle controller combines the camera and the vehicle body height engineering calibration system to calculate the vehicle wading depth information and judge the current warning level. When the wading depth is greater than the warning depth but less than the limit wading depth, the current wading depth will be displayed on the instrument panel or the central control screen, and the buzzer or horn will send out "the current water depth has exceeded the warning depth, continuing to drive may lead to flameout risk" voice broadcast to remind the driver to change the driving route in time. When the wading depth is greater than the limit wading depth, the current wading depth will be displayed on the instrument panel or the central control screen, and the buzzer or horn will send out the message "some important part of the vehicle has begun to enter water, please exit the current water area immediately" Voice broadcast to remind the driver to stop immediately and check the vehicle status. In addition, the above-mentioned safety warning playback will always exist until the vehicle has left the wading environment or the wading depth is no longer within the above-mentioned warning range.
图11示出了适于用来实现本申请实施例的电子设备的计算机系统的结构示意图。需要说明的是,图11示出的电子设备的计算机系统1000仅是一个示例,不应对本申请实施例的功能和使用范围带来任何限制。FIG. 11 shows a schematic structural diagram of a computer system suitable for implementing the electronic device of the embodiment of the present application. It should be noted that the computer system 1000 of the electronic device shown in FIG. 11 is only an example, and should not limit the functions and scope of use of the embodiments of the present application.
如图11所示,计算机系统1100包括中央处理单元(CentralProcessingUnit,CPU)1101,其可以根据存储在只读存储器(Read-OnlyMemory,ROM)1102中的程序或者从储存部分1108加载到随机访问存储器(RandomAccessMemory,RAM)1103中的程序而执行各种适当的动作和处理,例如执行上述实施例中的方法。在RAM1103中,还存储有系统操作所需的各种程序和数据。CPU1101、ROM1102以及RAM1103通过总线1104彼此相连。输入/输出(Input/Output,I/O)接口1105也连接至总线1104。As shown in FIG. 11 , the
以下部件连接至I/O接口1105:包括键盘、鼠标等的输入部分1106;包括诸如阴极射线管(CathodeRayTube,CRT)、液晶显示器(LiquidCrystalDisplay,LCD)等以及扬声器等的输出部分1107;包括硬盘等的储存部分1108;以及包括诸如LAN(LocalAreaNetwork,局域网)卡、调制解调器等的网络接口卡的通信部分1109。通信部分1109经由诸如因特网的网络执行通信处理。驱动器1010也根据需要连接至I/O接口1105。可拆卸介质1111,诸如磁盘、光盘、磁光盘、半导体存储器等等,根据需要安装在驱动器1110上,以便于从其上读出的计算机程序根据需要被安装入储存部分1108。The following components are connected to the I/O interface 1105: an
特别地,根据本申请的实施例,上文参考流程图描述的过程可以被实现为计算机软件程序。例如,本申请的实施例包括一种计算机程序产品,其包括承载在计算机可读介质上的计算机程序,该计算机程序包含用于执行流程图所示的方法的计算机程序。在这样的实施例中,该计算机程序可以通过通信部分1109从网络上被下载和安装,和/或从可拆卸介质1111被安装。在该计算机程序被中央处理单元(CPU)1101执行时,执行本申请的系统中限定的各种功能。In particular, according to the embodiments of the present application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, the embodiments of the present application include a computer program product, which includes a computer program carried on a computer-readable medium, where the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from a network via
需要说明的是,本申请实施例所示的计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质或者是上述两者的任意组合。计算机可读存储介质例如可以是电、磁、光、电磁、红外线、或半导体的系统、装置或器件,或者任意以上的组合。计算机可读存储介质的更具体的例子可以包括但不限于:具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(ErasableProgrammableReadOnlyMemory,EPROM)、闪存、光纤、便携式紧凑磁盘只读存储器(CompactDiscRead-Only Memory,CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本申请中,计算机可读的信号介质可以包括在基带中或者作为载波一部分传播的数据信号,其中承载了计算机可读的计算机程序。这种传播的数据信号可以采用多种形式,包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读的信号介质还可以是计算机可读存储介质以外的任何计算机可读介质,该计算机可读介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。计算机可读介质上包含的计算机程序可以用任何适当的介质传输,包括但不限于:无线、有线等等,或者上述的任意合适的组合。It should be noted that the computer-readable medium shown in the embodiment of the present application may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programmable Read-Only Memory (Erasable Programmable Read-Only Memory, EPROM), flash memory, optical fiber, portable compact disk read-only memory (Compact Disc Read-Only Memory, CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In this application, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying a computer-readable computer program thereon. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. . A computer program embodied on a computer readable medium can be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.
附图中的流程图和框图,图示了按照本申请各种实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。其中,流程图或框图中的每个方框可以代表一个模块、程序段、或代码的一部分,上述模块、程序段、或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意,在有些作为替换的实现中,方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如,两个接连地表示的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,框图或流程图中的每个方框、以及框图或流程图中的方框的组合,可以用执行规定的功能或操作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. Wherein, each block in the flowchart or block diagram may represent a module, a program segment, or a part of the code, and the above-mentioned module, program segment, or part of the code includes one or more executable instruction. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block in the block diagrams or flowchart illustrations, and combinations of blocks in the block diagrams or flowchart illustrations, can be implemented by a dedicated hardware-based system that performs the specified function or operation, or can be implemented by a A combination of dedicated hardware and computer instructions.
描述于本申请实施例中所涉及到的单元可以通过软件的方式实现,也可以通过硬件的方式来实现,所描述的单元也可以设置在处理器中。其中,这些单元的名称在某种情况下并不构成对该单元本身的限定。The units described in the embodiments of the present application may be implemented by software or by hardware, and the described units may also be set in a processor. Wherein, the names of these units do not constitute a limitation of the unit itself under certain circumstances.
本申请的另一方面还提供了一种计算机可读存储介质,其上存储有计算机程序,该计算机程序被计算机的处理器执行时,使计算机执行如前的车辆涉水状态确定方法。该计算机可读存储介质可以是上述实施例中描述的电子设备中所包含的,也可以是单独存在,而未装配入该电子设备中。Another aspect of the present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor of a computer, the computer is made to execute the method for determining a vehicle wading state as above. The computer-readable storage medium may be included in the electronic device described in the above embodiments, or may exist independently without being assembled into the electronic device.
本申请的另一方面还提供了一种计算机程序产品或计算机程序,该计算机程序产品或计算机程序包括计算机指令,该计算机指令存储在计算机可读存储介质中。计算机设备的处理器从计算机可读存储介质读取该计算机指令,处理器执行该计算机指令,使得该计算机设备执行上述各个实施例中提供的车辆涉水状态确定方法。Another aspect of the present application also provides a computer program product or computer program, the computer program product or computer program comprising computer instructions stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method for determining the vehicle wading state provided in the above-mentioned embodiments.
上述实施例仅示例性说明本发明的原理及其功效,而非用于限制本发明。任何熟悉此技术的人士皆可在不违背本发明的精神及范畴下,对上述实施例进行修饰或改变。因此,但凡所属技术领域中具有通常知识者在未脱离本发明所揭示的精神与技术思想下所完成的一切等效修饰或改变,仍应由本发明的权利要求所涵盖。The above-mentioned embodiments only illustrate the principles and effects of the present invention, but are not intended to limit the present invention. Anyone skilled in the art can modify or change the above-mentioned embodiments without departing from the spirit and scope of the present invention. Therefore, all equivalent modifications or changes made by those skilled in the art without departing from the spirit and technical ideas disclosed in the present invention shall still be covered by the claims of the present invention.
Claims (17)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211611668.0A CN115830563A (en) | 2022-12-14 | 2022-12-14 | Method, device, equipment and storage medium for determining vehicle wading state |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211611668.0A CN115830563A (en) | 2022-12-14 | 2022-12-14 | Method, device, equipment and storage medium for determining vehicle wading state |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115830563A true CN115830563A (en) | 2023-03-21 |
Family
ID=85547414
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211611668.0A Pending CN115830563A (en) | 2022-12-14 | 2022-12-14 | Method, device, equipment and storage medium for determining vehicle wading state |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115830563A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109632037A (en) * | 2018-12-12 | 2019-04-16 | 四创科技有限公司 | A kind of urban waterlogging depth of accumulated water detection method based on digital image recognition |
| CN114332820A (en) * | 2021-12-30 | 2022-04-12 | 上海洛轲智能科技有限公司 | Vehicle wading early warning method and device and electronic equipment |
| US20220170757A1 (en) * | 2020-12-02 | 2022-06-02 | Toyota Jidosha Kabushiki Kaisha | Information processing apparatus, information processing system, information processing method and non-transitory storage medium |
| CN115334283A (en) * | 2022-07-26 | 2022-11-11 | 同致电子科技(厦门)有限公司 | A water wading detection system and method based on a surround-view image system |
-
2022
- 2022-12-14 CN CN202211611668.0A patent/CN115830563A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109632037A (en) * | 2018-12-12 | 2019-04-16 | 四创科技有限公司 | A kind of urban waterlogging depth of accumulated water detection method based on digital image recognition |
| US20220170757A1 (en) * | 2020-12-02 | 2022-06-02 | Toyota Jidosha Kabushiki Kaisha | Information processing apparatus, information processing system, information processing method and non-transitory storage medium |
| CN114332820A (en) * | 2021-12-30 | 2022-04-12 | 上海洛轲智能科技有限公司 | Vehicle wading early warning method and device and electronic equipment |
| CN115334283A (en) * | 2022-07-26 | 2022-11-11 | 同致电子科技(厦门)有限公司 | A water wading detection system and method based on a surround-view image system |
Non-Patent Citations (2)
| Title |
|---|
| BYSTROV, A等: "Underwater optical imaging for automotive wading. Sensors", 《SENSORS》, vol. 18, no. 12, 18 December 2018 (2018-12-18), pages 1 - 12 * |
| 杨振宇等: "图像识别技术在水位监测中的比测分析", 《JOURNAL OF WATER RESOURCES RESEARCH》, vol. 9, no. 2, 30 April 2020 (2020-04-30), pages 218 - 225 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110430401B (en) | Vehicle blind area early warning method, early warning device, MEC platform and storage medium | |
| CN112937486B (en) | Vehicle-mounted online monitoring and driving assistance system and method for road accumulated water | |
| CN108647437A (en) | A kind of autonomous driving vehicle evaluation method and evaluation system | |
| CN107264521B (en) | A vehicle turning safety warning system | |
| CN106143308B (en) | Lane Departure Warning System based on intelligent back vision mirror | |
| CN107479061A (en) | A kind of safe early warning method and system based on image recognition and radar range finding | |
| CN108615383B (en) | Vehicle Traffic Intersection Assisted Traffic System and Control Method Based on Inter-vehicle Communication | |
| CN113140129B (en) | Vehicle early warning method, device and system | |
| CN101934771A (en) | Vehicle Collision Warning System | |
| CN110929606A (en) | Vehicle blind area pedestrian monitoring method and device | |
| CN111231946B (en) | Low-sight-distance vehicle safe driving control method | |
| CN204667643U (en) | A kind of early warning system for bend vehicle meeting early warning | |
| CN112216111A (en) | Vehicle speed and distance early warning system and method based on microwave radar and video image | |
| CN115862383B (en) | An Uncertainty-Based Quantification Method for the Potential Risk of Vehicle Blind Spots | |
| CN107680396A (en) | The monitoring method and its device of a kind of driving behavior | |
| CN115675282A (en) | Reversing early warning strategy determination method, early warning method, system, equipment and medium | |
| CN110930767B (en) | Intelligent highway safety early warning method and early warning system | |
| CN115830563A (en) | Method, device, equipment and storage medium for determining vehicle wading state | |
| CN116572845A (en) | Environment information detection method, device, storage medium and vehicle | |
| CN115431977A (en) | Automobile passability evaluation system, method and method for assisting automobiles to pass through obstacles | |
| CN111845560B (en) | A warning system for a vehicle head overrunning an object | |
| CN115416574A (en) | Strong light early warning method, device, equipment and storage medium in automobile driving | |
| CN114202962A (en) | Method and device for vehicle early warning | |
| CN108648479B (en) | Device and method for reminding night foggy road section in real time by using electronic map | |
| TW201434695A (en) | Driving safety distance display method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |