CN115134496B

CN115134496B - Intelligent driving control method, system, vehicle, electronic equipment and storage medium

Info

Publication number: CN115134496B
Application number: CN202210730986.2A
Authority: CN
Inventors: 蒲星; 卢斌
Original assignee: Chongqing Changan Automobile Co Ltd
Current assignee: Chongqing Changan Automobile Co Ltd
Priority date: 2022-06-24
Filing date: 2022-06-24
Publication date: 2023-07-14
Anticipated expiration: 2042-06-24
Also published as: CN115134496A

Abstract

The application provides an intelligent driving control method, an intelligent driving control system, electronic equipment and a storage medium, wherein request information is generated according to a cabin domain controller of a vehicle and is transmitted to the cabin domain controller; analyzing the request information by using a driving domain controller, and determining an image shooting device to be multiplexed from the existing image shooting devices of the vehicle according to an analysis result; the frame rate configuration is carried out on the image shooting device to be multiplexed, and the original image data shot after the frame rate configuration is completed is obtained; and transmitting the original image data, and transmitting the processed image data to a cabin controller to perform intelligent driving control on the vehicle. When the intelligent driving control is carried out on the vehicle, the existing image shooting device of the vehicle can be reused, and the hardware cost of the vehicle when the intelligent driving control is carried out is reduced; meanwhile, by multiplexing the existing image photographing device of the vehicle, the flexibility of the existing image photographing device of the vehicle can be improved.

Description

Intelligent driving control method, system, vehicle, electronic equipment and storage medium

Technical Field

The application relates to the technical field of vehicle control, in particular to an intelligent driving control method, an intelligent driving control system, electronic equipment and a storage medium.

Background

As consumer demand for safety and convenience of vehicles increases, more and more vehicles are equipped with intelligent driving systems. The intelligent driving system is used as an advanced auxiliary driving system, can improve the driving safety of the vehicle, and can help a driver to realize auxiliary driving under a limited scene. However, various sensors such as cameras, lidar, millimeter wave radar, etc. are required for the operation of the intelligent driving system, and cameras are widely used as a sensor with low cost and stable performance in the intelligent driving system. However, the performance of the camera as a sensor is affected by the angle of view, and if the vehicle needs to cover more scenes, the range of view to the surrounding environment during the running of the vehicle is enlarged, and more cameras are usually needed to be used for realizing. If a new camera is set for each scene to acquire a corresponding view angle range, the method not only increases the hardware cost of the vehicle; meanwhile, if cameras arranged on the vehicle can only be used for a single scene, the utilization rate of the cameras is low, and the flexibility is insufficient.

Disclosure of Invention

In view of the above drawbacks of the prior art, the present application provides an intelligent driving control method, system, electronic device and storage medium, so as to solve the technical problems of high hardware cost and low flexibility of a camera when the intelligent driving control is performed on the current vehicle.

The application provides an intelligent driving control method which is applied to a driving domain controller of a target vehicle, and comprises the following steps of:

receiving request information sent by a cabin domain controller of the target vehicle;

analyzing the request information, and determining one or more image shooting devices from the existing image shooting devices of the target vehicle according to an analysis result, wherein the one or more image shooting devices are used as image shooting devices to be multiplexed;

performing frame rate configuration on the image shooting device to be multiplexed, and acquiring original image data shot by the image shooting device to be multiplexed after the frame rate configuration is completed;

and transmitting the original image data, and transmitting the processed image data to the cabin controller so as to carry out intelligent driving control on the target vehicle.

In an embodiment of the present application, the process of analyzing the request information and determining one or more image capturing devices according to the analysis result includes:

Analyzing the request information, and acquiring a request pixel corresponding to the request information from an analysis result;

acquiring original pixels of each image shooting device existing in the target vehicle;

matching the request pixel with original pixels of each image shooting device existing in the target vehicle, and determining one or more image shooting devices from the existing image shooting devices of the target vehicle so that the sum of the determined original pixels of all the image shooting devices is equal to the request pixel; or, the original pixel of each image capturing device is determined to be greater than or equal to the request pixel.

In an embodiment of the present application, the process of configuring the frame rate of the image capturing device to be multiplexed includes:

acquiring an original frame rate of the image shooting device to be multiplexed, and acquiring a request frame rate corresponding to the request information from the analysis result;

and comparing the request frame rate with the original frame rate, and configuring the frame rate of the image shooting device to be multiplexed when the request frame rate is different from the original frame rate, so that the configured frame rate of the image shooting device to be multiplexed is the same as the request frame rate.

In an embodiment of the present application, the process of transmitting the raw image data and transmitting the processed image data to the cabin controller includes:

acquiring original image data shot by an image shooting device to be multiplexed after finishing frame rate configuration, and decompressing the original image data by using a first deserializer to obtain first decompressed image data;

cutting or splicing the first decompressed image data, and compressing the cut or spliced image data by using a serializer;

and transmitting the compressed image data to the cabin controller.

In an embodiment of the present application, the process of stitching the first decompressed image data includes:

acquiring the number of each image shooting device in the image shooting devices to be multiplexed and corresponding first decompressed image data;

correlating the number of each image shooting device with the corresponding first decompressed image data to form an image data set; wherein the number of each image data set is preceding and the first decompressed image data is following;

all the image data sets are spliced in sequence according to the serial number sequence, and a preset end frame mark is inserted between two adjacent image data sets.

The application also provides an intelligent driving control method applied to a cabin area controller of a target vehicle, comprising the following steps:

generating request information and transmitting the request information to a driving domain controller of the target vehicle; the method comprises the steps of,

receiving image data transmitted after the driving domain controller analyzes the request information, and performing intelligent driving control on the target vehicle according to the received image data; wherein the request information is used for multiplexing one or more image capturing devices existing in the target vehicle;

after the driving domain controller receives the request information, the driving domain controller analyzes the request information, and determines one or more image shooting devices from the existing image shooting devices of the target vehicle according to an analysis result to serve as image shooting devices to be multiplexed; the frame rate configuration is carried out on the image shooting device to be multiplexed, and original image data shot by the image shooting device to be multiplexed after the frame rate configuration is completed is obtained; and transmitting the original image data, and transmitting the processed image data to the cabin controller.

In an embodiment of the present application, the process of performing intelligent driving control on the target vehicle according to the received image data includes:

decompressing the received image data by using a second deserializer to obtain second decompressed image data;

and reversely disassembling the second decompressed image data according to the number of each image shooting device in the image shooting devices to be multiplexed and a preset end frame mark, and performing intelligent driving control on the target vehicle according to the reversely disassembled image data.

The application also provides an intelligent driving control method applied to a target vehicle, wherein the target vehicle comprises a cabin domain controller and a driving domain controller, and the method comprises the following steps:

generating request information according to the cabin domain controller, and transmitting the request information to the driving domain controller, wherein the request information is used for multiplexing one or more existing image shooting devices of the target vehicle;

analyzing the request information by using the driving domain controller, and determining one or more image shooting devices from the existing image shooting devices of the target vehicle according to an analysis result to serve as image shooting devices to be multiplexed; the frame rate configuration is carried out on the image shooting device to be multiplexed, and original image data shot by the image shooting device to be multiplexed after the frame rate configuration is completed is obtained; and transmitting the original image data, and transmitting the processed image data to the cabin controller so as to perform intelligent driving control on the target vehicle.

The application also provides an intelligent driving control system, which is applied to a driving domain controller of a target vehicle, and comprises:

the analysis unit is used for receiving the request information sent by the cabin domain controller of the target vehicle and analyzing the request information;

the multiplexing unit is used for determining one or more image shooting devices from the existing image shooting devices of the target vehicle according to the analysis result, and the one or more image shooting devices are used as image shooting devices to be multiplexed;

the frame rate configuration unit is used for carrying out frame rate configuration on the image shooting device to be multiplexed and acquiring original image data shot by the image shooting device to be multiplexed after the frame rate configuration is completed;

and the transmission processing unit is used for carrying out transmission processing on the original image data and transmitting the processed image data to the cabin domain controller so as to carry out intelligent driving control on the target vehicle.

The application also provides an intelligent driving control system, which is applied to a cabin area controller of a target vehicle, and comprises:

a request generation unit configured to generate request information for multiplexing one or more image capturing devices existing in the target vehicle;

A request transmission unit configured to transmit the request information to a driving-domain controller of the target vehicle;

the image receiving unit is used for receiving the image data transmitted after the driving domain controller analyzes the request information;

and the driving control unit is used for performing intelligent driving control on the target vehicle according to the received image data.

The application also provides an intelligent driving control system, which comprises:

a request generation module for generating request information using a cabin domain controller of a target vehicle; wherein the request information is used for multiplexing one or more image capturing devices existing in the target vehicle;

a first transmission module for transmitting the request information to a driving domain controller of the target vehicle;

the request analysis module is used for analyzing the request information by utilizing the driving domain controller, and determining one or more image shooting devices from the existing image shooting devices of the target vehicle according to an analysis result to serve as image shooting devices to be multiplexed;

the frame rate configuration module is used for configuring the frame rate of the image shooting device to be multiplexed;

the image acquisition module is used for acquiring original image data shot by the image shooting device to be multiplexed after the frame rate configuration is completed;

The transmission processing module is used for carrying out transmission processing on the original image data;

the second transmission module is used for transmitting the image data after the transmission processing to the cabin controller;

and the driving control module is used for performing intelligent driving control on the target vehicle according to the image data received by the cockpit area controller.

The application also provides a vehicle, the vehicle including: the driving domain controller is connected with the cabin domain controller; wherein,,

the cabin domain controller is used for generating request information and transmitting the request information to the driving domain controller; wherein the request information is used for multiplexing one or more existing image shooting devices of the vehicle;

the driving domain controller is used for analyzing the request information, and determining one or more image shooting devices from the existing image shooting devices of the target vehicle according to an analysis result to serve as image shooting devices to be multiplexed; the frame rate configuration is carried out on the image shooting device to be multiplexed, and original image data shot by the image shooting device to be multiplexed after the frame rate configuration is completed is obtained; and transmitting the original image data, and transmitting the processed image data to the cabin controller.

The application also provides an electronic device comprising:

one or more processors;

storage means for storing one or more programs that, when executed by the one or more processors, cause the electronic device to implement the intelligent driving control method as described in any one of the preceding claims.

The present application also provides a computer-readable storage medium, characterized in that it has stored thereon computer-readable instructions, which when executed by a processor of a computer, cause the computer to perform the intelligent driving control method according to any one of the above.

As described above, the present application provides an intelligent driving control method, system, electronic device, and storage medium, which have the following beneficial effects: the method comprises the steps that request information is generated according to a cabin domain controller of a target vehicle, and the request information is transmitted to a driving domain controller; analyzing the request information by using a driving domain controller, and determining one or more image shooting devices from the existing image shooting devices of the target vehicle according to the analysis result to serve as image shooting devices to be multiplexed; the frame rate configuration is carried out on the image shooting device to be multiplexed, and the original image data shot by the image shooting device to be multiplexed after the frame rate configuration is completed is obtained; and transmitting the original image data, and transmitting the processed image data to a cabin controller to perform intelligent driving control on the target vehicle. Therefore, when the intelligent driving control is performed on the target vehicle, the image shooting device of the target vehicle can be reused, and the hardware cost of the target vehicle when the intelligent driving control is performed is reduced; meanwhile, by multiplexing the existing image capturing device of the target vehicle, the flexibility of the existing image capturing device of the target vehicle can be improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application. It is apparent that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained from these drawings without inventive effort for a person of ordinary skill in the art. In the drawings:

FIG. 1 is a schematic diagram of an exemplary system architecture to which the subject matter of one or more embodiments of the present application may be applied;

fig. 2 is a flow chart of an intelligent driving control method applicable to a driving domain controller according to an embodiment of the present application;

fig. 3 is a schematic flow chart of stitching first decompressed image data according to an embodiment of the present application;

fig. 4 is a flow chart of an intelligent driving control method according to an embodiment of the present application;

FIG. 5 is a schematic diagram of a specific stitching of decompressed image data according to an embodiment of the present disclosure;

Fig. 6 is a flow chart of an intelligent driving control method applicable to a cabin controller according to an embodiment of the present application;

fig. 7 is a schematic flow chart of an intelligent driving control method applicable to a vehicle according to another embodiment of the present application;

fig. 8 is a flow chart of an intelligent driving control method according to another embodiment of the present application;

fig. 9 is a schematic hardware structure of an intelligent driving control system according to an embodiment of the present application;

fig. 10 is a schematic hardware structure of an intelligent driving control system according to another embodiment of the present application;

fig. 11 is a schematic hardware structure of an intelligent driving control system according to another embodiment of the present application;

FIG. 12 is a schematic diagram of a hardware structure of a vehicle according to an embodiment of the present disclosure;

fig. 13 is a schematic diagram of a hardware architecture of an electronic device suitable for implementing one or more embodiments of the present application.

Detailed Description

Further advantages and effects of the present application will be readily apparent to those skilled in the art from the disclosure in the present specification, by describing embodiments of the present application with reference to the accompanying drawings and preferred examples. The present application may be embodied or carried out in other specific embodiments, and the details of the present application may be modified or changed from various points of view and applications without departing from the spirit of the present application. It should be understood that the preferred embodiments are presented by way of illustration only and not by way of limitation to the scope of the present application.

It should be noted that, the illustrations provided in the following embodiments merely illustrate the basic concepts of the application by way of illustration, and only the components related to the application are shown in the drawings and are not drawn according to the number, shape and size of the components in actual implementation, and the form, number and proportion of the components in actual implementation may be arbitrarily changed, and the layout of the components may be more complex.

In the following description, numerous details are set forth to provide a more thorough explanation of embodiments of the present application, however, it will be apparent to one skilled in the art that embodiments of the present application may be practiced without these specific details, in other embodiments, well-known structures and devices are shown in block diagram form, rather than in detail, in order to avoid obscuring the embodiments of the present application.

Domain controller (Domain Controller, DC for short): in the 'domain' mode, at least one server is responsible for the verification work of each computer and/or user connected to the network; the domain controller is a storage location of the active directory, and a computer in which the active directory is installed is called a domain controller. The domain controller includes a database composed of information such as an account and a password of the domain, and a computer belonging to the domain. Meanwhile, the domain controller stores directory data and manages interaction relations of user domains, including user login process, identity verification, directory search and the like.

The inventor finds that with the development of intelligent driving technology of automobiles, particularly the rapid development of artificial intelligent chips with high computational power resources, the intelligent driving domain controller can process more and more sensor raw data, and the access mode of cameras is changed. The camera is used as a photosensitive module, and the collected video original data is transmitted to the intelligent driving domain controller for processing. The performance of the camera is affected by the angle of view, if more scenes are required to be covered and the range of the surrounding environment in the running process of the vehicle is enlarged, the intelligent driving camera system of a higher level generally comprises 2-3 high-definition cameras for front view, 4 peripheral vision cameras distributed around, 4 cameras for 360 panoramic images and 1 high-definition camera for back direction. The above cameras are only aimed at intelligent driving systems, but in terms of man-machine interaction, various new camera access requirements exist, such as forward camera data is needed for AR navigation; the streaming media rearview mirror requires backward camera data; the electronic exterior mirror requires camera data on both sides. In a limited vehicle exterior space, if a corresponding camera is also provided for human-computer interaction, the hardware cost of the whole vehicle is certainly increased, and the appearance of the vehicle is also affected. Therefore, the inventor thinks that if camera multiplexing is achieved, that is, camera data can be transmitted to more controllers, the cost of the whole vehicle can be reduced, and the influence on the appearance of the vehicle can be reduced; namely, the inventor proposes a technical idea of multiplexing cameras existing in vehicles.

FIG. 1 illustrates a schematic diagram of an exemplary system architecture to which the subject matter of one or more embodiments of the present application may be applied. As shown in fig. 1, system architecture 100 may include a terminal device 110, a network 120, and a server 130. Terminal device 110 may include various electronic devices such as smart phones, tablet computers, notebook computers, desktop computers, and the like. The server 130 may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing cloud computing services. Network 120 may be a communication medium of various connection types capable of providing a communication link between terminal device 110 and server 130, and may be, for example, a wired communication link or a wireless communication link.

The system architecture in the embodiments of the present application may have any number of terminal devices, networks, and servers, as desired for implementation. For example, the server 130 may be a server group composed of a plurality of server devices. In addition, the technical solution provided in the embodiment of the present application may be applied to the terminal device 110, or may be applied to the server 130, or may be implemented by the terminal device 110 and the server 130 together, which is not limited in particular in this application.

In one embodiment of the present application, the terminal device 110 or the server 130 of the present application may receive request information sent by a cabin domain controller of a target vehicle; analyzing the request information, and determining one or more image shooting devices from the existing image shooting devices of the target vehicle according to the analysis result, wherein the one or more image shooting devices are used as image shooting devices to be multiplexed; configuring the frame rate of the image shooting device to be multiplexed, and acquiring original image data shot by the image shooting device to be multiplexed after the frame rate configuration is completed; and transmitting the original image data, and transmitting the processed image data to a cabin controller so as to carry out intelligent driving control on the target vehicle. The intelligent driving control method is executed by using the terminal equipment 110 or the server 130, when the intelligent driving control is carried out on the target vehicle, the existing image shooting device of the target vehicle can be reused, and the hardware cost of the target vehicle when the intelligent driving control is carried out is reduced; meanwhile, by multiplexing the existing image capturing device of the target vehicle, the flexibility of the existing image capturing device of the target vehicle can be improved.

In another embodiment of the present application, the terminal device 110 or the server 130 of the present application may also generate request information and transmit the request information to the driving-domain controller of the target vehicle; the driving domain controller is used for receiving the image data transmitted after the request information is analyzed, and performing intelligent driving control on the target vehicle according to the received image data; wherein the request information is used for multiplexing one or more image capturing devices existing in the target vehicle. The intelligent driving control method is executed by using the terminal equipment 110 or the server 130, when the intelligent driving control is carried out on the target vehicle, the existing image shooting device of the target vehicle can be reused, and the hardware cost of the target vehicle when the intelligent driving control is carried out is reduced; meanwhile, by multiplexing the existing image capturing device of the target vehicle, the flexibility of the existing image capturing device of the target vehicle can be improved.

In another embodiment of the present application, the terminal device 110 or the server 130 of the present application may further generate request information according to the cabin domain controller, and transmit the request information to the driving domain controller, where the request information is used to multiplex one or more image capturing devices existing in the target vehicle; analyzing the request information by using a driving domain controller, and determining one or more image shooting devices from the existing image shooting devices of the target vehicle according to the analysis result to serve as image shooting devices to be multiplexed; the frame rate configuration is carried out on the image shooting device to be multiplexed, and the original image data shot by the image shooting device to be multiplexed after the frame rate configuration is completed is obtained; and transmitting the original image data, and transmitting the processed image data to a cabin controller to perform intelligent driving control on the target vehicle. The intelligent driving control method is executed by using the terminal equipment 110 or the server 130, when the intelligent driving control is carried out on the target vehicle, the existing image shooting device of the target vehicle can be reused, and the hardware cost of the target vehicle when the intelligent driving control is carried out is reduced; meanwhile, by multiplexing the existing image capturing device of the target vehicle, the flexibility of the existing image capturing device of the target vehicle can be improved.

The foregoing describes the content of an exemplary system architecture to which the technical solutions of the present application are applied, and the following description of the intelligent driving control method of the present application is continued.

Fig. 2 shows a flow chart of an intelligent driving control method according to an embodiment of the present application. Specifically, in an exemplary embodiment, as shown in fig. 2, the present embodiment provides an intelligent driving control method applied to a driving domain controller of a target vehicle, the method including the steps of:

s210, receiving request information sent by a cabin area controller of a target vehicle. As an example, the procedure of requesting information from the cabin domain controller may be: the user clicks a man-machine interaction interface connected with the cabin domain controller, then a camera to be multiplexed is selected, and the cabin domain controller generates corresponding camera multiplexing request information according to a trigger signal generated when the user clicks and simultaneously sends the generated multiplexing request information to a driving domain controller of a target vehicle.

S220, analyzing the request information, and determining one or more image shooting devices from the existing image shooting devices of the target vehicle according to the analysis result as image shooting devices to be multiplexed. As an example, the process of resolving the request information and determining one or more image capturing devices according to the resolving result in this embodiment may be: analyzing the request information, and acquiring a request pixel corresponding to the request information from an analysis result; acquiring original pixels of each image shooting device existing in the target vehicle; matching the request pixel with original pixels of each image shooting device existing in the target vehicle, and determining one or more image shooting devices from the existing image shooting devices of the target vehicle so that the sum of the determined original pixels of all the image shooting devices is equal to the request pixel; or, the original pixel of each image capturing device is determined to be greater than or equal to the request pixel.

S230, configuring the frame rate of the image shooting device to be multiplexed, and acquiring original image data shot by the image shooting device to be multiplexed after completing the frame rate configuration. As an example, the process of configuring the frame rate of the image capturing device to be multiplexed according to the present embodiment may be: acquiring an original frame rate of the image shooting device to be multiplexed, and acquiring a request frame rate corresponding to the request information from the analysis result; and comparing the request frame rate with the original frame rate, and configuring the frame rate of the image shooting device to be multiplexed when the request frame rate is different from the original frame rate, so that the configured frame rate of the image shooting device to be multiplexed is the same as the request frame rate.

S240, transmitting the original image data, and transmitting the processed image data to a cabin controller to perform intelligent driving control on the target vehicle. As an example, the process of performing transmission processing on the original image data and transmitting the processed image data to the cabin domain controller in this embodiment may be: acquiring original image data shot by an image shooting device to be multiplexed after finishing frame rate configuration, and decompressing the original image data by using a first deserializer to obtain first decompressed image data; cutting or splicing the first decompressed image data, and compressing the cut or spliced image data by using a serializer; and transmitting the compressed image data to the cabin controller.

Therefore, when the intelligent driving control is performed on the target vehicle, the image shooting device of the target vehicle can be reused, so that the hardware cost of the target vehicle when the intelligent driving control is performed is reduced; meanwhile, by multiplexing the existing image capturing device of the target vehicle, the flexibility of the existing image capturing device of the target vehicle can be improved. The target vehicle in the present embodiment may be an unmanned vehicle, a manned vehicle, or the like.

According to the above, in an exemplary embodiment, the present embodiment may crop or splice the first decompressed image data by a processor in the driving domain controller. As shown in fig. 3, the process of stitching the first decompressed image data may be:

s310, acquiring the number of each image shooting device in the image shooting devices to be multiplexed and corresponding first decompressed image data;

s320, correlating the number of each image shooting device with the corresponding first decompressed image data to form an image data set; wherein the number of each image data set is preceding and the first decompressed image data is following;

s330, all the image data sets are spliced in sequence according to the serial number sequence, and a preset end frame mark is inserted between two adjacent image data sets.

Specifically, as shown in fig. 4, a certain target vehicle a is provided with a front-view camera 1, a front-view camera 2, a front-view camera 3, a front-view camera 4, a front-view camera 5, and a front-view camera 6; when the intelligent cabin domain controller sends out request information of multiplexing the front-view camera 1, the front-view camera 1 and the front-view camera 5, a processor in the intelligent cabin domain controller performs frame rate configuration on the front-view camera 1, the front-view camera 1 and the front-view camera 5 respectively, then obtains image data shot by the front-view camera 1, the front-view camera 1 and the front-view camera 5 after the frame rate configuration is completed from the deserializer 1, the deserializer 2 and the deserializer 3 respectively, decompresses the image data obtained from the deserializer 1, the deserializer 2 and the deserializer 3, simultaneously cuts or splices the decompressed data, then transmits the image data which are cut or spliced to the intelligent cabin domain controller of the target vehicle A after the image data which are corresponding to the front-view camera 1, the front-view camera 1 and the front-view camera 5 are subjected to serialization or compression through a video output port, and then obtains the image data which are corresponding to the image data which are obtained by the deserializer 4 after the image data which are obtained by the deserializer or the deserializer is compressed. In this embodiment, when the driving domain controller obtains the image data from the deserializer 1, the deserializer 2, and the deserializer 3, a Low-voltage differential signal serial bus (Low-Voltage Differential Signaling, low-voltage differential signal, abbreviated as LVDS) connection may be adopted, so that the image data may be transmitted in an LVDS manner. In this embodiment, if the cameras used in the sensor of the intelligent driving system include 1-2 front-view high-definition cameras, 4 peripheral-view cameras, and 1 rear-view camera, then when a parking scene is involved, 4 fisheye cameras are also required to be included. In order to be able to access the image data of the above cameras, the video input interface of the processor is required to satisfy a video access capability of more than 10 ways and above. In addition, the above-mentioned original image data collected by the camera also needs to perform image signal processing on the original image data after the original image data enters the processor, so the processor in this embodiment needs to have a higher bandwidth of image signal processing bandwidth. As an example, the present embodiment may use a processor satisfying the above conditions as a high-performance processor.

According to the above description, as an example, when the intelligent cockpit area controller transmits the camera pixels and the frame rate to be multiplexed to the intelligent cockpit area controller, for example, the intelligent cockpit area controller needs the data of the front view camera 1, and the front view camera 5. When the required camera pixels and frame rate of the intelligent cabin are the same as the camera parameters set by the intelligent driving domain controller, the intelligent driving domain controller only needs to splice the video data of the three cameras. The manner in which the decompressed image data are spliced is shown in fig. 5, after the processor obtains the data of the front-view camera 1, the front-view camera 1 and the front-view camera 5 from each deserializer, the serial number ID of the camera is first placed at the front end of the spliced video data, the data serial number ID of the front-view camera 1 may be set to 01, the data serial number ID of the front-view camera 3 may be set to 03, and the data serial number ID of the front-view camera 5 may be set to 05. Then, the serial number ID is the corresponding camera data, and an end frame mark is added to the end section of each camera data, and then the data of the three cameras are spliced into one data to obtain the camera multiplexing data required by the intelligent cabin controller. And finally, outputting the spliced data to a string former in the intelligent driving domain controller, and transmitting the string to the intelligent cabin domain controller. In addition, when the pixel and frame rate of the camera needed by the intelligent cabin are different from the parameters of the camera set by the intelligent driving domain controller, the intelligent driving domain controller can process the pixel and frame rate of the camera according to the required parameters, and the corresponding processing mode can be as follows: for example, when the intelligent cabin controller needs to have two megapixels and 60 frame rate of the image data of the front-view camera 1, and the intelligent driving domain controller needs to have eight megapixels and 30 frame rate of the image data of the front-view camera 1 according to the requirement of the sensing algorithm, the processing method can be set in the high-performance processing, that is, the original data of the camera is firstly obtained according to the eight megapixels and 60 frame rate, and after entering the processor, the processor processes according to the two megapixels and 60 frame rate required by the intelligent cabin controller to obtain the data of the front-view camera 1 to be output. The image data of the front-view camera 1, the front-view camera 1 and the front-view camera 5 multiplexed by the method are spliced according to the splicing process, and the splicing result is transmitted to the serializer for braiding or compression and then transmitted to the intelligent cabin controller.

After the intelligent cabin domain controller receives the multiplexed camera data sent from the intelligent driving domain controller, the multiplexed camera data can be reversely disassembled according to the splicing mode to obtain corresponding image data. The reverse disassembly mode can be as follows: firstly, identifying a specific camera according to a camera number ID, and then, after an end frame mark is identified, considering the intermediate data as image data of one camera; and the like until the image data of the remaining two cameras are obtained.

In an exemplary embodiment, as shown in fig. 6, the present embodiment further provides an intelligent driving control method applied to a cabin controller of a target vehicle, the method including the steps of:

s610, generating request information and transmitting the request information to a driving domain controller of the target vehicle. As an example, the process of the cabin domain controller generating the request information may be: the user clicks a man-machine interaction interface connected with the cabin domain controller, then a camera to be multiplexed is selected, and the cabin domain controller generates corresponding camera multiplexing request information according to a trigger signal generated when the user clicks and simultaneously sends the generated multiplexing request information to a driving domain controller of a target vehicle. After the driving domain controller receives the request information, the driving domain controller analyzes the request information, and determines one or more image shooting devices from the existing image shooting devices of the target vehicle according to an analysis result to serve as image shooting devices to be multiplexed; the frame rate configuration is carried out on the image shooting device to be multiplexed, and original image data shot by the image shooting device to be multiplexed after the frame rate configuration is completed is obtained; and transmitting the original image data, and transmitting the processed image data to the cabin controller.

S620, receiving the image data transmitted after the driving domain controller analyzes the request information, and performing intelligent driving control on the target vehicle according to the received image data; wherein the request information is used for multiplexing one or more image capturing devices existing in the target vehicle. After the intelligent cabin domain controller receives the multiplexing camera data sent from the intelligent driving domain controller, the multiplexing camera data can be reversely disassembled according to the splicing mode in the driving domain controller, and corresponding image data are obtained. The reverse disassembly mode can be as follows: firstly, identifying a specific camera according to a camera number ID, and then, after an end frame mark is identified, considering the intermediate data as image data of one camera; and the like until the image data of the remaining two cameras are obtained.

According to the above, in an exemplary embodiment, the process of performing intelligent driving control on the target vehicle according to the received image data includes: decompressing the received image data by using a second deserializer to obtain second decompressed image data; and reversely disassembling the second decompressed image data according to the number of each image shooting device in the image shooting devices to be multiplexed and a preset end frame mark, and performing intelligent driving control on the target vehicle according to the reversely disassembled image data.

Specifically, a certain target vehicle B is provided with a front-view camera 1, a front-view camera 2, a front-view camera 3, a front-view camera 4, a front-view camera 5, and a front-view camera 6; when the intelligent cabin domain controller generates and sends request information of multiplexing the front-view camera 1, the front-view camera 1 and the front-view camera 5, a processor in the intelligent cabin domain controller performs frame rate configuration on the front-view camera 1, the front-view camera 1 and the front-view camera 5 respectively, then obtains image data shot by the front-view camera 1, the front-view camera 1 and the front-view camera 5 after the frame rate configuration is completed from the deserializer 1, the deserializer 2 and the deserializer 3 respectively, decompresses the image data obtained from the deserializer 1, the deserializer 2 and the deserializer 3, simultaneously cuts or splices the decompressed data, then transmits the cut or spliced image data to the intelligent cabin domain controller of the target vehicle B after the image data corresponding to the front-view camera 1, the front-view camera 1 and the front-view camera 5 are subjected to serialization or compression through a video output port, and receives the image data corresponding to the image data obtained after the deserializer and the image data obtained after the deserializer is subjected to the deserialization or the compression through the inside the deserializer 4.

As an example, for example, the user clicks the data of the front-view camera 1, the front-view camera 1 and the front-view camera 5 on the man-machine interaction interface of the intelligent cabin domain controller, when the intelligent cabin domain controller sends the camera pixels and the frame rate to be multiplexed to the intelligent driving domain controller, and when the camera pixels and the frame rate required by the intelligent cabin are the same as the camera parameters set by the intelligent driving domain controller, the intelligent driving domain controller only needs to splice the video data of the three cameras. The manner in which the decompressed image data are spliced is shown in fig. 5, after the processor obtains the data of the front-view camera 1, the front-view camera 1 and the front-view camera 5 from each deserializer, the serial number ID of the camera is first placed at the front end of the spliced video data, the data serial number ID of the front-view camera 1 may be set to 01, the data serial number ID of the front-view camera 3 may be set to 03, and the data serial number ID of the front-view camera 5 may be set to 05. Then, the serial number ID is the corresponding camera data, and an end frame mark is added to the end section of each camera data, and then the data of the three cameras are spliced into one data to obtain the camera multiplexing data required by the intelligent cabin controller. And finally, outputting the spliced data to a string former in the intelligent driving domain controller, and transmitting the string to the intelligent cabin domain controller. In addition, when the pixel and frame rate of the camera needed by the intelligent cabin are different from the parameters of the camera set by the intelligent driving domain controller, the intelligent driving domain controller can process the pixel and frame rate of the camera according to the required parameters, and the corresponding processing mode can be as follows: for example, when the intelligent cabin controller needs to have two megapixels and 60 frame rate of the image data of the front-view camera 1, and the intelligent driving domain controller needs to have eight megapixels and 30 frame rate of the image data of the front-view camera 1 according to the requirement of the sensing algorithm, the processing method can be set in the high-performance processing, that is, the original data of the camera is firstly obtained according to the eight megapixels and 60 frame rate, and after entering the processor, the processor processes according to the two megapixels and 60 frame rate required by the intelligent cabin controller to obtain the data of the front-view camera 1 to be output. The image data of the front-view camera 1, the front-view camera 1 and the front-view camera 5 multiplexed by the method are spliced according to the splicing process, and the splicing result is transmitted to the serializer for braiding or compression and then transmitted to the intelligent cabin controller.

In an exemplary embodiment, as shown in fig. 7, the embodiment provides an intelligent driving control method applied to a target vehicle including a cabin domain controller and a driving domain controller, the method comprising the steps of:

s710, generating request information according to the cabin domain controller, and transmitting the request information to the driving domain controller, wherein the request information is used for multiplexing one or more existing image shooting devices of the target vehicle. As an example, the process of the cabin domain controller generating the request information may be: the user clicks a man-machine interaction interface connected with the cabin domain controller, then a camera to be multiplexed is selected, and the cabin domain controller generates corresponding camera multiplexing request information according to a trigger signal generated when the user clicks and simultaneously sends the generated multiplexing request information to a driving domain controller of a target vehicle.

S720, analyzing the request information by using a driving domain controller, and determining one or more image shooting devices from the existing image shooting devices of the target vehicle according to the analysis result, wherein the one or more image shooting devices are used as image shooting devices to be multiplexed; the frame rate configuration is carried out on the image shooting device to be multiplexed, and the original image data shot by the image shooting device to be multiplexed after the frame rate configuration is completed is obtained; and transmitting the original image data, and transmitting the processed image data to a cabin controller to perform intelligent driving control on the target vehicle.

Specifically, in the embodiment, the process of step S720 of analyzing the request information by using the driving domain controller and determining one or more image capturing devices from the existing image capturing devices of the target vehicle according to the analysis result may be: analyzing the request information, and acquiring a request pixel corresponding to the request information from an analysis result; acquiring original pixels of each image shooting device existing in the target vehicle; matching the request pixel with original pixels of each image shooting device existing in the target vehicle, and determining one or more image shooting devices from the existing image shooting devices of the target vehicle so that the sum of the determined original pixels of all the image shooting devices is equal to the request pixel; or, the original pixel of each image capturing device is determined to be greater than or equal to the request pixel.

In this embodiment, step S720 of configuring the frame rate of the image capturing device to be multiplexed, and acquiring the original image data captured by the image capturing device to be multiplexed after completing the frame rate configuration may be: acquiring an original frame rate of the image shooting device to be multiplexed, and acquiring a request frame rate corresponding to the request information from the analysis result; and comparing the request frame rate with the original frame rate, and configuring the frame rate of the image shooting device to be multiplexed when the request frame rate is different from the original frame rate, so that the configured frame rate of the image shooting device to be multiplexed is the same as the request frame rate.

In this embodiment, the step S720 of transmitting the original image data and transmitting the processed image data to the cabin controller may be: acquiring original image data shot by an image shooting device to be multiplexed after finishing frame rate configuration, and decompressing the original image data by using a first deserializer to obtain first decompressed image data; cutting or splicing the first decompressed image data, and compressing the cut or spliced image data by using a serializer; and transmitting the compressed image data to the cabin controller. The process of splicing the first decompressed image data comprises the following steps: acquiring the number of each image shooting device in the image shooting devices to be multiplexed and corresponding first decompressed image data; correlating the number of each image shooting device with the corresponding first decompressed image data to form an image data set; wherein the number of each image data set is preceding and the first decompressed image data is following; all the image data sets are spliced in sequence according to the serial number sequence, and a preset end frame mark is inserted between two adjacent image data sets.

In an example, a certain target vehicle C is provided with a front-view camera 1, a front-view camera 2, a front-view camera 3, a front-view camera 4, a front-view camera 5, and a front-view camera 6; when the intelligent cabin domain controller sends out request information of multiplexing the front-view camera 1, the front-view camera 1 and the front-view camera 5, a processor in the intelligent cabin domain controller performs frame rate configuration on the front-view camera 1, the front-view camera 1 and the front-view camera 5 respectively, then obtains image data shot by the front-view camera 1, the front-view camera 1 and the front-view camera 5 after the frame rate configuration is completed from the deserializer 1, the deserializer 2 and the deserializer 3 respectively, decompresses the image data obtained from the deserializer 1, the deserializer 2 and the deserializer 3, simultaneously cuts or splices the decompressed data, then transmits the image data which are cut or spliced to the intelligent cabin domain controller of the target vehicle C after the image data which are corresponding to the front-view camera 1, the front-view camera 1 and the front-view camera 5 are subjected to serialization or compression through a video output port, and then obtains the image data which are corresponding to the image data which are obtained by the deserializer 4 after the image data which are obtained by the deserializer is compressed.

According to the above description, as a specific example, after the intelligent cockpit area controller transmits the camera pixels and the frame rate to be multiplexed to the intelligent cockpit area controller, for example, the intelligent cockpit area controller needs the data of the front view camera 1, and the front view camera 5. When the required camera pixels and frame rate of the intelligent cabin are the same as the camera parameters set by the intelligent driving domain controller, the intelligent driving domain controller only needs to splice the video data of the three cameras. The manner in which the decompressed image data are spliced is shown in fig. 5, after the processor obtains the data of the front-view camera 1, the front-view camera 1 and the front-view camera 5 from each deserializer, the serial number ID of the camera is first placed at the front end of the spliced video data, the data serial number ID of the front-view camera 1 may be set to 01, the data serial number ID of the front-view camera 3 may be set to 03, and the data serial number ID of the front-view camera 5 may be set to 05. Then, the serial number ID is the corresponding camera data, and an end frame mark is added to the end section of each camera data, and then the data of the three cameras are spliced into one data to obtain the camera multiplexing data required by the intelligent cabin controller. And finally, outputting the spliced data to a string former in the intelligent driving domain controller, and transmitting the string to the intelligent cabin domain controller. In addition, when the pixel and frame rate of the camera needed by the intelligent cabin are different from the parameters of the camera set by the intelligent driving domain controller, the intelligent driving domain controller can process the pixel and frame rate of the camera according to the required parameters, and the corresponding processing mode can be as follows: for example, when the intelligent cabin controller needs to have two megapixels and 60 frame rate of the image data of the front-view camera 1, and the intelligent driving domain controller needs to have eight megapixels and 30 frame rate of the image data of the front-view camera 1 according to the requirement of the sensing algorithm, the processing method can be set in the high-performance processing, that is, the original data of the camera is firstly obtained according to the eight megapixels and 60 frame rate, and after entering the processor, the processor processes according to the two megapixels and 60 frame rate required by the intelligent cabin controller to obtain the data of the front-view camera 1 to be output. The image data of the front-view camera 1, the front-view camera 1 and the front-view camera 5 multiplexed by the method are spliced according to the splicing process, and the splicing result is transmitted to the serializer for braiding or compression and then transmitted to the intelligent cabin controller.

In an exemplary embodiment, as shown in fig. 8, the embodiment provides an intelligent driving control method, which includes: all cameras are connected to the intelligent driving domain controller through the LVDS bus, and all cameras are input to the high-performance processor for data processing after being disassembled by the deserializer. If multiplexed cameras are required, the output can be bypassed to the serializer through the deserializer, since the transmission to the external controller can only be transmitted through LVDS. When a plurality of cameras are required to be multiplexed, a plurality of serializers are required to perform serialization processing on data. Meanwhile, after the intelligent cockpit area controller receives the data of the multiplexing camera, the intelligent cockpit area controller can be matched with the deserializer to deserialize the received data. Therefore, although the present embodiment has a number of serializers more than the above embodiments, thereby increasing the hardware cost, the present embodiment can still reuse the existing cameras in the vehicle, and solve the problem of low flexibility of the existing cameras in the vehicle.

In an exemplary embodiment, as shown in fig. 9, the embodiment provides an intelligent driving control system, which is applied to a driving domain controller of a target vehicle, and the system 900 includes:

and an parsing unit 910, configured to receive the request information sent by the cabin domain controller of the target vehicle, and parse the request information. As an example, the process of the parsing unit 910 parsing the request information and determining one or more image photographing devices according to the parsing result may be: and analyzing the request information, and acquiring request pixels, request frame rates, requested camera numbers and the like corresponding to the request information from analysis results.

And the multiplexing unit 920 is configured to determine one or more image capturing devices from the existing image capturing devices of the target vehicle according to the analysis result, as the image capturing devices to be multiplexed. As an example, the process of determining one or more image capturing devices from the existing image capturing devices of the target vehicle by the multiplexing unit 920 according to the analysis result may be: acquiring original pixels of each image shooting device existing in the target vehicle; matching the request pixel with original pixels of each image shooting device existing in the target vehicle, and determining one or more image shooting devices from the existing image shooting devices of the target vehicle so that the sum of the determined original pixels of all the image shooting devices is equal to the request pixel; or, the original pixel of each image capturing device is determined to be greater than or equal to the request pixel.

And a frame rate configuration unit 930, configured to perform frame rate configuration on the image capturing device to be multiplexed, and obtain original image data captured by the image capturing device to be multiplexed after the frame rate configuration is completed. As an example, the process of the frame rate configuration unit 930 for configuring the frame rate of the image capturing device to be multiplexed may be: acquiring an original frame rate of the image shooting device to be multiplexed, and acquiring a request frame rate corresponding to the request information from the analysis result; and comparing the request frame rate with the original frame rate, and configuring the frame rate of the image shooting device to be multiplexed when the request frame rate is different from the original frame rate, so that the configured frame rate of the image shooting device to be multiplexed is the same as the request frame rate.

And a transmission processing unit 940, configured to perform transmission processing on the raw image data, and transmit the processed image data to the cabin controller, so as to perform intelligent driving control on the target vehicle. As an example, the transmission processing unit 940 performs transmission processing on the raw image data, and the process of transmitting the processed image data to the cabin domain controller may be: acquiring original image data shot by an image shooting device to be multiplexed after finishing frame rate configuration, and decompressing the original image data by using a first deserializer to obtain first decompressed image data; cutting or splicing the first decompressed image data, and compressing the cut or spliced image data by using a serializer; and transmitting the compressed image data to the cabin controller. The process of stitching the first decompressed image data may be: acquiring the number of each image shooting device in the image shooting devices to be multiplexed and corresponding first decompressed image data; correlating the number of each image shooting device with the corresponding first decompressed image data to form an image data set; wherein the number of each image data set is preceding and the first decompressed image data is following; all the image data sets are spliced in sequence according to the serial number sequence, and a preset end frame mark is inserted between two adjacent image data sets.

It should be noted that, the intelligent driving control system provided in the above embodiment and the intelligent driving control method provided in fig. 2 belong to the same concept, and the specific manner in which each unit performs the operation has been described in detail in the method embodiment, which is not repeated here. In practical application, the intelligent driving control system provided in the above embodiment may distribute the functions to be completed by different functional modules according to needs, that is, the internal structure of the system is divided into different functional modules to complete all or part of the functions described above, which is not limited herein.

In an exemplary embodiment, as shown in fig. 10, the embodiment provides an intelligent driving control system, which is applied to a cabin controller of a target vehicle, and the system 1000 includes:

A request generation unit 1010 for generating request information for multiplexing one or more image capturing devices existing in the target vehicle. As an example, the process of the cabin domain controller generating the request information may be: the user clicks a man-machine interaction interface connected with the cabin domain controller, then the camera to be multiplexed is selected, and the cabin domain controller generates corresponding camera multiplexing request information according to a trigger signal generated when the user clicks.

A request transmission unit 1020 for transmitting the request information to a driving domain controller of the target vehicle. After receiving the request information, the driving domain controller analyzes the request information, and determines one or more image shooting devices from the existing image shooting devices of the target vehicle according to an analysis result to serve as image shooting devices to be multiplexed; the frame rate configuration is carried out on the image shooting device to be multiplexed, and original image data shot by the image shooting device to be multiplexed after the frame rate configuration is completed is obtained; and transmitting the original image data, and transmitting the processed image data to the cabin controller.

And an image receiving unit 1030, configured to receive image data transmitted after the driving domain controller parses the request information. As an example, after the intelligent cockpit area controller receives the multiplexed camera data sent from the intelligent cockpit area controller, the image receiving unit 1030 may reversely disassemble the multiplexed camera data according to the splicing manner in the cockpit area controller to obtain the corresponding image data. The reverse disassembly mode can be as follows: firstly, identifying a specific camera according to a camera number ID, and then, after an end frame mark is identified, considering the intermediate data as image data of one camera; and the like until the image data of the remaining two cameras are obtained.

And a driving control unit 1040 for performing intelligent driving control for the target vehicle based on the received image data. As an example, the process of the driving control unit 1040 performing intelligent driving control of the target vehicle according to the received image data includes: decompressing the received image data by using a second deserializer to obtain second decompressed image data; and reversely disassembling the second decompressed image data according to the number of each image shooting device in the image shooting devices to be multiplexed and a preset end frame mark, and performing intelligent driving control on the target vehicle according to the reversely disassembled image data.

It should be noted that, the intelligent driving control system provided in this embodiment and the intelligent driving control method provided in fig. 6 belong to the same concept, and the specific manner in which each unit performs the operation has been described in detail in the method embodiment, which is not repeated here. In practical application, the intelligent driving control system provided in this embodiment may distribute the functions to different functional modules as required, that is, the internal structure of the system is divided into different functional modules to complete all or part of the functions described above, which is not limited herein.

In an exemplary embodiment, as shown in fig. 11, the embodiment provides an intelligent driving control system, the system 1100 includes:

A request generation module 1110 for generating request information using a cabin domain controller of a target vehicle; wherein the request information is used for multiplexing one or more image capturing devices existing in the target vehicle. As an example, the process of generating the request information using the cabin domain controller may be: the user clicks a man-machine interaction interface connected with the cabin domain controller, then the camera to be multiplexed is selected, and the cabin domain controller generates corresponding camera multiplexing request information according to a trigger signal generated when the user clicks.

A first transmission module 1120 for transmitting the request information to a driving domain controller of the target vehicle;

the request analysis module 1130 is configured to analyze the request information by using the driving domain controller, and determine one or more image capturing devices from the existing image capturing devices of the target vehicle according to the analysis result, as image capturing devices to be multiplexed. As an example, the process of requesting the parsing module 1130 to determine one or more image capturing devices from the existing image capturing devices of the target vehicle according to the parsing result may be: acquiring original pixels of each image shooting device existing in the target vehicle; matching the request pixel with original pixels of each image shooting device existing in the target vehicle, and determining one or more image shooting devices from the existing image shooting devices of the target vehicle so that the sum of the determined original pixels of all the image shooting devices is equal to the request pixel; or, the original pixel of each image capturing device is determined to be greater than or equal to the request pixel.

And the frame rate configuration module 1140 is configured to perform frame rate configuration on the image capturing device to be multiplexed. As an example, the process of the frame rate configuration module 1140 performing the frame rate configuration on the image capturing device to be multiplexed may be: acquiring an original frame rate of the image shooting device to be multiplexed, and acquiring a request frame rate corresponding to the request information from the analysis result; and comparing the request frame rate with the original frame rate, and configuring the frame rate of the image shooting device to be multiplexed when the request frame rate is different from the original frame rate, so that the configured frame rate of the image shooting device to be multiplexed is the same as the request frame rate.

And the image acquisition module 1150 is used for acquiring the original image data shot by the image shooting device to be multiplexed after the frame rate configuration is completed. As an example, when the image capturing module 1150 obtains the original image data captured by the image capturing device to be multiplexed after the frame rate configuration is completed, a low voltage differential signal serial bus LVDS connection may be used, so that the image data may be transmitted in an LVDS manner.

And a transmission processing module 1160, configured to perform transmission processing on the raw image data. As an example, the process of the transmission processing module 1160 performing the transmission processing on the raw image data and transmitting the processed image data to the capsule domain controller may be: acquiring original image data shot by an image shooting device to be multiplexed after finishing frame rate configuration, and decompressing the original image data by using a first deserializer to obtain first decompressed image data; cutting or splicing the first decompressed image data, and compressing the cut or spliced image data by using a serializer; and transmitting the compressed image data to the cabin controller. The process of stitching the first decompressed image data may be: acquiring the number of each image shooting device in the image shooting devices to be multiplexed and corresponding first decompressed image data; correlating the number of each image shooting device with the corresponding first decompressed image data to form an image data set; wherein the number of each image data set is preceding and the first decompressed image data is following; all the image data sets are spliced in sequence according to the serial number sequence, and a preset end frame mark is inserted between two adjacent image data sets.

A second transmission module 1170, configured to transmit the image data after the transmission processing to the cabin controller;

and the driving control module 1180 is used for performing intelligent driving control on the target vehicle according to the image data received by the cabin area controller. As an example, the process of the driving control module 1180 performing intelligent driving control on the target vehicle according to the received image data includes: decompressing the received image data by using a second deserializer to obtain second decompressed image data; and reversely disassembling the second decompressed image data according to the number of each image shooting device in the image shooting devices to be multiplexed and a preset end frame mark, and performing intelligent driving control on the target vehicle according to the reversely disassembled image data.

In an example, a certain target vehicle E is provided with a front-view camera 1, a front-view camera 2, a front-view camera 3, a front-view camera 4, a front-view camera 5, and a front-view camera 6; when the intelligent cabin domain controller sends out request information of multiplexing the front-view camera 1, the front-view camera 1 and the front-view camera 5, a processor in the intelligent cabin domain controller performs frame rate configuration on the front-view camera 1, the front-view camera 1 and the front-view camera 5 respectively, then obtains image data shot by the front-view camera 1, the front-view camera 1 and the front-view camera 5 after the frame rate configuration is completed from the deserializer 1, the deserializer 2 and the deserializer 3 respectively, decompresses the image data obtained from the deserializer 1, the deserializer 2 and the deserializer 3, simultaneously cuts or splices the decompressed data, then transmits the image data which are cut or spliced to the intelligent cabin domain controller of the target vehicle E after the image data corresponding to the front-view camera 1, the front-view camera 1 and the front-view camera 5 are subjected to serialization or compression through a video output port, and then obtains the image data which are subjected to the deserialization or the compression through the deserialization of the inside the deserializer 4.

It should be noted that, the intelligent driving control system provided in this embodiment and the intelligent driving control method provided in fig. 2 to 7 belong to the same concept, and the specific manner in which each module performs the operation has been described in detail in the method embodiment, which is not described herein again. In practical application, the intelligent driving control system provided in this embodiment may distribute the functions to different functional modules as required, that is, the internal structure of the system is divided into different functional modules to complete all or part of the functions described above, which is not limited herein.

In an exemplary embodiment, as shown in fig. 12, the embodiment provides a vehicle 1200 including: a cabin domain controller 1210 and a driving domain controller 1220, wherein the driving domain controller 1220 is connected with the cabin domain controller 1210; wherein,,

The cabin domain controller 1210 is configured to generate request information and transmit the request information to the driving domain controller; wherein the request information is used for multiplexing one or more existing image capturing devices of the vehicle. As an example, the procedure of the cabin domain controller 1210 generating the request information may be: the user clicks a man-machine interaction interface connected with the cabin domain controller, then a camera to be multiplexed is selected, and the cabin domain controller generates corresponding camera multiplexing request information according to a trigger signal generated when the user clicks and simultaneously sends the generated multiplexing request information to a driving domain controller of a target vehicle.

The driving domain controller 1220 is configured to parse the request information, and determine, according to a parsing result, one or more image capturing devices from the existing image capturing devices of the target vehicle, as image capturing devices to be multiplexed; the frame rate configuration is carried out on the image shooting device to be multiplexed, and original image data shot by the image shooting device to be multiplexed after the frame rate configuration is completed is obtained; and transmitting the original image data, and transmitting the processed image data to the cabin controller.

Specifically, the process of the driving domain controller 1220 analyzing the request information and determining one or more image capturing devices from the existing image capturing devices of the target vehicle according to the analysis result may be: analyzing the request information, and acquiring a request pixel corresponding to the request information from an analysis result; acquiring original pixels of each image shooting device existing in the target vehicle; matching the request pixel with original pixels of each image shooting device existing in the target vehicle, and determining one or more image shooting devices from the existing image shooting devices of the target vehicle so that the sum of the determined original pixels of all the image shooting devices is equal to the request pixel; or, the original pixel of each image capturing device is determined to be greater than or equal to the request pixel.

The process of the driving domain controller 1220 performing the frame rate configuration of the image photographing device to be multiplexed and acquiring the original image data photographed by the image photographing device to be multiplexed after the frame rate configuration is completed may be: acquiring an original frame rate of the image shooting device to be multiplexed, and acquiring a request frame rate corresponding to the request information from the analysis result; and comparing the request frame rate with the original frame rate, and configuring the frame rate of the image shooting device to be multiplexed when the request frame rate is different from the original frame rate, so that the configured frame rate of the image shooting device to be multiplexed is the same as the request frame rate.

The process of the driving domain controller 1220 performing the transmission processing on the raw image data and transmitting the processed image data to the cabin domain controller may be: acquiring original image data shot by an image shooting device to be multiplexed after finishing frame rate configuration, and decompressing the original image data by using a first deserializer to obtain first decompressed image data; cutting or splicing the first decompressed image data, and compressing the cut or spliced image data by using a serializer; and transmitting the compressed image data to the cabin controller. The process of splicing the first decompressed image data comprises the following steps: acquiring the number of each image shooting device in the image shooting devices to be multiplexed and corresponding first decompressed image data; correlating the number of each image shooting device with the corresponding first decompressed image data to form an image data set; wherein the number of each image data set is preceding and the first decompressed image data is following; all the image data sets are spliced in sequence according to the serial number sequence, and a preset end frame mark is inserted between two adjacent image data sets.

It should be noted that, the vehicle provided in this embodiment may be used in the intelligent driving control method and the intelligent driving control system provided in some embodiments, and the technical functions and technical effects corresponding to the cabin domain controller 1210 and the driving domain controller 1220 in the vehicle have been described in detail in some embodiments, which are not repeated herein. In practical application, the vehicle provided in this embodiment may distribute the functions to different functional modules according to needs, that is, the internal structure of the vehicle is divided into different functional modules to complete all or part of the functions described above, which is not limited herein.

The embodiment of the application also provides electronic equipment, which comprises: one or more processors; and a storage means for storing one or more programs that, when executed by the one or more processors, cause the electronic device to implement the intelligent driving control method provided in the above-described respective embodiments.

Fig. 13 shows a schematic diagram of a computer system suitable for use in implementing the electronic device of the embodiments of the present application. It should be noted that, the computer system 1300 of the electronic device shown in fig. 13 is only an example, and should not impose any limitation on the functions and the application scope of the embodiments of the present application.

As shown in fig. 13, the computer system 1300 includes a central processing unit (Central Processing Unit, CPU) 1301 that can perform various appropriate actions and processes according to a program stored in a Read-Only Memory (ROM) 1302 or a program loaded from a storage portion 1308 into a random access Memory (Random Access Memory, RAM) 1303, for example, performing the method described in the above embodiment. In the RAM 1303, various programs and data required for the system operation are also stored. The CPU 1301, ROM 1302, and RAM 1303 are connected to each other through a bus 1304. An Input/Output (I/O) interface 1305 is also connected to bus 1304.

The following components are connected to the I/O interface 1305: an input section 1306 including a keyboard, a mouse, and the like; an output portion 1307 including a Cathode Ray Tube (CRT), a liquid crystal display (Liquid Crystal Display, LCD), and the like, a speaker, and the like; a storage portion 1308 including a hard disk or the like; and a communication section 1309 including a network interface card such as a LAN (Local Area Network ) card, a modem, or the like. The communication section 1309 performs a communication process via a network such as the internet. The drive 1313 is also connected to the I/O interface 1305 as needed. Removable media 1311, such as magnetic disks, optical disks, magneto-optical disks, semiconductor memory, and the like, is mounted on drive 1313 as needed so that a computer program read therefrom is mounted to storage portion 1308 as needed.

In particular, according to embodiments of the present application, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present application include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising a computer program for performing the method shown in the flowchart. In such embodiments, the computer program may be downloaded and installed from a network via the communication portion 1309 and/or installed from the removable medium 1311. When executed by a Central Processing Unit (CPU) 1301, performs the various functions defined in the system of the present application.

It should be noted that, the computer readable medium shown in the embodiments of the present application may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium may be, for example, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-Only Memory (ROM), an erasable programmable read-Only Memory (Erasable Programmable Read Only Memory, EPROM), flash Memory, an optical fiber, a portable compact disc read-Only Memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present application, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with a computer-readable computer program embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. A computer program embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the foregoing.

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. Where each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units involved in the embodiments of the present application may be implemented by means of software, or may be implemented by means of hardware, and the described units may also be provided in a processor. Wherein the names of the units do not constitute a limitation of the units themselves in some cases.

Another aspect of the present application also provides a computer readable storage medium having stored thereon a computer program which when executed by a processor implements the intelligent driving control method as described above. The computer-readable storage medium may be included in the electronic device described in the above embodiment or may exist alone without being incorporated in the electronic device.

Another aspect of the present application also provides a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the intelligent driving control method provided in the above-described respective embodiments.

The above embodiments are merely illustrative of the principles of the present application and its effectiveness and are not intended to limit the present application. Modifications and variations may be made to the above-described embodiments by those of ordinary skill in the art without departing from the spirit and scope of the present application. It is therefore contemplated that the appended claims will cover all such equivalent modifications and changes as fall within the true spirit and scope of the disclosure.

Claims

1. An intelligent driving control method, characterized by being applied to a driving-domain controller of a target vehicle, comprising the steps of:

analyzing the request information, and determining one or more image shooting devices from the existing image shooting devices of the target vehicle according to an analysis result, wherein the one or more image shooting devices are used as image shooting devices to be multiplexed; comprising the following steps: analyzing the request information, and acquiring a request pixel corresponding to the request information from an analysis result; acquiring original pixels of each image shooting device existing in the target vehicle; matching the request pixel with original pixels of each image shooting device existing in the target vehicle, and determining one or more image shooting devices from the existing image shooting devices of the target vehicle so that the sum of the determined original pixels of all the image shooting devices is equal to the request pixel; or, the original pixel of each determined image shooting device is larger than or equal to the request pixel;

performing frame rate configuration on the image shooting device to be multiplexed, and acquiring original image data shot by the image shooting device to be multiplexed after the frame rate configuration is completed; comprising the following steps: acquiring an original frame rate of the image shooting device to be multiplexed, and acquiring a request frame rate corresponding to the request information from the analysis result; comparing the request frame rate with the original frame rate, and configuring the frame rate of the image shooting device to be multiplexed when the request frame rate is different from the original frame rate, so that the configured frame rate of the image shooting device to be multiplexed is the same as the request frame rate;

Transmitting the original image data, and transmitting the processed image data to the cabin controller so as to carry out intelligent driving control on the target vehicle; comprising the following steps: acquiring original image data shot by an image shooting device to be multiplexed after finishing frame rate configuration, and decompressing the original image data by using a first deserializer to obtain first decompressed image data; cutting or splicing the first decompressed image data, and compressing the cut or spliced image data by using a serializer; and transmitting the compressed image data to the cabin controller.

2. The intelligent driving control method according to claim 1, characterized in that the process of stitching the first decompressed image data includes:

3. An intelligent driving control method, characterized by being applied to a cabin controller of a target vehicle, comprising the steps of:

after the driving domain controller receives the request information, the driving domain controller analyzes the request information, and determines one or more image shooting devices from the existing image shooting devices of the target vehicle according to an analysis result to serve as image shooting devices to be multiplexed; the frame rate configuration is carried out on the image shooting device to be multiplexed, and original image data shot by the image shooting device to be multiplexed after the frame rate configuration is completed is obtained; the original image data is transmitted and processed, and the processed image data is transmitted to the cabin controller;

The driving domain controller analyzes the request information, determines one or more image shooting devices according to the analysis result, and the process of serving as the image shooting device to be multiplexed comprises the following steps: analyzing the request information, and acquiring a request pixel corresponding to the request information from an analysis result; acquiring original pixels of each image shooting device existing in the target vehicle; matching the request pixel with original pixels of each image shooting device existing in the target vehicle, and determining one or more image shooting devices from the existing image shooting devices of the target vehicle so that the sum of the determined original pixels of all the image shooting devices is equal to the request pixel; or, the original pixel of each determined image shooting device is larger than or equal to the request pixel;

the process of the driving domain controller for configuring the frame rate of the image shooting device to be multiplexed comprises the following steps: acquiring an original frame rate of the image shooting device to be multiplexed, and acquiring a request frame rate corresponding to the request information from the analysis result; comparing the request frame rate with the original frame rate, and configuring the frame rate of the image shooting device to be multiplexed when the request frame rate is different from the original frame rate, so that the configured frame rate of the image shooting device to be multiplexed is the same as the request frame rate;

The process of the driving domain controller transmitting the original image data and transmitting the processed image data to the cabin domain controller comprises the following steps: acquiring original image data shot by an image shooting device to be multiplexed after finishing frame rate configuration, and decompressing the original image data by using a first deserializer to obtain first decompressed image data; cutting or splicing the first decompressed image data, and compressing the cut or spliced image data by using a serializer; and transmitting the compressed image data to the cabin controller.

4. The intelligent driving control method according to claim 3, characterized in that the process of performing intelligent driving control of the target vehicle based on the received image data includes:

5. An intelligent driving control method, characterized by being applied to a target vehicle, the target vehicle including a cabin domain controller and a driving domain controller, the method comprising the steps of:

analyzing the request information by using the driving domain controller, and determining one or more image shooting devices from the existing image shooting devices of the target vehicle according to an analysis result to serve as image shooting devices to be multiplexed; the frame rate configuration is carried out on the image shooting device to be multiplexed, and original image data shot by the image shooting device to be multiplexed after the frame rate configuration is completed is obtained; the original image data is transmitted and processed, and the processed image data is transmitted to the cabin controller so as to carry out intelligent driving control on the target vehicle;

6. An intelligent driving control system, characterized by being applied to a driving-domain controller of a target vehicle, comprising:

the multiplexing unit is used for determining one or more image shooting devices from the existing image shooting devices of the target vehicle according to the analysis result, and the one or more image shooting devices are used as image shooting devices to be multiplexed; comprising the following steps: analyzing the request information, and acquiring a request pixel corresponding to the request information from an analysis result; acquiring original pixels of each image shooting device existing in the target vehicle; matching the request pixel with original pixels of each image shooting device existing in the target vehicle, and determining one or more image shooting devices from the existing image shooting devices of the target vehicle so that the sum of the determined original pixels of all the image shooting devices is equal to the request pixel; or, the original pixel of each determined image shooting device is larger than or equal to the request pixel;

the frame rate configuration unit is used for carrying out frame rate configuration on the image shooting device to be multiplexed and acquiring original image data shot by the image shooting device to be multiplexed after the frame rate configuration is completed; comprising the following steps: acquiring an original frame rate of the image shooting device to be multiplexed, and acquiring a request frame rate corresponding to the request information from the analysis result; comparing the request frame rate with the original frame rate, and configuring the frame rate of the image shooting device to be multiplexed when the request frame rate is different from the original frame rate, so that the configured frame rate of the image shooting device to be multiplexed is the same as the request frame rate;

The transmission processing unit is used for carrying out transmission processing on the original image data and transmitting the processed image data to the cabin domain controller so as to carry out intelligent driving control on the target vehicle; comprising the following steps: acquiring original image data shot by an image shooting device to be multiplexed after finishing frame rate configuration, and decompressing the original image data by using a first deserializer to obtain first decompressed image data; cutting or splicing the first decompressed image data, and compressing the cut or spliced image data by using a serializer; and transmitting the compressed image data to the cabin controller.

7. An intelligent driving control system, characterized by being applied to a cabin controller of a target vehicle, comprising:

the image receiving unit is used for receiving the image data transmitted after the driving domain controller analyzes the request information; the process of transmitting image data after the driving domain controller analyzes the request information comprises the following steps: analyzing the request information, and acquiring a request pixel corresponding to the request information from an analysis result; acquiring original pixels of each image shooting device existing in the target vehicle; matching the request pixel with original pixels of each image shooting device existing in the target vehicle, and determining one or more image shooting devices from the existing image shooting devices of the target vehicle so that the sum of the determined original pixels of all the image shooting devices is equal to the request pixel; or, the original pixel of each determined image shooting device is larger than or equal to the request pixel; acquiring an original frame rate of an image shooting device to be multiplexed, and acquiring a request frame rate corresponding to the request information from the analysis result; comparing the request frame rate with the original frame rate, and configuring the frame rate of the image shooting device to be multiplexed when the request frame rate is different from the original frame rate, so that the configured frame rate of the image shooting device to be multiplexed is the same as the request frame rate; acquiring original image data shot by an image shooting device to be multiplexed after finishing frame rate configuration, and decompressing the original image data by using a first deserializer to obtain first decompressed image data; cutting or splicing the first decompressed image data, and compressing the cut or spliced image data by using a serializer; transmitting the compressed image data to the cabin controller;

8. An intelligent driving control system, which is characterized by comprising:

the request analysis module is used for analyzing the request information by utilizing the driving domain controller, and determining one or more image shooting devices from the existing image shooting devices of the target vehicle according to an analysis result to serve as image shooting devices to be multiplexed; comprising the following steps: analyzing the request information, and acquiring a request pixel corresponding to the request information from an analysis result; acquiring original pixels of each image shooting device existing in the target vehicle; matching the request pixel with original pixels of each image shooting device existing in the target vehicle, and determining one or more image shooting devices from the existing image shooting devices of the target vehicle so that the sum of the determined original pixels of all the image shooting devices is equal to the request pixel; or, the original pixel of each determined image shooting device is larger than or equal to the request pixel;

The frame rate configuration module is used for configuring the frame rate of the image shooting device to be multiplexed; comprising the following steps: acquiring an original frame rate of the image shooting device to be multiplexed, and acquiring a request frame rate corresponding to the request information from the analysis result; comparing the request frame rate with the original frame rate, and configuring the frame rate of the image shooting device to be multiplexed when the request frame rate is different from the original frame rate, so that the configured frame rate of the image shooting device to be multiplexed is the same as the request frame rate;

the transmission processing module is used for carrying out transmission processing on the original image data; comprising the following steps: acquiring original image data shot by an image shooting device to be multiplexed after finishing frame rate configuration, and decompressing the original image data by using a first deserializer to obtain first decompressed image data; cutting or splicing the first decompressed image data, and compressing the cut or spliced image data by using a serializer to obtain image data which is subjected to transmission processing;

9. A vehicle, the vehicle comprising: the driving domain controller is connected with the cabin domain controller; wherein,,

the driving domain controller is used for analyzing the request information, and determining one or more image shooting devices from the existing image shooting devices of the target vehicle according to the analysis result to serve as image shooting devices to be multiplexed; the frame rate configuration is carried out on the image shooting device to be multiplexed, and original image data shot by the image shooting device to be multiplexed after the frame rate configuration is completed is obtained; the original image data is transmitted and processed, and the processed image data is transmitted to the cabin controller;

10. An electronic device, comprising:

one or more processors;

storage means for storing one or more programs that, when executed by the one or more processors, cause the electronic device to implement the intelligent driving control method of any one of claims 1 to 5.

11. A computer readable storage medium having stored thereon computer readable instructions which, when executed by a processor of a computer, cause the computer to perform the intelligent driving control method of any one of claims 1 to 5.