+

WO2023207016A1 - Autonomous driving test system and method based on digital twin cloud control platform - Google Patents

Autonomous driving test system and method based on digital twin cloud control platform Download PDF

Info

Publication number
WO2023207016A1
WO2023207016A1 PCT/CN2022/129299 CN2022129299W WO2023207016A1 WO 2023207016 A1 WO2023207016 A1 WO 2023207016A1 CN 2022129299 W CN2022129299 W CN 2022129299W WO 2023207016 A1 WO2023207016 A1 WO 2023207016A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
test
real
data
virtual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2022/129299
Other languages
French (fr)
Chinese (zh)
Inventor
赵祥模
刘占文
李蕊芬
李超
王超
肖方伟
房颜明
王洋
宋明哲
孟虎
徐志刚
王润民
林杉
程娟茹
范锦
李文倩
闵海根
蒋渊德
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chang' an University
Original Assignee
Chang' an University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chang' an University filed Critical Chang' an University
Publication of WO2023207016A1 publication Critical patent/WO2023207016A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B23/00Testing or monitoring of control systems or parts thereof
    • G05B23/02Electric testing or monitoring
    • G05B23/0205Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults
    • G05B23/0208Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults characterized by the configuration of the monitoring system
    • G05B23/0213Modular or universal configuration of the monitoring system, e.g. monitoring system having modules that may be combined to build monitoring program; monitoring system that can be applied to legacy systems; adaptable monitoring system; using different communication protocols

Definitions

  • the invention relates to the field of automatic driving technology, and specifically relates to an automatic driving testing system and method based on a digital twin cloud control platform.
  • the present invention proposes an automatic driving testing system and method based on a digital twin cloud control platform.
  • the present invention proposes an automatic driving test system and method based on a digital twin cloud control platform, which realizes virtual and real combined automatic driving algorithm function verification, scene simulation testing and vehicle-related integrated testing, and overcomes the existing Real vehicle road testing and software simulation testing technology are insufficient to improve testing efficiency.
  • the present invention provides the following technical solutions.
  • An autonomous driving test system based on a digital twin cloud control platform including:
  • Autonomous driving simulation software builds virtual dynamic test scenarios based on vehicle simulation model data and real vehicle test tasks
  • the data center processes real vehicle test tasks and virtual dynamic test scenarios into point clouds, images and ADC sensing data; and converts real vehicle status and control data into vehicle simulation model data and sends it to the autonomous driving simulation software;
  • Autonomous driving algorithm platform which includes:
  • Perception fusion algorithm platform used to fuse point cloud, image and ADC perception data, and generate traffic target location and category information
  • the decision-making planning algorithm platform outputs the traffic target trajectory based on the traffic target location and category information
  • the motion control algorithm platform calculates vehicle control signals based on the traffic target trajectory
  • the real vehicle actuator is installed on the test vehicle. According to the vehicle control signal, the test vehicle performs acceleration, braking and steering actions, and generates real vehicle status and control data;
  • the dynamic twin platform renders and displays real-time dynamic twin effects based on virtual dynamic test scene data and real-time vehicle simulation model data.
  • the construction of the virtual dynamic test scenario data includes:
  • the automatic driving simulation software generates virtual dynamic test scenarios required for development and testing, and establishes multiple virtual sensor models in the simulation software.
  • the target object information detected by the virtual sensors constitutes virtual dynamic test scenario data, which is injected into the automatic driving system through the bus. in the driving algorithm platform.
  • the real vehicle actuator and the data center perform wireless communication data transmission through a local area network
  • the data center uses wired communication to convert the actual vehicle status and control data obtained by the test vehicle into vehicle simulation model data and transmits it back to the autonomous driving simulation software.
  • the actual vehicle test tasks include actual vehicle collision avoidance warning and actual vehicle avoidance of pedestrians.
  • the actual vehicle status and control data include pose data and GPS data.
  • An autonomous driving testing method based on a digital twin cloud control platform including the following steps:
  • OPENDRIVE data is collected and produced to obtain high-precision maps, simulate the traffic environment through simulation software, and create test cases; calibrate the mapping relationship between the real map and the virtual traffic environment, and calibrate the mapping between the tested vehicle and the simulated vehicle model. relation;
  • Map-related road scene and traffic scene information is collected through sensors installed on the roadside, and processed into point clouds, images and ADC sensing data;
  • perception fusion processes point cloud, image and ADC perception data to obtain perception results, generate full-area perception results, and generate traffic target location and category information;
  • the test vehicle is controlled by the real vehicle actuator for testing, and the vehicle status information is obtained;
  • the built-in high-precision road network map and objective environmental scene model are loaded and rendered, and the real-time dynamic twin effect is presented in real time through the visual interface.
  • the testing by controlling the test vehicle through a real vehicle actuator according to the vehicle control signal includes the following steps:
  • the built-in high-precision road network map and objective environmental scene model are loaded and rendered, and the parallel twin of the test field is presented in real time through the visual interface.
  • the testing by controlling the test vehicle through a real vehicle actuator according to the vehicle control signal includes the following steps:
  • the OPENDRIVE data is OPENDRIVE data adapted to scenarios related to the handling and stability square, and the vehicle control signal is sent to the test vehicle located in the handling and stability square to obtain vehicle status information;
  • the built-in high-precision road network map and objective environmental scene model are loaded and rendered, and the twin of the real intersection is presented in real time through the visual interface.
  • it also includes:
  • the motion information of the simulated vehicle model at each timestamp is used as the analysis basis for the performance test of the controller under test. After the case is completed, the algorithm is analyzed.
  • the present invention proposes an automatic driving test system and method based on a digital twin cloud control platform, which can automatically generate large batches of simulation sample data and intelligent true value calibration for various virtual experimental conditions and scenarios, and is efficient, fast, and Accurately generate training data samples required in the field of autonomous vehicle driving; it can integrate high-precision map data road mining equipment and combine the expression of key scene elements and automatic reconstruction methods to quickly build three-dimensional reconstruction scenes that meet the testing requirements of different dimensions to help users improve The use value of self-collected scene data; it can integrate simulation test tools, V2X communication equipment, real test vehicles and other functional units to carry out digital twin autonomous driving tests based on virtual simulation and real environments, and has the ability to carry out virtual complex scenarios under limited resource conditions Autonomous driving real vehicle test verification capabilities.
  • the invention not only has the advantages of real vehicle road testing, but also integrates the advantages of simulation technology by integrating real vehicles in the virtual traffic environment, realizing the integration of real test dynamics, traffic flow simulation and complex virtual traffic scenes. Organically combined, it can continuously adapt to the rapidly changing testing needs of autonomous driving technology.
  • Figure 1 is a flow chart of the digital twin autonomous driving test method according to the embodiment of the present invention.
  • Figure 2 is a rendering of the digital twin according to the embodiment of the present invention.
  • Figure 3 is the testing process of the Class A software-in-the-loop vehicle automatic driving algorithm according to the embodiment of the present invention
  • Figure 4 is the virtual and real combined test and parallel twin process of Class B autonomous driving of the embodiment of the present invention.
  • Figure 5 is a class C vehicle automatic driving adaptability test and twin process according to the embodiment of the present invention.
  • Figure 6 shows test items and test scenarios according to the embodiment of the present invention.
  • Figure 7 is a simulation test road scene rendering according to the embodiment of the present invention.
  • Figure 8 is a layout diagram of an intersection and a stability plaza according to an embodiment of the present invention.
  • the invention provides an automatic driving testing system and method based on a digital twin cloud control platform. As shown in Figure 1-8. As shown in Figure 1, the present invention integrates two functional units of the digital twin cloud control platform and the test vehicle.
  • the digital twin cloud control platform includes dynamic twin platform, autonomous driving simulation software and data center.
  • Autonomous driving simulation software constructs virtual dynamic test scene data based on real vehicle test tasks issued by testers (real vehicle collision avoidance warning and real vehicle avoidance of pedestrians); the data center processes data based on real vehicle test tasks and virtual dynamic test scenarios Sensing data for point clouds, images and ADC (Analog to digital converter); dynamic twin platform; through the data center, the real vehicle status and control data (including pose data and GPS data) generated by the real vehicle actuator are converted into The vehicle simulation model data is sent to the autonomous driving simulation software; the dynamic twin platform renders and displays the real-time dynamic twin effect based on the virtual dynamic test scene data and real-time vehicle simulation model data sent by the autonomous driving simulation software.
  • the rendering effect is shown in Figure 2 .
  • the digital twin cloud control platform is the host computer module of the test management software. It provides multi-account management, authority management, import of requirements, preparation of test plans on the platform, and can realize the management of specific test scenarios through integrated simulation software. As well as test record playback, test analysis, report generation and other functions. Users can create and edit test scenarios on the digital twin cloud control platform. They can directly access the software-in-the-loop and model-in-the-loop methods for testing. They can also use wireless methods on the actual vehicle side to add data to the digital twin cloud on the digital twin cloud. The test plan and test scenarios formulated on the control platform are downloaded to the vehicle-mounted terminal for vehicle-in-the-loop testing.
  • the test vehicle side includes: an autonomous driving algorithm platform, which is installed on the test vehicle; the autonomous driving algorithm platform includes: a perception fusion algorithm platform, which is used to fuse point clouds, images and ADC perception data sent by the data processing platform, and generate traffic targets Position and category information; the decision planning algorithm platform outputs the traffic target trajectory based on the generated traffic target location and category information; the motion control algorithm platform calculates the vehicle control signal based on the output traffic target trajectory;
  • the real vehicle actuator is mounted on the test vehicle, receives vehicle control signals, the test vehicle performs acceleration, braking and steering actions, and generates real vehicle status and control data;
  • the test vehicle end and the digital twin cloud control platform end carry out wireless communication data transmission through the local area network, receive the test task configuration and complete the vehicle in-the-loop test.
  • the data center uses wired communication to convert the actual vehicle status and control data (including pose data and GPS data) obtained by the test vehicle into vehicle simulation model data and transmits it back to the autonomous driving simulation software to achieve "from virtual to real" Virtual-real interactive closed-loop automated testing of sensor injection and “real-to-virtual” control feedback.
  • the main functions of the invention are:
  • the invention can automatically generate large batches of simulation sample data and intelligently calibrate true values for various virtual experimental working conditions and scenarios, and efficiently, quickly and accurately generate training data samples required in the field of automatic driving of automobiles;
  • This invention can integrate high-precision map data road collection equipment and combine the expression of key scene elements and the automatic reconstruction method to quickly construct a three-dimensional reconstruction scene that meets the test requirements of different dimensions, helping users improve the use value of self-collection scene data;
  • This invention can integrate functional units such as simulation test tools, V2X communication equipment, real test vehicles, etc., to carry out digital twin automatic driving tests based on virtual simulation and real environments, and has the ability to carry out automatic driving real vehicle test verification in virtual complex scenarios under limited resource conditions. ability.
  • Step 1 Collect and produce OPENDRIVE data. Obtain the data through the collection vehicle and produce it into a high-precision map. The simulation software simulates the traffic environment;
  • Step 2 The simulator imports the prepared map into the simulation software and creates a test case
  • Step 3 In the test case, virtual cameras, lidar and other sensors are added to the roadside to collect detection data within the scanning range.
  • the sensors obtain map-related road scene and traffic scene information and pass it to the ADAS/AD algorithm platform through ROS;
  • Step 4 According to the test requirements, access the autonomous driving algorithm under test.
  • the perception fusion algorithm processes point clouds, images, true values and other information, performs perception fusion, calculates perception results, and generates global perception results.
  • the output position, category and other information are passed
  • the topic communication method is passed to the decision-making planning algorithm.
  • the decision-making planning algorithm outputs the vehicle trajectory after calculation. It is passed to the motion control algorithm through the topic communication method. After processing and calculation by the motion control algorithm, the control signal is finally output;
  • Step 5 The vehicle model obtains the control signal output by the controller under test for the controller sensor signal through ROS.
  • the vehicle model moves and returns vehicle status information such as GPS, vehicle position and attitude, and the simulation software obtains it through the API interface to proceed to the next moment. algorithm testing;
  • Step 6 The motion information of the simulated vehicle model at each timestamp is used as the analysis basis for the performance test of the controller under test. After the case is completed, the algorithm is analyzed.
  • Step 1 According to the test requirements, collect and produce OPENDRIVE data. Obtain the data through the collection vehicle and produce it into a high-precision map.
  • the simulation software simulates the simulated traffic environment, calibrates the mapping relationship between the real map and the virtual traffic environment, and calibrates the vehicle under test and the simulated vehicle.
  • the mapping relationship of the model
  • Step 2 The simulator imports the prepared map into the simulation software and creates a test case
  • Step 3 The simulation software transfers the map-related road scene and traffic scene information to the ADAS/AD algorithm platform through ROS;
  • Step 4 According to the test requirements, access the autonomous driving algorithm under test.
  • the perceptual fusion algorithm processes point clouds, images, true values and other information to perform perceptual fusion.
  • the output position, category and other information are passed to the decision-making planning algorithm through topic communication, and the decision is made.
  • the planning algorithm outputs the vehicle trajectory after calculation, and passes it to the motion control algorithm through topic communication. After processing and calculation by the motion control algorithm, the control signal is finally output;
  • Step 5 Send the control signal to the driverless bus located on the road of the test site.
  • the industrial computer of the actual vehicle moves and returns vehicle status information such as GPS, vehicle position and attitude, etc.
  • the simulation software obtains it through the API interface and performs Algorithm testing at the next moment;
  • Step 6 After receiving vehicle status and other information, the simulation software loads the built-in high-precision road network map and objective environmental scene model, renders it through the cloud control platform, and presents the parallel twin of the test field in real time on the visual interface.
  • Step 1 According to the test requirements, collect and produce OPENDRIVE data that adapts to the scenarios related to the handling and stability square.
  • the data is obtained through the collection vehicle and produced into a high-precision map.
  • the simulation software simulates the traffic environment and calibrates the mapping between the real map and the virtual traffic environment. Relationship, calibrate the mapping relationship between the vehicle under test and the simulated vehicle model;
  • Step 2 The simulator imports the prepared map into the simulation software and creates a test case
  • Step 3 The simulation software transfers the map-related road scene and traffic scene information to the ADAS/AD algorithm platform through ROS;
  • Step 4 According to the test requirements, access the autonomous driving algorithm under test.
  • the perceptual fusion algorithm processes point clouds, images, true values and other information to perform perceptual fusion.
  • the output position, category and other information are passed to the decision-making planning algorithm through topic communication, and the decision is made.
  • the planning algorithm outputs the vehicle trajectory after calculation, and passes it to the motion control algorithm through topic communication. After processing and calculation by the motion control algorithm, the control signal is finally output;
  • Step 5 Send the control signal to the driverless bus located in the Stability Square.
  • the real vehicle industrial computer moves and returns vehicle status information such as GPS, vehicle position and attitude, etc.
  • the simulation software obtains it through the API interface. Carry out algorithm testing at the next moment;
  • Step 6 After receiving vehicle status and other information, the simulation software loads the built-in high-precision road network map and objective environmental scene model, renders it through the cloud control platform, and presents a twin of the real intersection on the visual interface.
  • the present invention uses simulation software to generate virtual scenes required for development and testing, and establishes multiple virtual sensor models in the simulation software, and injects target object information detected by the virtual sensors into the automatic driving controller on the real vehicle through the bus for information processing. Fusion and control decision-making, the controller sends the decision-making acceleration, braking and steering instructions to the real vehicle actuator, and the real vehicle then feeds back the vehicle motion status information on the vehicle bus to the virtual scene through the roadside communication system to complete the vehicle Position synchronization, thereby achieving closed-loop real-time simulation of the entire system.
  • the obtained target object information is injected into the autonomous driving algorithm platform through the wireless network for information fusion and decision-making control.
  • the autonomous driving algorithm platform sends the decision-making acceleration, braking, steering and other control signals to the real vehicle actuator.
  • the actual vehicle operation At the same time, the vehicle information collection system collects real-time real vehicle motion status information and feeds it back to the virtual scene to complete the synchronization of vehicle positions in the virtual and real environments, thereby realizing closed-loop real-time simulation testing of the entire digital twin system.
  • the virtual simulation platform can generate the original signal or target signal of the sensor according to the needs of the test scenario in the test task management system, and inject it into the autonomous driving prototype before the data perception and fusion module or the decision-making layer algorithm.
  • the virtual simulation platform generates original signals based on different models such as camera models, millimeter-wave radar models, lidar models, and V2X models, and injects various basic test data in the original signals into the vehicle controller.
  • the original signal of the camera is the video stream
  • the original signal of the lidar is the laser point cloud data;
  • Target signal injection Based on the idealized true value sensing model, the virtual simulation platform injects the following target signals detected within a certain range of the prototype vehicle into the vehicle controller through CAN or other suitable methods;
  • a classic intersection model is used to conduct intelligent vehicle testing for the test scenario.
  • the test in this article will be based on the autonomous driving test site of Chang'an University, with the Stability Plaza as the physical basis, and a virtual and real smart vehicle test will be carried out based on urban intersection scenarios.
  • a two-way eight-lane intersection in a certain area of Xi'an City is used as a model.
  • the typical traffic conditions at intersections in urban traffic flow were extracted.
  • Test samples were set up for starting, stopping, going straight, and turning scenarios in the intersection. At the same time, the situation of pedestrians crossing the road was taken into consideration, and corresponding scenarios were set up. Carry out the test and simulate the test road scene effect as shown in Figure 7.
  • the selected test items and test scenarios are shown in Figure 6.
  • the present invention uses the minimum safe distance at the warning time and the TTC at the warning time as the judgment conditions for whether to issue a warning, and uses the minimum safe distance model between vehicles to illustrate the possibility of collision during vehicle braking.
  • the time when the application issues an early warning must ensure that there is sufficient time or distance between the test vehicle and the target vehicle for the smart vehicle to react and brake to a safe speed to avoid a collision.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Traffic Control Systems (AREA)

Abstract

An autonomous driving test system and method based on a digital twin cloud control platform. A high-fidelity virtual scene, which needs to be developed and tested, is generated by means of simulation software, and a plurality of virtual sensor models are established in the simulation software; information of a target object that is detected by a virtual sensor is input into an autonomous driving controller on a real vehicle by means of a bus, and information fusion and control decision are performed; and the controller sends decided acceleration, braking and steering instructions to a real-vehicle actuator. The real vehicle feeds vehicle motion state information on a vehicle bus back to the virtual scene, so as to complete synchronization of vehicle positions, closed-loop real-time testing and verification of the entire system are realized, and a scene-related twin effect is displayed in real time by means of the digital twin cloud control platform. Therefore, an integration test related to virtuality and reality combined autonomous driving algorithm function verification, a scene simulation test and a vehicle is realized, and the defects of existing real-vehicle road tests and software simulation testing technology are overcome, such that the test efficiency is improved.

Description

一种基于数字孪生云控平台的自动驾驶测试系统和方法An autonomous driving testing system and method based on digital twin cloud control platform 技术领域Technical field

本发明涉及自动驾驶技术领域,具体涉及一种基于数字孪生云控平台的自动驾驶测试系统和方法。The invention relates to the field of automatic driving technology, and specifically relates to an automatic driving testing system and method based on a digital twin cloud control platform.

背景技术Background technique

随着市场需求的明确以及自动驾驶技术的发展,很多传统车辆制造企业转型或设立自动驾驶部门,以及一些自动驾驶初创企业,都研发了很多自动驾驶相关的控制器和传感器,并深度融合集成应用L2到L4级的智能汽车中。这些系统赋能智能汽车,但应对各种长尾效应的系统鲁棒性与安全性成为制约高级别智能汽车投入使用的瓶颈。因此需要对自动驾驶车辆进行充分的测试验证。With the clarification of market demand and the development of autonomous driving technology, many traditional vehicle manufacturing companies have transformed or established autonomous driving departments, and some autonomous driving start-ups have developed many autonomous driving-related controllers and sensors, and have deeply integrated integrated applications. In L2 to L4 smart cars. These systems empower smart cars, but system robustness and security to cope with various long-tail effects have become bottlenecks that restrict the use of high-level smart cars. Therefore, sufficient testing and verification of autonomous vehicles is required.

受复杂场景构造难度、测试成本和安全风险等因素的影响,仅依靠实车道路测试难以满足智能车辆的研究及测试需求。除实车道路测试外,软件仿真测试也是智能汽车测试验证的重要技术手段,具有成本低、周期短、效率高等优势,但是其场景建模及传感器仿真大多是建立在理想条件下,没有考虑到传感器硬件或软件自身造成的噪点问题,以及雨雪、灰尘等干扰雷达传感性能的环境因素,使得仿真结果的置信度存在较大的局限性。Affected by factors such as the difficulty of constructing complex scenarios, test costs, and safety risks, it is difficult to meet the research and testing needs of intelligent vehicles by relying solely on actual vehicle road tests. In addition to actual vehicle road testing, software simulation testing is also an important technical means for smart vehicle testing and verification. It has the advantages of low cost, short cycle, and high efficiency. However, its scene modeling and sensor simulation are mostly based on ideal conditions and do not take into account Noise problems caused by the sensor hardware or software itself, as well as rain, snow, dust and other environmental factors that interfere with radar sensing performance, make the confidence of simulation results have great limitations.

为此,本发明提出一种基于数字孪生云控平台的自动驾驶测试系统和方法。To this end, the present invention proposes an automatic driving testing system and method based on a digital twin cloud control platform.

发明内容Contents of the invention

为解决上述问题,本发明提出了一种基于数字孪生云控平台的自动驾驶 测试系统和方法,实现了虚实结合自动驾驶算法功能验证、场景仿真测试与整车相关的集成测试,并且克服现有实车道路测试和软件仿真测试技术不足,提高测试效率。In order to solve the above problems, the present invention proposes an automatic driving test system and method based on a digital twin cloud control platform, which realizes virtual and real combined automatic driving algorithm function verification, scene simulation testing and vehicle-related integrated testing, and overcomes the existing Real vehicle road testing and software simulation testing technology are insufficient to improve testing efficiency.

本发明提供了如下的技术方案。The present invention provides the following technical solutions.

一种基于数字孪生云控平台的自动驾驶测试系统,包括:An autonomous driving test system based on a digital twin cloud control platform, including:

自动驾驶仿真软件,根据车辆仿真模型数据和实车测试任务,构建虚拟动态测试场景;Autonomous driving simulation software builds virtual dynamic test scenarios based on vehicle simulation model data and real vehicle test tasks;

数据中台,将实车测试任务和虚拟动态测试场景处理为点云、图像和ADC感知数据;及将实车状态和控制数据转换为车辆仿真模型数据,发送给自动驾驶仿真软件;The data center processes real vehicle test tasks and virtual dynamic test scenarios into point clouds, images and ADC sensing data; and converts real vehicle status and control data into vehicle simulation model data and sends it to the autonomous driving simulation software;

自动驾驶算法平台,其包括:Autonomous driving algorithm platform, which includes:

感知融合算法平台,用于融合点云、图像和ADC感知数据,并生成交通目标位置和类别信息;Perception fusion algorithm platform, used to fuse point cloud, image and ADC perception data, and generate traffic target location and category information;

决策规划算法平台,根据交通目标位置和类别信息,输出交通目标轨迹;The decision-making planning algorithm platform outputs the traffic target trajectory based on the traffic target location and category information;

运动控制算法平台,根据交通目标轨迹,计算车辆控制信号;The motion control algorithm platform calculates vehicle control signals based on the traffic target trajectory;

实车执行器,搭载于测试车辆上,根据车辆控制信号,测试车辆执行加速、制动以及转向动作,生成实车状态和控制数据;The real vehicle actuator is installed on the test vehicle. According to the vehicle control signal, the test vehicle performs acceleration, braking and steering actions, and generates real vehicle status and control data;

以及,as well as,

动态孪生平台,根据虚拟动态测试场景数据和实时车辆仿真模型数据,渲染并展示实时动态孪生效果。The dynamic twin platform renders and displays real-time dynamic twin effects based on virtual dynamic test scene data and real-time vehicle simulation model data.

优选地,所述虚拟动态测试场景数据的构建,包括:Preferably, the construction of the virtual dynamic test scenario data includes:

所述自动驾驶仿真软件生成所需开发测试的虚拟动态测试场景,并在仿 真软件中建立多种虚拟传感器模型,将虚拟传感器探测到的目标物体信息构成虚拟动态测试场景数据,通过总线注入到自动驾驶算法平台中。The automatic driving simulation software generates virtual dynamic test scenarios required for development and testing, and establishes multiple virtual sensor models in the simulation software. The target object information detected by the virtual sensors constitutes virtual dynamic test scenario data, which is injected into the automatic driving system through the bus. in the driving algorithm platform.

优选地,所述实车执行器与数据中台通过局域网进行无线通信数据传输;Preferably, the real vehicle actuator and the data center perform wireless communication data transmission through a local area network;

所述数据中台利用有线通信方式将测试车辆端获取的实车状态和控制数据转换为车辆仿真模型数据并回传至自动驾驶仿真软件。The data center uses wired communication to convert the actual vehicle status and control data obtained by the test vehicle into vehicle simulation model data and transmits it back to the autonomous driving simulation software.

优选地,所述实车测试任务包括实车避撞预警和实车避让行人。Preferably, the actual vehicle test tasks include actual vehicle collision avoidance warning and actual vehicle avoidance of pedestrians.

优选地,所述实车状态和控制数据包括位姿数据和GPS数据。Preferably, the actual vehicle status and control data include pose data and GPS data.

一种基于数字孪生云控平台的自动驾驶测试方法,包括以下步骤:An autonomous driving testing method based on a digital twin cloud control platform, including the following steps:

根据实车测试任务,采集并制作OPENDRIVE数据,获得高精度地图,通过仿真软件仿真模拟交通环境,创建测试案例;标定真实地图与虚拟交通环境的映射关系,标定被测车辆与仿真车辆模型的映射关系;According to the real vehicle test task, OPENDRIVE data is collected and produced to obtain high-precision maps, simulate the traffic environment through simulation software, and create test cases; calibrate the mapping relationship between the real map and the virtual traffic environment, and calibrate the mapping between the tested vehicle and the simulated vehicle model. relation;

通过路侧设置的传感器采集地图相关道路场景和交通场景信息,并处理为点云、图像和ADC感知数据;Map-related road scene and traffic scene information is collected through sensors installed on the roadside, and processed into point clouds, images and ADC sensing data;

根据实车测试任务,感知融合处理点云、图像和ADC感知数据,获得感知结果,并生成全域感知结果,并生成交通目标位置和类别信息;According to the actual vehicle test task, perception fusion processes point cloud, image and ADC perception data to obtain perception results, generate full-area perception results, and generate traffic target location and category information;

根据生成的交通目标位置和类别信息规划交通目标轨迹,并通过运动控制算法处理计算,输出车辆控制信号;Plan the traffic target trajectory according to the generated traffic target position and category information, process and calculate it through the motion control algorithm, and output the vehicle control signal;

根据车辆控制信号通过实车执行器控制测试车辆进行测试,获得车辆状态信息;According to the vehicle control signal, the test vehicle is controlled by the real vehicle actuator for testing, and the vehicle status information is obtained;

接收车辆状态信息后,加载内置高精度路网地图及客观环境场景模型,并进行渲染,通过可视化界面实时呈现实时动态孪生效果。After receiving the vehicle status information, the built-in high-precision road network map and objective environmental scene model are loaded and rendered, and the real-time dynamic twin effect is presented in real time through the visual interface.

优选地,所述根据车辆控制信号通过实车执行器控制测试车辆进行测试, 包括以下步骤:Preferably, the testing by controlling the test vehicle through a real vehicle actuator according to the vehicle control signal includes the following steps:

将车辆控制信号发至位于测试场道路的测试车辆,获得车辆状态信息;Send vehicle control signals to the test vehicle on the road at the test site to obtain vehicle status information;

接收车辆状态信息后,加载内置高精度路网地图及客观环境场景模型,并进行渲染,通过可视化界面实时呈现测试场的平行孪生。After receiving the vehicle status information, the built-in high-precision road network map and objective environmental scene model are loaded and rendered, and the parallel twin of the test field is presented in real time through the visual interface.

优选地,所述根据车辆控制信号通过实车执行器控制测试车辆进行测试,包括以下步骤:Preferably, the testing by controlling the test vehicle through a real vehicle actuator according to the vehicle control signal includes the following steps:

所述OPENDRIVE数据为适配操稳性广场相关场景的OPENDRIVE数据,将车辆控制信号发至位于操稳性广场的测试车辆,获得车辆状态信息;The OPENDRIVE data is OPENDRIVE data adapted to scenarios related to the handling and stability square, and the vehicle control signal is sent to the test vehicle located in the handling and stability square to obtain vehicle status information;

接收车辆状态信息后,加载内置高精度路网地图及客观环境场景模型,并进行渲染,通过可视化界面实时呈现真实路口的孪生。After receiving the vehicle status information, the built-in high-precision road network map and objective environmental scene model are loaded and rendered, and the twin of the real intersection is presented in real time through the visual interface.

优选地,还包括:Preferably, it also includes:

通过车辆控制信号控制仿真车辆模型运动,获得车辆状态信息;Control the movement of the simulated vehicle model through vehicle control signals and obtain vehicle status information;

仿真车辆模型在每一个时间戳的运动信息作为被测控制器的性能测试的分析依据,案例结束之后对算法进行分析。The motion information of the simulated vehicle model at each timestamp is used as the analysis basis for the performance test of the controller under test. After the case is completed, the algorithm is analyzed.

本发明的有益效果:Beneficial effects of the present invention:

本发明提出了一种基于数字孪生云控平台的自动驾驶测试系统和方法,能够对各种虚拟实验工况和场景进行大批量仿真样本数据的自动生成与智能化真值标定,高效、快速、准确地生成汽车自动驾驶领域所需要的训练数据样本;可集成高精度地图数据路采设备并结合场景关键要素表达与自动重构方法快速构建出符合不同维度测试需求的三维重建场景,帮助用户提升自采场景数据的使用价值;可集成仿真测试工具、V2X通信设备、真实测试车辆等功能单元,开展基于虚拟仿真以及真实环境的数字孪生自动驾驶测试,具备 在有限资源条件下开展虚拟复杂场景的自动驾驶实车测试验证能力。The present invention proposes an automatic driving test system and method based on a digital twin cloud control platform, which can automatically generate large batches of simulation sample data and intelligent true value calibration for various virtual experimental conditions and scenarios, and is efficient, fast, and Accurately generate training data samples required in the field of autonomous vehicle driving; it can integrate high-precision map data road mining equipment and combine the expression of key scene elements and automatic reconstruction methods to quickly build three-dimensional reconstruction scenes that meet the testing requirements of different dimensions to help users improve The use value of self-collected scene data; it can integrate simulation test tools, V2X communication equipment, real test vehicles and other functional units to carry out digital twin autonomous driving tests based on virtual simulation and real environments, and has the ability to carry out virtual complex scenarios under limited resource conditions Autonomous driving real vehicle test verification capabilities.

本发明不仅具备了实车道路测试的优势,同时还通过在虚拟交通环境中集成真实车辆的方式来整合了仿真技术的优势,实现了将真实测试动力学、交通流仿真与复杂虚拟交通场景的有机结合,能够不断适应自动驾驶技术快速变化的测试需求。The invention not only has the advantages of real vehicle road testing, but also integrates the advantages of simulation technology by integrating real vehicles in the virtual traffic environment, realizing the integration of real test dynamics, traffic flow simulation and complex virtual traffic scenes. Organically combined, it can continuously adapt to the rapidly changing testing needs of autonomous driving technology.

附图说明Description of the drawings

图1是本发明实施例的数字孪生自动驾驶测试方法流程框图;Figure 1 is a flow chart of the digital twin autonomous driving test method according to the embodiment of the present invention;

图2是本发明实施例数字孪生呈现效果图;Figure 2 is a rendering of the digital twin according to the embodiment of the present invention;

图3是本发明实施例A类软件在环整车自动驾驶算法测试流程;Figure 3 is the testing process of the Class A software-in-the-loop vehicle automatic driving algorithm according to the embodiment of the present invention;

图4是本发明实施例B类整车自动驾驶虚实结合测试及平行孪生流程;Figure 4 is the virtual and real combined test and parallel twin process of Class B autonomous driving of the embodiment of the present invention;

图5是本发明实施例C类整车自动驾驶适应性测试及孪生流程;Figure 5 is a class C vehicle automatic driving adaptability test and twin process according to the embodiment of the present invention;

图6是本发明实施例的测试项目及测试场景;Figure 6 shows test items and test scenarios according to the embodiment of the present invention;

图7是本发明实施例的仿真测试道路场景效果图;Figure 7 is a simulation test road scene rendering according to the embodiment of the present invention;

图8是本发明实施例的路口及操稳性广场布局图。Figure 8 is a layout diagram of an intersection and a stability plaza according to an embodiment of the present invention.

具体实施方式Detailed ways

为了使本发明的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅用以解释本发明,并不用于限定本发明。In order to make the purpose, technical solutions and advantages of the present invention more clear, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention and are not intended to limit the present invention.

实施例Example

本发明的一种基于数字孪生云控平台的自动驾驶测试系统和方法。如图 1-8所示。如图1所示本发明集成了数字孪生云控平台端和测试车辆两个功能单元。The invention provides an automatic driving testing system and method based on a digital twin cloud control platform. As shown in Figure 1-8. As shown in Figure 1, the present invention integrates two functional units of the digital twin cloud control platform and the test vehicle.

数字孪生云控平台端包括动态孪生平台、自动驾驶仿真软件和数据中台。自动驾驶仿真软件,根据测试者下发实车测试任务(实车避撞预警和实车避让行人),构建虚拟动态测试场景数据;数据中台,根据实车测试任务和虚拟动态测试场景数据处理为点云、图像和ADC(Analog to digital converter)感知数据;动态孪生平台;通过所述数据中台将实车执行器生成的实车状态和控制数据(包括位姿数据和GPS数据)转换为车辆仿真模型数据,发送给自动驾驶仿真软件;动态孪生平台根据自动驾驶仿真软件发送的虚拟动态测试场景数据和实时车辆仿真模型数据,进行渲染并展示实时动态孪生效果,呈现效果如图2所示。The digital twin cloud control platform includes dynamic twin platform, autonomous driving simulation software and data center. Autonomous driving simulation software constructs virtual dynamic test scene data based on real vehicle test tasks issued by testers (real vehicle collision avoidance warning and real vehicle avoidance of pedestrians); the data center processes data based on real vehicle test tasks and virtual dynamic test scenarios Sensing data for point clouds, images and ADC (Analog to digital converter); dynamic twin platform; through the data center, the real vehicle status and control data (including pose data and GPS data) generated by the real vehicle actuator are converted into The vehicle simulation model data is sent to the autonomous driving simulation software; the dynamic twin platform renders and displays the real-time dynamic twin effect based on the virtual dynamic test scene data and real-time vehicle simulation model data sent by the autonomous driving simulation software. The rendering effect is shown in Figure 2 .

数字孪生云控平台端为测试管理软件的上位机模块,在平台上提供用户多账号管理,权限管理,需求的导入,测试计划的编制,并可通过集成的仿真软件实现具体测试场景的管理,以及测试记录回放、测试分析、报告生成等功能。用户能够在数字孪生云控平台端进行测试场景的创建、编辑,能够直接通过接入软件在环、模型在环的方式进行测试,也可以在实车端通过无线的方式,将在数字孪生云控平台端制定的测试计划和测试场景下载到车载端,进行整车在环的测试。The digital twin cloud control platform is the host computer module of the test management software. It provides multi-account management, authority management, import of requirements, preparation of test plans on the platform, and can realize the management of specific test scenarios through integrated simulation software. As well as test record playback, test analysis, report generation and other functions. Users can create and edit test scenarios on the digital twin cloud control platform. They can directly access the software-in-the-loop and model-in-the-loop methods for testing. They can also use wireless methods on the actual vehicle side to add data to the digital twin cloud on the digital twin cloud. The test plan and test scenarios formulated on the control platform are downloaded to the vehicle-mounted terminal for vehicle-in-the-loop testing.

测试车辆端,包括:自动驾驶算法平台,搭载于测试车辆上;自动驾驶算法平台包括:感知融合算法平台,用于融合处理数据中台发送的点云、图像和ADC感知数据,并生成交通目标位置和类别信息;决策规划算法平台,根据生成的交通目标位置和类别信息输出交通目标轨迹;运动控制算法平台, 根据输出的交通目标轨迹计算车辆控制信号;The test vehicle side includes: an autonomous driving algorithm platform, which is installed on the test vehicle; the autonomous driving algorithm platform includes: a perception fusion algorithm platform, which is used to fuse point clouds, images and ADC perception data sent by the data processing platform, and generate traffic targets Position and category information; the decision planning algorithm platform outputs the traffic target trajectory based on the generated traffic target location and category information; the motion control algorithm platform calculates the vehicle control signal based on the output traffic target trajectory;

以及,实车执行器,搭载于测试车辆上,接收车辆控制信号,测试车辆执行加速、制动以及转向动作,生成实车状态和控制数据;And, the real vehicle actuator is mounted on the test vehicle, receives vehicle control signals, the test vehicle performs acceleration, braking and steering actions, and generates real vehicle status and control data;

测试车辆端与数字孪生云控平台端通过局域网进行无线通信数据传输,并接收测试任务配置并完成整车在环测试。数据中台利用有线通信方式将测试车辆端获取的实车状态和控制数据(包括位姿数据和GPS数据)转换为车辆仿真模型数据并回传至自动驾驶仿真软件,实现“从虚到实”传感注入和“从实到虚”控制反馈的虚实互动闭环自动化测试。The test vehicle end and the digital twin cloud control platform end carry out wireless communication data transmission through the local area network, receive the test task configuration and complete the vehicle in-the-loop test. The data center uses wired communication to convert the actual vehicle status and control data (including pose data and GPS data) obtained by the test vehicle into vehicle simulation model data and transmits it back to the autonomous driving simulation software to achieve "from virtual to real" Virtual-real interactive closed-loop automated testing of sensor injection and “real-to-virtual” control feedback.

本发明的主要功能为:The main functions of the invention are:

本发明能够对各种虚拟实验工况和场景进行大批量仿真样本数据的自动生成与智能化真值标定,高效、快速、准确地生成汽车自动驾驶领域所需要的训练数据样本;The invention can automatically generate large batches of simulation sample data and intelligently calibrate true values for various virtual experimental working conditions and scenarios, and efficiently, quickly and accurately generate training data samples required in the field of automatic driving of automobiles;

本发明可集成高精度地图数据路采设备并结合场景关键要素表达与自动重构方法快速构建出符合不同维度测试需求的三维重建场景,帮助用户提升自采场景数据的使用价值;This invention can integrate high-precision map data road collection equipment and combine the expression of key scene elements and the automatic reconstruction method to quickly construct a three-dimensional reconstruction scene that meets the test requirements of different dimensions, helping users improve the use value of self-collection scene data;

本发明可集成仿真测试工具、V2X通信设备、真实测试车辆等功能单元,开展基于虚拟仿真以及真实环境的数字孪生自动驾驶测试,具备在有限资源条件下开展虚拟复杂场景的自动驾驶实车测试验证能力。This invention can integrate functional units such as simulation test tools, V2X communication equipment, real test vehicles, etc., to carry out digital twin automatic driving tests based on virtual simulation and real environments, and has the ability to carry out automatic driving real vehicle test verification in virtual complex scenarios under limited resource conditions. ability.

实施例1Example 1

如图3所示,SIL软件在环自动驾驶算法测试及其可视化:As shown in Figure 3, SIL software-in-the-loop autonomous driving algorithm testing and visualization:

步骤一:采集、制作OPENDRIVE数据,通过采集车获得数据并制作成为高精度地图,仿真软件仿真模拟交通环境;Step 1: Collect and produce OPENDRIVE data. Obtain the data through the collection vehicle and produce it into a high-precision map. The simulation software simulates the traffic environment;

步骤二:仿真机将制作好的地图导入仿真软件,创建测试案例;Step 2: The simulator imports the prepared map into the simulation software and creates a test case;

步骤三:测试案例中在路侧加入虚拟摄像头、激光雷达等传感器,采集扫描范围内的检测数据,传感器获得地图相关道路场景、交通场景信息,通过ROS传递给ADAS/AD算法平台;Step 3: In the test case, virtual cameras, lidar and other sensors are added to the roadside to collect detection data within the scanning range. The sensors obtain map-related road scene and traffic scene information and pass it to the ADAS/AD algorithm platform through ROS;

步骤四:根据测试需求,接入被测自动驾驶算法,感知融合算法处理点云、图像、真值等信息,进行感知融合,计算感知结果,并生成全域感知结果,输出位置、类别等信息通过topic通信方式传递给决策规划算法,决策规划算法经过计算后输出车辆轨迹,通过topic通信方式传递给运动控制算法,经过运动控制算法处理计算后,最后输出控制信号;Step 4: According to the test requirements, access the autonomous driving algorithm under test. The perception fusion algorithm processes point clouds, images, true values and other information, performs perception fusion, calculates perception results, and generates global perception results. The output position, category and other information are passed The topic communication method is passed to the decision-making planning algorithm. The decision-making planning algorithm outputs the vehicle trajectory after calculation. It is passed to the motion control algorithm through the topic communication method. After processing and calculation by the motion control algorithm, the control signal is finally output;

步骤五:车辆模型通过ROS获取被测控制器针对控制器传感器信号输出的控制信号,车辆模型进行运动,返回GPS、车辆位置与姿态等车辆状态信息,仿真软件通过API接口获取,进行下一个时刻的算法测试;Step 5: The vehicle model obtains the control signal output by the controller under test for the controller sensor signal through ROS. The vehicle model moves and returns vehicle status information such as GPS, vehicle position and attitude, and the simulation software obtains it through the API interface to proceed to the next moment. algorithm testing;

步骤六:仿真车辆模型在每一个时间戳的运动信息作为被测控制器的性能测试的分析依据,案例结束之后对算法进行分析。Step 6: The motion information of the simulated vehicle model at each timestamp is used as the analysis basis for the performance test of the controller under test. After the case is completed, the algorithm is analyzed.

实施例2Example 2

如图4所示,整车自动驾驶虚实结合测试及平行孪生:As shown in Figure 4, the virtual and real combined test and parallel twin of complete vehicle autonomous driving:

步骤一:根据测试需求,采集、制作OPENDRIVE数据,通过采集车获得数据并制作成为高精度地图,仿真软件仿真模拟交通环境,标定真实地图与虚拟交通环境的映射关系,标定被测车辆与仿真车辆模型的映射关系;Step 1: According to the test requirements, collect and produce OPENDRIVE data. Obtain the data through the collection vehicle and produce it into a high-precision map. The simulation software simulates the simulated traffic environment, calibrates the mapping relationship between the real map and the virtual traffic environment, and calibrates the vehicle under test and the simulated vehicle. The mapping relationship of the model;

步骤二:仿真机将制作好的地图导入仿真软件,创建测试案例;Step 2: The simulator imports the prepared map into the simulation software and creates a test case;

步骤三:仿真软件将地图相关道路场景、交通场景信息,通过ROS传递给ADAS/AD算法平台;Step 3: The simulation software transfers the map-related road scene and traffic scene information to the ADAS/AD algorithm platform through ROS;

步骤四:根据测试需求,接入被测自动驾驶算法,感知融合算法处理点云、图像、真值等信息,进行感知融合,输出位置、类别等信息通过topic通信方式传递给决策规划算法,决策规划算法经过计算后输出车辆轨迹,通过topic通信方式传递给运动控制算法,经过运动控制算法处理计算后,最后输出控制信号;Step 4: According to the test requirements, access the autonomous driving algorithm under test. The perceptual fusion algorithm processes point clouds, images, true values and other information to perform perceptual fusion. The output position, category and other information are passed to the decision-making planning algorithm through topic communication, and the decision is made. The planning algorithm outputs the vehicle trajectory after calculation, and passes it to the motion control algorithm through topic communication. After processing and calculation by the motion control algorithm, the control signal is finally output;

步骤五:将控制信号下发至位于测试场道路的无人驾驶巴士,实车工控机接收控制信号之后进行运动,返回GPS、车辆位置与姿态等车辆状态信息,仿真软件通过API接口获取,进行下一个时刻的算法测试;Step 5: Send the control signal to the driverless bus located on the road of the test site. After receiving the control signal, the industrial computer of the actual vehicle moves and returns vehicle status information such as GPS, vehicle position and attitude, etc. The simulation software obtains it through the API interface and performs Algorithm testing at the next moment;

步骤六:仿真软件接收车辆状态等信息后,加载内置高精度路网地图及客观环境场景模型,通过云控平台进行渲染,在可视化界面实时呈现测试场的平行孪生。Step 6: After receiving vehicle status and other information, the simulation software loads the built-in high-precision road network map and objective environmental scene model, renders it through the cloud control platform, and presents the parallel twin of the test field in real time on the visual interface.

实施例3Example 3

如图5所示,整车自动驾驶适应性测试及孪生流程:As shown in Figure 5, the vehicle autonomous driving adaptability test and twin process:

步骤一:根据测试需求,采集、制作适配操稳性广场相关场景的OPENDRIVE数据,通过采集车获得数据并制作成为高精度地图,仿真软件仿真模拟交通环境,标定真实地图与虚拟交通环境的映射关系,标定被测车辆与仿真车辆模型的映射关系;Step 1: According to the test requirements, collect and produce OPENDRIVE data that adapts to the scenarios related to the handling and stability square. The data is obtained through the collection vehicle and produced into a high-precision map. The simulation software simulates the traffic environment and calibrates the mapping between the real map and the virtual traffic environment. Relationship, calibrate the mapping relationship between the vehicle under test and the simulated vehicle model;

步骤二:仿真机将制作好的地图导入仿真软件,创建测试案例;Step 2: The simulator imports the prepared map into the simulation software and creates a test case;

步骤三:仿真软件将地图相关道路场景、交通场景信息,通过ROS传递给ADAS/AD算法平台;Step 3: The simulation software transfers the map-related road scene and traffic scene information to the ADAS/AD algorithm platform through ROS;

步骤四:根据测试需求,接入被测自动驾驶算法,感知融合算法处理点云、图像、真值等信息,进行感知融合,输出位置、类别等信息通过topic 通信方式传递给决策规划算法,决策规划算法经过计算后输出车辆轨迹,通过topic通信方式传递给运动控制算法,经过运动控制算法处理计算后,最后输出控制信号;Step 4: According to the test requirements, access the autonomous driving algorithm under test. The perceptual fusion algorithm processes point clouds, images, true values and other information to perform perceptual fusion. The output position, category and other information are passed to the decision-making planning algorithm through topic communication, and the decision is made. The planning algorithm outputs the vehicle trajectory after calculation, and passes it to the motion control algorithm through topic communication. After processing and calculation by the motion control algorithm, the control signal is finally output;

步骤五:将控制信号下发至位于操稳性广场的无人驾驶巴士,实车工控机接收控制信号之后进行运动,返回GPS、车辆位置与姿态等车辆状态信息,仿真软件通过API接口获取,进行下一个时刻的算法测试;Step 5: Send the control signal to the driverless bus located in the Stability Square. After receiving the control signal, the real vehicle industrial computer moves and returns vehicle status information such as GPS, vehicle position and attitude, etc. The simulation software obtains it through the API interface. Carry out algorithm testing at the next moment;

步骤六:仿真软件接收车辆状态等信息后,加载内置高精度路网地图及客观环境场景模型,通过云控平台进行渲染,在可视化界面呈现真实路口的孪生。Step 6: After receiving vehicle status and other information, the simulation software loads the built-in high-precision road network map and objective environmental scene model, renders it through the cloud control platform, and presents a twin of the real intersection on the visual interface.

实施例4Example 4

本发明借助仿真软件生成所需开发测试的虚拟场景,并在仿真软件中建立多种虚拟传感器模型,将虚拟传感器探测到的目标物体信息通过总线注入到实车上的自动驾驶控制器中进行信息融合与控制决策,控制器将决策后的加速、制动以及转向指令发送给实车执行器,实车再将车辆总线上的整车运动状态信息通过路侧通信系统反馈给虚拟场景来完成车辆位置的同步,进而实现整个系统的闭环实时仿真。The present invention uses simulation software to generate virtual scenes required for development and testing, and establishes multiple virtual sensor models in the simulation software, and injects target object information detected by the virtual sensors into the automatic driving controller on the real vehicle through the bus for information processing. Fusion and control decision-making, the controller sends the decision-making acceleration, braking and steering instructions to the real vehicle actuator, and the real vehicle then feeds back the vehicle motion status information on the vehicle bus to the virtual scene through the roadside communication system to complete the vehicle Position synchronization, thereby achieving closed-loop real-time simulation of the entire system.

为了实现本发明系统需求,我们构建基于整车的数字孪生测试系统,充分结合XIL在环仿真测试与实车测试的优势,通过仿真软件生成虚拟测试场景,将虚拟的场景信息注入给自动驾驶算法控制器中,进而控制实际被测车辆的运动状态。In order to realize the system requirements of the present invention, we build a digital twin test system based on the entire vehicle, fully combining the advantages of XIL in-the-loop simulation testing and real vehicle testing, generating virtual test scenes through simulation software, and injecting virtual scene information into the automatic driving algorithm. In the controller, the movement state of the actual vehicle under test is controlled.

在虚拟仿真系统中设置、生成所需开发测试的虚拟场景,并在仿真软件中部署所需要的虚拟传感器模型(支持摄像头、毫米波雷达、激光雷达、超声 波雷达),虚拟传感器在仿真环境中探测到的目标物体信息通过无线网络注入到自动驾驶算法平台中进行信息融合与决策控制,自动驾驶算法平台将决策后的加速、制动以及转向等控制信号发送给实车执行器,实车运行的同时车辆信息采集系统将实时的实车运动状态信息采集并反馈给虚拟场景来完成虚实环境中车辆位置的同步,从而实现整个数字孪生系统的闭环实时仿真测试。通过提供标准的传感器数据格式接口及车辆状态信息接收接口,实现较为通用的注入测试需求。Set up and generate the virtual scenes required for development and testing in the virtual simulation system, and deploy the required virtual sensor models in the simulation software (supporting cameras, millimeter wave radar, lidar, ultrasonic radar), and the virtual sensors detect in the simulation environment The obtained target object information is injected into the autonomous driving algorithm platform through the wireless network for information fusion and decision-making control. The autonomous driving algorithm platform sends the decision-making acceleration, braking, steering and other control signals to the real vehicle actuator. The actual vehicle operation At the same time, the vehicle information collection system collects real-time real vehicle motion status information and feeds it back to the virtual scene to complete the synchronization of vehicle positions in the virtual and real environments, thereby realizing closed-loop real-time simulation testing of the entire digital twin system. By providing a standard sensor data format interface and vehicle status information receiving interface, more general injection test requirements are achieved.

虚拟仿真平台能够在测试任务管理系统中根据测试场景的需要生成传感器的原始信号或目标信号,分别在数据感知与融合模块之前或者决策层算法之前注入给自动驾驶样车。The virtual simulation platform can generate the original signal or target signal of the sensor according to the needs of the test scenario in the test task management system, and inject it into the autonomous driving prototype before the data perception and fusion module or the decision-making layer algorithm.

具体如下:details as follows:

(1)原始信号注入:虚拟仿真平台根据摄像头模型、毫米波雷达模型、激光雷达模型、V2X模型等不同模型生成原始信号,把原始信号中的各类基本测试数据注入给整车控制器。其中摄像头的原始信号为视频流,激光雷达的原始信号为激光点云数据;(1) Original signal injection: The virtual simulation platform generates original signals based on different models such as camera models, millimeter-wave radar models, lidar models, and V2X models, and injects various basic test data in the original signals into the vehicle controller. The original signal of the camera is the video stream, and the original signal of the lidar is the laser point cloud data;

(2)目标信号注入:虚拟仿真平台根据理想化的真值传感模型,把样车一定范围内探测到的以下目标信号通过CAN或其他合适的方式注入给整车控制器;(2) Target signal injection: Based on the idealized true value sensing model, the virtual simulation platform injects the following target signals detected within a certain range of the prototype vehicle into the vehicle controller through CAN or other suitable methods;

(3)机动车,行人,非机动车,交通牌,交通灯和车道线等;(3) Motor vehicles, pedestrians, non-motor vehicles, traffic signs, traffic lights and lane lines, etc.;

(4)上述目标的位置、朝向、包围盒、速度、加速度和角速度等。(4) The position, orientation, bounding box, speed, acceleration and angular velocity of the above-mentioned target.

为验证本发明的有效性,采用经典的十字路口模型为测试场景展开智能车辆测试。本文中测试将基于长安大学自动驾驶测试试验场,以操稳性广场 为实体基础,针对城市交叉路口场景展开进行虚实结合的智能车辆测试,以西安市某地区的双向八车道十字路口为模型,提取了典型的在城市交通流中交叉路口的交通情况,对于交叉路口中的起步、停止、直行、转向场景分别设置测试样例进行测试,同时考虑了行人横穿马路的情况,设置了对应场景进行测试,仿真测试道路场景效果如图7所示。In order to verify the effectiveness of the present invention, a classic intersection model is used to conduct intelligent vehicle testing for the test scenario. The test in this article will be based on the autonomous driving test site of Chang'an University, with the Stability Plaza as the physical basis, and a virtual and real smart vehicle test will be carried out based on urban intersection scenarios. A two-way eight-lane intersection in a certain area of Xi'an City is used as a model. The typical traffic conditions at intersections in urban traffic flow were extracted. Test samples were set up for starting, stopping, going straight, and turning scenarios in the intersection. At the same time, the situation of pedestrians crossing the road was taken into consideration, and corresponding scenarios were set up. Carry out the test and simulate the test road scene effect as shown in Figure 7.

选用的测试项目及测试场景如图6所示,本发明采用预警时刻的最小安全距离与预警时刻的TTC作为是否发出预警的判断条件,采用车辆间最小安全距离模型说明车辆制动过程存在碰撞可能性的应用场景中,应用发出预警的时刻必须保证测试车辆与目标车辆之间有足够的时间或距离用于智能车辆做出反应以及制动至安全车速,以避免碰撞的发生。The selected test items and test scenarios are shown in Figure 6. The present invention uses the minimum safe distance at the warning time and the TTC at the warning time as the judgment conditions for whether to issue a warning, and uses the minimum safe distance model between vehicles to illustrate the possibility of collision during vehicle braking. In specific application scenarios, the time when the application issues an early warning must ensure that there is sufficient time or distance between the test vehicle and the target vehicle for the smart vehicle to react and brake to a safe speed to avoid a collision.

以长安大学交通部认定“自动驾驶封闭场地测试基地”道路及操稳性广场为基础,以西安某地某交叉路口构建平行孪生虚拟场景,分析五个测试项目,以真实智能车辆为测试对象,在接受虚拟交通流场景后,在真实场景中进行测试和决策,实现虚实结合智能汽车测试,能够克服现有虚拟测试与场地测试技术不足等问题,提高测试效率。Based on the road and handling stability square recognized by the Ministry of Transportation of Chang'an University as the "Autonomous Driving Closed Site Test Base", a parallel twin virtual scene was constructed at a certain intersection in Xi'an, and five test items were analyzed. Real smart vehicles were used as test objects. After accepting the virtual traffic flow scenario, testing and decision-making are carried out in the real scenario, and the combination of virtual and real smart vehicle testing can overcome the problems of existing virtual testing and field testing technology deficiencies and improve testing efficiency.

以上仅为本发明的较佳实施例而已,并不用以限制本发明,凡在本发明的精神和原则之内所作的任何修改、等同替换和改进等,均应包含在本发明的保护范围之内。The above are only preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention shall be included in the protection scope of the present invention. Inside.

Claims (9)

一种基于数字孪生云控平台的自动驾驶测试系统,其特征在于,包括:An autonomous driving test system based on a digital twin cloud control platform, which is characterized by including: 自动驾驶仿真软件,根据车辆仿真模型数据和实车测试任务,构建虚拟动态测试场景;Autonomous driving simulation software builds virtual dynamic test scenarios based on vehicle simulation model data and real vehicle test tasks; 数据中台,将实车测试任务和虚拟动态测试场景处理为点云、图像和ADC感知数据;及将实车状态和控制数据转换为车辆仿真模型数据,发送给自动驾驶仿真软件;The data center processes real vehicle test tasks and virtual dynamic test scenarios into point clouds, images and ADC sensing data; and converts real vehicle status and control data into vehicle simulation model data and sends it to the autonomous driving simulation software; 自动驾驶算法平台,其包括:Autonomous driving algorithm platform, which includes: 感知融合算法平台,用于融合点云、图像和ADC感知数据,并生成交通目标位置和类别信息;Perception fusion algorithm platform, used to fuse point cloud, image and ADC perception data, and generate traffic target location and category information; 决策规划算法平台,根据交通目标位置和类别信息,输出交通目标轨迹;The decision-making planning algorithm platform outputs the traffic target trajectory based on the traffic target location and category information; 运动控制算法平台,根据交通目标轨迹,计算车辆控制信号;The motion control algorithm platform calculates vehicle control signals based on the traffic target trajectory; 实车执行器,搭载于测试车辆上,根据车辆控制信号,测试车辆执行加速、制动以及转向动作,生成实车状态和控制数据;The real vehicle actuator is installed on the test vehicle. According to the vehicle control signal, the test vehicle performs acceleration, braking and steering actions, and generates real vehicle status and control data; 以及,as well as, 动态孪生平台,根据虚拟动态测试场景数据和实时车辆仿真模型数据,渲染并展示实时动态孪生效果。The dynamic twin platform renders and displays real-time dynamic twin effects based on virtual dynamic test scene data and real-time vehicle simulation model data. 根据权利要求1所述的基于数字孪生云控平台的自动驾驶测试系统,其特征在于,所述虚拟动态测试场景数据的构建,包括:The automatic driving test system based on the digital twin cloud control platform according to claim 1, characterized in that the construction of the virtual dynamic test scene data includes: 所述自动驾驶仿真软件生成所需开发测试的虚拟动态测试场景,并在仿真软件中建立多种虚拟传感器模型,将虚拟传感器探测到的目标物体信息构成虚拟动态测试场景数据,通过总线注入到自动驾驶算法平台中。The automatic driving simulation software generates virtual dynamic test scenarios required for development and testing, and establishes multiple virtual sensor models in the simulation software. The target object information detected by the virtual sensors constitutes virtual dynamic test scenario data, which is injected into the automatic driving system through the bus. in the driving algorithm platform. 根据权利要求1所述的基于数字孪生云控平台的自动驾驶测试系统,其特征在于,所述实车执行器与数据中台通过局域网进行无线通信数据传输;The automatic driving test system based on the digital twin cloud control platform according to claim 1, characterized in that the real vehicle actuator and the data center perform wireless communication data transmission through a local area network; 所述数据中台利用有线通信方式将测试车辆端获取的实车状态和控制数据转换为车辆仿真模型数据并回传至自动驾驶仿真软件。The data center uses wired communication to convert the actual vehicle status and control data obtained by the test vehicle into vehicle simulation model data and transmits it back to the autonomous driving simulation software. 根据权利要求1所述的基于数字孪生云控平台的自动驾驶测试系统,其特征在于,所述实车测试任务包括实车避撞预警和实车避让行人。The automatic driving test system based on the digital twin cloud control platform according to claim 1, characterized in that the real vehicle test tasks include real vehicle collision avoidance warning and real vehicle avoidance of pedestrians. 根据权利要求1所述的基于数字孪生云控平台的自动驾驶测试系统,其特征在于,所述实车状态和控制数据包括位姿数据和GPS数据。The automatic driving test system based on the digital twin cloud control platform according to claim 1, wherein the actual vehicle status and control data include pose data and GPS data. 一种基于数字孪生云控平台的自动驾驶测试方法,其特征在于,包括以下步骤:An autonomous driving testing method based on a digital twin cloud control platform, which is characterized by including the following steps: 根据实车测试任务,采集并制作OPENDRIVE数据,获得高精度地图,通过仿真软件仿真模拟交通环境,创建测试案例;标定真实地图与虚拟交通环境的映射关系,标定被测车辆与仿真车辆模型的映射关系;According to the real vehicle test task, OPENDRIVE data is collected and produced to obtain high-precision maps, simulate the traffic environment through simulation software, and create test cases; calibrate the mapping relationship between the real map and the virtual traffic environment, and calibrate the mapping between the tested vehicle and the simulated vehicle model. relation; 通过路侧设置的传感器采集地图相关道路场景和交通场景信息,并处理为点云、图像和ADC感知数据;Map-related road scene and traffic scene information is collected through sensors installed on the roadside, and processed into point clouds, images and ADC sensing data; 根据实车测试任务,感知融合处理点云、图像和ADC感知数据,获得感知结果,并生成全域感知结果,并生成交通目标位置和类别信息;According to the actual vehicle test task, perception fusion processes point cloud, image and ADC perception data to obtain perception results, generate full-area perception results, and generate traffic target location and category information; 根据生成的交通目标位置和类别信息规划交通目标轨迹,并通过运动控制算法处理计算,输出车辆控制信号;Plan the traffic target trajectory according to the generated traffic target position and category information, process and calculate it through the motion control algorithm, and output the vehicle control signal; 根据车辆控制信号通过实车执行器控制测试车辆进行测试,获得车辆状态信息;According to the vehicle control signal, the test vehicle is controlled by the real vehicle actuator for testing, and the vehicle status information is obtained; 接收车辆状态信息后,加载内置高精度路网地图及客观环境场景模型,并进行渲染,通过可视化界面实时呈现实时动态孪生效果。After receiving the vehicle status information, the built-in high-precision road network map and objective environmental scene model are loaded and rendered, and the real-time dynamic twin effect is presented in real time through the visual interface. 根据权利要求6所述的基于数字孪生云控平台的自动驾驶测试方法,其特征在于,所述根据车辆控制信号通过实车执行器控制测试车辆进行测试, 包括以下步骤:The automatic driving test method based on the digital twin cloud control platform according to claim 6, characterized in that the testing by controlling the test vehicle through the real vehicle actuator according to the vehicle control signal includes the following steps: 将车辆控制信号发至位于测试场道路的测试车辆,获得车辆状态信息;Send vehicle control signals to the test vehicle on the road at the test site to obtain vehicle status information; 接收车辆状态信息后,加载内置高精度路网地图及客观环境场景模型,并进行渲染,通过可视化界面实时呈现测试场的平行孪生。After receiving the vehicle status information, the built-in high-precision road network map and objective environmental scene model are loaded and rendered, and the parallel twin of the test field is presented in real time through the visual interface. 根据权利要求6所述的基于数字孪生云控平台的自动驾驶测试方法,其特征在于,所述根据车辆控制信号通过实车执行器控制测试车辆进行测试,包括以下步骤:The automatic driving test method based on the digital twin cloud control platform according to claim 6, characterized in that the testing by controlling the test vehicle through the real vehicle actuator according to the vehicle control signal includes the following steps: 所述OPENDRIVE数据为适配操稳性广场相关场景的OPENDRIVE数据,将车辆控制信号发至位于操稳性广场的测试车辆,获得车辆状态信息;The OPENDRIVE data is OPENDRIVE data adapted to scenarios related to the handling and stability square, and the vehicle control signal is sent to the test vehicle located in the handling and stability square to obtain vehicle status information; 接收车辆状态信息后,加载内置高精度路网地图及客观环境场景模型,并进行渲染,通过可视化界面实时呈现真实路口的孪生。After receiving the vehicle status information, the built-in high-precision road network map and objective environmental scene model are loaded and rendered, and the twin of the real intersection is presented in real time through the visual interface. 根据权利要求6所述的基于数字孪生云控平台的自动驾驶测试方法,其特征在于,还包括:The automatic driving testing method based on the digital twin cloud control platform according to claim 6, further comprising: 通过车辆控制信号控制仿真车辆模型运动,获得车辆状态信息;Control the movement of the simulated vehicle model through vehicle control signals and obtain vehicle status information; 仿真车辆模型在每一个时间戳的运动信息作为被测控制器的性能测试的分析依据,案例结束之后对算法进行分析。The motion information of the simulated vehicle model at each timestamp is used as the analysis basis for the performance test of the controller under test. After the case is completed, the algorithm is analyzed.
PCT/CN2022/129299 2022-04-29 2022-11-02 Autonomous driving test system and method based on digital twin cloud control platform Ceased WO2023207016A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210466439.8A CN114879631A (en) 2022-04-29 2022-04-29 An autonomous driving test system and method based on a digital twin cloud control platform
CN202210466439.8 2022-04-29

Publications (1)

Publication Number Publication Date
WO2023207016A1 true WO2023207016A1 (en) 2023-11-02

Family

ID=82673567

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/129299 Ceased WO2023207016A1 (en) 2022-04-29 2022-11-02 Autonomous driving test system and method based on digital twin cloud control platform

Country Status (2)

Country Link
CN (1) CN114879631A (en)
WO (1) WO2023207016A1 (en)

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117238038A (en) * 2023-11-15 2023-12-15 山东海博科技信息系统股份有限公司 Data monitoring system based on digital twin technology
CN117274237A (en) * 2023-11-10 2023-12-22 广东元耀仪器设备有限公司 Aging experiment simulation method, system and test device based on image rendering
CN117765796A (en) * 2024-02-22 2024-03-26 深圳风向标教育资源股份有限公司 automatic driving teaching system, method and device
CN117828899A (en) * 2024-03-04 2024-04-05 沈阳展播智慧科技有限公司 Road environment sensing method and device combined with three-dimensional vehicle body modeling
CN117871117A (en) * 2024-01-05 2024-04-12 武汉万曦智能科技有限公司 Method and system for testing running state of field vehicle
CN117970832A (en) * 2024-01-31 2024-05-03 哈尔滨工业大学 A hybrid scenario simulation system for heterogeneous multi-unmanned systems
CN118035057A (en) * 2024-02-23 2024-05-14 北京航天拓扑高科技有限责任公司 A method for constructing a capability assessment model for the object under test in digital-real fusion testing
CN118095018A (en) * 2024-04-25 2024-05-28 陕西重型汽车有限公司 Fatigue durability analysis method for heavy-duty car cab considering vibration frequency
CN118212779A (en) * 2024-04-10 2024-06-18 长安大学 A hybrid traffic flow testing method and system based on digital twin virtual and real combination
CN118278663A (en) * 2024-03-28 2024-07-02 理工雷科智途(北京)科技有限公司 Mine unmanned cluster dispatching and safety control simulation method and system
CN118467395A (en) * 2024-07-02 2024-08-09 中国第一汽车股份有限公司 Vehicle function testing method, system, storage medium and vehicle
CN118656594A (en) * 2024-08-06 2024-09-17 北京航空航天大学 Cloud-based safety monitoring system and monitoring method based on single-vehicle-multi-vehicle fusion
CN119201644A (en) * 2024-09-13 2024-12-27 中国标准化研究院 Construction method of intelligent product simulation test scenario based on virtual reality
CN119203853A (en) * 2024-11-26 2024-12-27 神龙电气股份有限公司 Water level sensor gland and diaphragm assembly method combined with simulation
CN119247802A (en) * 2024-09-29 2025-01-03 润芯微科技(江苏)有限公司 A smart car-home digital twin control method and system
CN119268756A (en) * 2024-09-10 2025-01-07 中国航空工业集团公司洛阳电光设备研究所 A ground evaluation device and method for scanning effect of a long-term airborne platform
CN119283900A (en) * 2024-10-15 2025-01-10 东风汽车集团股份有限公司 An intelligent driving system based on digital twins
CN119374874A (en) * 2024-09-26 2025-01-28 安徽江淮汽车集团股份有限公司 Intelligent auxiliary braking system testing device and method
CN119512039A (en) * 2024-11-14 2025-02-25 上海科络达云软件技术有限公司 A vehicle fault diagnosis method and system based on digital twin
CN119691455A (en) * 2025-02-21 2025-03-25 河北工业职业技术大学 A method for constructing a digital twin system of an intelligent driving vehicle
CN119880369A (en) * 2025-03-17 2025-04-25 常州星宇车灯股份有限公司 Digital twinning-based self-closing loop car lamp testing system and testing method
CN119872271A (en) * 2025-03-28 2025-04-25 湖南工程学院 Multi-drive motor cooperative control method and system for new energy special vehicle
CN120334958A (en) * 2025-06-18 2025-07-18 交通运输部公路科学研究所 Intelligent calibration method and system for vehicle-mounted satellite positioning device

Families Citing this family (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113343582A (en) * 2021-06-28 2021-09-03 聚时科技(上海)有限公司 Automatic honing vehicle control method based on reinforcement learning
CN114879631A (en) * 2022-04-29 2022-08-09 长安大学 An autonomous driving test system and method based on a digital twin cloud control platform
CN115061897B (en) * 2022-08-16 2022-12-09 北京京深深向科技有限公司 Data generation method and device for Internet of vehicles, electronic equipment and storage medium
CN115357006B (en) * 2022-08-17 2025-02-18 山东高速信息集团有限公司 Virtual-reality testing methods, equipment and media for intelligent connected vehicles based on digital twins
CN115230672B (en) * 2022-08-30 2023-10-20 重庆长安汽车股份有限公司 Digital twinning-based anti-lock brake test method, device, equipment and storage medium
CN115576296A (en) * 2022-09-20 2023-01-06 三一智矿科技有限公司 Vehicle in-loop test system, method and device and storage medium
CN115782782A (en) * 2022-10-10 2023-03-14 中汽创智科技有限公司 Mirror image digital twinning device and method for intelligent networking automobile dynamic behavior
CN115593433B (en) * 2022-10-13 2025-07-01 河南科技大学 A remote takeover method for an autonomous driving vehicle
CN115933586A (en) * 2022-10-27 2023-04-07 中汽创智科技有限公司 Vehicle testing method and device, electronic equipment and storage medium
CN115659701B (en) * 2022-12-09 2023-03-10 中汽数据(天津)有限公司 Verification method, device and storage medium for vehicle-road cooperative V2X application scene
CN115840404B (en) * 2022-12-21 2023-11-03 浙江大学 A cloud-controlled autonomous driving system based on a dedicated road network for autonomous driving and a digital twin map
CN116081488B (en) * 2022-12-21 2023-07-04 中国矿业大学 A scene-adaptive monorail crane transportation robot unmanned control method
CN116224954A (en) * 2022-12-23 2023-06-06 北京国家新能源汽车技术创新中心有限公司 An intelligent driving-in-the-loop test method, environment and storage medium that integrates real road scenes
CN116232955B (en) * 2022-12-30 2025-03-18 中国汽车工程研究院股份有限公司 Low-latency transmission method and test system based on digital twin vehicle-in-the-loop testing
CN116027766B (en) * 2023-01-13 2025-07-25 北京百度网讯科技有限公司 Test method and device for automatic driving vehicle, electronic equipment, medium and product
CN116203953A (en) * 2023-02-20 2023-06-02 南京航空航天大学 Automatic driving method for reconstructing real scene into virtual scene
CN116434539B (en) * 2023-02-28 2024-03-15 东南大学 Expressway speed early warning method based on digital twinning under extreme rainwater weather
CN116089313A (en) * 2023-03-07 2023-05-09 北京路凯智行科技有限公司 Vehicle cloud interaction function test system, method and storage medium
CN116149970B (en) * 2023-04-06 2023-06-23 苏州简诺科技有限公司 Software performance efficiency testing and verifying method and device based on digital twin technology
CN116306029B (en) * 2023-05-16 2023-10-27 南京航空航天大学 Autonomous driving simulation testing method based on Carla and ROS
CN116499770A (en) * 2023-05-17 2023-07-28 集度科技有限公司 Vehicle detection method, vehicle, electronic device, and storage medium
CN116481836A (en) * 2023-05-17 2023-07-25 阿波罗智联(北京)科技有限公司 Test method, device, equipment, medium and product of vehicle digital twin
CN117077286A (en) * 2023-08-15 2023-11-17 长安大学 Simulation and test method for intelligent network-connected vehicle following model under heterogeneous traffic flow
CN117094182B (en) * 2023-10-19 2024-03-12 中汽研(天津)汽车工程研究院有限公司 V2V traffic scene construction method and V2X virtual-real fusion test system
CN117689827B (en) * 2023-12-01 2024-11-22 公安部道路交通安全研究中心 A road network control method, device and storage medium based on digital twin model
CN117742292A (en) * 2023-12-22 2024-03-22 大陆软件系统开发中心(重庆)有限公司 Test methods and devices for autonomous driving functions of vehicles
CN117872803A (en) * 2024-01-08 2024-04-12 深圳技术大学 A digital twin real-world scenario intelligent network simulation test system
CN117809498B (en) * 2024-01-09 2024-08-20 北京千乘科技有限公司 Virtual-real interaction multidimensional twinning projection road network system
CN118279729B (en) * 2024-05-29 2025-02-18 中汽智联技术有限公司 Method and system for verifying intelligent driving domain controller sensing algorithm based on analog camera
CN118549157B (en) * 2024-06-13 2025-09-05 南京金龙客车制造有限公司 Testing methods, devices and electronic equipment for automotive electrical components
CN119918246A (en) * 2024-12-23 2025-05-02 清华大学 Autonomous driving algorithm verification method based on cloud-controlled multi-vehicle experimental platform
CN119830613A (en) * 2025-03-17 2025-04-15 苏州万集车联网技术有限公司 Scene test method, apparatus, system, computer device, computer readable storage medium and computer program product
CN120336170B (en) * 2025-03-20 2025-09-26 北京市计量检测科学研究院 A vehicle-road collaboration application scenario testing method and system
CN120012441B (en) * 2025-04-16 2025-08-29 长春工程学院 A virtual-real combined vehicle autonomous driving testing method

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011203663A (en) * 2010-03-26 2011-10-13 Mitsubishi Precision Co Ltd Driving simulator with automatic movement control function, and automatic movement control method
CN112015164A (en) * 2020-08-24 2020-12-01 苏州星越智能科技有限公司 Intelligent networking automobile complex test scene implementation system based on digital twin
CN112925291A (en) * 2021-01-22 2021-06-08 大连理工大学 Digital twin automatic driving test method based on camera dark box
CN112924185A (en) * 2021-01-22 2021-06-08 大连理工大学 Human-computer co-driving test method based on digital twin virtual-real interaction technology
CN113642242A (en) * 2021-08-17 2021-11-12 上海电气集团智能交通科技有限公司 Intelligent bus traffic simulation platform based on digital twins
CN113777952A (en) * 2021-08-19 2021-12-10 北京航空航天大学 Automatic driving simulation test method for interactive mapping of real vehicle and virtual vehicle
CN114387844A (en) * 2022-01-17 2022-04-22 北京国家新能源汽车技术创新中心有限公司 A teaching platform based on autonomous driving virtual reality fusion test technology
CN114879631A (en) * 2022-04-29 2022-08-09 长安大学 An autonomous driving test system and method based on a digital twin cloud control platform

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109213126B (en) * 2018-09-17 2020-05-19 安徽江淮汽车集团股份有限公司 Automatic driving automobile test system and method
CN111309599A (en) * 2020-01-21 2020-06-19 同济大学 A vehicle-road coordination system testing method and architecture
CN111859618B (en) * 2020-06-16 2024-03-29 长安大学 Virtual-real combined traffic comprehensive scene simulation test system and method for multi-terminal ring

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011203663A (en) * 2010-03-26 2011-10-13 Mitsubishi Precision Co Ltd Driving simulator with automatic movement control function, and automatic movement control method
CN112015164A (en) * 2020-08-24 2020-12-01 苏州星越智能科技有限公司 Intelligent networking automobile complex test scene implementation system based on digital twin
CN112925291A (en) * 2021-01-22 2021-06-08 大连理工大学 Digital twin automatic driving test method based on camera dark box
CN112924185A (en) * 2021-01-22 2021-06-08 大连理工大学 Human-computer co-driving test method based on digital twin virtual-real interaction technology
CN113642242A (en) * 2021-08-17 2021-11-12 上海电气集团智能交通科技有限公司 Intelligent bus traffic simulation platform based on digital twins
CN113777952A (en) * 2021-08-19 2021-12-10 北京航空航天大学 Automatic driving simulation test method for interactive mapping of real vehicle and virtual vehicle
CN114387844A (en) * 2022-01-17 2022-04-22 北京国家新能源汽车技术创新中心有限公司 A teaching platform based on autonomous driving virtual reality fusion test technology
CN114879631A (en) * 2022-04-29 2022-08-09 长安大学 An autonomous driving test system and method based on a digital twin cloud control platform

Cited By (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117274237A (en) * 2023-11-10 2023-12-22 广东元耀仪器设备有限公司 Aging experiment simulation method, system and test device based on image rendering
CN117238038A (en) * 2023-11-15 2023-12-15 山东海博科技信息系统股份有限公司 Data monitoring system based on digital twin technology
CN117238038B (en) * 2023-11-15 2024-01-26 山东海博科技信息系统股份有限公司 Data monitoring system based on digital twin technology
CN117871117A (en) * 2024-01-05 2024-04-12 武汉万曦智能科技有限公司 Method and system for testing running state of field vehicle
CN117871117B (en) * 2024-01-05 2024-06-07 武汉万曦智能科技有限公司 Method and system for testing running state of field vehicle
CN117970832A (en) * 2024-01-31 2024-05-03 哈尔滨工业大学 A hybrid scenario simulation system for heterogeneous multi-unmanned systems
CN117765796A (en) * 2024-02-22 2024-03-26 深圳风向标教育资源股份有限公司 automatic driving teaching system, method and device
CN117765796B (en) * 2024-02-22 2024-05-10 深圳风向标教育资源股份有限公司 Automatic driving teaching system, method and device
CN118035057A (en) * 2024-02-23 2024-05-14 北京航天拓扑高科技有限责任公司 A method for constructing a capability assessment model for the object under test in digital-real fusion testing
CN117828899A (en) * 2024-03-04 2024-04-05 沈阳展播智慧科技有限公司 Road environment sensing method and device combined with three-dimensional vehicle body modeling
CN117828899B (en) * 2024-03-04 2024-05-07 沈阳展播智慧科技有限公司 Road environment sensing method and device combined with three-dimensional vehicle body modeling
CN118278663A (en) * 2024-03-28 2024-07-02 理工雷科智途(北京)科技有限公司 Mine unmanned cluster dispatching and safety control simulation method and system
CN118212779A (en) * 2024-04-10 2024-06-18 长安大学 A hybrid traffic flow testing method and system based on digital twin virtual and real combination
CN118095018A (en) * 2024-04-25 2024-05-28 陕西重型汽车有限公司 Fatigue durability analysis method for heavy-duty car cab considering vibration frequency
CN118467395A (en) * 2024-07-02 2024-08-09 中国第一汽车股份有限公司 Vehicle function testing method, system, storage medium and vehicle
CN118656594A (en) * 2024-08-06 2024-09-17 北京航空航天大学 Cloud-based safety monitoring system and monitoring method based on single-vehicle-multi-vehicle fusion
CN119268756A (en) * 2024-09-10 2025-01-07 中国航空工业集团公司洛阳电光设备研究所 A ground evaluation device and method for scanning effect of a long-term airborne platform
CN119201644A (en) * 2024-09-13 2024-12-27 中国标准化研究院 Construction method of intelligent product simulation test scenario based on virtual reality
CN119374874A (en) * 2024-09-26 2025-01-28 安徽江淮汽车集团股份有限公司 Intelligent auxiliary braking system testing device and method
CN119247802A (en) * 2024-09-29 2025-01-03 润芯微科技(江苏)有限公司 A smart car-home digital twin control method and system
CN119283900A (en) * 2024-10-15 2025-01-10 东风汽车集团股份有限公司 An intelligent driving system based on digital twins
CN119512039A (en) * 2024-11-14 2025-02-25 上海科络达云软件技术有限公司 A vehicle fault diagnosis method and system based on digital twin
CN119203853A (en) * 2024-11-26 2024-12-27 神龙电气股份有限公司 Water level sensor gland and diaphragm assembly method combined with simulation
CN119691455A (en) * 2025-02-21 2025-03-25 河北工业职业技术大学 A method for constructing a digital twin system of an intelligent driving vehicle
CN119880369A (en) * 2025-03-17 2025-04-25 常州星宇车灯股份有限公司 Digital twinning-based self-closing loop car lamp testing system and testing method
CN119872271A (en) * 2025-03-28 2025-04-25 湖南工程学院 Multi-drive motor cooperative control method and system for new energy special vehicle
CN120334958A (en) * 2025-06-18 2025-07-18 交通运输部公路科学研究所 Intelligent calibration method and system for vehicle-mounted satellite positioning device

Also Published As

Publication number Publication date
CN114879631A (en) 2022-08-09

Similar Documents

Publication Publication Date Title
WO2023207016A1 (en) Autonomous driving test system and method based on digital twin cloud control platform
Chen et al. A novel integrated simulation and testing platform for self-driving cars with hardware in the loop
CN111859618B (en) Virtual-real combined traffic comprehensive scene simulation test system and method for multi-terminal ring
CN110456757B (en) Whole vehicle testing method and system for unmanned vehicle
CN113032285A (en) High-precision map testing method and device, electronic equipment and storage medium
CN110779730A (en) L3-level automatic driving system testing method based on virtual driving scene vehicle on-ring
CN108681264A (en) A kind of intelligent vehicle digitalized artificial test device
Galko et al. Vehicle-Hardware-In-The-Loop system for ADAS prototyping and validation
Wang et al. Simulation and application of cooperative driving sense systems using prescan software
CN111223354A (en) Unmanned trolley, and AR and AI technology-based unmanned trolley practical training platform and method
CN113419518A (en) VIL test platform based on VTS
WO2023028858A1 (en) Test method and system
CN111240224A (en) Multifunctional simulation system for vehicle automatic driving technology
Shoukat et al. Autonomous driving test system under hybrid reality: The role of digital twin technology
CN114387844A (en) A teaching platform based on autonomous driving virtual reality fusion test technology
Bai et al. Cyber mobility mirror for enabling cooperative driving automation in mixed traffic: A co-simulation platform
Guvenc et al. Simulation Environment for Safety Assessment of CEAV Deployment in Linden
Zhou et al. Garchingsim: An autonomous driving simulator with photorealistic scenes and minimalist workflow
Yang et al. CAVTest: A closed connected and automated vehicles test field of Chang’an University in China
Zhao et al. Corroborative evaluation of the real-world energy saving potentials of inforich eco-autonomous driving (iread) system
US11847869B1 (en) Multimodal perception simulation
Weiguo et al. An augmented reality-based proving ground vehicle-in-the-loop test platform
US20220289217A1 (en) Vehicle-in-virtual-environment (vve) methods and systems for autonomous driving system
Rossi et al. Vehicle hardware-in-the-loop system for ADAS virtual testing
CN114925457A (en) Early warning function test method and device applied to Internet of vehicles

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22939833

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22939833

Country of ref document: EP

Kind code of ref document: A1

点击 这是indexloc提供的php浏览器服务,不要输入任何密码和下载