CN107038745B - A 3D tourist landscape roaming interaction method and device - Google Patents

Abstract

The present invention provides a 3D tourist landscape roaming interaction method and device. The method includes: S1, constructing an entity model of a tourist landscape through 3dmax; S2, performing draw call optimization and viewing angle optimization on the entity model based on Unity3D; and performing post-processing to obtain a tourist landscape roaming system; and S3, based on The tourist landscape roaming system is combined with the HTC Vive device for game interaction. The invention optimizes various entity models based on the functions in Unity3D, reduces the redundancy of the models, and improves the drawing speed of the models; Integration can optimize the tourism service model and drive the development of landscape tourism services that combine tourism and virtual reality.

Description

A 3D tourist landscape roaming interaction method and device

technical field

The invention relates to the technical field of virtual simulation, and more particularly, to a 3D tourist landscape roaming interaction method and device.

Background technique

At present, with the improvement of people's living standards, landscape tourism has gradually developed from a single shallow sightseeing tour to an in-depth experiential tourism. The traditional way of publicity and promotion of landscape tourism and entertainment experience is mainly displayed in a shallow two-dimensional way. Its visualization effect is poor, and it lacks a certain degree of interactivity. It can no longer meet the needs of virtual exhibitions.

The so-called virtual interactive tourism is to use computers to model the tourist landscape and build a realistic three-dimensional virtual environment to realize the interaction between people and the virtual scene. In addition, through the integration of offline tourism and online in-depth experiential tourism, optimize the tourism service mode, drive the development of landscape tourism services that combine tourism and virtual reality, change the blind tourism in tourism, and better convey the meaning behind the attractions. cultural connotation.

The existing application system has certain defects in the display of the scene, including the single display method, which can only be realized by the mouse, keyboard, touch screen, etc., and lacks immersion and interactivity.

SUMMARY OF THE INVENTION

The present invention provides a 3D tourist landscape roaming interaction method and device that overcome the above problems or at least partially solve the above problems.

According to an aspect of the present invention, a 3D tourist landscape roaming interaction method is provided, comprising:

S1, build a solid model of the tourist landscape through 3dmax;

S2, based on Unity3D, perform draw call optimization and optimization of the number of faces in the perspective of the entity model; and perform post-processing to obtain a tourist landscape roaming system; and

S3, based on the tourist landscape roaming system, combined with the HTC Vive device to perform game interaction .

According to another aspect of the present invention, a 3D tourist landscape roaming interaction device is also provided, including:

The solid model module is used to construct the solid model of the tourist landscape through 3dmax;

The model optimization module is used to optimize the draw call and the number of inner faces of the perspective for the entity model based on Unity3D; and perform post-processing to obtain a tourist landscape roaming system; and

The game interaction module is used to perform game interaction in combination with the HTC Vive device based on the tourist landscape roaming system.

The invention proposes a 3D tourist landscape roaming interaction method and device, which optimizes various entity models based on the functions in Unity3D, reduces the redundancy of the models, and thus improves the drawing speed of the models; The form of three-dimensional picture combined with interactive equipment brings shocking visual, auditory and tactile experience, integrating immersion, interactivity and imagination; as a combination of tourism landscape and virtual reality, through offline tourism and online in-depth experience The integration of traditional tourism can optimize the tourism service mode and drive the development of landscape tourism services combining tourism and virtual reality.

Description of drawings

FIG. 1 is a schematic diagram of a 3D tourism landscape roaming interaction method according to an embodiment of the present invention.

Detailed ways

The specific embodiments of the present invention will be described in further detail below with reference to the accompanying drawings and embodiments. The following examples are intended to illustrate the present invention, but not to limit the scope of the present invention.

As shown in Figure 1, a 3D tourism landscape roaming interaction method includes:

S1, build a solid model of the tourist landscape through 3dmax;

S2, based on Unity3D, perform draw call optimization and optimization of the number of faces in the perspective of the entity model; and perform post-processing to obtain a tourist landscape roaming system; and

S3, based on the tourist landscape roaming system, combined with the HTC Vive device to perform game interaction.

In this embodiment, the three-dimensional modeling software 3dmax is used to create a three-dimensional model for modeling and mapping according to the specific characteristics of the scene in the tourist landscape, so as to obtain various entity models. Then, based on the functions in Unity3D, various entity models are optimized to reduce the redundancy of the model, thereby improving the drawing speed of the model; and post-synthesis is performed to finally generate a tourist landscape roaming system, which is combined with HTC Vive devices for game interaction.

The present invention utilizes the three-dimensional visualized tourist landscape scene, combines interactive equipment in the form of three-dimensional pictures to bring people shocking visual, auditory and tactile experiences, and integrates immersion, interactivity and imagination into it; Combined, through the integration of offline tourism and online in-depth experiential tourism, the tourism service mode can be optimized, and the development of landscape tourism services combining tourism and virtual reality can be promoted.

Specifically, the entity model described in S1 includes: a building model, an indoor object model, a scene model and an animation model.

In one embodiment, the draw call optimization described in S2 includes:

Splicing a plurality of different model textures together, and performing the same shader rendering; changing the UV shape of the entity model to perform the docking between the entity model and the model texture, and merge them into a whole;

For the entity model of the similar scene in the tourist landscape, share the UV material by copying the shape of the model;

Use the baked map to merge the shadow part with the original map.

In this embodiment, by optimizing the model textures, the texture textures of models of different shapes are the same, and the draw call is batched, thereby improving the processing efficiency of the draw call. In a landscape scene, there are bound to be many similar parts; the model shape is optimized for the entity models of the similar scenes in the tourist landscape, and the similar parts can directly share the UV material through the method of copying, and then share the draw call, saving resources and improve processing efficiency. The real-time calculation of shadows will also consume a lot of draw calls; if the shapes of shadows mapped on different solid model surfaces are different, a draw call needs to be called again for settlement; Part of the image is merged with the original texture, which can save the draw call consumed by solving the shadow.

This embodiment greatly simplifies draw call processing, saves draw call resources, improves draw call processing efficiency, and improves user experience by optimizing three aspects of model texture, model shape, and baked texture.

In one embodiment, the optimization of the number of faces within the viewing angle in S2 includes:

Based on Unity3d's Frustum Culling, the objects in the conical area of the main viewing angle are rendered;

Based on Unity3d's Occlusion Culling, the objects that can be seen intuitively in the scene are rendered.

In this embodiment, Occlusion Culling and Frustum Culling that come with Unity3d are used for processing inside and outside the viewing angle, respectively.

When Frustum Culling is done for out-of-view, only objects within the cone of the main view are rendered. Objects outside the cone of the main camera are not rendered. It effectively saves resources and prompts the fluency of the game.

When Occlusion Culling is performed on the viewing angle, only the objects that can be seen intuitively in the scene are rendered, and the occluded objects are not rendered, but the specific parameters need to be set later.

In another embodiment, there is a simple and easy way to optimize the number of faces in the field of view, that is, to adjust the viewing distance of the camera. This method can be selected when the camera does not need to pay attention to many scene elements at the same time, that is, appropriately reducing the camera's viewing distance and enabling the fog effect can also reduce the rendering burden of the scene.

In one embodiment, before the step S2, the method further includes: after performing depth map projection on the entity model, calculating a contour map by using a Gaussian difference algorithm;

The contour plots were fitted using polygonal approximation and Bezier curves.

In this embodiment, the entity model is compressed into a contour map, which can save storage space and solve the problem that the storage space is too large due to the large three-dimensional model.

In one embodiment, the post-processing in S2 includes:

Export the file corresponding to the entity model created by 3dmax as a .fbx format file through Unity3D;

Import the .fbx format file into the Unity3D game engine, generate the tourist landscape roaming system, and export the exe file for release;

Carry out the environment configuration of the hardware of the HTC Vive device and the Unity3D game engine;

The physical collision effect is set in the Unity3D game engine.

This embodiment includes three parts: scene construction, environment configuration with the HTC Vive device, and setting of physical collision effects.

When the scene is built, Unity3D receives the entity file created in 3DSmax. It needs to export the file in 3DSmax in the form of .fbx file, and then import the .fbx format file into the Unity3d game engine to complete the development of the tourist landscape roaming system. The tourist landscape was exported as an EXE file from Unity3d and finally released.

When configuring the environment with the HTC Vive device, the Unity3D game engine is used to set the environment parameters, so that the HTC Vive device and the tourist landscape roaming system exported by the Unity3D game engine are integrated and interacted.

In the setting of the physical collision effect, when the character roams in the virtual scene, it involves collision detection with terrain and collision detection with objects.

Unity3d has a built-in physics engine that can implement a variety of collision detection processing. Specifically, the physical collision effects include: box colliders, spherical colliders, capsule colliders, and mesh colliders.

Preferably, the obstacles in this embodiment mainly use box-type colliders and grid colliders.

In one embodiment, the S3 further includes:

According to the infrared tracking system of the HTC Vive device, in conjunction with the helmet display of the HTC Vive device and several positioning tracking devices on the handle, as well as the positioning camera on the helmet display, the target in the tourist landscape roaming system can be positioned, tracked and tracked. motion capture.

In one embodiment, the step S2 further includes: rendering a closer object in the scene, and displaying only a contour map for a far object in the scene; when the far object gradually approaches, The contour lines of distant objects are textured.

This embodiment can simplify data processing and reduce the amount of data without reducing the roaming effect of the 3D game landscape.

In one embodiment, a series of different thresholds can also be selected to compress the images in the game scene, so as to obtain a series of images of different quality, and then the images of different levels can be called in the virtual reality scene according to the distance between the viewpoint and the scene. document. This method has a certain value for reducing the system load and improving the real-time display speed of images.

Fractal processing and wavelet transform have inherent multi-scale properties and scale invariance. They can describe the roughness features in texture images, and can extract different resolutions for texture maps used on the surface of scene objects to obtain different resolutions. rate images.

After the HTC Vive device described in this embodiment is integrated with the tourist landscape roaming system, positioning tracking and motion capture of the target can be achieved within milliseconds, bringing real-time picture feedback and motion recognition. Preferably, several positioning and tracking devices on the handle are more than 10 positioning and tracking devices.

The present invention also provides a 3D tourist landscape roaming interaction device, comprising:

The solid model module is used to construct the solid model of the tourist landscape through 3dmax;

The model optimization module is used to optimize the draw call and the number of inner faces of the perspective for the entity model based on Unity3D; and perform post-processing to obtain a tourist landscape roaming system; and

The game interaction module is used to perform game interaction in combination with the HTC Vive device based on the tourist landscape roaming system.

In one embodiment, the model optimization module further includes:

The draw call optimization unit is used for the entity model to perform model texture optimization, model shape optimization and baking texture;

A viewing angle optimization unit, which is used to render objects in the cone area of the main viewing angle based on Unity3d's Frustum Culling, and render visually visible objects in the scene based on Unity3d's Occlusion Culling; and

The post-processing unit is used for the scene construction of the tourist landscape roaming system, the environment configuration with the HTC Vive device, and the setting of the physical collision effect.

In this embodiment, the model texture optimization includes: splicing together a plurality of different model textures to perform the same shader rendering; changing the UV shape of the entity model to connect the entity model and the model textures , and merged into a whole.

In this embodiment, the optimization of the model shape includes: for the entity model of the similar scene in the tourist landscape, sharing the UV material by duplicating the model shape.

In this embodiment, the baked map includes: using the baked map to perform image merging processing on the shadow part and the original map.

In this embodiment, the scene construction includes: Unity3D receives the entity file created in 3DSmax, needs to export the file in 3DSmax in the form of .fbx file, and then import the .fbx format file into the Unity3d game engine to complete the tourist landscape roaming system. Develop, export the generated virtual tourist landscape from Unity3d to an EXE file, and finally publish it.

In this embodiment, the physical collision effects include: box-type colliders, spherical colliders, capsule colliders, and mesh colliders. Preferably, the obstacles in this embodiment mainly use box-type colliders and grid colliders.

In one embodiment, the HTC Vive device includes:

A helmet, a helmet display, a handle, an infrared tracking system, several positioning tracking devices arranged on the handle, and a positioning camera arranged on the helmet display.

In this embodiment, according to the infrared tracking system of the HTC Vive device, in conjunction with the helmet display of the HTC Vive device and several positioning tracking devices on the handle, as well as the positioning camera on the helmet display, the tracking devices in the tourist landscape roaming system are monitored. Target positioning tracking and motion capture, which can achieve target positioning tracking and motion capture within milliseconds, bringing real-time picture feedback and motion recognition.

Preferably, several positioning and tracking devices on the handle are more than 10 positioning and tracking devices.

The present invention provides a 3D tourism landscape roaming interaction method and device based on virtual simulation technology. The model optimization method in Unity3D, the three-dimensional display, and the HTC Vive interactive positioning technology can simulate the damaged tourism landscape more realistically; The integration of offline tourism and online in-depth experiential tourism, optimize the tourism service model, and drive the development of new tourism services that combine tourism and virtual reality. Users can experience the historical changes before the scenic spot is damaged through interactive experience, drive the development of offline tourism, change the phenomenon of blind tourism in tourism, and better convey the cultural connotation behind the scenic spot.

Finally, the method of the present invention is only a preferred embodiment, and is not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included within the protection scope of the present invention.

Claims (9)

1. A3D tourist landscape roaming interaction method is characterized by comprising the following steps:

s1, constructing an entity model of the tourist landscape through 3 dmax;

s2, performing draw call optimization and view-angle inner face number optimization on the solid model based on Unity 3D; performing post-processing to obtain a tourist landscape roaming system; and

s3, based on the tourist landscape roaming system, game interaction is carried out by combining HTC Vive equipment, wherein the drawcall optimization in S2 comprises the following steps:

splicing a plurality of different model maps together, and performing the same shader rendering; changing the UV shape of the solid model to carry out butt joint between the solid model and the model map, and combining the solid model and the model map into a whole;

sharing UV materials of the entity models of the similar scenes in the tourist landscape through copying the model shapes;

using the baking map, the shadow part and the original map are subjected to image merging processing.

2. The method of claim 1, wherein the face-in-view optimization in S2 comprises:

rendering objects within the cone region of the main perspective based on the Frustum Culling of Unity3 d;

occlusion Culling based on Unity3d renders objects in a scene that can be viewed directly.

3. The method of claim 1, wherein S2 is preceded by: after the depth map projection is carried out on the solid model, a contour line graph is calculated by utilizing a Gaussian difference algorithm;

and fitting the contour line graph by utilizing polygonal approximation and Bezier curve.

4. The method of claim 1, wherein the post-processing in S2 comprises:

exporting a file corresponding to the entity model created by 3dmax into a.fbx format file through Unity 3D;

importing the fbx format file into a Unity3D game engine to generate the tourist landscape roaming system, and exporting an exe file for publishing;

performing environment configuration of hardware of an HTC Vive device and the Unity3D game engine;

the setting of the physical crash effect is performed in the Unity3D game engine.

5. The method of claim 1, wherein the S3 further comprises:

according to an infrared tracking system of HTC Vive equipment, a helmet display of the HTC Vive equipment is matched with a plurality of positioning tracking devices on a handle, and a positioning camera on the helmet display is used for positioning tracking and motion capture of a target in the tourist landscape roaming system.

6. The method of claim 1, wherein the S2 further comprises: rendering objects closer to the scene, and only displaying a contour line graph on objects farther away from the scene;

texture filling the contour line plot of the farther object as the farther object approaches gradually.

7. The method of claim 4, wherein the physical impact effect comprises: a box-type collision body, a ball-type collision body, a capsule collision body and a mesh collision body.

8. The utility model provides a 3D tourist attraction roaming interaction device which characterized in that includes:

the entity model module is used for constructing an entity model of the tourist landscape through 3 dmax;

the model optimization module is used for carrying out draw call optimization and view-angle inner face number optimization on the entity model based on Unity 3D; performing post-processing to obtain a tourist landscape roaming system; and

the game interaction module is used for carrying out game interaction by combining HTC Vive equipment based on the tourist landscape roaming system;

wherein the draw call optimization comprises:

splicing a plurality of different model maps together, and performing the same shader rendering; changing the UV shape of the solid model to carry out butt joint between the solid model and the model map, and combining the solid model and the model map into a whole;

sharing UV materials of the entity models of the similar scenes in the tourist landscape through copying the model shapes;

using the baking map, the shadow part and the original map are subjected to image merging processing.

9. The apparatus of claim 8, wherein the HTC Vive device comprises:

helmet, helmet display, handle, infrared tracking system, set up in a plurality of localization tracking device on the handle and set up in location camera on the helmet display.

Images