+

CN114004946B - A real-time processing method and device for dynamically loading SAR images under GIS - Google Patents

A real-time processing method and device for dynamically loading SAR images under GIS Download PDF

Info

Publication number
CN114004946B
CN114004946B CN202111328279.2A CN202111328279A CN114004946B CN 114004946 B CN114004946 B CN 114004946B CN 202111328279 A CN202111328279 A CN 202111328279A CN 114004946 B CN114004946 B CN 114004946B
Authority
CN
China
Prior art keywords
image
range
sar
point
target point
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111328279.2A
Other languages
Chinese (zh)
Other versions
CN114004946A (en
Inventor
邹汉松
丰宁宁
王岩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu Juntian Electronic Technology Co ltd
Original Assignee
Jiangsu Juntian Electronic Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu Juntian Electronic Technology Co ltd filed Critical Jiangsu Juntian Electronic Technology Co ltd
Priority to CN202111328279.2A priority Critical patent/CN114004946B/en
Publication of CN114004946A publication Critical patent/CN114004946A/en
Application granted granted Critical
Publication of CN114004946B publication Critical patent/CN114004946B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/05Geographic models
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00General purpose image data processing
    • G06T1/20Processor architectures; Processor configuration, e.g. pipelining
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10032Satellite or aerial image; Remote sensing
    • G06T2207/10044Radar image
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20021Dividing image into blocks, subimages or windows

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Remote Sensing (AREA)
  • Computer Graphics (AREA)
  • Processing Or Creating Images (AREA)

Abstract

本发明提供一种在GIS下动态加载SAR图像的实时处理方法及装置,其中方法基于PC端和服务器,包括以下步骤:步骤一:PC端加载SAR图像并显示地图,服务器获取SAR图像文件,PC端对SAR图像当前可见的范围进行计算,并根据计算结果发送切图请求给服务器;步骤二:服务器接收切图请求,并根据坐标范围及像素大小进行切图。本发明的图像计算处理方式,根据实际需要显示的内容进行切图,大大减少了加载图像的内存大小,并且采用了分布式方式,将SAR图像处理模块安装到CPU性能较好的服务器上,提高了图像并行处理的能力,实现了在地理信息系统上对超大SAR图像实时加载、显示、处理的能力,解决了对超大SAR图像加载、显示、处理的难题。

The present invention provides a real-time processing method and device for dynamically loading SAR images under GIS, wherein the method is based on a PC and a server, and includes the following steps: Step 1: the PC loads the SAR image and displays the map, the server obtains the SAR image file, the PC calculates the current visible range of the SAR image, and sends a cut-image request to the server according to the calculation result; Step 2: the server receives the cut-image request, and cuts the image according to the coordinate range and pixel size. The image calculation processing method of the present invention cuts the image according to the content that actually needs to be displayed, greatly reducing the memory size of the loaded image, and adopts a distributed method to install the SAR image processing module on a server with good CPU performance, thereby improving the ability of image parallel processing, realizing the ability to load, display, and process ultra-large SAR images in real time on the geographic information system, and solving the problem of loading, displaying, and processing ultra-large SAR images.

Description

Real-time processing method and device for dynamically loading SAR image under GIS
Technical Field
The invention relates to the technical field of radars, in particular to a real-time processing method and device for dynamically loading SAR images under GIS.
Background
Synthetic Aperture Radar (SAR) is not affected by climatic conditions in the process of ground observation, and can penetrate through vegetation canopy, the obtained image has clear outline, and the structural information is stored completely, so that the SAR has an extremely important position in the modern remote sensing field. At present, most of data of a Geographic Information System (GIS) come from early field survey and optical image-based production, the former has long updating period and high cost, and the latter can not describe an imaging area completely due to the influence of weather conditions or shielding of mountain shadows. Therefore, updating the GIS by taking the SAR image as a data source has become the primary choice for solving the problems of long updating period, poor completeness and the like of the GIS database at present.
The geographic information system (Geographic Information System, GIS) is one particular spatial information system. Which is a computer system having means for centralizing, storing, operating, and displaying geographical reference information. The method has powerful functions in aspects of data editing, data conversion, data query, space analysis and the like, and has the advantages of clear classification of ground features, accurate geographic position, convenience in geographic research and geographic decision and the like.
Based on the characteristics of the GIS, the SAR image is guided to carry out information extraction by taking GIS information as priori knowledge. The method has the advantages that (1) the acquired real-time SAR image is analyzed by utilizing GIS information, the defects of SAR image imaging blurring caused by speckle noise, low resolution caused by radar performance and the like can be reduced, and (2) the SAR image is extracted by utilizing GIS information as priori knowledge, so that the fuzzy or hidden targets in the SAR image can be extracted, the limit of manual interpretation is broken through, and the method has important significance in the aspects of military target identification and accurate striking.
SAR images or data are fused with GIS geographic information, so that on one hand, guidance of the GIS on the SAR images can be realized, and on the other hand, change detection of landform can be realized by updating a GIS information base by using the SAR data.
In some occasions needing to correct and mark SAR images, the SAR images need to be loaded on a geographic information system in real time, and then the operations such as correcting and marking the images are performed. When images are generally superimposed on a geographic information system, loading efficiency can be ensured when the image size is within a range of tens of M, but in many cases, the size of the SAR image can reach more than 1G, and at this time, the entire image superimposition mode is basically impossible. If the SAR image is pyramid-constructed and then loaded as a map into the geographic information system, the entire map needs to be reloaded, and the SAR image cannot be moved. Therefore, the present invention is needed to design a real-time display processing system for dynamically loading a plurality of oversized SAR images under a geographic information system to solve the above-mentioned problems.
Disclosure of Invention
The invention aims to provide a real-time processing method for dynamically loading SAR images under GIS to solve the problems in the background technology.
In order to achieve the purpose, the invention provides a real-time processing method for dynamically loading SAR images under GIS, which is based on a PC end and a server and comprises the following steps:
The method comprises the steps that firstly, a PC end loads SAR images and displays a map, a server obtains SAR image files, the PC end calculates the current visible range of the SAR images, and a map cutting request is sent to the server according to a calculation result;
the server receives the image cutting request, cuts images according to the coordinate range and the pixel size, and then sends image cutting information to the PC end;
and thirdly, the PC end receives the image cutting information and then adds the image cutting information to a map for display.
Further, in the present invention, the PC and the server exchange data via ethernet.
Further, in the present invention, when calculating the current visible range of the SAR image in the first step, different modes are adopted for the difference of the two-dimensional and three-dimensional display modes;
In a two-dimensional mode, acquiring a rectangular range coordinate of the current screen display, and then performing high-precision geometric intersection with the rectangular range coordinate of the SAR image to finally obtain an accurate intersection range value;
in the three-dimensional mode, the SAR image is cut into small square areas through an iterative optimization algorithm, whether the small square areas are in the view angle range or not is calculated, and after a plurality of iterations, the small square areas remained in the display range are calculated to be the maximum display rectangular range, and the rectangular range is the approximate actual display area range.
Further, in the present invention, the specific steps in the two-dimensional mode are as follows:
S1, uniformly converting screen coordinates of a display area and longitude and latitude coordinates of an SAR image into world coordinates, and obtaining two polygons;
S2, carrying out high-precision geometric intersection on the two polygons, if the two polygons are intersected, returning a result to contain all intersected points, traversing the intersected points at the moment, converting world coordinates into longitude and latitude coordinates, finding out the maximum and minimum values in the longitude and latitude directions, and forming a rectangular coordinate range, wherein the range is an intersected area, and thus the calculation result is obtained.
Further, in the first step, when a graph cutting request is sent to the server according to the calculation result, the pixel width and height values of the intersection region image are calculated and sent to the server together, and the method includes the following steps:
And calculating the range under the world coordinates represented by 1 pixel in the longitude and latitude directions according to the current map display zoom level, converting the longitude and latitude range of the image into world coordinates, converting according to the world coordinate size represented by each pixel, and finally calculating the pixel width and height values of the image of the intersection region.
Further, in the present invention, in the three-dimensional display mode, the map is displayed in a spherical shape, whether the position of the target point is in front of or behind the viewing plane, and whether the angle between the target point and the viewpoint is within the range of the angle between the viewpoint and the earth are determined, whether the target point is within the visual range is determined, the viewing plane is a plane formed by connecting all points from the viewpoint position and the earth tangential position, and the method for calculating whether the target point is in front of the horizon viewing plane comprises the following specific steps:
definition V is the viewpoint, T is the target point, C is the sphere center, H is the horizon point of the tangential position of the viewpoint and the earth, H 'is the projection point of VH on VC, T' is the projection point of VT on VC, HC is the earth radius, we will As a unit vector, according to the pythagorean theorem:
triangles Δvch and Δhch' are similar triangles that share one corner at point C and all have a right angle, so:
thus, the distance from the viewpoint to the plane is:
If it is At the position ofThe projection onto the lens is smaller than or equal toThen the target point is immediately in front of the plane,
Both sides are multiplied by
I.e. using the dot product of the vector from the viewpoint to the target point and the vector from the viewpoint to the center of the ellipsoid, if this value is less than or equal to the square of the modulus of the vector from the observer to the center of the ellipsoid minus one, the target point is in front of the view plane.
Further, in the present invention, if the target point is behind the view plane, it needs to be determined whether the target point is in the view cone, the view cone is an infinite cone formed by connecting the view point with all the horizon points, if the target point is in the view cone, it is blocked, if the target point is out of the view cone, it is not blocked, and the method for calculating whether the target point is in the view cone range is as follows:
Defining an angle HVC as alpha, and an angle TVC as beta, if the point T is in the cone, then:
β<α;
namely:
cos(β)>cos(α);
the angle α is part of a right triangle Δvch, the right side of the inequality is rewritten by a trigonometric function:
According to the definition of dot product, there are:
according to the previous formula The square is performed on both sides of the formula,
Finally, the following formula is obtained:
If this inequality holds, the target point is inside the view cone. If it is also behind the view plane, the target point is occluded.
Further, in the present invention, in order to reduce the number of iterations, the target point is replaced by a target sphere, and whether the target sphere is within the display range is calculated;
the method for calculating whether the target point is within the view cone range is as follows:
Defining T as the center point of the target ball, the radius of the ball as R t,T2 as the tangent point from the viewpoint to the target ball, T 1 as the point from the viewpoint to the center point of the target ball and the intersection of the edge of the target ball, and the angle CVT 2 as beta 1. First, the vector from the viewpoint to T 1、T2 is calculated:
At this time, the mode of calculating whether the target ball is in front of the viewing plane is that as long as the point T 1 is in front of the viewing plane, the target ball is considered to be in front of the viewing plane, and the judgment formula is as follows:
At this time, whether the target point is in the view cone range is calculated, and the judgment formula is as follows:
Then an iterative optimization algorithm is adopted to divide the image into a plurality of square blocks, and then whether the square blocks are in a visual range or not is calculated iteratively, specifically, the center point of the square is taken as the center of a circle, and the side length of the square is calculated iteratively As a radius, after a plurality of iterations, the regions not in the visual range are removed, and the positions of the remaining regions are calculated as a maximum rectangular range.
When the image is divided for the first time, the short side of the image is used forDividing an image into a plurality of square line areas as the side length of the square divided for the first time, expanding and complementing the area where the long side of the image is not divided enough, and finally removing small square areas which are not in the range of the SAR image area;
Then centering on the square central point and the side length And after the radius is used for detecting whether the circle is in the visual range or not, filtering squares which are not in the visual range after the first round of detection, then cutting the rest squares, visually detecting the cut areas, after a plurality of iterations, considering that the accuracy required by calculation is achieved when the edge length pixel distance of the cut squares is preset, exiting the iteration, counting the current rest small square areas and combining the current rest small square areas into a rectangular range, wherein the rectangular range is the finally required SAR image display range.
The real-time processing device for dynamically loading SAR images under the GIS comprises a geographic information display module and an SAR image processing module, wherein the geographic information display module and the SAR image processing module adopt a distributed deployment mode, the SAR image processing module operates on a server with a multi-core CPU and can process a plurality of oversized SAR images at the same time, and the geographic information display module operates on a computer and is used for displaying a map and the SAR images;
the geographic information display module loads SAR images and displays maps, calculates the current visible range of the SAR images, sends a map cutting request to the SAR image processing module according to calculation results, and adds the map cutting information to the maps for display after receiving the map cutting information;
the SAR image processing module acquires an SAR image file, receives a graph cutting request, cuts a graph according to a coordinate range and a pixel size, and then sends graph cutting information to the geographic information display module.
Furthermore, in the invention, the geographical information display module needs to perform a translation operation on the SAR image, and during the operation, a mouse event is monitored, and the translation operation is performed by adopting a mode of pressing and dragging a left button of a mouse.
The beneficial effects are that the technical scheme of the application has the following technical effects:
According to the image computing processing mode, the image is cut according to the content displayed according to actual needs, the memory size of the loaded image is greatly reduced, the SAR image processing module is installed on a server with good CPU performance in a distributed mode, the image parallel processing capability is improved, the capability of loading, displaying and processing the oversized SAR image on a geographic information system in real time is realized, and the problems of loading, displaying and processing the oversized SAR image are solved.
It should be understood that all combinations of the foregoing concepts, as well as additional concepts described in more detail below, may be considered a part of the inventive subject matter of the present disclosure as long as such concepts are not mutually inconsistent.
The foregoing and other aspects, embodiments, and features of the present teachings will be more fully understood from the following description, taken together with the accompanying drawings. Other additional aspects of the invention, such as features and/or advantages of the exemplary embodiments, will be apparent from the description which follows, or may be learned by practice of the embodiments according to the teachings of the invention.
Drawings
The drawings are not intended to be drawn to scale. In the drawings, each identical or nearly identical component that is illustrated in various figures may be represented by a like numeral. For purposes of clarity, not every component may be labeled in every drawing. Embodiments of various aspects of the invention will now be described, by way of example, with reference to the accompanying drawings, in which:
FIG. 1 is a system overall frame diagram of the method of the present invention;
FIG. 2 is a topology of the present invention;
FIG. 3 is a diagram of a system network architecture of the present invention;
FIG. 4 is a diagram showing SAR image display modes in a two-dimensional mode according to the present invention;
FIG. 5 is a view of the position of a target point relative to a plane of view in a three-dimensional mode according to the present invention;
FIG. 6 is a view of the position of a target point relative to a cone in a three-dimensional mode according to the present invention;
FIG. 7 is a view of the target ball relative to the viewing plane and viewing cone in a three-dimensional mode of the present invention;
FIG. 8 is a schematic diagram of an image iterative optimization algorithm of the present invention;
FIG. 9 is a schematic view of image movement according to the present invention;
FIG. 10 is a diagram showing the code generation in the present embodiment;
FIG. 11 is a diagram of the code in the present embodiment;
FIG. 12 is a diagram of the code in the present embodiment;
FIG. 13 is a diagram of an embodiment of an epoch code.
Detailed Description
For a better understanding of the technical content of the present invention, specific examples are set forth below, along with the accompanying drawings. Aspects of the invention are described in this disclosure with reference to the drawings, in which are shown a number of illustrative embodiments. The embodiments of the present disclosure need not be defined to include all aspects of the present invention. It should be understood that the various concepts and embodiments described above, as well as those described in more detail below, may be implemented in any of a number of ways, as the disclosed concepts and embodiments are not limited to any implementation. Additionally, some aspects of the disclosure may be used alone or in any suitable combination with other aspects of the disclosure.
At present, when images are generally superimposed on a geographic information system, loading efficiency can be ensured when the image size is within a range of tens of M, but in many cases, the size of the SAR image can reach more than 1G, and at this time, the entire image superimposition mode is basically impossible. If the SAR image is pyramid-constructed and then loaded as a map into the geographic information system, the entire map needs to be reloaded, and the SAR image cannot be moved. Therefore, the present invention is needed to design a real-time display processing system for dynamically loading a plurality of oversized SAR images under a geographic information system to solve the above-mentioned problems.
Based on the above problems, the embodiment improves the following technical scheme:
Referring to fig. 1-9, specifically, the present embodiment provides a real-time processing method for dynamically loading SAR images under GIS, based on a PC end and a server, as shown in fig. 1, including the following steps:
The method comprises the steps that firstly, a PC end loads SAR images and displays a map, a server obtains SAR image files, the PC end calculates the current visible range of the SAR images, and a map cutting request is sent to the server according to a calculation result;
the server receives the image cutting request, cuts images according to the coordinate range and the pixel size, and then sends image cutting information to the PC end;
and thirdly, the PC end receives the image cutting information and then adds the image cutting information to a map for display.
The invention provides a real-time processing device for dynamically loading SAR images under GIS, which comprises a geographic information display module and an SAR image processing module, wherein the geographic information display module and the SAR image processing module adopt a distributed deployment mode, the SAR image processing module operates on a server with a multi-core CPU and can process a plurality of oversized SAR images at the same time, and the geographic information display module operates on a computer and is used for displaying a map and the SAR images. The geographic information display module loads SAR images and displays maps, the geographic information display module calculates the current visible range of the SAR images, sends a map cutting request to the SAR image processing module according to a calculation result, adds map cutting information to the map for display after receiving the map cutting information, obtains SAR image files by the SAR image processing module, receives the map cutting request, cuts maps according to the coordinate range and the pixel size, and then sends the map cutting information to the geographic information display module.
The geographic information display module is used for displaying a geographic information picture, calculating the display range of the SAR image in the picture, requesting to process the SAR image, displaying the SAR image and translating the SAR image;
The SAR image processing module is used for carrying out image interception on the SAR image according to the requested content and returning the result to the geographic information display module.
The geographic information display module is operated on a PC, the SAR image processing module is operated on a high-performance server, and data exchange is carried out between the modules through a high-speed Ethernet, as shown in figure 3.
The geographical information display module calculates the current visible range of the SAR image and then informs the SAR image processing module to intercept the image. When the visible range is calculated, different modes are adopted according to different two-dimensional and three-dimensional display modes.
In two-dimensional mode:
In the two-dimensional geographic information display mode, various conditions can occur in map display, and three conditions including ① normal display, ② map rotation display and ③ map incomplete display are summarized. As in fig. 4. In this figure, we need to calculate the intersection area of the display area, which is the screen coordinates, and the SAR image area, which is the latitude and longitude coordinates. Because four corner positions of the display area in ③ mode are not covered by the map, longitude and latitude coordinates cannot be obtained, and calculation cannot be performed by using the longitude and latitude coordinates. When the SAR image is not within the screen range, the screen coordinates cannot be used for calculation either. Therefore, in order to solve the problem that our calculation mode can be used in various display states, we choose to perform calculation by uniformly converting them into world coordinates. Note that when in ③ mode, the world coordinates cannot be limited in scope to the map range when screen coordinates reincarnation world coordinates are performed, otherwise world coordinates outside the map range cannot be acquired.
The method for converting screen coordinates into world coordinates is as follows:
Coordinates of the near point and the far point of the current screen point are calculated by using a matrix formula, and then coordinates of the z=0 position are calculated according to the coordinates of the far point and the near point.
A code segment of screen coordinates to world coordinates is shown in fig. 10.
When the intersection area is prepared to be calculated, screen coordinates of a current screen display rectangular range are firstly converted into world coordinates, then longitude and latitude coordinate ranges of SAR images are also converted into world coordinates, and after the coordinate systems are unified, high-precision geometric intersection is carried out on two polygons. If so, the returned result will contain all points of intersection. At this time, the intersecting points are traversed, the points are converted from world coordinates to longitude and latitude coordinates, and the maximum and minimum values in the longitude and latitude directions are found out to form a rectangular coordinate range, namely an intersecting area.
When a cut is requested from the SAR image processing software, the pixel width and height values of the image in the intersecting range are also needed, the range under world coordinates represented by 1 pixel in the longitude and latitude directions is calculated according to the current map display zoom level, then the longitude and latitude range of the image is converted into world coordinates, conversion is carried out according to the world coordinate size represented by each pixel, and finally the pixel width and height values of the image are calculated.
When the calculation method in the two-dimensional mode is used, the calculation display of the SAR image in the 2.5D mode can be supported.
In three-dimensional mode:
In the three-dimensional display mode, the map is in spherical display, a display area cannot be obtained through a polygon-solving intersection mode in the two-dimensional mode, and whether a point is in a display range or not in the three-dimensional mode cannot be judged through a screen coordinate calculating mode. In the three-dimensional mode, whether the target point is in the visual range can be known by judging whether the position of the target point is in front of the visual plane (the visual plane: the plane formed by connecting all points from the viewpoint position and the tangential position of the earth) and whether the included angle between the target point and the viewpoint is in the range of the included angle between the viewpoint and the earth.
The method for calculating whether the target point is in front of the horizon plane is as follows:
See fig. 5, v is the viewpoint, T is the target point, C is the sphere center, H is the horizon point of the tangential position of the viewpoint and the earth, H 'is the projection point of VH on VC, T' is the projection point of VT on VC, HC is the earth radius, we will be As a unit vector, according to the pythagorean theorem:
Next, we note that triangles Δvch and Δhch' are similar triangles. They share a corner at point C and all have a right angle, so:
thus, the distance from the viewpoint to the plane is:
If it is At the position ofThe projection onto the lens is smaller than or equal toThen the target point is immediately in front of the plane.
Both sides are multiplied by
To sum up, to determine whether the target point is in front of the view plane, a dot product of the vector from the view point to the target point and the vector from the view point to the center of the ellipsoid may be used. If the value is equal to or less than one less than the square of the modulus of the vector from the observer to the center of the ellipsoid, then the target point is in front of the view plane.
If the target point is in front of the view plane, the target point is never occluded by the sphere, at which point the task is complete. But if it is behind the view plane it is uncertain whether it can be occluded. It is necessary to determine whether the target point is inside the view cone (view cone: infinite cone formed by connecting the viewpoint with all horizon points), if the target point is inside the view cone, it is occluded, and if outside the view cone, it is not occluded.
The method for calculating whether the target point is within the view cone range is as follows:
See fig. 5. Angle HVC is marked as α, angle TVC is marked as β, if point T is inside the cone:
β<α;
namely:
cos(β)>cos(α);
the angle α is part of a right triangle Δvch, so we rewrite the right side of the inequality by a trigonometric function:
According to the definition of dot product, there are:
according to the previous formula Squaring the two sides of the formula
Finally, the following formula is obtained:
If this inequality holds, the target point is inside the view cone. If it is also behind the view plane, the target point is occluded.
In order to reduce the iteration times, the target point is replaced by a target ball, and whether the target ball is in the display range is calculated.
The method of calculating whether the target sphere is within the view cone range is as follows:
See fig. 6:T for a target ball center point, a ball radius R t,T2 for a point of tangency from the viewpoint to the target ball, and T 1 for a point of intersection of the viewpoint to the target ball center point and the target ball edge, with angle < CVT 2 labeled β 1. First, the vector from the viewpoint to T 1、T2 is calculated:
At this time, the mode of calculating whether the target ball is in front of the vision plane is changed to a minimum mode, and the target ball is considered to be in front of the vision plane as long as the point T 1 is in front of the vision plane. The previous judgment formula is Now change to:
At this time, the mode of calculating whether the target point is within the view cone range is changed into the judgment point T 2, and the previous judgment formula is Now change to:
After judging whether the sphere is in the visual angle range, dividing the image into a plurality of square blocks by adopting an iterative optimization algorithm, and then iteratively calculating whether the square blocks are in the visual range (taking the center point of the square as the circle center and the side length of the square) As radius). After multiple iterations, removing the areas which are not in the visual range, and calculating the positions of the remaining areas to obtain a maximum rectangular range.
When the image is divided for the first time, the short side of the image is used forAs the square side length of the first division, the image is divided into a plurality of square line areas, and the area where the long side of the image is not divided is expanded and complemented (small square areas which are not in the range of the SAR image area are finally removed) first, see fig. 8- (1). The main code segments are as in fig. 11.
Then centering on the square central point and the side lengthAs a radius it is checked whether this circle is in the visible range. After the first round of detection, squares that are not within a possible range are filtered out, then the remaining squares are segmented, see fig. 8- (2), and the segmented areas are visually detected. After a plurality of iterations, when the edge length pixel distance of the segmented square is smaller than a certain value (for example, 10 pixels), the calculation accuracy is considered to be achieved, the iteration is stopped, the current remaining small square area is counted and combined into a rectangular range, and the rectangular range is the final required SAR image display range. The main code segments are as in fig. 12 and 13.
When the SAR image processing software requests to cut a picture, the pixel width and height values of the image in the intersecting range are also needed, the screen coordinates are converted according to the longitude and latitude coordinates of the intersecting image range, and the obtained polygon is not a rectangle but a rectangle in the three-dimensional mode, and the longer side of the polygon in the longitude/latitude direction is taken as the image width and height values.
The SAR image translation operation is needed in the geographic information display module. When in operation, the current state is set as an editing mode, and at the moment, the operation event of the mouse on the map is intercepted. When the left button of the mouse is pressed and the pressed position is on the image, the image can be dragged at the moment, the position of the mouse is recorded as the moving starting position, and when the current mouse moves, the offset of the image is set according to the moving position of the mouse and the offset of the starting position, as shown in fig. 9.
The SAR image processing module is used for carrying out image interception on the SAR image according to the requested content and returning the result to the geographic information display module. After receiving the request, the SAR image processing module takes out the requested image interception range and size and the image name parameter, then uses GDAL library to intercept the tiff image of the SAR, and returns the intercepted image to the geographic information display module.
According to the image computing processing mode, the image is cut according to the content displayed according to actual needs, the memory size of the loaded image is greatly reduced, the SAR image processing module is installed on a server with good CPU performance in a distributed mode, the image parallel processing capability is improved, the capability of loading, displaying and processing the oversized SAR image on a geographic information system in real time is realized, and the problems of loading, displaying and processing the oversized SAR image are solved.
While the invention has been described with reference to preferred embodiments, it is not intended to be limiting. Those skilled in the art will appreciate that various modifications and adaptations can be made without departing from the spirit and scope of the present invention. Accordingly, the scope of the invention is defined by the appended claims.

Claims (6)

1.一种在GIS下动态加载SAR图像的实时处理方法,基于PC端和服务器,其特征在于:包括以下步骤:1. A real-time processing method for dynamically loading SAR images under GIS, based on a PC and a server, characterized in that it includes the following steps: 步骤一:PC端加载SAR图像并显示地图,服务器获取SAR图像文件,PC端对SAR图像当前可见的范围进行计算,并根据计算结果发送切图请求给服务器;Step 1: The PC loads the SAR image and displays the map. The server obtains the SAR image file. The PC calculates the currently visible range of the SAR image and sends a map-slicing request to the server based on the calculation result. 步骤二:服务器接收切图请求,并根据坐标范围及像素大小进行切图,之后将切图信息发送给PC端;Step 2: The server receives the image cutting request, cuts the image according to the coordinate range and pixel size, and then sends the image cutting information to the PC; 步骤三:PC端收到切图信息后添加到地图上显示;Step 3: After receiving the image-cutting information, the PC adds it to the map for display; 所述步骤一中对SAR图像当前可见的范围计算时,针对二维和三维显示模式的不同;When calculating the currently visible range of the SAR image in step 1, the difference between two-dimensional and three-dimensional display modes is considered; 二维模式下:通过获取当前屏幕显示矩形范围坐标,然后和SAR图像的矩形范围坐标进行高精度几何求交,最终得到一个准确的相交范围值;In 2D mode: by obtaining the coordinates of the current screen display rectangle range, and then performing high-precision geometric intersection with the rectangular range coordinates of the SAR image, an accurate intersection range value is finally obtained; 三维模式下:通过迭代优化算法,将SAR图像切成一个个小正方形区域,计算这些小正方形区域是否在视角范围内,在经过多次迭代后,将剩余在显示范围内的小正方形区域计算出一个最大显示矩形范围,这个矩形范围就是近似实际的显示区域范围;In 3D mode: the SAR image is cut into small square areas through an iterative optimization algorithm, and the calculation is made as to whether these small square areas are within the viewing angle range. After multiple iterations, the remaining small square areas within the display range are used to calculate a maximum display rectangular range, which is an approximation of the actual display area range. 二维模式下具体步骤如下:The specific steps in 2D mode are as follows: S1:将显示区域的屏幕坐标和SAR图像的经纬度坐标统一转换为世界坐标下,并得到两个多边形;S1: Convert the screen coordinates of the display area and the longitude and latitude coordinates of the SAR image into world coordinates and obtain two polygons; S2:对两个多边形进行高精度几何求交,如果相交,则返回结果会包含所有相交的点,此时遍历这些相交点,将这些点从世界坐标转换成经纬度坐标,并找出经纬度方向上最大最小值,形成一个矩形坐标范围,这个范围为相交区域,即得计算结果;S2: Perform high-precision geometric intersection on two polygons. If they intersect, the returned result will include all the intersecting points. At this time, traverse these intersecting points, convert these points from world coordinates to longitude and latitude coordinates, and find the maximum and minimum values in the longitude and latitude directions to form a rectangular coordinate range. This range is the intersection area, and the calculation result is obtained; 所述步骤一中,并根据计算结果发送切图请求给服务器时,计算相交区域图像的像素宽高值,一起发送给服务器,包括如下步骤:In the step 1, when sending a cut image request to the server according to the calculation result, the pixel width and height values of the image in the intersection area are calculated and sent to the server together, including the following steps: 根据当前的地图显示缩放级别计算出在经度和纬度方向上1像素所代表的世界坐标下的范围,然后将图像的经纬度范围换算成世界坐标,在根据每像素代表的世界坐标大小进行换算,最终计算出相交区域图像的像素宽高值;According to the current map display zoom level, calculate the range of world coordinates represented by 1 pixel in the longitude and latitude directions, then convert the longitude and latitude range of the image into world coordinates, and then convert according to the world coordinate size represented by each pixel, and finally calculate the pixel width and height values of the intersecting area image; 在三维显示模式下,地图是球形显示,判断目标点位置是否在视平面前方或者后方,以及目标点和视点的夹角在是否视点和地球夹角的范围内,判断目标点是否在可视范围内,视平面为从视点位置和地球相切位置所有点的连线形成的平面,计算目标点是否在地平线视平面前的方法,具体步骤如下:In the 3D display mode, the map is displayed spherically. The method of judging whether the target point is in front of or behind the viewing plane, and whether the angle between the target point and the viewpoint is within the range of the angle between the viewpoint and the earth, is used to judge whether the target point is within the visible range. The viewing plane is the plane formed by the lines connecting all points at the viewpoint position and the tangent position of the earth. The specific steps for calculating whether the target point is in front of the horizon viewing plane are as follows: 定义V是视点,T是目标点,C是球心,H是视点和地球相切位置地平线点,H′是VH在VC上的投影点,T′是VT在VC上的投影点,HC是地球半径,我们将作为单位向量,根据勾股定理:Define V as the viewpoint, T as the target point, C as the center of the sphere, H as the horizon point where the viewpoint and the earth are tangent, H′ is the projection point of VH on VC, T′ is the projection point of VT on VC, and HC is the radius of the earth. We will As a unit vector, according to the Pythagorean theorem: 三角形△VCH和△HCH′是相似三角形,他们共享一个位于C点的角并且都有一个直角,因此:Triangles △VCH and △HCH′ are similar triangles. They share an angle at point C and both have a right angle, so: 因此,从视点到平面的距离为:Therefore, the distance from the viewpoint to the plane is: 如果上的投影小于等于那么目标点就在平面之前,if exist The projection on is less than or equal to Then the target point is just before the plane, 两边同时乘以 Multiply both sides by 即使用视点到目标点的矢量,与视点到椭球体的中心的矢量的点积,如果该值小于等于从观察者到椭球中心的向量的模的平方减一,则目标点在视平面之前。That is, the dot product of the vector from the viewpoint to the target point and the vector from the viewpoint to the center of the ellipsoid is used. If this value is less than or equal to the square of the magnitude of the vector from the observer to the center of the ellipsoid minus one, the target point is before the viewing plane. 2.根据权利要求1所述的一种在GIS下动态加载SAR图像的实时处理方法,其特征在于:所述PC端和服务器通过以太网进行数据交换。2. The real-time processing method for dynamically loading SAR images under GIS according to claim 1 is characterized in that: the PC terminal and the server exchange data via Ethernet. 3.根据权利要求1所述的一种在GIS下动态加载SAR图像的实时处理方法,其特征在于:若目标点在视平面后方,需要判断目标点是否在视锥体内,视锥体为视点与所有地平线点连接而形成的无限锥体,如果目标点在视锥体内,则它被遮挡;在视锥体外,那么它不会被遮挡,计算目标点是否在视锥体范围内的方法如下:3. A real-time processing method for dynamically loading SAR images under GIS according to claim 1, characterized in that: if the target point is behind the viewing plane, it is necessary to determine whether the target point is within the viewing cone, the viewing cone is an infinite cone formed by connecting the viewpoint and all horizon points, if the target point is within the viewing cone, it is blocked; if it is outside the viewing cone, it will not be blocked, and the method for calculating whether the target point is within the viewing cone is as follows: 定义角度∠HVC标记为α,∠TVC标记为β,如果要点T在圆锥体内,那么:Define the angle ∠HVC as α and ∠TVC as β. If point T is inside the cone, then: β<α;β<α; 即:Right now: cos(β)>cos(α);cos(β)>cos(α); 角α是直角三角形△VCH的一部分,通过三角函数,重写不等式的右边:Angle α is part of the right triangle △VCH. Using trigonometric functions, we can rewrite the right side of the inequality: 根据点积的定义,有:According to the definition of dot product, we have: 根据之前的公式将公式两边进行平方,According to the previous formula Square both sides of the formula, 最终得到一下公式:Finally, we get the following formula: 如果此不等式成立,则目标点在视锥体内部,如果它也在视平面后面,则目标点被遮挡。If this inequality holds, the target point is inside the view frustum, if it is also behind the view plane, then the target point is occluded. 4.根据权利要求3所述的一种在GIS下动态加载SAR图像的实时处理方法,其特征在于:为了减少迭代次数,将权利要求1中的目标点换成目标球,进行计算目标球是否在显示范围内;4. A real-time processing method for dynamically loading SAR images under GIS according to claim 3, characterized in that: in order to reduce the number of iterations, the target point in claim 1 is replaced with a target ball, and calculation is performed to determine whether the target ball is within the display range; 计算目标点是否在视锥体范围内的方法如下:The method to calculate whether the target point is within the range of the viewing cone is as follows: 定义T为目标球中心点,球半径为Rt,T2为视点到目标球的相切点,T1是视点到目标球中心点和目标球边缘相交的点,角度∠CVT2标记为β1,先计算出视点到T1、T2的向量:Define T as the center point of the target ball, the radius of the ball is R t , T 2 is the tangent point from the viewpoint to the target ball, T 1 is the point where the viewpoint to the center point of the target ball and the edge of the target ball intersect, and the angle ∠CVT 2 is marked as β 1 . First calculate the vectors from the viewpoint to T 1 and T 2 : 此时计算目标球是否在视平面前的方式为只要T1点在视平面前,就认为目标球在视平面前,判断公式为:At this time, the way to calculate whether the target ball is in front of the viewing plane is that as long as point T1 is in front of the viewing plane, the target ball is considered to be in front of the viewing plane. The judgment formula is: 此时计算目标点是否在视锥体范围内的,判断公式为:At this time, the calculation formula for whether the target point is within the range of the viewing cone is: 再采用迭代优化算法,将图像划分为多个正方形块,然后迭代计算这些正方形块是否在可视范围内,具体以正方形中心点为圆心,正方形边长的作为半径,经过多次迭代后,剔除不在可视范围内的区域,将剩下的区域位置计算出一个最大矩形范围;Then, an iterative optimization algorithm is used to divide the image into multiple square blocks, and then iteratively calculate whether these square blocks are within the visible range. Specifically, the center point of the square is the center of the circle, and the side length of the square is As the radius, after multiple iterations, the areas that are not within the visible range are eliminated, and the positions of the remaining areas are calculated to form a maximum rectangular range; 图像首次划分时,以图像短的一边的作为第一次划分的正方形边长,将图像划分成若干个正方行区域,图像长边不够划分的地方先扩展补上,最终不在SAR图像区域范围内的小正方形区域会剔除;When the image is first divided, the shorter side of the image is The side length of the square used for the first division is used to divide the image into several square areas. The areas where the long side of the image is not enough for division are expanded and filled first. Finally, the small square areas that are not within the SAR image area will be eliminated. 然后以正方形中心点为中心,边长的作为半径检测这个圆形是否在可视范围内,第一轮检测后,过滤掉不在可是范围内的正方形,然后对剩余的正方形进行切分,再对切分后的区域进行可视检测,在进行多次迭代后,当切分的正方形边长像素距离预设值时,可认为达到计算需要的精度了,退出迭代,统计当前剩余小正方形区域并组合成一个矩形范围,这个矩形范围就是最终需要的SAR图像显示范围。Then, with the center point of the square as the center, the length of the side As the radius, detect whether the circle is within the visible range. After the first round of detection, filter out the squares that are not within the visible range, then divide the remaining squares, and then perform visual detection on the divided area. After multiple iterations, when the pixel distance of the divided square side length is the preset value, it can be considered that the accuracy required for calculation has been achieved, exit the iteration, count the current remaining small square areas and combine them into a rectangular range, which is the final required SAR image display range. 5.一种在GIS下动态加载SAR图像的实时处理装置,其特征在于:包括地理信息显示模块和SAR图像处理模块,地理信息显示模块和SAR图像处理模块采用分布式部署方式,其中SAR图像处理模块运行在一个具有多核心CPU的服务器上,能够同时处理多个超大SAR图像,所述地理信息显示模块运行在电脑上,用来显示地图和SAR图像;5. A real-time processing device for dynamically loading SAR images under GIS, characterized in that: it comprises a geographic information display module and a SAR image processing module, the geographic information display module and the SAR image processing module are deployed in a distributed manner, wherein the SAR image processing module runs on a server with a multi-core CPU and can process multiple super-large SAR images at the same time, and the geographic information display module runs on a computer to display maps and SAR images; 地理信息显示模块加载SAR图像并显示地图,地理信息显示模块对SAR图像当前可见的范围进行计算,并根据计算结果发送切图请求给SAR图像处理模块,地理信息显示模块收到切图信息后添加到地图上显示;The geographic information display module loads the SAR image and displays the map. The geographic information display module calculates the currently visible range of the SAR image and sends a cut-image request to the SAR image processing module based on the calculation result. After receiving the cut-image information, the geographic information display module adds it to the map for display; SAR图像处理模块获取SAR图像文件,SAR图像处理模块接收切图请求,并根据坐标范围及像素大小进行切图,之后将切图信息发送给地理信息显示模块。The SAR image processing module obtains the SAR image file, receives the image cutting request, and cuts the image according to the coordinate range and pixel size, and then sends the image cutting information to the geographic information display module. 6.根据权利要求5所述的一种在GIS下动态加载SAR图像的实时处理装置,其特征在于:所述地理信息显示模块中需对SAR图像进行平移操作,在操作时,监听鼠标事件,平移操作采用鼠标左键按下拖动方式进行。6. A real-time processing device for dynamically loading SAR images under GIS according to claim 5, characterized in that: the SAR image needs to be translated in the geographic information display module, and during the operation, mouse events are monitored, and the translation operation is performed by pressing and dragging the left button of the mouse.
CN202111328279.2A 2021-11-10 2021-11-10 A real-time processing method and device for dynamically loading SAR images under GIS Active CN114004946B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111328279.2A CN114004946B (en) 2021-11-10 2021-11-10 A real-time processing method and device for dynamically loading SAR images under GIS

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111328279.2A CN114004946B (en) 2021-11-10 2021-11-10 A real-time processing method and device for dynamically loading SAR images under GIS

Publications (2)

Publication Number Publication Date
CN114004946A CN114004946A (en) 2022-02-01
CN114004946B true CN114004946B (en) 2025-06-24

Family

ID=79928514

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111328279.2A Active CN114004946B (en) 2021-11-10 2021-11-10 A real-time processing method and device for dynamically loading SAR images under GIS

Country Status (1)

Country Link
CN (1) CN114004946B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118226965B (en) * 2024-04-18 2024-10-11 江苏嘉嘉地理信息科技有限公司 Method and system for informationized management of natural resource files

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102336069A (en) * 2010-07-16 2012-02-01 鸿富锦精密工业(深圳)有限公司 Printer with picture clipping function and picture clipping method
CN103903508A (en) * 2012-12-28 2014-07-02 上海优途信息科技有限公司 Tile map segmenting method and system

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102012924B (en) * 2010-11-29 2013-07-03 深圳市融创天下科技股份有限公司 Map display method and system and mobile terminal
CN103230283B (en) * 2013-04-16 2014-11-05 清华大学 Method for optimizing ultrasonic probe imaging plane space position calibration
CN103595974B (en) * 2013-12-01 2016-09-28 北京航空航天大学深圳研究院 A kind of video geographic information system towards metropolitan area and method

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102336069A (en) * 2010-07-16 2012-02-01 鸿富锦精密工业(深圳)有限公司 Printer with picture clipping function and picture clipping method
CN103903508A (en) * 2012-12-28 2014-07-02 上海优途信息科技有限公司 Tile map segmenting method and system

Also Published As

Publication number Publication date
CN114004946A (en) 2022-02-01

Similar Documents

Publication Publication Date Title
CN112085844B (en) Unmanned aerial vehicle image rapid three-dimensional reconstruction method for field unknown environment
US9542770B1 (en) Automatic method for photo texturing geolocated 3D models from geolocated imagery
US8139111B2 (en) Height measurement in a perspective image
CN111046776A (en) Mobile robot traveling path obstacle detection method based on depth camera
KR102200299B1 (en) A system implementing management solution of road facility based on 3D-VR multi-sensor system and a method thereof
CN112348886A (en) Visual positioning method, terminal and server
CN111721281B (en) Position identification method and device and electronic equipment
Wang et al. A new method for measuring the attitude and straightness of hydraulic support groups based on point clouds
WO2022217988A1 (en) Sensor configuration scheme determination method and apparatus, computer device, storage medium, and program
CN113345072A (en) Multi-view remote sensing topographic image point cloud reconstruction method and system
US11776148B1 (en) Multi-view height estimation from satellite images
CN114004946B (en) A real-time processing method and device for dynamically loading SAR images under GIS
US11361502B2 (en) Methods and systems for obtaining aerial imagery for use in geospatial surveying
US20250109940A1 (en) System and method for providing improved geocoded reference data to a 3d map representation
Oliveira et al. Height gradient approach for occlusion detection in UAV imagery
Böhm et al. Automated appearance-based building detection in terrestrial images
NL2035685B1 (en) Method for determining accurate coordinates from images with human supervision using a virtual three-dimensional marker
Nakagawa LiDAR VR generation with point-based rendering
Arefi et al. Ridge based decomposition of complex buildings for 3D model generation from high resolution digital surface models
Ahmadabadian Photogrammetric multi-view stereo and imaging network design
Salvaggio et al. A voxel-based approach for imaging voids in three-dimensional point clouds
Ovrén et al. Long‐Range Time‐Correlated Single‐Photon Counting Lidar 3D‐Reconstruction From a Moving Ground Vehicle
Bethmann et al. Multi-image semi-global matching in object space
Wang et al. Upsampling method for sparse light detection and ranging using coregistered panoramic images
Bang et al. A new true ortho-photo generation algorithm for high resolution satellite imagery

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Country or region after: China

Address after: No. 2 Yongshun Road, Qinhuai District, Nanjing City, Jiangsu Province 211000

Applicant after: Jiangsu Juntian Electronic Technology Co.,Ltd.

Address before: 210000 fifth floor, teaching building, No. 14, Tiantang new village, Qinhuai District, Nanjing City, Jiangsu Province

Applicant before: XINCHUANHUI ELECTRONIC TECHNOLOGY Co.,Ltd.

Country or region before: China

GR01 Patent grant
GR01 Patent grant
点击 这是indexloc提供的php浏览器服务,不要输入任何密码和下载