+

WO2018133849A1 - Procédé photographique d'image panoramique, procédé d'affichage d'image panoramique, dispositif photographique d'image panoramique et dispositif d'affichage d'image panoramique - Google Patents

Procédé photographique d'image panoramique, procédé d'affichage d'image panoramique, dispositif photographique d'image panoramique et dispositif d'affichage d'image panoramique Download PDF

Info

Publication number
WO2018133849A1
WO2018133849A1 PCT/CN2018/073474 CN2018073474W WO2018133849A1 WO 2018133849 A1 WO2018133849 A1 WO 2018133849A1 CN 2018073474 W CN2018073474 W CN 2018073474W WO 2018133849 A1 WO2018133849 A1 WO 2018133849A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
camera
panoramic
panoramic image
captured
Prior art date
Application number
PCT/CN2018/073474
Other languages
English (en)
Chinese (zh)
Inventor
罗勇
余熙平
陈�全
喻运辉
胡文波
Original Assignee
盯盯拍（东莞）视觉设备有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 盯盯拍（东莞）视觉设备有限公司 filed Critical 盯盯拍（东莞）视觉设备有限公司
Publication of WO2018133849A1 publication Critical patent/WO2018133849A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio

Definitions

  • the present application relates to the field of image processing, and in particular, to a panoramic image capturing method, a panoramic image display method, a panoramic image capturing device, and a panoramic image display device.
  • panoramic image capturing refers to shooting in which the horizontal direction is 360° and the vertical direction is 180° or more with a reference point as a center point.
  • panoramic shooting is performed by a panoramic camera, such as a panoramic camera that shoots a wide angle of 180° vertically and 360° horizontally, or a panoramic camera consisting of two cameras on the front and rear sides.
  • the cameras are shot from a panoramic camera composed of different angles.
  • the definition is relatively low, and high-definition video cannot be captured, and the content and details that the user pays more attention to in the panoramic image cannot be well presented.
  • the panoramic camera in the prior art generally has a low definition of the panoramic image, especially when used in the fields of events, conferences, etc., the attention is easily dispersed, and the problem that the user cares about the content cannot be focused, even though multiple HD cameras are assembled to capture images and then stitched together to capture high-definition panoramic images, but this can also lead to problems with high cost and inefficiency, and inconvenient user use.
  • the present application provides a panoramic image capturing method, a panoramic image display method, a panoramic image capturing device, and a panoramic image display device, which can solve the problem that the panoramic image captured by the panoramic camera is low in definition and cannot focus on the user's concern and adopt multiple
  • the combination of high-definition cameras to obtain panoramic images increases the cost, the shooting efficiency is low, and the user is inconvenient to use.
  • the present application provides a panoramic image capturing method, the method comprising: setting a camera module, the camera module includes at least two cameras, and the camera captures images in a panoramic range for splicing into a panoramic image, wherein at least one The image captured by the camera has higher definition than the rest of the camera; the control module is set, and the control module controls the camera module to perform shooting.
  • the camera module comprises: a camera combination for capturing an image of the panoramic range for splicing into a panoramic image or a camera combination composed of at least two first cameras; at least one for capturing an image of a partial area within the panoramic range
  • the second camera wherein the image of the partial area captured by the second camera has higher definition than the image captured by the first camera; the camera body, the first camera and the second camera are disposed on the camera body.
  • the camera module comprises: at least one first camera; at least one second camera that can adjust the sharpness of the captured image to be higher than the sharpness of the image captured by the first camera, and the first camera captures the image of the panoramic range for splicing A panoramic image; and a camera body, the first camera and the second camera are disposed on the camera body.
  • the method further comprises: adjusting the sharpness of the image captured by the second camera or controlling the shooting focal length of the second camera when the panoramic image has a single sharpness, so that the second The camera is consistent with the sharpness of the image captured by the first camera; when the panoramic image has at least two partial regions of different definition, the second camera is controlled to adjust the shooting focal length so that the image captured by the second camera is sharper than the first camera The sharpness of the captured image.
  • the present application provides a panoramic image display method, the method comprising: processing an image captured by a camera module and splicing into a single-resolution panoramic image for selection by a user; and selecting a panoramic image by an interactive action a display area to be displayed; determining whether the display area selected by the interactive action and the local area captured by the camera with high definition of the captured image have an intersection area; if so, according to the corresponding position of the image corresponding to the intersection area on the panoramic image, An image captured by a camera with a high resolution of the intersection image is spliced onto the image corresponding to the display area, and an image corresponding to the display area is displayed, wherein the image corresponding to the display area has at least two partial regions of different definitions; otherwise, The image corresponding to the display display area maintains a single sharpness.
  • the method further comprises the step of: if the display area and the local area have an intersection area, further determining whether the interaction is satisfied The setting condition, if yes, jumps to the step of splicing the image corresponding to the intersection area onto the image corresponding to the display area; otherwise, the image corresponding to the display area remains a single sharpness.
  • the interactive action may be implemented by setting at least one of an action of detecting a user setting part, a gesture recognition technology, and setting an input device.
  • the setting condition is whether the interactive action maintains the selection action setting time, whether the display range of the interaction action selection and the intersection range of the partial region are set values, or whether the interaction action performs the set operation.
  • the image of the display partial area is gradually changed from the image sharpness with the remaining area to the image sharpness higher than the remaining area.
  • the present application provides a panoramic image capturing apparatus, the apparatus comprising: a camera module, the camera module includes at least two cameras, and the camera captures images for splicing into a panoramic image, wherein at least one camera captures The sharpness of the image is higher than the rest of the camera; and the control module is used to control the module to control the camera module for shooting.
  • the present application provides a panoramic image display apparatus, including: a processing module for processing an image captured by a camera module and splicing into a single-resolution panoramic image for user selection;
  • the display unit is configured to select a display area to be displayed in the panoramic image by an interactive action;
  • the determining module is configured to determine whether the display area selected by the interaction action and the local area captured by the camera with high definition of the captured image have an intersection area; and a display module, If yes, the processing module splices the image captured by the camera with the higher resolution of the captured image corresponding to the intersection area to the image corresponding to the display area according to the corresponding position of the image corresponding to the intersection area on the panoramic image, and displays the display area.
  • Corresponding image wherein the image corresponding to the display area has at least two partial regions of different definitions; otherwise, the image corresponding to the display display area maintains a single sharpness.
  • the utility model has the beneficial effects that: the image is captured by at least two cameras for splicing into a panoramic image, and the image captured by the at least one camera has higher definition than the remaining cameras, so that the spliced panoramic image can have at least two different definitions.
  • the local area so that the panoramic image can be obtained, and the sharper image of the local area that the user needs to pay attention to can be obtained, so that the user can enjoy the advantage of the immersive experience brought by the panoramic image, and can also obtain attention.
  • the clearer image of the content enhances the user's shooting experience, and the cost is lower, and the implementation is simpler and more convenient for the user.
  • FIG. 1 is a schematic diagram of a panoramic image capturing device of the present application connected to a panoramic image display device;
  • FIG. 2 is a schematic diagram of a panoramic image capturing apparatus including a microphone sensor in a third embodiment of the present application
  • FIG. 3 is a schematic diagram of a panoramic image capturing apparatus including a fixed connection module in a fourth embodiment of the present application;
  • FIG. 4 is a schematic diagram of a panoramic image capturing apparatus shown in a fifth embodiment of the present application.
  • FIG. 5 is a schematic diagram of a panoramic image capturing apparatus according to a sixth embodiment of the present application.
  • FIG. 6 is a schematic diagram of a panoramic image capturing apparatus according to a seventh embodiment of the present application.
  • FIG. 7 is a schematic diagram of a panoramic image capturing apparatus according to an eighth embodiment of the present application.
  • FIG. 8 is a schematic diagram of a panoramic image capturing apparatus according to a ninth embodiment of the present application.
  • FIG. 9 is a schematic diagram of a panoramic image capturing apparatus shown in a tenth embodiment of the present application.
  • FIG. 10 is a schematic diagram of a panoramic image capturing apparatus shown in an eleventh embodiment of the present application.
  • FIG. 11 is a schematic diagram of a panoramic image capturing apparatus shown in a twelfth embodiment of the present application.
  • Figure 12 is a schematic diagram of a panoramic image capturing apparatus shown in a thirteenth embodiment of the present application.
  • Figure 13 is a schematic diagram of a panoramic image capturing apparatus shown in a fourteenth embodiment of the present application.
  • FIG. 14 is a flowchart of a panoramic image capturing method illustrated in a seventeenth embodiment of the present application.
  • Fig. 15 is a flowchart showing a panoramic image display method shown in a seventeenth embodiment of the present application.
  • camera module 1 first camera 11 second camera 12 camera body 13 rotation unit 14 control module 2 processing module 3 interaction module 4 display module 5.
  • VR full name
  • Chinese virtual reality
  • the idea of the present application is to capture an image by at least two cameras for splicing into a panoramic image, and the image captured by at least one camera has higher definition than the remaining cameras, so that the spliced panoramic image may have at least two different definitions.
  • the local area so that the user can obtain a partial area image with higher definition than other areas while acquiring the panoramic image.
  • Embodiment 1 is a diagrammatic representation of Embodiment 1:
  • an image capturing apparatus of the present application comprising: a camera module 1 , the camera module 1 includes at least two cameras, and the camera captures images for splicing into a composite image, wherein at least one camera captures an image.
  • the clarity is higher than the rest of the camera.
  • the control module 2 is connected to the camera module 1 for controlling the camera module 1 to perform shooting.
  • control module 2 controls the synchronous shooting of the camera to ensure that the captured images can be correlated, and the time for capturing the images can be synchronized.
  • the composite image may have two or more partial regions of different image sharpness.
  • image sharpness is determined by the number of pixels per unit area of the image captured when the target object is captured. The more the number of pixels per unit area of the image of the target object, the more the number of pixels can be seen. The more detail the target object has, the higher the sharpness of the image. Conversely, the sharper the sharpness of the image.
  • the image capturing device includes two cameras, one of which is a camera disposed at the top and facing in the direction of the sky.
  • the pixels of the camera are 1080P
  • the wide angle is 240° vertically
  • the horizontal is 360°
  • the pixel of the other camera is 720P.
  • the wide angle is 120° horizontal and 110° vertical.
  • the camera's shooting pixels are relatively high, because of its wide shooting angle, the image in the captured image has fewer pixels per unit area, which makes the image taken by the camera less clear.
  • the camera with a pixel of 720P has a smaller shooting angle than 1080P, so the pixel area per unit area in the captured image is relatively large, so that the image taken by the camera with the pixel of 720P is more clear than 1080P. Therefore, the composite image obtained by splicing the image captured by the image capturing device has two partial image regions of sharpness.
  • Embodiment 2 is a diagrammatic representation of Embodiment 1:
  • a panoramic image capturing apparatus of the present application comprising: a camera module 1 , at least two cameras, the camera capturing images in a panoramic range for splicing into a panoramic image, wherein at least one camera captures an image The clarity is higher than the rest of the camera.
  • the control module 2 is connected to the camera module 1 for controlling the camera module 1 to perform shooting.
  • control module 2 controls the synchronous shooting of the camera to ensure that the time during shooting can be consistent.
  • the panoramic image has two or more partial regions with different image sharpness.
  • image sharpness is determined by the number of pixels per unit area of the image captured when the target object is captured. The more the number of pixels per unit area of the image of the target object, the more the number of pixels can be seen. The more detail the target object has, the higher the sharpness of the image. Conversely, the sharper the sharpness of the image.
  • the sharpness of the image is determined by the wide angle of the camera and the captured pixels.
  • the wide angle of the second camera is smaller than the wide angle of the first camera, the sharpness of the second camera is higher than the sharpness of the first camera, or the wide angle of the second camera and the first
  • the shooting pixels of the second camera are higher than the shooting pixels of the first camera.
  • the wide angle of the second camera is smaller than the wide angle of the first camera and the pixels of the second camera are higher than the shooting angle of the second camera. The pixels of the first camera.
  • the panoramic image capturing device can capture the panoramic image of the panoramic range in two ways: in the first mode, the panoramic range image is captured by a camera or a camera combination, and at least one camera captures a partial region in the panoramic range.
  • the image is implemented, wherein the sharpness of the captured image of the camera that captures the partial area image is higher than the sharpness of the image of the camera or the camera combination that captures the panoramic range; the second way, through two or more cameras
  • the camera combination is composed to capture a panoramic range of images, wherein at least one camera captures images with higher definition than the rest of the cameras. In both of these ways, it is possible to acquire a partial area image within a panoramic range while obtaining a panoramic image, and the sharpness of the partial area image is higher than that of other area images.
  • the panoramic image capturing device includes two cameras, one of which is a panoramic camera, the pixel of the panoramic camera is 1080P, the wide angle is 180° vertical, 360° horizontal, for capturing panoramic images, and the other camera is 720P.
  • the wide angle is 120° horizontal and 110° vertical, and is used to capture an image of a local area within a panoramic range set by the user.
  • the panoramic camera has a relatively high shooting pixel, because of its wide shooting angle, the image in the captured image has fewer pixels per unit area, so that the image captured by the panoramic camera is not clear enough.
  • the camera with a pixel of 720P is smaller than the 1080P, so the image of the captured image has a relatively large number of pixels per pixel area, so that the image taken by the camera with the pixel of 720P is more clear than 1080P. Therefore, the composite image obtained by the image captured by the panoramic image capturing device has a partial region image of two definitions in the composite image.
  • the panoramic image capturing device includes a camera combination composed of three cameras to capture a panoramic image, wherein the pixels of the three cameras are 4K, 2K, and 1080P, respectively, and the wide angles of the three cameras are the same, 120°, the rest of the parameters are the same. The difference between these three cameras is only the pixels. Obviously, the number of pixels per unit area of the image captured by the 4K camera is the most. Therefore, the sharpness of the image captured by the 4K camera is the highest, and the resolution of the image captured by the 2K camera. A camera above 1080P captures the sharpness of the image so that the panoramic image has three different resolution local area images.
  • control module 2 can control shooting by setting a button on the panoramic image capturing device.
  • the control module 2 can also set a remote controller to control shooting in the panoramic image capturing device.
  • the control signal is sent by the remote controller, and the panoramic image capturing device performs an action after receiving the control signal through the wireless communication module, wherein the control signal can be a WIFI signal. , Bluetooth signal or 2G/3G/4G signal.
  • control module 2 controls the synchronous shooting of the camera to ensure that the time during shooting can be consistent.
  • the camera can adjust the shooting focal length.
  • the control module 2 can control the camera to adjust the focal length.
  • the panoramic image capturing device in the embodiment has different sharpness of the image captured by the camera, so that after the image is stitched into a panoramic image, the panoramic image has at least two partial regions of different definitions, so that the panoramic image can be acquired at the same time. Get a higher-resolution image of the local area that the user needs to pay attention to, so that the user can enjoy the advantage of the immersive experience brought by the panoramic image, and also obtain a clearer image of the content that needs attention, and enhance the user's shooting. Experience, and low cost, it is also relatively simple to implement, user-friendly.
  • Embodiment 3 is a diagrammatic representation of Embodiment 3
  • the panoramic image capturing apparatus further includes a sound collection module, and the sound collection module includes a microphone sensor or a microphone sensor array composed of the microphone sensor.
  • the microphone sensor when the image pickup main body of the image pickup module 1 of the panoramic image capturing apparatus has a shape of a cube, a rectangular parallelepiped or a cylinder, the microphone sensor can be disposed around the photographing module one week, and can realize sound collection in a horizontal 360° and a vertical 360° range.
  • the shape of the imaging body of the camera module of the panoramic image capturing device is spherical, the microphone sensor can be disposed around the circumference of the sphere. In this way, when the collected sound is played, the sound effect of the scene can be restored, and the realism of the captured image is enhanced.
  • the microphone sensor is not necessarily disposed on the panoramic image capturing device, and the matrix array of the microphone sensor can be first set on the external accessory, and then the external accessory is fixed on the panoramic image capturing device.
  • the panoramic image capturing device combined with the microphone sensor, especially the microphone sensor array has a wide range of applications, for example, the application in the live broadcast of the live event, while giving the user a sense of visual immersion, but also restore the sound of the live scene, so that the user can be better Feel the atmosphere of the scene and increase the user experience; for example, in the case of video conferencing, the microphone sensor array can truly restore the position of the video conference sound, so that the participants who participated in the panoramic image capturing device can participate in the discussion at the scene. There will be no sense of distance.
  • Embodiment 4 is a diagrammatic representation of Embodiment 4:
  • the panoramic image capturing device further includes a fixed connection module. Only the content of the fixed connection module is described in detail. For other parts of the panoramic image capturing device, refer to the second embodiment. Or the third embodiment.
  • the fixed connection module comprises a UAV connection component that can be fixed on the UAV and is connected to the UAV, a bracket connection component that can fix the connection bracket, a mobile terminal connection component that can be fixed on the mobile terminal and connects the communication interface of the mobile terminal, and At least one of wearable components for wear by a user.
  • the UAV connection component includes a connection unit and a fixing unit, and the connection unit can be connected to the UAV through a wired or wireless manner, so that the video captured by the panoramic image capturing device can be transmitted to the UAV, and then passed through The man-machine is transmitted to the control terminal;
  • the fixing unit may be a suction cup, a robot or a clamping structure.
  • the bracket connecting component comprises a fixing unit, and the fixing unit is generally arranged with the bracket.
  • the top of the bracket is provided with an extended connecting rod, and the connecting rod is provided with a thread, and the fixing unit of the bracket connecting component is provided.
  • the screw hole allows the panoramic image capturing device to be fixed to the connecting rod by the cooperation of the connecting rod and the screw hole.
  • the mobile terminal connection component includes a fixed unit and a connection interface.
  • the connection interface can be set according to the model of the mobile terminal.
  • the Android mobile phone generally uses a USB interface
  • the connection interface of the mobile terminal connection component can be set as a USB interface
  • the Apple mobile phone uses a Lightning C interface
  • the interface can be set to the Lightning C interface.
  • the fixing unit can be a clamping mechanism and can be clamped on the mobile terminal. In this way, the user can control the panoramic image capturing device through the mobile terminal, and also enable the panoramic image capturing device to be carried and used with him or her.
  • the wear fixing component may be a helmet that the user can wear on the head; or a glove, a bracelet, or the like, and the user can fix the panoramic image capturing device head to the arm.
  • connection module By fixing the connection module, the structure of the fixed connection module can be set according to actual needs, thereby fixing the panoramic image capturing device on different devices, so that the panoramic image capturing device has a wider application range.
  • Embodiment 5 is a diagrammatic representation of Embodiment 5:
  • a panoramic image capturing device of the present application comprising: a camera module 1 and a control module 2 .
  • the camera module 1 includes: a camera combination for capturing an image of a panoramic range for splicing into a panoramic image or a combination of at least two first cameras 11; at least one for capturing an image of a partial area within a panoramic range a second camera 12, wherein a sharpness of an image of a partial area captured by the second camera 12 is higher than a sharpness of an image captured by the first camera 11; and an image capturing main body 13, a first camera and a second camera are disposed in the image capturing body 13 on.
  • the control module 2 is connected to the camera module 1 for controlling the camera to perform shooting.
  • control module 2 can control shooting by setting a button on the panoramic image capturing device.
  • the control module 2 can also set a remote controller to control shooting in the panoramic image capturing device.
  • the control signal is sent by the remote controller, and the panoramic image capturing device performs an action after receiving the control signal through the wireless communication module, wherein the control signal can be a WIFI signal. , Bluetooth signal or 2G/3G/4G signal.
  • control module 2 controls the synchronous shooting of the camera to ensure that the time during shooting can be consistent.
  • both the first camera 11 and the second camera 12 can adjust the shooting focal length.
  • the control module 2 controls the first camera 11 and the second camera 12 to adjust the focal length.
  • the panoramic image may have two or more partial regions with different image definitions.
  • the type of the image clarity of the second camera 12 and the number of the second camera 12 can be set according to actual conditions, and are not limited herein. This allows you to capture images of more than one local area of interest in the panoramic range.
  • the panoramic image capture device further includes a sound collection module.
  • the sound collection module includes a microphone sensor disposed at a set position of the panoramic image capturing device or a microphone sensor array composed of the microphone sensor.
  • the specific structure of the sound collection module refer to the description of the second embodiment, which is not repeated here.
  • the panoramic image capture device further includes a fixed connection module.
  • the fixed connection module comprises a UAV connection component that can be fixed on the UAV and is connected to the UAV, a bracket connection component that can fix the connection bracket, a mobile terminal connection component that can be fixed on the mobile terminal and connects the communication interface of the mobile terminal, and At least one of wearable components for wear by a user.
  • the fixed connection module comprises a UAV connection component that can be fixed on the UAV and is connected to the UAV, a bracket connection component that can fix the connection bracket, a mobile terminal connection component that can be fixed on the mobile terminal and connects the communication interface of the mobile terminal, and At least one of wearable components for wear by a user.
  • the spliced panoramic image has at least two partial regions of different definitions, so that while acquiring the panoramic image, it is also possible to acquire an image with higher definition of the local area that the user needs to pay attention to, so that the user You can enjoy the advantages of the immersive experience brought by the panoramic image, and you can get a clearer image of the content you need to pay attention to, improve the user's shooting experience, and the cost is lower, and it is simpler to implement and convenient for users.
  • a panoramic image capturing apparatus of the present application includes: a camera module 1 and a control module 2 .
  • the camera module 1 includes: a camera combination for capturing an image of a panoramic range for splicing into a panoramic image or a combination of at least two first cameras 11; at least one for capturing an image of a partial area within a panoramic range a second camera 12, wherein the image of the partial area captured by the second camera 12 has higher definition than the image captured by the first camera 11; the camera body 13, the first camera 11 and the second camera 12 are disposed in the On the camera body 13.
  • the control module 2 is connected to the camera module 1 for controlling the camera to perform shooting.
  • the camera module includes a first camera 11 , at least one second camera 12 , and a camera body 13 .
  • the first camera 11 is a panoramic camera, and the first camera 11 is disposed at a center position of the top or bottom of the camera body 13 .
  • the second camera 12 is disposed on the panoramic image capturing device, and the control module 2 connects the first camera 11 and the second camera 12.
  • the first camera 11 is a panoramic camera, and the image in the panoramic range is captured.
  • the range of the wide angle of the first camera 11 is greater than 180° in the vertical direction and 360° in the horizontal direction.
  • the wide angle of shooting of the first camera 11 in the vertical direction is preferably 210° because the first camera 11 is disposed at the top of the panoramic image capturing device, so that the first camera 11 can capture an angle of 30° with the horizontal direction.
  • the upper image or video, and the second camera 12 has a shooting angle of view of 160°.
  • the second camera 12 can adjust the shooting focal length.
  • the control module 2 controls the second camera 12 to adjust the focal length.
  • the shape of the imaging body 13 may be a shape of a plurality of cylinders such as a cylinder, a rectangular parallelepiped, a cube, and a hexahedron, and is not limited thereto, and may be set according to actual conditions.
  • the first camera 11 is fixed to the top or bottom of the cylinder so that an image of a 360° range around the panoramic image capturing device can be captured, and the second camera 12 can be fixed to any side of the panoramic image capturing device body 13. Takes an image of a partial area of interest to the user within the panoramic range.
  • the second camera 12 is detachably fixed to the panoramic image capturing apparatus main body 13. Specifically, the second camera 12 is detachably fixed to different mounting positions by providing an installation position on the image pickup main body 13. Taking the imaging body 13 having a cubic shape as an example, the mounting position can be provided on all four sides of the cube, and the second camera 12 can be mounted on the mounting position of any of the front, rear, left, and right sides of the imaging body 13 according to the actual needs of the user.
  • the second camera 12 By providing the mounting position of the second camera 12 on the camera body 13, the second camera 12 can be mounted at different positions according to actual needs, which can more easily change the shooting direction of the second camera 12, and also makes the camera body A plurality of second cameras 12 can be installed so that the user can obtain more sharper images in more directions in the panoramic image.
  • the panoramic image capturing device further includes a sound collecting module and/or a fixed connection module, and the description is not repeated herein, and the above-mentioned contents are specifically referred to.
  • the panoramic image capturing apparatus further includes a rotating unit 14 disposed on the imaging body 13, the rotating unit 14 is rotatable relative to the imaging body 13, and the second camera 12 is disposed on the rotating unit. 14 to achieve the adjustment of the shooting direction.
  • the rotating unit 14 can adjust the direction of the second camera 12 by electric or manual manual means.
  • the camera body 13 is in the form of a cylinder.
  • the rotating unit 14 includes a motor and a turntable.
  • the motor is disposed at the bottom of the camera body 13.
  • the rotating shaft of the motor is perpendicular to the bottom surface of the camera body 13.
  • the rotating shaft of the motor is connected to the turntable.
  • the second camera 12 is fixed on the turntable, so that the turntable can be rotated by the driving of the motor, thereby changing the photographing direction of the second camera 12.
  • the rotating unit 14 includes a rotating shaft and a turntable. One end of the rotating shaft is fixed at the center of the bottom of the camera body 13.
  • the other end of the rotating shaft is fixedly connected to the center position of the turntable, and the rotating shaft is opposite to the camera body. 13 turns.
  • the second camera 12 is fixed to the side of the turntable.
  • a panoramic image capturing apparatus of the present application includes: a camera module 1 and a control module 2 .
  • the camera module 1 includes: a camera combination for capturing an image of a panoramic range for splicing into a panoramic image or a combination of at least two first cameras 11; at least one for capturing an image of a partial area within a panoramic range a second camera 12, wherein a sharpness of an image of a partial area captured by the second camera is higher than a sharpness of an image captured by the first camera; and an image capturing main body 13, a first camera and a second camera are disposed on the image capturing body 13.
  • the control module 2 is connected to the camera module 1 for controlling the camera to perform shooting.
  • the camera module includes a camera combination composed of two first cameras 11 , at least one second camera 12 , and an imaging body 13 .
  • the first camera 11 is a panoramic camera, wherein a first camera 11 is disposed on one side of the imaging body 13, another first camera 11 is disposed on the other side of the camera body 13 side, and the second camera 12 is disposed on the camera body. 13
  • the control module 2 connects the first camera 11 and the second camera 12 .
  • the panoramic camera captures a wide angle of 360 degrees vertically and a horizontal angle of 180 or more. In other embodiments, the panoramic camera can also be replaced with a fisheye camera.
  • the first camera 11 and the second camera 12 can adjust the shooting focal length.
  • the control module 2 controls the first camera 11 and the second camera 12 to adjust the focal length.
  • the shape of the imaging body 13 may be a shape of a plurality of cylinders such as a cylinder, a rectangular parallelepiped, a cube, a hexahedron, and the like, which is not limited herein, and may be set according to actual application conditions.
  • the second camera 12 is detachably fixed to the camera body 13. Specifically, the second camera 12 is detachably fixed to different mounting positions by providing an installation position on the image pickup main body 13. Taking the imaging body 13 having a cubic shape as an example, the mounting position can be provided on all four sides of the cube, and the second camera 12 can be mounted on the mounting position of any of the front, rear, left, and right sides of the imaging body 13 according to the actual needs of the user.
  • the second camera 12 By providing the mounting position of the second camera 12 on the camera body 13, the second camera 12 can be mounted at different positions according to actual needs, which can more easily change the shooting direction of the second camera 12, and also makes the camera body A plurality of second cameras 12 can be installed so that the user can obtain more high-definition content in the panoramic image.
  • the camera body 13 further includes a rotating unit 14 disposed on the camera body 13, the rotating unit 14 is rotatable relative to the camera body 13, and the second camera 12 is disposed on the rotating unit. 14 to achieve the adjustment of the shooting direction.
  • the rotating unit 14 can adjust the direction of the second camera 12 by electric or manual manual means.
  • the camera body 13 is in the form of a cylinder.
  • the rotating unit 14 includes a motor and a turntable.
  • the motor is disposed at the bottom of the camera body 13.
  • the rotating shaft of the motor is perpendicular to the bottom surface of the camera body 13.
  • the rotating shaft of the motor is connected to the turntable.
  • the second camera 12 is fixed on the turntable, so that the turntable can be rotated by the driving of the motor, thereby changing the photographing direction of the second camera 12.
  • the rotating unit 14 includes a rotating shaft and a turntable. One end of the rotating shaft is fixed at the center of the bottom of the camera body 13.
  • the other end of the rotating shaft is fixedly connected to the center position of the turntable, and the rotating shaft is opposite to the camera body. 13 turns.
  • the second camera 12 is fixed to the side of the turntable.
  • a panoramic image capturing device of the present application includes a camera module 1 and a control module 2 .
  • the camera module 1 includes: a camera combination for capturing an image of a panoramic range for splicing into a panoramic image or a combination of at least two first cameras 11; at least one for capturing an image of a partial area within a panoramic range a second camera 12, wherein a sharpness of an image of a partial area captured by the second camera is higher than a sharpness of an image captured by the first camera; and an image capturing main body 13, a first camera and a second camera are disposed on the image capturing body 13.
  • the control module 2 is connected to the camera module 1 for controlling the camera to perform shooting.
  • the camera module 1 includes a camera combination composed of a plurality of first cameras 11 disposed around the panoramic image capturing device, at least one second camera 12, and an imaging body 13.
  • the first camera 11 is circumferentially disposed on the imaging body 13.
  • the second camera 12 is disposed at any position on either side of the imaging body 13, and the control module 2 connects the first camera 11 and the second camera 12.
  • the imaging body 13 includes four first cameras 11 disposed on the imaging body 13, and the first cameras 11 are arranged at equal intervals on the same circumference. This allows panoramic shooting with a range of 360°.
  • the second camera 12 is disposed on either side of the imaging body 13.
  • the second camera 12 is detachably fixed to the camera body 13. Specifically, the second camera 12 is detachably fixed to different mounting positions by providing an installation position on the image pickup main body 13. Taking the imaging body 13 having a cubic shape as an example, the mounting position can be provided on all four sides of the cube, and the second camera 12 can be mounted on the mounting position of any of the front, rear, left, and right sides of the imaging body 13 according to the actual needs of the user.
  • the second camera 12 By providing the mounting position of the second camera 12 on the camera body 13, the second camera 12 can be mounted at different positions according to actual needs, which can more easily change the shooting direction of the second camera 12, and also makes the camera body A plurality of second cameras 12 can be installed so that the user can obtain more high-definition content in the panoramic image.
  • the camera body 13 further includes a rotating unit 14 disposed on the camera body 13 , the rotating unit 14 is rotatable relative to the camera body 13 , and the second camera 12 is disposed on the rotating unit 14 . Achieve adjustment of the shooting direction.
  • the rotating unit 14 can adjust the direction of the second camera 12 by electric or manual manual means.
  • the camera body 13 is in the form of a cylinder.
  • the rotating unit 14 includes a motor and a turntable.
  • the motor is disposed at the bottom of the camera body 13.
  • the rotating shaft of the motor is perpendicular to the bottom surface of the camera body 13.
  • the rotating shaft of the motor is connected to the turntable.
  • the second camera 12 is fixed on the turntable, so that the turntable can be rotated by the driving of the motor, thereby changing the photographing direction of the second camera 12.
  • the rotating unit 14 includes a rotating shaft and a turntable. One end of the rotating shaft is fixed at the center of the bottom of the camera body 13.
  • the other end of the rotating shaft is fixedly connected to the center position of the turntable, and the rotating shaft is opposite to the camera body. 13 turns.
  • the second camera 12 is fixed to the side of the turntable.
  • the imaging module 1 includes an imaging combination composed of a plurality of first cameras 11 , at least one second camera 12 , and an imaging body 13 .
  • the imaging body 13 has a spherical shape, and the first camera 11 and the second camera 12 are disposed on the imaging body. 13 on.
  • This embodiment is similar to the above several embodiments, except that the panoramic image capturing device is spherical, and the improvement based on this embodiment is not exemplified here. Please refer to the above example.
  • a panoramic image capturing device of the present application comprising: a camera module 1 and a control module 2 .
  • the camera module 1 includes: at least one first camera 11; at least one second camera 12 having a sharpness of the captured image higher than the sharpness of the image captured by the first camera, and the first camera 11 capturing an image of the panoramic range for splicing
  • the image is synthesized into a panoramic image; and the image pickup main body 13 is disposed on the image pickup main body 13.
  • the control module 2 is connected to the camera module 1 for controlling the camera to perform shooting.
  • the camera module includes four cameras, wherein the two first cameras 11 and the two second cameras 12 have a cube shape, and the first camera 11 is fixedly disposed on the front and rear of the camera body 13 respectively. On the side, the second cameras 12 are fixedly disposed on the left and right sides of the camera body 13, respectively.
  • the camera module 1 includes a second camera 12 , three first cameras 11 , the camera body 13 has a cylindrical shape, and the second camera 12 and the first camera 11 surround the camera body 13 .
  • Side setting the combination of the first camera 11 and the second camera 12 is not limited, and may be set according to actual conditions.
  • the imaging resolution of the second camera 2 may be various, for example, the imaging pixel of the first camera 1 may be 480P, and the imaging pixel of the second camera 2 may be 720P or 1080P.
  • the camera body 13 is spherical, and the camera body 13 includes a plurality of first cameras 11 and second cameras 12 that are simultaneously captured from various angles.
  • the first camera 11 and the second camera 12 are disposed on the spherical camera body 13 .
  • a plurality of positions constitute a camera combination for capturing a panoramic image.
  • the camera is detachably fixed to the camera body 13.
  • the first camera 11 and the second camera 12 are detachably fixed to the imaging body 13.
  • the camera module 1 includes two first cameras 11 and two second cameras 12.
  • the initial combination is that the front and rear sides of the camera body 13 are the first camera 11, and the left and right sides are the second camera 12, which can be removed by the user.
  • the first camera 11 and the second camera 12 change their combination, such as mounting the first camera 11 on the front side and the left side of the image pickup main body 13, and mounting the second camera 12 on the rear side and the right side of the image pickup main body 13.
  • control module 2 can control shooting by setting a button on the panoramic image capturing device.
  • the control module 2 can also set a remote controller to control shooting in the panoramic image capturing device.
  • the control signal is sent by the remote controller, and the panoramic image capturing device performs an action after receiving the control signal through the wireless communication module, wherein the control signal can be a WIFI signal. , Bluetooth signal or 2G/3G/4G signal.
  • control module 2 controls the synchronous shooting of the camera to ensure that the time during shooting can be consistent.
  • the first camera 11 and the second camera 12 combine to capture a panoramic image. Since the shooting resolution of the second camera 12 is higher than that of the first camera 11, the sharpness of the image captured by the second camera 12 in the panoramic image is higher than that of the other regions in the panoramic range.
  • the number of the second cameras 12 may be one or more, so that the stitched panoramic image may have at least one image area with higher definition than other areas, and the user may pay attention to a plurality of interesting contents in the panoramic image.
  • the type of photographing sharpness of the second camera 12 may also have two or more types, so that the panoramic area image screen may have various definitions, such as image areas of two or more kinds of sharpness. Therefore, the type of the sharpness of the captured image of the second camera 12 and the number of the second camera 12 can be set according to actual conditions, and are not limited herein.
  • the first way is to adjust the sharpness of the image captured by the second camera, so that the sharpness of the image captured by the second camera 12 is consistent with the sharpness of the image captured by the first camera 11, or the image captured by the second camera 12.
  • the sharpness is higher than the sharpness of the image captured by the first camera 11 of the imaging main body 13.
  • the second mode is that the second camera 12 is an adjustable focus shooting camera, and the control module 2 of the camera body 13 can control the second camera 12 to adjust the shooting focal length, so that the shooting focal length of the second camera is consistent with the shooting focal length of the first camera 11 .
  • the second camera 12 is caused to capture a focal length higher than the shooting focal length of the first camera 11.
  • the panoramic image capture device further includes a sound collection module.
  • the sound collection module includes a microphone sensor disposed at a set position of the camera body 13 or a microphone sensor array composed of a microphone sensor.
  • the specific structure of the sound collection module refer to the description of the second embodiment, which is not repeated here.
  • the panoramic image capture device further includes a fixed connection module.
  • the fixed connection module comprises a UAV connection component that can be fixed on the UAV and is connected to the UAV, a bracket connection component that can fix the connection bracket, a mobile terminal connection component that can be fixed on the mobile terminal and connects the communication interface of the mobile terminal, and At least one of wearable components for wear by a user.
  • the fixed connection module comprises a UAV connection component that can be fixed on the UAV and is connected to the UAV, a bracket connection component that can fix the connection bracket, a mobile terminal connection component that can be fixed on the mobile terminal and connects the communication interface of the mobile terminal, and At least one of wearable components for wear by a user.
  • the panoramic image can be acquired, and the image area of interest to the user in the panoramic range can be made to have higher definition, so that the user can obtain the panoramic image and enjoy the immersive image brought by the panoramic image.
  • the advantage of the experience can also enable the user to obtain a clearer image of the content that needs attention, enhance the user's shooting experience, and the cost is lower, and the implementation is relatively simple and convenient for the user to use.
  • a panoramic image display device of the present application includes:
  • the interaction module 4 is configured to allow the user to select a display area to be displayed in the panoramic image through an interaction action, and is connected to the processing module 3.
  • a processing module 3 which is connected to the camera module 1 for processing and stitching the image captured by the camera module 1 into a panoramic image, so that the panoramic image has a single sharpness or the panoramic image has at least two different definitions Local area of degree.
  • the display module 5 is configured to connect to the processing module 3 according to the processing result of the processing module 3.
  • the display module 5 processes and combines the images captured by the camera module into a single-resolution panoramic image for the user to select; the processing module 3 determines the display area selected by the interaction action and the local area captured by the camera with high definition of the captured image. Whether the image has an intersection area, and if so, the processing module 3 splices the image corresponding to the intersection area to the image corresponding to the display area according to the corresponding position of the image corresponding to the intersection area on the panoramic image, and the display module 5 displays the image corresponding to the display area.
  • the image corresponding to the intersection area is included, so that the image corresponding to the display area has at least two partial areas of different definitions; otherwise, the image corresponding to the display area still maintains a single definition.
  • the processing module 3 determines whether the interaction action satisfies the setting condition, and if yes, splicing the image corresponding to the intersection area to the image corresponding to the display area, otherwise, displaying the image corresponding to the display area remains Single clarity.
  • the interaction may be implemented by setting a sensor to detect an action of the user setting part, a gesture recognition technology, and setting at least one of the input devices.
  • the setting condition is whether the interactive action maintains the selection action setting time, whether the display range of the interaction action selection and the intersection range of the partial region are set values, or whether the interaction action performs the set operation.
  • an image in a panoramic range is captured by a combination of a first camera 11 or a first camera 11, and a partial area image of interest of the user in the panoramic range is captured by the second camera 12.
  • the panoramic image capturing apparatus can obtain two types of code streams, one is the first code stream of the image captured by the first camera 11 or the first camera 11 array, and the other is the partial area image obtained by the second camera 12 Two streams.
  • the processing module 3 encodes the first code stream and then splices the processing. Therefore, the display module 5 displays the panoramic image formed by the splicing of the first code stream.
  • the interaction module 4 monitors the interaction of the user.
  • the processing module 3 corresponds to the image corresponding to the intersection area according to the image on the panoramic image.
  • Position, the splicing of the second code stream and the first code stream is implemented, and the content displayed by the display module 5 includes the image corresponding to the second code stream indicating the intersection area and the image spliced corresponding to the first code stream.
  • the second way is to capture a panoramic range of images by a combination of cameras consisting of two or more cameras, at least one of which captures images with a higher definition than the rest of the cameras.
  • the code stream obtained by the panoramic image capturing device includes two types, one is the first code stream obtained by the first camera 11 capturing the image, and the other is the second camera 12 capturing the image to obtain the second code stream.
  • the processing module 3 adjusts the image resolution of the second code stream to the image clarity of the first code stream according to the interaction.
  • the control module 2 adjusts the shooting focal length of the second camera, so that the second camera can acquire the same image sharpness code stream as the first camera to achieve the image sharpness of the first code stream and the second code stream.
  • the first code stream of the processing module 3 and the adjusted second code stream are spliced, so that the image clarity of the panoramic image displayed by the display module 5 is consistent.
  • the interaction module 4 detects that the display area selected by the interaction action has an intersection area with the local area captured by the second camera 12, the processing module 3 implements the second code stream according to the corresponding position of the image corresponding to the intersection area on the panoramic image.
  • the splicing of a code stream, the content displayed by the display module 5 includes the image corresponding to the second code stream indicating the intersection area and the image spliced corresponding to the first code stream.
  • the panoramic image is displayed on the interactive interface of the mobile terminal as an example for description.
  • the interaction interface of the mobile terminal displays the initial state of the panoramic image.
  • the interaction module 4 monitors the interaction of the user, and when the interaction selection is detected,
  • the processing module 3 compares the second code stream according to the corresponding position of the image corresponding to the intersection area on the panoramic image.
  • the first stream is spliced such that the interactive interface displays the enlarged local area image with higher definition while displaying the panoramic image.
  • the interactive action is to move the image.
  • the interaction module 4 detects that the image related to the local area is moved to the interactive interface, that is, when the content displayed by the display module 5 includes the partial area image
  • the processing module 3 is based on the local area image.
  • the proportion occupied by the interactive interface splices the second code stream representing the intersection area with the first code stream, so that the interactive interface displays an image in which a part of the area is clear to the rest of the area.
  • the application of the virtual reality display device will be described as an example.
  • the display area in which the panoramic image is viewed that is, the display window moves in accordance with the moving direction of the head, when the display window and the partial area captured by the second camera 12 have an intersection area , judging the length of time the display window stays, when the window stays longer than the set value, it is considered that the user is interested in the part of the content, the panoramic image changes, and the second code stream is decompressed and the first code stream
  • the splicing is performed such that the image of the panoramic image involving the intersection area is sharper relative to the portion of the image captured by the first camera, and therefore, the window viewing the panoramic image sees at least two images of different definitions.
  • the processing module 3 continues to decode the second code stream and splicing with the first code stream.
  • the present application provides an image processing system including: a panoramic image capturing device and a panoramic image display device as described above.
  • the image processing system is applied to a virtual reality display device.
  • the panoramic image capturing device captures a panoramic image at an event, a concert, or a meeting site, and captures an image of a set region within the panoramic range by the sharpness panoramic image capturing device that captures the image, and then the panoramic image capturing device compresses and transmits the camera for shooting.
  • the code of the image is streamed to the virtual reality display device.
  • the head-mounted virtual reality display device receives the compressed code stream, and the interaction module 4 of the head-mounted virtual reality display device monitors the user's interaction.
  • the virtual reality display device monitors a gesture or a head motion of the user. For example, when the user's head motion moves from left to right, the interaction module 4 of the virtual reality display device monitors the movement of the user's head motion and involves an image of the set region.
  • the local area in the panoramic image range selected according to the direction of the user's head is displayed, the corresponding partial area image is displayed, wherein the process of display is gradually changed from unclear to clear, so that the user may finally see the picture.
  • the live broadcast or playback of the live situation of the event, concert or conference is realized, and the user can obtain the panoramic image through the virtual reality display device, and also obtain the high-definition image of the region that is more concerned in the panoramic range.
  • the user can obtain an immersive effect like a concert or a performance at a concert through this virtual reality display device. Therefore, while giving the user an immersive effect, the device enables the user to focus on the content of the event, concert or meeting without losing the real atmosphere of the scene, making the playing effect more realistic and the experience better.
  • the technical solutions of the present application have a wide range of applications, and are not limited to the above applications, and also include fields such as personal sports, live events, live broadcasts, and on-site monitoring.
  • the user can wear the panoramic image capturing device by wearing the fixing component, so that during the movement, the surrounding environment can be changed during the movement, and the user's own can be clearly recorded.
  • the state of motion which increases the user's enjoyment of exercise and enhances the user's shooting experience.
  • a method for photographing a panoramic image of the present application includes:
  • Step S101 setting a camera module, the camera module includes at least two cameras, and the camera captures images in a panoramic range for splicing into a panoramic image, wherein at least one camera captures images with higher definition than the remaining cameras;
  • the camera module includes: a camera combination for capturing a panoramic range image for splicing into a panoramic image or a camera combination composed of at least two first cameras; at least one image for capturing a partial area within the panoramic range
  • the second camera wherein the image of the local area captured by the second camera has higher definition than the image captured by the first camera; the camera body, the first camera and the second camera are disposed on the camera body.
  • the camera module includes: at least one first camera; at least one second camera that can adjust the sharpness of the captured image to be higher than the sharpness of the image captured by the first camera, and the first camera captures the image of the panoramic range For splicing into a panoramic image; and a camera body, the first camera and the second camera are disposed on the camera body.
  • the method further includes: adjusting the sharpness of the image captured by the second camera or controlling the shooting focal length of the second camera when the panoramic image has a single sharpness, so that the second camera Consistent with the sharpness of the image captured by the first camera; when the panoramic image has at least two partial regions of different resolution, controlling the second camera to adjust the shooting focal length so that the image captured by the second camera is sharper than the first camera The clarity of the image.
  • Step S102 setting a control module, and the control module controls the camera module to perform shooting.
  • control module controls the camera of the camera module to perform synchronous shooting, so as to ensure that the images captured by the camera can be synchronized in time series.
  • an image display method of the present application includes:
  • Step S201 processing the image captured by the camera module and splicing into a single-resolution panoramic image for the user to select.
  • Step S202 Select a display area to be displayed in the panoramic image by an interactive action.
  • the interaction may be implemented by setting a sensor to detect an action of the user setting part, a gesture recognition technology, and setting at least one of the input devices.
  • the orientation can be realized by setting the orientation sensor and monitoring the orientation action to which the head is rotated.
  • the interaction can be achieved by the binocular camera recognizing the gesture.
  • Step S203 It is judged whether the display area selected by the interactive action and the partial area photographed by the camera with high definition of the captured image have an intersection area.
  • Step S204 If the display area and the local area have an intersection area, further determine whether the interaction action satisfies the setting condition, and if yes, skip to step S205; otherwise, the image corresponding to the display display area still maintains a single definition.
  • the setting condition may be whether the interaction action maintains the selection action setting time, whether the display range of the interaction action selection and the intersection area of the local area captured by the camera with high definition of the captured image are set values, or Whether the interactive action performs the set operation.
  • the head action acts as an interactive action
  • the user's head is directed to the local area 5S of the camera with high definition of the captured image
  • the user is deemed to have selected the area.
  • the user selects the local area as the display area as long as the user's head motion is toward the boundary of the local area captured by the camera with high definition of the captured image.
  • Step S205 According to the corresponding position of the image corresponding to the intersection area on the panoramic image, the image captured by the camera with high definition of the intersection image corresponding to the intersection area is spliced onto the image corresponding to the display area, and the image corresponding to the display area is displayed, wherein The image corresponding to the display area has at least two partial regions of different definitions. Otherwise, the image corresponding to the display display area maintains a single sharpness.
  • the image showing the partial area is gradually changed from the image sharpness with the remaining area to the image sharpness higher than the remaining area.
  • the image display method of the present application will be described below by taking a head-mounted virtual reality device as an example.
  • the user views a single-resolution panoramic image through the head-mounted virtual reality device, and the user selects a display area to be displayed in the panoramic image by moving the head motion, which is also detected by the gyroscope in the head-mounted virtual reality device.
  • the change in the direction of the user's head, the image displayed in the display area of the head-mounted virtual reality device also follows the change.
  • the change of the gesture can be recognized by the binocular camera recognition technology to control the change of the display area. For example, if the gesture is detected to slide from left to right, the display area also slides from the left side to the right side of the panoramic image.
  • the interaction action satisfies the set condition.
  • the user's head motion stays in a certain area setting time, it is determined that the interaction action satisfies the setting condition.
  • the user can confirm the selection of the area as the display area by using the confirmation button on the remote control.
  • the interaction may be considered to satisfy the set condition as long as the display area and the local area intersect.
  • the image corresponding to the intersection area is spliced to the image corresponding to the display area according to the corresponding position of the image corresponding to the intersection area on the panoramic image, and the image corresponding to the displayed display area includes the intersection area corresponding to the image.
  • the image is such that the image corresponding to the display area has at least two partial regions of different definition.
  • the image corresponding to the display area may be half-clear or half-clear, or may have multiple sharpness images.
  • the image corresponding to the display area When the image corresponding to the display area is displayed, if the corresponding image has at least two partial regions of different definition, when displaying, the image of the local region with higher definition is changed from the image clarity corresponding to the rest of the image to Higher image clarity.
  • An image capturing apparatus of the present application includes: a camera module, the camera module includes at least two cameras, and the camera captures images for splicing into a panoramic image, wherein at least one camera captures images with higher definition than the remaining cameras; and controls Module for controlling the module to control the camera module for shooting.
  • An image display apparatus of the present application includes: a processing module for processing an image captured by the camera module and splicing into a single-resolution panoramic image for selection by a user; and an interaction module for selecting a panoramic image through an interactive action a display area; a judging module, configured to determine whether the display area selected by the interaction action and the local area photographed by the camera with high definition of the captured image have an intersection area; and a display module, if yes, the processing module according to the intersection area Corresponding position of the corresponding image on the panoramic image, the image captured by the camera with high definition of the intersection image corresponding to the intersection area is spliced onto the image corresponding to the display area, and the image corresponding to the display area is displayed, wherein the image corresponding to the display area A local area having at least two different sharpnesses, otherwise the image corresponding to the display display area maintains a single sharpness.
  • the application can also be applied to a drone or a robot, which is not limited herein, and can be set according to a specific situation.
  • the beneficial effects of the present application are: capturing a panoramic image by a camera or a combination of cameras, and having at least one captured image having a higher resolution than a camera of the remaining cameras to capture a partial area image within the panoramic range, so that at least the panoramic image can be made
  • Two kinds of local image of different definitions while acquiring the panoramic image, acquire the image with higher definition of the local area, so that the user can obtain the panoramic image and enjoy the immersive experience brought by the panoramic image.
  • the advantage also enables the user to obtain a clearer image of the content that needs attention, enhances the user's shooting experience, and is simpler to implement, lower in cost, and convenient for the user to use.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)
  • Stereoscopic And Panoramic Photography (AREA)

Abstract

L'invention concerne un procédé photographique d'image panoramique consistant à : agencer deux appareils photo ou plus pour photographier des images dans une plage panoramique, et assembler les images photographiques en une image panoramique, une image photographiée par au moins l'un des appareils photo étant plus nette qu'une image photographiée par un appareil photo restant. L'invention concerne en outre un procédé d'affichage d'image panoramique consistant à : afficher une image panoramique à sélectionner par un utilisateur; sélectionner une zone d'affichage selon une opération interactive; déterminer si une zone d'intersection est présente entre la zone d'affichage sélectionnée par l'opération interactive et une zone partielle; et si tel est le cas, assembler une image correspondant à la zone d'intersection avec une image correspondant à la zone d'affichage. L'invention concerne en outre un dispositif photographique d'image panoramique et un dispositif d'affichage d'image panoramique. L'application peut être utilisée pour acquérir une image panoramique et une image haute définition au niveau d'une zone partielle, et par conséquent, un utilisateur peut acquérir l'image panoramique pour bénéficier d'une couverture complète d'un champ de vision fourni par l'image panoramique, et voir des détails dans une image claire et nette au niveau de la zone partielle, améliorant l'expérience utilisateur avec une photographie à moindre coût.
PCT/CN2018/073474 2017-01-21 2018-01-19 Procédé photographique d'image panoramique, procédé d'affichage d'image panoramique, dispositif photographique d'image panoramique et dispositif d'affichage d'image panoramique WO2018133849A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710046846.2 2017-01-21
CN201710046846.2A CN108347556A (zh) 2017-01-21 2017-01-21 全景图像拍摄方法、全景图像显示方法、全景图像拍摄装置以及全景图像显示装置

Publications (1)

Publication Number Publication Date
WO2018133849A1 true WO2018133849A1 (fr) 2018-07-26

Family

ID=62908980

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/073474 WO2018133849A1 (fr) 2017-01-21 2018-01-19 Procédé photographique d'image panoramique, procédé d'affichage d'image panoramique, dispositif photographique d'image panoramique et dispositif d'affichage d'image panoramique

Country Status (2)

Country Link
CN (1) CN108347556A (fr)
WO (1) WO2018133849A1 (fr)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110264180A (zh) * 2019-05-31 2019-09-20 安徽中科智链信息科技有限公司 一种基于长焦距摄像头的扫描支付系统及方法
CN113114819A (zh) * 2021-04-20 2021-07-13 Oppo广东移动通信有限公司 全景拍摄方法、电子装置和可读存储介质
CN113808022A (zh) * 2021-09-22 2021-12-17 南京信息工程大学 一种基于端侧深度学习的手机全景拍摄与合成方法
CN114079768A (zh) * 2020-08-18 2022-02-22 杭州海康汽车软件有限公司 图像的清晰度测试方法及装置
CN114938417A (zh) * 2022-05-12 2022-08-23 安徽声讯信息技术有限公司 一种面向网页的高拍仪图像采集系统及图像采集方法

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109801211B (zh) * 2018-12-19 2022-08-12 中德（珠海）人工智能研究院有限公司 一种基于全景相机的目标物消除方法
CN111917904B (zh) * 2019-05-10 2022-05-06 深圳富泰宏精密工业有限公司 控制方法及电子装置
CN111586341A (zh) * 2020-05-20 2020-08-25 深圳随锐云网科技有限公司 一种视频会议拍摄装置拍摄方法和画面显示方法
TWI735237B (zh) * 2020-05-22 2021-08-01 茂傑國際股份有限公司 ３６０度全景影像選擇顯示之攝影機及方法
CN112601007B (zh) * 2020-11-11 2022-06-28 联想(北京)有限公司 一种特征区域的图像采集方法及设备
CN113014871B (zh) * 2021-02-20 2023-11-10 青岛小鸟看看科技有限公司 内窥镜图像显示方法、装置及内窥镜手术辅助系统
CN114115525B (zh) * 2021-10-29 2022-11-18 北京城市网邻信息技术有限公司 信息显示方法、装置、设备及存储介质
CN114125179B (zh) * 2021-12-07 2024-04-05 维沃移动通信有限公司 拍摄方法和装置
CN114827673B (zh) * 2022-04-24 2023-12-01 北京北航天宇长鹰无人机科技有限公司 无人设备及其远程控制系统
CN115484334A (zh) * 2022-09-02 2022-12-16 维沃移动通信有限公司 便携式电子设备及其控制方法

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020063711A1 (en) * 1999-05-12 2002-05-30 Imove Inc. Camera system with high resolution image inside a wide angle view
CN101616260A (zh) * 2008-06-27 2009-12-30 索尼株式会社 信号处理装置、信号处理方法、程序和记录介质
CN104125433A (zh) * 2014-07-30 2014-10-29 西安冉科信息技术有限公司 基于多球机联动结构的视频运动目标监控方法
CN104349044A (zh) * 2013-08-09 2015-02-11 联想(北京)有限公司 全景图像的拍摄方法及电子设备
CN206524898U (zh) * 2017-01-21 2017-09-26 深圳市为创视讯智能有限责任公司 全景图像拍摄装置以及图像处理系统
CN206533440U (zh) * 2017-01-21 2017-09-29 深圳市为创视讯智能有限责任公司 应用于全景图像拍摄装置的摄像模块、全景图像拍摄装置以及图像处理系统

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101707671A (zh) * 2009-11-30 2010-05-12 杭州普维光电技术有限公司 一种全景摄像机与ptz摄像机联动控制方法和装置
EP2590396B1 (fr) * 2010-07-02 2018-08-08 Sony Interactive Entertainment Inc. Système de traitement d'informations et procédé de traitement d'informations
US8913142B2 (en) * 2012-04-18 2014-12-16 Sony Corporation Context aware input system for focus control
US20130329004A1 (en) * 2012-06-06 2013-12-12 Apple Inc. Method of and Apparatus for Image Enhancement
CN103543831A (zh) * 2013-10-25 2014-01-29 梁权富 头戴式全景播放装置
CN104052931A (zh) * 2014-06-27 2014-09-17 宇龙计算机通信科技(深圳)有限公司 一种图像拍摄装置、方法及终端
CN104349063B (zh) * 2014-10-27 2018-05-15 东莞宇龙通信科技有限公司 一种控制摄像头拍摄的方法、装置及终端
US9898868B2 (en) * 2014-11-06 2018-02-20 Seiko Epson Corporation Display device, method of controlling the same, and program
CN105741239B (zh) * 2014-12-11 2018-11-30 合肥美亚光电技术股份有限公司 牙齿全景图像的生成方法、装置及用于拍摄牙齿的全景机
GB2536025B (en) * 2015-03-05 2021-03-03 Nokia Technologies Oy Video streaming method
US9977241B2 (en) * 2015-03-17 2018-05-22 Seiko Epson Corporation Head-mounted display device, control method for head-mounted display device, and computer program
CN105187726B (zh) * 2015-06-17 2021-05-18 巽腾(广东)科技有限公司 一种多功能移动图像处理装置、处理方法
CN105049569A (zh) * 2015-08-20 2015-11-11 擎亚国际贸易（上海）有限公司 基于手机前后摄像头的全景照片合成方法
CN105739525B (zh) * 2016-02-14 2019-09-03 普宙飞行器科技（深圳）有限公司 一种配合体感操作实现虚拟飞行的系统
CN105979224A (zh) * 2016-06-23 2016-09-28 青岛歌尔声学科技有限公司 一种头戴显示器、视频输出设备和视频处理方法、系统

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020063711A1 (en) * 1999-05-12 2002-05-30 Imove Inc. Camera system with high resolution image inside a wide angle view
CN101616260A (zh) * 2008-06-27 2009-12-30 索尼株式会社 信号处理装置、信号处理方法、程序和记录介质
CN104349044A (zh) * 2013-08-09 2015-02-11 联想(北京)有限公司 全景图像的拍摄方法及电子设备
CN104125433A (zh) * 2014-07-30 2014-10-29 西安冉科信息技术有限公司 基于多球机联动结构的视频运动目标监控方法
CN206524898U (zh) * 2017-01-21 2017-09-26 深圳市为创视讯智能有限责任公司 全景图像拍摄装置以及图像处理系统
CN206533440U (zh) * 2017-01-21 2017-09-29 深圳市为创视讯智能有限责任公司 应用于全景图像拍摄装置的摄像模块、全景图像拍摄装置以及图像处理系统

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110264180A (zh) * 2019-05-31 2019-09-20 安徽中科智链信息科技有限公司 一种基于长焦距摄像头的扫描支付系统及方法
CN114079768A (zh) * 2020-08-18 2022-02-22 杭州海康汽车软件有限公司 图像的清晰度测试方法及装置
CN114079768B (zh) * 2020-08-18 2023-12-05 杭州海康汽车软件有限公司 图像的清晰度测试方法及装置
CN113114819A (zh) * 2021-04-20 2021-07-13 Oppo广东移动通信有限公司 全景拍摄方法、电子装置和可读存储介质
CN113114819B (zh) * 2021-04-20 2023-09-01 Oppo广东移动通信有限公司 全景拍摄方法、电子装置和可读存储介质
CN113808022A (zh) * 2021-09-22 2021-12-17 南京信息工程大学 一种基于端侧深度学习的手机全景拍摄与合成方法
CN113808022B (zh) * 2021-09-22 2023-05-30 南京信息工程大学 一种基于端侧深度学习的手机全景拍摄与合成方法
CN114938417A (zh) * 2022-05-12 2022-08-23 安徽声讯信息技术有限公司 一种面向网页的高拍仪图像采集系统及图像采集方法
CN114938417B (zh) * 2022-05-12 2023-10-17 安徽声讯信息技术有限公司 一种面向网页的高拍仪图像采集系统及图像采集方法

Also Published As

Publication number Publication date
CN108347556A (zh) 2018-07-31

Similar Documents

Publication Publication Date Title
WO2018133849A1 (fr) Procédé photographique d'image panoramique, procédé d'affichage d'image panoramique, dispositif photographique d'image panoramique et dispositif d'affichage d'image panoramique
CN206524898U (zh) 全景图像拍摄装置以及图像处理系统
WO2018133848A1 (fr) Dispositif de photographie d'image panoramique, dispositif d'affichage, procédé de photographie et procédé d'affichage
CA2949005C (fr) Procede et systeme destines a une production televisee a faible cout
US9965026B2 (en) Interactive video display method, device, and system
JP7123523B2 (ja) 自動的にテレビ番組を制作する方法及びシステム
CN108337497B (zh) 一种虚拟现实视频/图像格式以及拍摄、处理、播放方法和装置
EP3206398B1 (fr) Dispositif de caméra stéréoscopique
JP5428210B2 (ja) 情報処理装置、撮像システム、録画制御方法及びプログラム
CN206533440U (zh) 应用于全景图像拍摄装置的摄像模块、全景图像拍摄装置以及图像处理系统
WO2021012855A1 (fr) Système et procédé de génération d'image panoramique et procede de génération d'image panoramique
CN106507094B (zh) 校正全景视频显示视角的方法及装置
JPWO2017200049A1 (ja) 撮像装置およびその設定画面
WO2014162324A1 (fr) Système omnidirectionnel sphérique pour le tournage d'une vidéo
JP2014529930A (ja) ネイティブ画像の一部の選択的キャプチャとその表示
JP2000032319A (ja) カメラ制御システム、カメラ制御方法、カメラ制御装置、及びこれらに用いる画像処理装置、記録媒体
US20110157394A1 (en) Image processing apparatus, image processing method and program
JP2011188163A (ja) 撮像制御装置、撮像制御方法
JP2012080431A (ja) パノラマ画像表示装置およびパノラマ画像表示方法
WO2011013562A9 (fr) Dispositif de commande, procédé de commande et programme de commande
CN108259921A (zh) 一种基于场景切换的多角度直播系统及切换方法
CN105939497B (zh) 媒体串流系统及媒体串流方法
US20130044258A1 (en) Method for presenting video content on a hand-held electronic device
JP2022102923A (ja) バーチャルスタジオシステム
WO2020206647A1 (fr) Procédé et appareil pour commander, au moyen du suivi du mouvement d'utilisateur, la lecture d'un contenu vidéo

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18741253

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 20.11.2019)

122 Ep: pct application non-entry in european phase

Ref document number: 18741253

Country of ref document: EP

Kind code of ref document: A1

点击 这是indexloc提供的php浏览器服务，不要输入任何密码和下载