+

WO2018157616A1 - Display method, and terminal - Google Patents

Display method, and terminal Download PDF

Info

Publication number
WO2018157616A1
WO2018157616A1 PCT/CN2017/108874 CN2017108874W WO2018157616A1 WO 2018157616 A1 WO2018157616 A1 WO 2018157616A1 CN 2017108874 W CN2017108874 W CN 2017108874W WO 2018157616 A1 WO2018157616 A1 WO 2018157616A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
terminal
display
eye
unit
Prior art date
Application number
PCT/CN2017/108874
Other languages
French (fr)
Chinese (zh)
Inventor
张如龙
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2018157616A1 publication Critical patent/WO2018157616A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/70Protecting specific internal or peripheral components, in which the protection of a component leads to protection of the entire computer
    • G06F21/82Protecting input, output or interconnection devices
    • G06F21/84Protecting input, output or interconnection devices output devices, e.g. displays or monitors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/544Buffers; Shared memory; Pipes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4023Scaling of whole images or parts thereof, e.g. expanding or contracting based on decimating pixels or lines of pixels; based on inserting pixels or lines of pixels
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/46Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
    • G06V10/462Salient features, e.g. scale invariant feature transforms [SIFT]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/21Combinations with auxiliary equipment, e.g. with clocks or memoranda pads
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/725Cordless telephones

Definitions

  • the present invention relates to the field of communications, and in particular, to a display method and a terminal.
  • the display methods of existing smart terminals are usually designed with anti-peeping technology.
  • the display method of the existing smart terminal includes: the terminal lowers the brightness of the screen to a brightness that can not be easily seen by others, but the user can normally use; or the terminal improves the difficulty of being peeked through an improved design of the appearance or material; or The terminal detects the person who may be voyeating through the camera to achieve the effect of voyeur warning.
  • the display method of the existing smart terminal cannot completely prevent the display content of the terminal screen from being peeked.
  • the embodiment of the present invention is to provide a display method and a terminal, which can prevent the display content of the terminal screen from being sneaked, and improve the security of the screen display.
  • An embodiment of the present invention provides a display method, where the method is applied to an eye-wearing device, including:
  • the first image is a content including a terminal display screen and an environment image currently located therein, wherein the terminal display screen content is that the terminal is in an anti-peep mode
  • Identifying a display area in the first image, the display area being in the first image The screen display area of the terminal;
  • Preprocessing the second image combining the preprocessed second image into the display area, generating a final display image, completing an image synthesis process, and displaying the final display image.
  • the acquiring the first image specifically includes:
  • the first image is acquired by an imaging device, and the imaging device is disposed on the eye-wearing device.
  • the identifying the display area in the first image specifically includes:
  • the display area is identified by presetting the image features of the terminal.
  • the method further includes:
  • the N final display images are obtained through N image synthesis processes, the final display image is in one-to-one correspondence with the image synthesis process, and the N is greater than or equal to 2;
  • a final display video is generated and played according to the N final display images.
  • An embodiment of the present invention provides a display method, where the method is applied to a terminal, including:
  • the second image is obtained, and the second image is the real content hidden by the terminal display screen, and the anti-peep mode is a state in which the display screen of the terminal hides the real display content;
  • the second image is transmitted to the eyewear device while in a connected state with the eyewear device.
  • the method before the acquiring the second image, the method further includes:
  • the anti-peep mode is turned on according to the received open command.
  • the method before the sending the second image to the eye-wearing device, the method further includes:
  • a connection is established with the eye-wearing device via a network.
  • Embodiments of the present invention provide an eye-wearing device, which includes an acquiring unit and a receiving device.
  • Receiving unit, identifying unit and synthesizing unit wherein:
  • the acquiring unit is configured to acquire a first image when the terminal is in a connected state, where the first image is an environment image including a terminal display content and a current environment image thereof, wherein the terminal display content is The content displayed by the terminal in the anti-peep mode;
  • the receiving unit is configured to receive a second image sent by the terminal, where the second image is real content hidden by the terminal display screen;
  • the identification unit is configured to identify a display area in the first image acquired by the acquiring unit, where the display area is a screen display area of the terminal in the first image;
  • the synthesizing unit is configured to preprocess the second image received by the receiving unit, merge the pre-processed second image into the display area, generate a final display image, and complete an image synthesizing process. And displaying the final display image.
  • the acquiring unit is specifically configured to:
  • the first image is acquired by an imaging device, and the imaging device is disposed on the eye-wearing device.
  • the identification unit is specifically configured to:
  • the display area is identified by presetting the image features of the terminal.
  • the acquiring unit is further configured to acquire N pieces of the final display image after the synthesizing unit generates a final display image, where the N final display images are synthesized by N pieces of the image Obtained by the process, the final display image is in one-to-one correspondence with the image synthesis process, and the N is greater than or equal to 2;
  • the synthesizing unit is further configured to generate a final display video and play according to the N final display images.
  • An embodiment of the present invention provides a terminal, where the terminal includes an acquiring unit and a sending unit, where:
  • the acquiring unit is configured to acquire a second image when the anti-peeping mode is in use, where the second image is real content hidden by the terminal display screen, and the anti-peeping mode is The display screen of the terminal hides the state of the real display content;
  • the transmitting unit is configured to send the second image acquired by the acquiring unit to the eye-wearing device when in a connected state with the eye-wearing device.
  • the terminal further includes an opening unit, configured to enable the anti-peeping mode according to the received opening instruction before the acquiring unit acquires the second image.
  • the terminal further includes a connection unit configured to establish a connection with the eye-wearing device through the network before the transmitting unit transmits the second image to the eye-wearing device.
  • a storage medium is further provided, and the storage medium may store an execution instruction for performing the implementation of the display method in the foregoing embodiment.
  • the embodiment of the present invention provides a display method and a terminal.
  • the eye-wearing device acquires a first image when the terminal device is in a connected state, and the first image is an environment image including the terminal display content and the current environment image thereof.
  • the content of the terminal display is the content displayed by the terminal in the anti-peep mode; the second image sent by the receiving terminal is the real content hidden by the terminal display screen; the display area in the first image is recognized, and the display area is displayed. It is a screen display area of the terminal in the first image; the second image is preprocessed, the preprocessed second image is merged into the display area, the final display image is generated, the image synthesis process is completed, and the final display image is displayed.
  • the final display image is generated by the eye-wearing device connected to the terminal, the display content of the terminal screen is prevented from being peeked, and the security of the screen display is improved.
  • FIG. 1 is a schematic flowchart 1 of a display method according to an embodiment of the present invention.
  • FIG. 2 is a schematic diagram of a first image according to an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of a second image according to an embodiment of the present disclosure.
  • FIG. 4 is a schematic diagram of a display area in a first image according to an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of a final display image according to an embodiment of the present invention.
  • FIG. 6 is a schematic flowchart 2 of a display method according to an embodiment of the present disclosure.
  • FIG. 7 is a schematic flowchart 3 of a display method according to an embodiment of the present disclosure.
  • FIG. 8 is a schematic flowchart 4 of a display method according to an embodiment of the present disclosure.
  • FIG. 9 is a schematic flowchart 5 of a display method according to an embodiment of the present disclosure.
  • FIG. 10 is a schematic diagram of an interaction process of a display method according to an embodiment of the present disclosure.
  • FIG. 11 is a schematic structural diagram of an eye-wearing device according to an embodiment of the present invention.
  • FIG. 12 is a schematic structural diagram 1 of a terminal according to an embodiment of the present disclosure.
  • FIG. 13 is a schematic structural diagram 2 of a terminal according to an embodiment of the present disclosure.
  • FIG. 14 is a schematic structural diagram 3 of a terminal according to an embodiment of the present invention.
  • FIG. 1 is a schematic flowchart 1 of a display method according to an embodiment of the present invention.
  • the display method is applied to an eye-wearing device. Referring to FIG. 1, the method includes:
  • Step 101 Acquire a first image when the terminal is in a connected state, where the first image is an environment image including the terminal display content and the current environment, wherein the terminal display content is displayed by the terminal in the anti-peep mode. content;
  • the eye-wearing device can be connected to the terminal through a network, for example, a network such as Bluetooth or a wireless local area network, and when the eye-wearing device is connected to the terminal, the image of the environment in which the terminal is currently located is obtained by photographing or the like. An image.
  • a network for example, a network such as Bluetooth or a wireless local area network
  • the terminal is in the anti-peeping mode, and therefore, the terminal user needs to browse the terminal display screen by means of the eye-wearing device.
  • the content displayed by the terminal in the anti-peep mode includes the content that the terminal brightness is lower than the preset brightness; or the brightness is zero, that is, it is in a black screen state; or the terminal hides and displays the real thing.
  • the content, such as the terminal displays the encrypted or processed image, for example, the other person sees the cartoon image, and the terminal real content is the communication record. In this way, the people around the terminal cannot see the content displayed by the terminal, thereby eliminating the possibility that the terminal is peeked by the non-terminal user.
  • the first image is an environment image currently viewed by the terminal, and the first image is also a terminal image observed by the non-terminal user.
  • the first image is a matrix formed of pixels having different pixel values.
  • the eyewear device acquires the first image, and specifically includes: acquiring the first image by using the imaging device, and the camera device is disposed on the eyewear device.
  • the eye-wearing device can capture the first image by taking a video of the dual camera set by itself.
  • the video captured by the dual camera is 60 Hz
  • one frame is a first image, wherein the first image includes anti-peeping.
  • Terminal display image in mode is not specifically limited in the embodiment of the present invention.
  • Step 102 Receive a second image sent by the terminal, where the second image is the real content hidden by the terminal display screen;
  • the eye-wearing device receives the second image sent by the terminal about the real content hidden by the terminal display screen in real time, for example, the other person sees the cartoon image, and the terminal real content, that is, the second image is the communication record. .
  • the eye-wearing device can know the content currently displayed on the terminal display in real time, so that the content currently displayed on the terminal display screen is presented to the user terminal through subsequent processing.
  • the eye-wearing device can connect to the terminal through a network such as WiFi (Wireless Fidelity), Bluetooth, or wireless local area network, and receive the second image sent by the terminal.
  • a network such as WiFi (Wireless Fidelity), Bluetooth, or wireless local area network.
  • WiFi Wireless Fidelity
  • Bluetooth Wireless Fidelity
  • wireless local area network wireless local area network
  • the auxiliary program in Figure 3 can be Accessories, the calculator can be Calculator, the calendar can be Calendar, the phone can be Call+, the camera can be Camera, the browser can be Chrome, the clock can be Clock, the contact can Is Contacts, documentation Can be Docs, download can be Downloads, driver can be Drive, mail can be Email, file manager can be File Manager, red board can be Flipboard, radio can be FM Radio, picture can be Gallery, Google can be Gmail, Google can be Google, Google+ can be Google+, and Hangouts can be Hangouts; as shown in Figure 3, the second image includes what is currently displayed on the terminal display. Specifically, the second image is a matrix having different pixel values, and the pixel values are distributed in a matrix on the terminal display screen.
  • the terminal can convert the pixel value into an array, and send the array to the eye-wearing device through a data connection method, such as a Socket connection method, and after the eye-wearing device receives the array, the array is restored to a second pixel value including the terminal screen. image.
  • a data connection method such as a Socket connection method
  • Step 103 Identify a display area in the first image, where the display area is a screen display area of the terminal in the first image;
  • the eye-wearing device needs to recognize that the brightness in the first image is low.
  • the terminal screen display area is for subsequent image processing of the display area, so that the user can present the complete final display image including the content currently displayed on the terminal display screen to the user through the eye-wearing device.
  • the display area in the first image is the selected portion of the white solid line frame in FIG.
  • the eyewear device identifies the display area in the first image, and specifically includes: identifying the display area by using the image feature of the preset terminal.
  • the eye-wearing device is capable of recognizing the display area using the image features of the preset terminal.
  • the image features of the preset terminal include regular quadrilateral features, the color of the terminal screen area is black, the color of the terminal screen border, and the position of the terminal front camera.
  • the eye-wearing device identifies the terminal by presetting the image feature of the terminal, wherein the terminal screen is a regular quadrilateral in the first image, the color of the terminal screen region is black, the color of the terminal screen border, and the position of the terminal front camera;
  • the terminal screen is then identified by an image recognition algorithm, such as a Scale-invariant feature transform (SIFT).
  • SIFT Scale-invariant feature transform
  • the feature is the local feature of the image, which has good invariance to translation, rotation, scale scaling, brightness variation, occlusion and noise, and maintains a certain degree of stability for visual changes and affine transformations.
  • the speed is relatively fast and optimized.
  • the Sift matching algorithm can even meet real-time requirements; it has good uniqueness and rich information, and is suitable for fast and accurate matching in massive feature database.
  • the Sift feature matching algorithm mainly includes two stages, one is the generation of Sift features, that is, the feature vectors irrelevant to scale scaling, rotation and brightness change are extracted from the first image; the second stage is the matching of Sift feature vectors.
  • Step 104 Preprocess the second image, merge the preprocessed second image into the display area, generate a final display image, complete the image synthesis process, and display the final display image.
  • the eye-wearing device pre-processes the second image such that the image region size of the second image is consistent with the image region size of the display region in the first image, so that the pre-processed second image can be integrated into the first image.
  • the image generated at this time includes both the second image of the content currently displayed by the terminal display screen and the first image of the environment in which the terminal is currently located, and the image generated by the eye-wearing device at this time is the terminal user.
  • an image synthesis process includes the process of steps 101-104, and the eye-wearing device completes an image synthesis process to generate a final display image.
  • the eye-wearing device pre-processes the second image, and may appropriately scale the second image to fit the scaled second image into the display area to generate a final display image. .
  • the eye-wearing device needs to scale the second image to a corresponding display area in the first image. For example, if the display area needs to be reduced, the eye-wearing device can average the four pixel points into one pixel. Point, the partial pixel area is reduced; if the display area needs to be enlarged, the eye-wearing device can achieve the purpose of amplification by inserting the average of the two pixels between adjacent pixels.
  • the method further includes steps 105-106:
  • Step 105 Acquiring N final display images, the N final display images are obtained through N image synthesis processes, and the final display image is in one-to-one correspondence with the image synthesis process, and N is greater than or equal to 2;
  • Step 106 Generate a final display video and play according to the N final display images.
  • an image synthesis process includes the process of steps 101-104, and the eye-wearing device completes an image synthesis process to generate a final display image. Therefore, the eye-wearing device obtains N final display images through N image synthesis processes; and further generates a final display video according to the N final display images and displays them to the user. That is to say, only the user of the terminal connected to the eye-wearing device can obtain the final display video through the eye-wearing device, thus eliminating the possibility that the terminal is peeked by the non-terminal user.
  • the eye-wearing device can perform N image synthesis processes at a preset frequency, for example, a frequency of 60 Hz, that is, the process of step 101-step 104 is performed N times repeatedly, so that the terminal screen can be displayed to the terminal user in real time.
  • the content is such that the end user can normally see the content of the terminal screen, while the non-terminal user sees the terminal in a state of low brightness, thereby achieving the anti-peeping effect of the terminal.
  • the display method provided by the embodiment of the present invention can be applied to various scenarios. For example, when the subway is on the subway, the terminal user is surrounded by people. If the user operates the terminal, the surrounding person can clearly see it. Chu, at this time, you can wear anti-peeping effects through eye-wearing equipment.
  • FIG. 7 is a schematic flowchart of a display method according to an embodiment of the present disclosure.
  • the display method is applied to a terminal. Referring to FIG. 7, the method includes:
  • Step 201 When in the anti-peep mode, obtain a second image, where the second image is the real content hidden by the terminal display, and the anti-peep mode is a state in which the display screen of the terminal hides the real display content;
  • the terminal display screen in the anti-peep mode hides the real display content, for example, the brightness of the terminal display screen is lower than the preset brightness, or the brightness is zero, that is, the black screen state, or the terminal hides and displays the real content, such as the terminal.
  • Display encrypted or processed images for example For example, other people see a cartoon image, and the real content of the terminal is a communication record. In this way, the people around the terminal cannot see the content displayed by the terminal, thereby eliminating the possibility that the terminal is peeked by the non-terminal user.
  • the method further includes the step 200, specifically:
  • Step 200 Turn on the anti-peeping mode according to the received opening instruction.
  • the anti-peep mode is a state in which the brightness of the terminal is lower than the preset brightness, the mobile phone operates normally, the screen display function is turned off or the brightness is adjusted to the minimum, and the screen touch input function is normal. At this time, the scene seen by others is as shown in FIG. 1 . Shown.
  • Step 202 Send the second image to the eye-wearing device while in the connected state with the eye-wearing device.
  • step 2021 specifically:
  • Step 2021 Establish a connection with the eye-wearing device through the network.
  • the terminal can be connected to the eye-wearing device through a network such as wifi, Bluetooth, or wireless LAN.
  • a network such as wifi, Bluetooth, or wireless LAN.
  • the terminal can also connect the eye-wearing device in other manners, which is not specifically limited in this embodiment of the present invention.
  • the display method provided by the embodiment of the present invention sets the terminal to the anti-peep mode, that is, the terminal is in the off-screen state or the terminal screen brightness is lowered to a state invisible to the human eye, and the terminal device is browsed through the eye-wearing device connected to the terminal. Content and secure operation of the terminal.
  • FIG. 10 is a schematic diagram of an interaction process of a display method according to an embodiment of the present invention. Referring to FIG. 10, the method includes:
  • Step 301 The terminal starts the anti-peep mode according to the received opening instruction.
  • the anti-peep mode of the terminal is a state in which the brightness of the terminal is lower than the preset brightness. It should be noted that when the terminal is in the anti-peep mode, the terminal screen can only touch the input and does not display the output.
  • Step 302 The terminal establishes a connection with the eye-wearing device.
  • Step 303 The eye-wearing device acquires the image A through the built-in camera device
  • the image A is the first image of the environment image in which the terminal is currently located, and the image A is a matrix A formed by pixels having different pixel values.
  • the matrix A is as follows:
  • Step 304 The terminal acquires the image B, and sends the image B to the eye-wearing device;
  • the image B is a second image that is currently displayed on the terminal display screen, and is specifically a matrix B formed by pixels having different pixel values.
  • Matrix B is as follows:
  • Step 305 The eyewear device recognizes the display area B' in the image A;
  • the display area B' is a screen display area of the terminal in the image A, specifically a matrix B' formed by pixels having different pixel values.
  • the area with a value of 1 in the matrix B' is the area B' space, the area with the value 0 is the non-area B' space, and the matrix B' is as follows:
  • Step 306 After the eye-wearing device performs the scaling process on the image B, the zoom-processed image is merged into the matrix B' to obtain the image A';
  • the eye-wearing device will merge the scaled image into the non-zero portion of the matrix B' to obtain A', and the matrix A' of the image A' is as follows:
  • Step 307 The eye-wearing device obtains the final display image C according to the image A' and the image A and displays the image C.
  • the eye-wearing device replaces the non-zero portion of the matrix A' with the matrix A to obtain the final display image C, and the matrix C of the image C is as follows:
  • the eye-wearing device can prevent the display content of the terminal screen from being sneaked by displaying the finally generated image C to the end user, thereby improving the security of the screen display.
  • the display method provided by the embodiment of the present invention acquires a first image when the terminal is in a connected state, the first image is an environment image currently located by the terminal; the second image sent by the terminal is received, and the second image is a terminal display The currently displayed content; the display area in the first image is identified, and the display area is a screen display area of the terminal in the first image; the second image is preprocessed, and the preprocessed second image is merged into the display area to generate The image is finally displayed.
  • the technical solution of the embodiment of the invention can prevent the display content of the terminal screen from being sneaked, thereby improving the security of the screen display.
  • FIG. 11 is a schematic structural diagram of an eye-wearing device according to an embodiment of the present invention.
  • the eye-wearing device 11 includes an acquiring unit 111, a receiving unit 112, an identifying unit 113, and a synthesizing unit 114, where:
  • the obtaining unit 111 is configured to acquire the first image when the terminal is connected to the terminal, An image includes a content of the terminal display screen and an environment image currently located therein, wherein the content of the terminal display screen is content displayed by the terminal in the anti-peep mode;
  • the receiving unit 112 is configured to receive the second image sent by the terminal, where the second image is the real content hidden by the terminal display screen;
  • the identification unit 113 is configured to identify a display area in the first image acquired by the obtaining unit 111, where the display area is a screen display area of the terminal in the first image;
  • the synthesizing unit 114 is configured to preprocess the second image received by the receiving unit 112, merge the preprocessed second image into the display area, generate a final display image, complete the image synthesizing process, and display the final display image.
  • the acquiring unit 111 is specifically configured to: acquire the first image by using the imaging device, and set the imaging device on the eye-wearing device.
  • the identifying unit 113 is specifically configured to: identify the display area by using an image feature of the preset terminal.
  • the obtaining unit 111 is further configured to: after the synthesizing unit 114 generates the final display image, acquire N final display images, where the N final display images are obtained through N image synthesizing processes, and finally display the image and image synthesizing process.
  • N is greater than or equal to 2;
  • the synthesizing unit 114 is also arranged to generate a final display video and play according to the N final display images.
  • the obtaining unit 111, the receiving unit 112, the identifying unit 113, and the synthesizing unit 114 may be implemented by a processor located on the eye-wearing device, specifically a central processing unit (CPU), a microprocessor (MPU), and a digital signal processor. (DSP) or field programmable gate array (FPGA) implementation.
  • the eye-wearing device further includes a memory connectable to the processor on the terminal through the system bus, wherein the memory is used to store executable program code, the program code includes computer operating instructions, and the memory may include high-speed RAM memory, or Also included is a non-volatile memory, such as at least one disk storage.
  • FIG. 12 is a schematic structural diagram of a terminal according to an embodiment of the present invention.
  • the terminal 12 includes an obtaining unit 121 and a sending unit 122, where:
  • the obtaining unit 121 is configured to acquire a second image when the anti-peep mode is in use, where the second image is the real content hidden by the terminal display screen, and the anti-peep mode is a state in which the display screen of the terminal hides the real display content;
  • the transmitting unit 122 is configured to transmit the second image acquired by the obtaining unit 121 to the eye-wearing device when the eye-wearing device is in a connected state.
  • the terminal further includes an opening unit 123 configured to enable the anti-peeping mode according to the received opening instruction before the acquiring unit 121 acquires the second image.
  • the terminal further includes a connection unit 124 configured to establish a connection with the eye-wearing device through the network before the sending unit 122 sends the second image to the eye-wearing device.
  • a connection unit 124 configured to establish a connection with the eye-wearing device through the network before the sending unit 122 sends the second image to the eye-wearing device.
  • the terminal in the embodiment of the present invention includes a smart phone, a smart home appliance, a tablet computer, and the like.
  • the obtaining unit 121, the sending unit 12, the opening unit 123, and the connecting unit 124 may be implemented by a processor located on the terminal, specifically a central processing unit (CPU), a microprocessor (MPU), and a digital signal processor (DSP). ) or field programmable gate array (FPGA) implementation.
  • the terminal further includes a memory connectable to the processor on the terminal through the system bus, wherein the memory is used to store executable program code, the program code includes computer operating instructions, the memory may include high speed RAM memory, and may also include A non-volatile memory, such as at least one disk storage.
  • embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention can take the form of a hardware embodiment, a software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) including computer usable program code.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
  • the embodiment of the present invention provides a display method and a terminal.
  • the eye-wearing device acquires a first image when the terminal device is in a connected state, and the first image is an environment image including the terminal display content and the current environment image thereof.
  • the content of the terminal display is the content displayed by the terminal in the anti-peep mode; the second image sent by the receiving terminal is the real content hidden by the terminal display screen; the display area in the first image is recognized, and the display area is displayed. It is a screen display area of the terminal in the first image; the second image is preprocessed, the preprocessed second image is merged into the display area, the final display image is generated, the image synthesis process is completed, and the final display image is displayed.
  • the final display image is generated by the eye-wearing device connected to the terminal, the display content of the terminal screen is prevented from being sneaked, and the screen display is improved. safety.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Hardware Design (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Data Mining & Analysis (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Computation (AREA)
  • Evolutionary Biology (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

Provided are a display method and a terminal. The method comprises: when in a connected state with a terminal, acquiring a first image, wherein the first image is an image comprising terminal display screen content and the environment where the terminal is currently located, and the terminal display screen content is content displayed by the terminal when same is in an anti-peep mode (step 101); receiving a second image sent by the terminal, wherein the second image is real content displayed by the terminal display screen in a hidden way currently (step 102); identifying a display region in the first image, wherein the display region is a screen display region, in the first image, of the terminal (step 103); and pre-processing the second image, combining the second image after being pre-processed into the display region to generate a final display image, accomplishing an image synthesis process and displaying the final display image (step 104). According to the present invention, display content on a terminal screen can be prevented from being peeped, and screen display security is improved.

Description

一种显示方法及终端Display method and terminal 技术领域Technical field
本发明涉及通信领域,尤其涉及一种显示方法及终端。The present invention relates to the field of communications, and in particular, to a display method and a terminal.
背景技术Background technique
目前,人们越来越关注个人隐私问题,为了避免用户使用智能终端时的个人隐私泄露问题,现有的智能终端的显示方法通常采用防偷窥技术进行设计。At present, people pay more and more attention to personal privacy issues. In order to avoid personal privacy leakage when users use smart terminals, the display methods of existing smart terminals are usually designed with anti-peeping technology.
现有的智能终端的显示方法,包括:终端将屏幕亮度调低至别人无法轻易看见,但用户能够正常使用的亮度;或者,终端通过外观或材料上的改进设计,增加被偷窥的难度;或者,终端通过摄像头检测周围可能偷窥的人,达到偷窥预警的效果。The display method of the existing smart terminal includes: the terminal lowers the brightness of the screen to a brightness that can not be easily seen by others, but the user can normally use; or the terminal improves the difficulty of being peeked through an improved design of the appearance or material; or The terminal detects the person who may be voyeating through the camera to achieve the effect of voyeur warning.
然而,现有的智能终端的显示方法并不能完全避免终端屏幕显示内容被人偷窥。However, the display method of the existing smart terminal cannot completely prevent the display content of the terminal screen from being peeked.
发明内容Summary of the invention
为解决上述技术问题,本发明实施例期望提供一种显示方法及终端,能够避免终端屏幕的显示内容被偷窥,提高了屏幕显示的安全性。In order to solve the above technical problem, the embodiment of the present invention is to provide a display method and a terminal, which can prevent the display content of the terminal screen from being sneaked, and improve the security of the screen display.
本发明的技术方案是这样实现的:The technical solution of the present invention is implemented as follows:
本发明实施例提供了一种显示方法,所述方法应用于眼戴设备,包括:An embodiment of the present invention provides a display method, where the method is applied to an eye-wearing device, including:
在与终端处于连接状态时,获取第一图像,所述第一图像为包括终端显示屏内容及其当前所处的环境图像,其中,所述终端显示屏内容为所述终端处于防偷窥模式下所显示的内容;Obtaining a first image when the terminal is in a connection state, where the first image is a content including a terminal display screen and an environment image currently located therein, wherein the terminal display screen content is that the terminal is in an anti-peep mode The content displayed;
接收所述终端发送的第二图像,所述第二图像为终端显示屏当前所隐藏显示的真实内容;Receiving a second image sent by the terminal, where the second image is real content hidden by the terminal display screen;
识别所述第一图像中的显示区域,所述显示区域为所述第一图像中所 述终端的屏幕显示区域;Identifying a display area in the first image, the display area being in the first image The screen display area of the terminal;
对所述第二图像进行预处理,将所述预处理后的第二图像合入所述显示区域,生成最终显示图像,完成图像合成流程,并显示所述最终显示图像。Preprocessing the second image, combining the preprocessed second image into the display area, generating a final display image, completing an image synthesis process, and displaying the final display image.
在上述方案中,所述获取第一图像,具体包括:In the above solution, the acquiring the first image specifically includes:
通过摄像装置获取所述第一图像,所述摄像装置设置于所述眼戴设备上。The first image is acquired by an imaging device, and the imaging device is disposed on the eye-wearing device.
在上述方案中,所述识别所述第一图像中的显示区域,具体包括:In the above solution, the identifying the display area in the first image specifically includes:
利用预设所述终端的图像特征识别所述显示区域。The display area is identified by presetting the image features of the terminal.
在上述方案中,在所述生成最终显示图像之后,所述方法还包括:In the above solution, after the generating the final display image, the method further includes:
获取N个所述最终显示图像,所述N个最终显示图像为经过N个所述图像合成流程获得的,所述最终显示图像与所述图像合成流程一一对应,所述N大于等于2;Obtaining the N final display images, the N final display images are obtained through N image synthesis processes, the final display image is in one-to-one correspondence with the image synthesis process, and the N is greater than or equal to 2;
根据所述N个最终显示图像生成最终显示视频并播放。A final display video is generated and played according to the N final display images.
本发明实施例提供了一种显示方法,所述方法应用于终端,包括:An embodiment of the present invention provides a display method, where the method is applied to a terminal, including:
在处于防偷窥模式时,获取第二图像,所述第二图像为所述终端显示屏当前所隐藏显示的真实内容,所述防偷窥模式为所述终端的显示屏隐藏真实显示内容的状态;When in the anti-peep mode, the second image is obtained, and the second image is the real content hidden by the terminal display screen, and the anti-peep mode is a state in which the display screen of the terminal hides the real display content;
在与眼戴设备处于连接状态时,将所述第二图像发送至所述眼戴设备。The second image is transmitted to the eyewear device while in a connected state with the eyewear device.
在上述方案中,在所述获取第二图像之前,所述方法还包括:In the above solution, before the acquiring the second image, the method further includes:
根据接收的开启指令,开启所述防偷窥模式。The anti-peep mode is turned on according to the received open command.
在上述方案中,在所述将所述第二图像发送至所述眼戴设备之前,所述方法还包括:In the above solution, before the sending the second image to the eye-wearing device, the method further includes:
通过网络与所述眼戴设备建立连接。A connection is established with the eye-wearing device via a network.
本发明实施例提供了一种眼戴设备,所述眼戴设备包括获取单元、接 收单元、识别单元和合成单元,其中:Embodiments of the present invention provide an eye-wearing device, which includes an acquiring unit and a receiving device. Receiving unit, identifying unit and synthesizing unit, wherein:
所述获取单元,设置为在与终端处于连接状态时,获取第一图像,所述第一图像为包括终端显示屏内容及其当前所处的环境图像,其中,所述终端显示屏内容为所述终端处于防偷窥模式下所显示的内容;The acquiring unit is configured to acquire a first image when the terminal is in a connected state, where the first image is an environment image including a terminal display content and a current environment image thereof, wherein the terminal display content is The content displayed by the terminal in the anti-peep mode;
所述接收单元,设置为接收所述终端发送的第二图像,所述第二图像为所述终端显示屏当前所隐藏显示的真实内容;The receiving unit is configured to receive a second image sent by the terminal, where the second image is real content hidden by the terminal display screen;
所述识别单元,设置为识别所述获取单元获取的所述第一图像中的显示区域,所述显示区域为所述第一图像中所述终端的屏幕显示区域;The identification unit is configured to identify a display area in the first image acquired by the acquiring unit, where the display area is a screen display area of the terminal in the first image;
所述合成单元,设置为对所述接收单元接收的所述第二图像进行预处理,将所述预处理后的第二图像合入所述显示区域,生成最终显示图像,完成图像合成流程,并显示所述最终显示图像。The synthesizing unit is configured to preprocess the second image received by the receiving unit, merge the pre-processed second image into the display area, generate a final display image, and complete an image synthesizing process. And displaying the final display image.
在上述眼戴设备中,所述获取单元具体设置为:In the above-mentioned eye-wearing device, the acquiring unit is specifically configured to:
通过摄像装置获取所述第一图像,所述摄像装置设置于所述眼戴设备上。The first image is acquired by an imaging device, and the imaging device is disposed on the eye-wearing device.
在上述眼戴设备,所述识别单元具体设置为:In the above eye-wearing device, the identification unit is specifically configured to:
利用预设所述终端的图像特征识别所述显示区域。The display area is identified by presetting the image features of the terminal.
在上述眼戴设备中,所述获取单元还设置为,在所述合成单元生成最终显示图像之后,获取N个所述最终显示图像,所述N个最终显示图像为经过N个所述图像合成流程获得的,所述最终显示图像与所述图像合成流程一一对应,所述N大于等于2;In the above eye-wearing device, the acquiring unit is further configured to acquire N pieces of the final display image after the synthesizing unit generates a final display image, where the N final display images are synthesized by N pieces of the image Obtained by the process, the final display image is in one-to-one correspondence with the image synthesis process, and the N is greater than or equal to 2;
所述合成单元还设置为根据所述N个最终显示图像生成最终显示视频并播放。The synthesizing unit is further configured to generate a final display video and play according to the N final display images.
本发明实施例提供了一种终端,所述终端包括获取单元和发送单元,其中:An embodiment of the present invention provides a terminal, where the terminal includes an acquiring unit and a sending unit, where:
所述获取单元,设置为在处于防偷窥模式时,获取第二图像,所述第二图像为所述终端显示屏当前所隐藏显示的真实内容,所述防偷窥模式为 所述终端的显示屏隐藏真实显示内容的状态;The acquiring unit is configured to acquire a second image when the anti-peeping mode is in use, where the second image is real content hidden by the terminal display screen, and the anti-peeping mode is The display screen of the terminal hides the state of the real display content;
所述发送单元,设置为在与眼戴设备处于连接状态时,将所述获取单元获取的所述第二图像发送至所述眼戴设备。The transmitting unit is configured to send the second image acquired by the acquiring unit to the eye-wearing device when in a connected state with the eye-wearing device.
在上述终端中,所述终端还包括开启单元,设置为在所述获取单元获取所述第二图像之前,根据接收的开启指令,开启所述防偷窥模式。In the above terminal, the terminal further includes an opening unit, configured to enable the anti-peeping mode according to the received opening instruction before the acquiring unit acquires the second image.
在上述终端中,所述终端还包括连接单元,设置为在所述发送单元将所述第二图像发送至所述眼戴设备之前,通过网络与所述眼戴设备建立连接。In the above terminal, the terminal further includes a connection unit configured to establish a connection with the eye-wearing device through the network before the transmitting unit transmits the second image to the eye-wearing device.
在本发明实施例中,还提供了一种存储介质,该存储介质可以存储有执行指令,该执行指令用于执行上述实施例中的显示方法的实现。In the embodiment of the present invention, a storage medium is further provided, and the storage medium may store an execution instruction for performing the implementation of the display method in the foregoing embodiment.
本发明实施例提供了一种显示方法及终端,通过在与终端处于连接状态时,眼戴设备获取第一图像,第一图像为包括终端显示屏内容及其当前所处的环境图像,其中,终端显示屏内容为终端处于防偷窥模式下所显示的内容;接收终端发送的第二图像,第二图像为终端显示屏当前所隐藏显示的真实内容;识别第一图像中的显示区域,显示区域为第一图像中终端的屏幕显示区域;对第二图像进行预处理,将预处理后的第二图像合入显示区域,生成最终显示图像,完成图像合成流程,并显示最终显示图像。采用本发明实施例的技术方案,由于通过与终端连接的眼戴设备来生成最终显示图像,因此避免了终端屏幕的显示内容被偷窥,提高了屏幕显示的安全性。The embodiment of the present invention provides a display method and a terminal. The eye-wearing device acquires a first image when the terminal device is in a connected state, and the first image is an environment image including the terminal display content and the current environment image thereof. The content of the terminal display is the content displayed by the terminal in the anti-peep mode; the second image sent by the receiving terminal is the real content hidden by the terminal display screen; the display area in the first image is recognized, and the display area is displayed. It is a screen display area of the terminal in the first image; the second image is preprocessed, the preprocessed second image is merged into the display area, the final display image is generated, the image synthesis process is completed, and the final display image is displayed. According to the technical solution of the embodiment of the present invention, since the final display image is generated by the eye-wearing device connected to the terminal, the display content of the terminal screen is prevented from being peeked, and the security of the screen display is improved.
附图说明DRAWINGS
图1为本发明实施例提供的一种显示方法的流程示意图一;1 is a schematic flowchart 1 of a display method according to an embodiment of the present invention;
图2为本发明实施例提供的第一图像的示意图;2 is a schematic diagram of a first image according to an embodiment of the present invention;
图3为本发明实施例提供的第二图像的示意图;FIG. 3 is a schematic diagram of a second image according to an embodiment of the present disclosure;
图4为本发明实施例提供的第一图像中显示区域的示意图;4 is a schematic diagram of a display area in a first image according to an embodiment of the present invention;
图5为本发明实施例提供的最终显示图像的示意图; FIG. 5 is a schematic diagram of a final display image according to an embodiment of the present invention; FIG.
图6为本发明实施例提供的一种显示方法的流程示意图二;FIG. 6 is a schematic flowchart 2 of a display method according to an embodiment of the present disclosure;
图7为本发明实施例提供的一种显示方法的流程示意图三;FIG. 7 is a schematic flowchart 3 of a display method according to an embodiment of the present disclosure;
图8为本发明实施例提供的一种显示方法的流程示意图四;FIG. 8 is a schematic flowchart 4 of a display method according to an embodiment of the present disclosure;
图9为本发明实施例提供的一种显示方法的流程示意图五;FIG. 9 is a schematic flowchart 5 of a display method according to an embodiment of the present disclosure;
图10为本发明实施例提供的一种显示方法的交互流程示意图;FIG. 10 is a schematic diagram of an interaction process of a display method according to an embodiment of the present disclosure;
图11为本发明实施例提供的一种眼戴设备的结构示意图;FIG. 11 is a schematic structural diagram of an eye-wearing device according to an embodiment of the present invention;
图12为本发明实施例提供的一种终端的结构示意图一;FIG. 12 is a schematic structural diagram 1 of a terminal according to an embodiment of the present disclosure;
图13为本发明实施例提供的一种终端的结构示意图二;FIG. 13 is a schematic structural diagram 2 of a terminal according to an embodiment of the present disclosure;
图14为本发明实施例提供的一种终端的结构示意图三。FIG. 14 is a schematic structural diagram 3 of a terminal according to an embodiment of the present invention.
具体实施方式detailed description
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述。The technical solutions in the embodiments of the present invention will be clearly and completely described in the following with reference to the accompanying drawings.
实施例一Embodiment 1
图1为本发明实施例提供的一种显示方法的流程示意图一,该显示方法应用于眼戴设备,参见图1所示,方法包括:1 is a schematic flowchart 1 of a display method according to an embodiment of the present invention. The display method is applied to an eye-wearing device. Referring to FIG. 1, the method includes:
步骤101:在与终端处于连接状态时,获取第一图像,第一图像为包括终端显示屏内容及其当前所处的环境图像,其中,终端显示屏内容为终端处于防偷窥模式下所显示的内容;Step 101: Acquire a first image when the terminal is in a connected state, where the first image is an environment image including the terminal display content and the current environment, wherein the terminal display content is displayed by the terminal in the anti-peep mode. content;
实际应用中,眼戴设备可以通过网络,例如,蓝牙、无线局域网等网络与终端进行连接,并在眼戴设备与终端处于连接状态时,通过拍摄等方式获取终端当前所处的环境图像即第一图像。In an actual application, the eye-wearing device can be connected to the terminal through a network, for example, a network such as Bluetooth or a wireless local area network, and when the eye-wearing device is connected to the terminal, the image of the environment in which the terminal is currently located is obtained by photographing or the like. An image.
需要说明的是,若眼戴设备与终端处于连接状态,说明该终端处于防偷窥模式,因此,终端用户需要借助眼戴设备来浏览终端显示屏。可以理解的,终端处于防偷窥模式下所显示的内容,包括终端亮度低于预设亮度所显示的内容;或者亮度为零,即处于黑屏状态;或者终端隐藏显示真实 内容,比如终端显示加密后的或处理后的图像,例如:其他人看得是卡通图像,而终端真实内容是通信记录。如此一来,使得终端周围的人无法看见终端所显示的内容,从而杜绝了终端被非终端用户偷窥的可能性。It should be noted that if the eye-wearing device is in a connected state with the terminal, the terminal is in the anti-peeping mode, and therefore, the terminal user needs to browse the terminal display screen by means of the eye-wearing device. It can be understood that the content displayed by the terminal in the anti-peep mode includes the content that the terminal brightness is lower than the preset brightness; or the brightness is zero, that is, it is in a black screen state; or the terminal hides and displays the real thing. The content, such as the terminal displays the encrypted or processed image, for example, the other person sees the cartoon image, and the terminal real content is the communication record. In this way, the people around the terminal cannot see the content displayed by the terminal, thereby eliminating the possibility that the terminal is peeked by the non-terminal user.
需要补充的是,参考图2所示,第一图像为终端用户所观察到的终端当前所处的环境图像,另外,第一图像也为非终端用户所观察到的终端图像。It should be added that, as shown in FIG. 2 , the first image is an environment image currently viewed by the terminal, and the first image is also a terminal image observed by the non-terminal user.
实际应用中,第一图像为由具有不同像素值的像素点形成的矩阵。In practical applications, the first image is a matrix formed of pixels having different pixel values.
示例性的,眼戴设备获取第一图像,具体包括:通过摄像装置获取第一图像,摄像装置设置于眼戴设备上。For example, the eyewear device acquires the first image, and specifically includes: acquiring the first image by using the imaging device, and the camera device is disposed on the eyewear device.
可理解的,眼戴设备内置的摄像装置的数量越多,眼戴设备获得的第一图像越清晰真实。举例来说,眼戴设备可以通过自身设置的双摄像头拍摄视频获取第一图像,例如,双摄像头所拍摄视频为60Hz,一帧为一张第一图像,其中,第一图像中包含处于防偷窥模式下的终端显示屏图像。当然,本发明实施例对眼戴设备内置的摄像装置的数量不做具体限定。Understandably, the more the number of camera devices built into the eye-wearing device, the clearer and more realistic the first image obtained by the eye-wearing device. For example, the eye-wearing device can capture the first image by taking a video of the dual camera set by itself. For example, the video captured by the dual camera is 60 Hz, and one frame is a first image, wherein the first image includes anti-peeping. Terminal display image in mode. Of course, the number of the camera devices built in the eye-wearing device is not specifically limited in the embodiment of the present invention.
步骤102:接收终端发送的第二图像,第二图像为终端显示屏当前所隐藏显示的真实内容;Step 102: Receive a second image sent by the terminal, where the second image is the real content hidden by the terminal display screen;
可理解的,眼戴设备通过实时接收终端发送的关于终端显示屏当前所隐藏显示的真实内容的第二图像,例如:其他人看得是卡通图像,而终端真实内容即第二图像是通信记录。如此一来,使得眼戴设备可以实时了解终端显示屏当前所显示内容,从而通过后续处理将终端显示屏当前所显示内容呈现个用户终端。It can be understood that the eye-wearing device receives the second image sent by the terminal about the real content hidden by the terminal display screen in real time, for example, the other person sees the cartoon image, and the terminal real content, that is, the second image is the communication record. . In this way, the eye-wearing device can know the content currently displayed on the terminal display in real time, so that the content currently displayed on the terminal display screen is presented to the user terminal through subsequent processing.
实际应用中,眼戴设备可以通过无线保真(WiFi,Wireless Fidelity)、蓝牙、无线局域网等网络连接至终端,并接收终端发送的第二图像。本发明实施例对眼戴设备接收终端发送的第二图像的方式不做具体限定。In practical applications, the eye-wearing device can connect to the terminal through a network such as WiFi (Wireless Fidelity), Bluetooth, or wireless local area network, and receive the second image sent by the terminal. The manner in which the eye-wearing device receives the second image sent by the terminal is not specifically limited in the embodiment of the present invention.
需要补充的是,图3中的辅助程序可以是Accessories,计算器可以是Calculator,日历可以是Calendar,电话可以是Call+,相机可以是Camera,浏览器可以是Chrome,时钟可以是Clock,联系人可以是Contacts,文档 可以是Docs,下载可以是Downloads,驱动可以是Drive,邮件可以是Email,文件管理器可以是File Manager,红板报可以是Flipboard,收音机可以是FM Radio,图片可以是Gallery,谷歌邮箱可以是Gmail,谷歌可以是Google,谷歌+可以是Google+,环聊可以是Hangouts;参考图3所示,第二图像包括终端显示屏当前所显示的内容。具体的,第二图像为具有不同像素值的矩阵,这些像素值在终端显示屏上以矩阵的方式分布。终端可将像素值转化为一个数组,并通过数据连接方式,例如Socket连接方式,将数组发送至眼戴设备,眼戴设备接收到数组后,将该数组还原为包括终端屏幕像素值的第二图像。Need to be added, the auxiliary program in Figure 3 can be Accessories, the calculator can be Calculator, the calendar can be Calendar, the phone can be Call+, the camera can be Camera, the browser can be Chrome, the clock can be Clock, the contact can Is Contacts, documentation Can be Docs, download can be Downloads, driver can be Drive, mail can be Email, file manager can be File Manager, red board can be Flipboard, radio can be FM Radio, picture can be Gallery, Google can be Gmail, Google can be Google, Google+ can be Google+, and Hangouts can be Hangouts; as shown in Figure 3, the second image includes what is currently displayed on the terminal display. Specifically, the second image is a matrix having different pixel values, and the pixel values are distributed in a matrix on the terminal display screen. The terminal can convert the pixel value into an array, and send the array to the eye-wearing device through a data connection method, such as a Socket connection method, and after the eye-wearing device receives the array, the array is restored to a second pixel value including the terminal screen. image.
步骤103:识别第一图像中的显示区域,显示区域为第一图像中终端的屏幕显示区域;Step 103: Identify a display area in the first image, where the display area is a screen display area of the terminal in the first image;
需要说明的是,由于处于防偷窥模式的终端的亮度低于预设亮度,或者亮度为零即处于黑屏状态,因此,眼戴设备为了生成最终显示图像,需要识别第一图像中的亮度较低的终端屏幕显示区域,以便后续对该显示区域进行图像处理,使得通过眼戴设备能向用户呈现完整的包含终端显示屏当前所显示内容的最终显示图像。It should be noted that, since the brightness of the terminal in the anti-peep mode is lower than the preset brightness, or the brightness is zero, it is in a black screen state. Therefore, in order to generate the final display image, the eye-wearing device needs to recognize that the brightness in the first image is low. The terminal screen display area is for subsequent image processing of the display area, so that the user can present the complete final display image including the content currently displayed on the terminal display screen to the user through the eye-wearing device.
举例来说,参考图4所示,第一图像中的显示区域为图4中白色实线框所选中的部分。For example, referring to FIG. 4, the display area in the first image is the selected portion of the white solid line frame in FIG.
示例性的,眼戴设备识别第一图像中的显示区域,具体包括:利用预设终端的图像特征识别显示区域。For example, the eyewear device identifies the display area in the first image, and specifically includes: identifying the display area by using the image feature of the preset terminal.
目前,眼戴设备能够利用预设终端的图像特征识别显示区域。其中,预设终端的图像特征包括规则四边形特征、终端屏幕区域颜色为黑色、终端屏幕边框颜色、终端前置摄像头位置等特征。具体的,眼戴设备通过预设所述终端的图像特征识别终端包括,终端屏幕在第一图像中是个规则四边形、终端屏幕区域颜色为黑色、终端屏幕边框颜色、终端前置摄像头位置等特征;再通过图像识别算法,如尺度不变特征变换(SIFT,Scale-invariant feature transform)识别终端屏幕。其中,SIFT算法的Sift 特征是图像的局部特征,对平移、旋转、尺度缩放、亮度变化、遮挡和噪声等具有良好的不变性,对视觉变化、仿射变换也保持一定程度的稳定性,速度相对较快,经优化的Sift匹配算法甚至可以达到实时的要求;独特性好,信息量丰富,适用于在海量特征数据库中进行快速、准确的匹配。Sift特征匹配算法主要包括两个阶段,一个是Sift特征的生成,即从第一图像中提取对尺度缩放、旋转、亮度变化无关的特征向量;第二阶段是Sift特征向量的匹配。Currently, the eye-wearing device is capable of recognizing the display area using the image features of the preset terminal. The image features of the preset terminal include regular quadrilateral features, the color of the terminal screen area is black, the color of the terminal screen border, and the position of the terminal front camera. Specifically, the eye-wearing device identifies the terminal by presetting the image feature of the terminal, wherein the terminal screen is a regular quadrilateral in the first image, the color of the terminal screen region is black, the color of the terminal screen border, and the position of the terminal front camera; The terminal screen is then identified by an image recognition algorithm, such as a Scale-invariant feature transform (SIFT). Among them, Sift of SIFT algorithm The feature is the local feature of the image, which has good invariance to translation, rotation, scale scaling, brightness variation, occlusion and noise, and maintains a certain degree of stability for visual changes and affine transformations. The speed is relatively fast and optimized. The Sift matching algorithm can even meet real-time requirements; it has good uniqueness and rich information, and is suitable for fast and accurate matching in massive feature database. The Sift feature matching algorithm mainly includes two stages, one is the generation of Sift features, that is, the feature vectors irrelevant to scale scaling, rotation and brightness change are extracted from the first image; the second stage is the matching of Sift feature vectors.
步骤104:对第二图像进行预处理,将预处理后的第二图像合入显示区域,生成最终显示图像,完成图像合成流程,并显示最终显示图像。Step 104: Preprocess the second image, merge the preprocessed second image into the display area, generate a final display image, complete the image synthesis process, and display the final display image.
可理解的,眼戴设备对第二图像进行预处理,使得第二图像的图像区域大小与第一图像中的显示区域的图像区域大小一致,从而能够将预处理后的第二图像合入第一图像中的显示区域。而且此时生成的图像既包含了终端显示屏当前所显示的内容的第二图像,也包括了终端当前所处环境的第一图像,可见,眼戴设备此时生成的图像即为向终端用户呈现的最终显示图像。It can be understood that the eye-wearing device pre-processes the second image such that the image region size of the second image is consistent with the image region size of the display region in the first image, so that the pre-processed second image can be integrated into the first image. The display area in an image. Moreover, the image generated at this time includes both the second image of the content currently displayed by the terminal display screen and the first image of the environment in which the terminal is currently located, and the image generated by the eye-wearing device at this time is the terminal user. The final displayed image rendered.
需要补充的是,一个图像合成流程包括了步骤101-步骤104的过程,眼戴设备完成一个图像合成流程,便生成一个最终显示图像。It should be added that an image synthesis process includes the process of steps 101-104, and the eye-wearing device completes an image synthesis process to generate a final display image.
需要说明的是,参考图5所示,眼戴设备对第二图像进行预处理,可以为对第二图像进行适当的缩放,以便将缩放后的第二图像合入显示区域,生成最终显示图像。It should be noted that, as shown in FIG. 5, the eye-wearing device pre-processes the second image, and may appropriately scale the second image to fit the scaled second image into the display area to generate a final display image. .
可理解的,眼戴设备需要将第二图像需缩放为第一图像中对应的显示区域,例如,若需要对显示区域进行缩小,眼戴设备可以将四个像素点求平均值合为一个像素点,进行部分像素区域的缩小;若需要对显示区域进行放大,眼戴设备可以通过在相邻两个像素点间插入二者的平均值,达到放大的目的。It can be understood that the eye-wearing device needs to scale the second image to a corresponding display area in the first image. For example, if the display area needs to be reduced, the eye-wearing device can average the four pixel points into one pixel. Point, the partial pixel area is reduced; if the display area needs to be enlarged, the eye-wearing device can achieve the purpose of amplification by inserting the average of the two pixels between adjacent pixels.
示例性的,参考图6所示,在生成最终显示图像之后,方法还包括步骤105-步骤106: Exemplarily, referring to FIG. 6, after generating the final display image, the method further includes steps 105-106:
步骤105:获取N个最终显示图像,N个最终显示图像为经过N个图像合成流程获得的,最终显示图像与图像合成流程一一对应,N大于等于2;Step 105: Acquiring N final display images, the N final display images are obtained through N image synthesis processes, and the final display image is in one-to-one correspondence with the image synthesis process, and N is greater than or equal to 2;
步骤106:根据N个最终显示图像生成最终显示视频并播放。Step 106: Generate a final display video and play according to the N final display images.
可理解的,一个图像合成流程包括了步骤101-步骤104的过程,眼戴设备完成一个图像合成流程,便生成一个最终显示图像。因此,眼戴设备经过N个图像合成流程获得N个最终显示图像;进而根据N个最终显示图像生成最终显示视频并显示给用户。也就是说,只有与眼戴设备连接的终端的用户才可以通过眼戴设备获得最终显示视频,如此杜绝了终端被非终端用户偷窥的可能性。It can be understood that an image synthesis process includes the process of steps 101-104, and the eye-wearing device completes an image synthesis process to generate a final display image. Therefore, the eye-wearing device obtains N final display images through N image synthesis processes; and further generates a final display video according to the N final display images and displays them to the user. That is to say, only the user of the terminal connected to the eye-wearing device can obtain the final display video through the eye-wearing device, thus eliminating the possibility that the terminal is peeked by the non-terminal user.
需要说明的是,眼戴设备可以以预设频率,例如,60Hz的频率执行N个图像合成流程,即重复执行N次步骤101-步骤104的过程,便可实现实时向终端用户显示终端屏幕的内容,以便终端用户可以正常地看到终端屏幕的内容,而非终端用户则看到的是处于亮度较低的状态的终端,从而达到终端的防偷窥效果。It should be noted that the eye-wearing device can perform N image synthesis processes at a preset frequency, for example, a frequency of 60 Hz, that is, the process of step 101-step 104 is performed N times repeatedly, so that the terminal screen can be displayed to the terminal user in real time. The content is such that the end user can normally see the content of the terminal screen, while the non-terminal user sees the terminal in a state of low brightness, thereby achieving the anti-peeping effect of the terminal.
实际应用中,本发明实施例提供的显示方法能够应用在多种场景下,举例来说,在地铁上时,终端用户周围都是人,若用户操作终端则会被周围的人看得清清楚楚,此时便可以通过眼戴设备来做到防偷窥的效果。In practical applications, the display method provided by the embodiment of the present invention can be applied to various scenarios. For example, when the subway is on the subway, the terminal user is surrounded by people. If the user operates the terminal, the surrounding person can clearly see it. Chu, at this time, you can wear anti-peeping effects through eye-wearing equipment.
实施例二Embodiment 2
图7为本发明实施例提供的一种显示方法的流程示意图,该显示方法应用于终端,参见图7所示,方法包括:FIG. 7 is a schematic flowchart of a display method according to an embodiment of the present disclosure. The display method is applied to a terminal. Referring to FIG. 7, the method includes:
步骤201:在处于防偷窥模式时,获取第二图像,第二图像为终端显示屏当前所隐藏显示的真实内容,防偷窥模式为终端的显示屏隐藏真实显示内容的状态;Step 201: When in the anti-peep mode, obtain a second image, where the second image is the real content hidden by the terminal display, and the anti-peep mode is a state in which the display screen of the terminal hides the real display content;
需要说明的是,处于防偷窥模式的终端显示屏隐藏真实显示内容,例如,终端显示屏亮度低于预设亮度,或者亮度为零,即处于黑屏状态,或者,终端隐藏显示真实内容,比如终端显示加密后的或处理后的图像,例 如:其他人看得是卡通图像,而终端真实内容是通信记录。如此一来,使得终端周围的人无法看见终端所显示的内容,从而杜绝了终端被非终端用户偷窥的可能性。It should be noted that the terminal display screen in the anti-peep mode hides the real display content, for example, the brightness of the terminal display screen is lower than the preset brightness, or the brightness is zero, that is, the black screen state, or the terminal hides and displays the real content, such as the terminal. Display encrypted or processed images, for example For example, other people see a cartoon image, and the real content of the terminal is a communication record. In this way, the people around the terminal cannot see the content displayed by the terminal, thereby eliminating the possibility that the terminal is peeked by the non-terminal user.
进一步的,参见图8所示,在步骤201之前,方法还包括步骤200,具体为:Further, referring to FIG. 8, before the step 201, the method further includes the step 200, specifically:
步骤200:根据接收的开启指令,开启防偷窥模式。Step 200: Turn on the anti-peeping mode according to the received opening instruction.
需要说明的是,防偷窥模式为终端亮度低于预设亮度的状态,手机正常运行,关闭屏幕显示功能或亮度调至最低,屏幕触摸输入功能照常,此时,旁人看到的景象如图1所示。It should be noted that the anti-peep mode is a state in which the brightness of the terminal is lower than the preset brightness, the mobile phone operates normally, the screen display function is turned off or the brightness is adjusted to the minimum, and the screen touch input function is normal. At this time, the scene seen by others is as shown in FIG. 1 . Shown.
步骤202:在与眼戴设备处于连接状态时,将第二图像发送至眼戴设备。Step 202: Send the second image to the eye-wearing device while in the connected state with the eye-wearing device.
进一步的,参见图9所示,在步骤202之前,方法还包括步骤2021,具体为:Further, referring to FIG. 9, before step 202, the method further includes step 2021, specifically:
步骤2021:通过网络与眼戴设备建立连接。Step 2021: Establish a connection with the eye-wearing device through the network.
实际应用中,终端可以通过wifi、蓝牙、无线局域网等网络连接至眼戴设备。当然,终端还可以通过其他方式连接眼戴设备,本发明实施例对此不做具体限制。In practical applications, the terminal can be connected to the eye-wearing device through a network such as wifi, Bluetooth, or wireless LAN. Of course, the terminal can also connect the eye-wearing device in other manners, which is not specifically limited in this embodiment of the present invention.
本发明实施例提供的显示方法通过将终端设置为防偷窥模式,即终端处于灭屏或者将终端屏幕亮度调低至人眼无法看见的状态,并通过与终端连接的眼戴设备浏览终端屏幕中的内容,并对终端进行安全操作。The display method provided by the embodiment of the present invention sets the terminal to the anti-peep mode, that is, the terminal is in the off-screen state or the terminal screen brightness is lowered to a state invisible to the human eye, and the terminal device is browsed through the eye-wearing device connected to the terminal. Content and secure operation of the terminal.
实施例三Embodiment 3
图10为本发明实施例提供的一种显示方法的交互流程示意图,参见图10所示,方法包括:FIG. 10 is a schematic diagram of an interaction process of a display method according to an embodiment of the present invention. Referring to FIG. 10, the method includes:
步骤301:终端根据接收的开启指令,开启防偷窥模式;Step 301: The terminal starts the anti-peep mode according to the received opening instruction.
其中,终端的防偷窥模式为终端的亮度低于预设亮度的状态。需要说明的是,终端处于防偷窥模式时,终端屏幕只能触摸输入,不显示输出。 The anti-peep mode of the terminal is a state in which the brightness of the terminal is lower than the preset brightness. It should be noted that when the terminal is in the anti-peep mode, the terminal screen can only touch the input and does not display the output.
步骤302:终端建立与眼戴设备的连接;Step 302: The terminal establishes a connection with the eye-wearing device.
步骤303:眼戴设备通过内置的摄像装置获取图像A;Step 303: The eye-wearing device acquires the image A through the built-in camera device;
其中,图像A为终端当前所处的环境图像即第一图像,图像A为由具有不同像素值的像素点形成的矩阵A。矩阵A如下:The image A is the first image of the environment image in which the terminal is currently located, and the image A is a matrix A formed by pixels having different pixel values. The matrix A is as follows:
Figure PCTCN2017108874-appb-000001
Figure PCTCN2017108874-appb-000001
步骤304:终端获取图像B,并向眼戴设备发送图像B;Step 304: The terminal acquires the image B, and sends the image B to the eye-wearing device;
其中,图像B为终端显示屏当前所显示的内容即第二图像,具体为由具有不同像素值的像素点形成的矩阵B。矩阵B如下:The image B is a second image that is currently displayed on the terminal display screen, and is specifically a matrix B formed by pixels having different pixel values. Matrix B is as follows:
Figure PCTCN2017108874-appb-000002
Figure PCTCN2017108874-appb-000002
步骤305:眼戴设备识别图像A中的显示区域B′;Step 305: The eyewear device recognizes the display area B' in the image A;
其中,显示区域B′为图像A中终端的屏幕显示区域,具体为由具有不同像素值的像素点形成的矩阵B′。矩阵B′中值为1的区域为区域B′空间,值为0的区域为非区域B′空间,矩阵B′如下所示:The display area B' is a screen display area of the terminal in the image A, specifically a matrix B' formed by pixels having different pixel values. The area with a value of 1 in the matrix B' is the area B' space, the area with the value 0 is the non-area B' space, and the matrix B' is as follows:
Figure PCTCN2017108874-appb-000003
Figure PCTCN2017108874-appb-000003
步骤306:眼戴设备对图像B进行缩放处理后,将缩放处理后的图像合入矩阵B′中获得图像A′;Step 306: After the eye-wearing device performs the scaling process on the image B, the zoom-processed image is merged into the matrix B' to obtain the image A';
具体的,眼戴设备将将缩放处理后的图像合入矩阵B′中非0的部分,得到A′,图像A′的矩阵A′如下所示: Specifically, the eye-wearing device will merge the scaled image into the non-zero portion of the matrix B' to obtain A', and the matrix A' of the image A' is as follows:
Figure PCTCN2017108874-appb-000004
Figure PCTCN2017108874-appb-000004
步骤307:眼戴设备根据图像A′和图像A得到最终显示图像C并显示图像C。Step 307: The eye-wearing device obtains the final display image C according to the image A' and the image A and displays the image C.
具体的,眼戴设备将矩阵A′中非0的部分替换至矩阵A中得到最终显示图像C,图像C的矩阵C如下所示:Specifically, the eye-wearing device replaces the non-zero portion of the matrix A' with the matrix A to obtain the final display image C, and the matrix C of the image C is as follows:
Figure PCTCN2017108874-appb-000005
Figure PCTCN2017108874-appb-000005
可理解的,眼戴设备通过将最终生成的图像C显示给终端用户,避免了终端屏幕的显示内容被偷窥,提高了屏幕显示的安全性。It can be understood that the eye-wearing device can prevent the display content of the terminal screen from being sneaked by displaying the finally generated image C to the end user, thereby improving the security of the screen display.
本发明实施例提供的显示方法,通过在与终端处于连接状态时,获取第一图像,第一图像为终端当前所处的环境图像;接收终端发送的第二图像,第二图像为终端显示屏当前所显示的内容;识别第一图像中的显示区域,显示区域为第一图像中终端的屏幕显示区域;对第二图像进行预处理,将预处理后的第二图像合入显示区域,生成最终显示图像。采用本发明实施例的技术方案,能够避免终端屏幕的显示内容被偷窥,提高了屏幕显示的安全性。The display method provided by the embodiment of the present invention acquires a first image when the terminal is in a connected state, the first image is an environment image currently located by the terminal; the second image sent by the terminal is received, and the second image is a terminal display The currently displayed content; the display area in the first image is identified, and the display area is a screen display area of the terminal in the first image; the second image is preprocessed, and the preprocessed second image is merged into the display area to generate The image is finally displayed. The technical solution of the embodiment of the invention can prevent the display content of the terminal screen from being sneaked, thereby improving the security of the screen display.
实施例四Embodiment 4
图11为本发明实施例提供的一种眼戴设备的结构示意图,参考图11所示,该眼戴设备11包括获取单元111、接收单元112、识别单元113和合成单元114,其中:FIG. 11 is a schematic structural diagram of an eye-wearing device according to an embodiment of the present invention. Referring to FIG. 11, the eye-wearing device 11 includes an acquiring unit 111, a receiving unit 112, an identifying unit 113, and a synthesizing unit 114, where:
获取单元111,设置为在与终端处于连接状态时,获取第一图像,第 一图像为包括终端显示屏内容及其当前所处的环境图像,其中,终端显示屏内容为终端处于防偷窥模式下所显示的内容;The obtaining unit 111 is configured to acquire the first image when the terminal is connected to the terminal, An image includes a content of the terminal display screen and an environment image currently located therein, wherein the content of the terminal display screen is content displayed by the terminal in the anti-peep mode;
接收单元112,设置为接收终端发送的第二图像,第二图像为终端显示屏当前所隐藏显示的真实内容;The receiving unit 112 is configured to receive the second image sent by the terminal, where the second image is the real content hidden by the terminal display screen;
识别单元113,设置为识别获取单元111获取的第一图像中的显示区域,显示区域为第一图像中终端的屏幕显示区域;The identification unit 113 is configured to identify a display area in the first image acquired by the obtaining unit 111, where the display area is a screen display area of the terminal in the first image;
合成单元114,设置为对接收单元112接收的第二图像进行预处理,将预处理后的第二图像合入显示区域,生成最终显示图像,完成图像合成流程,并显示最终显示图像。The synthesizing unit 114 is configured to preprocess the second image received by the receiving unit 112, merge the preprocessed second image into the display area, generate a final display image, complete the image synthesizing process, and display the final display image.
可选的,获取单元111具体设置为:通过摄像装置获取第一图像,摄像装置设置于眼戴设备上。Optionally, the acquiring unit 111 is specifically configured to: acquire the first image by using the imaging device, and set the imaging device on the eye-wearing device.
可选的,识别单元113具体设置为:利用预设终端的图像特征识别显示区域。Optionally, the identifying unit 113 is specifically configured to: identify the display area by using an image feature of the preset terminal.
可选的,获取单元111还设置为,在合成单元114生成最终显示图像之后,获取N个最终显示图像,N个最终显示图像为经过N个图像合成流程获得的,最终显示图像与图像合成流程一一对应,N大于等于2;Optionally, the obtaining unit 111 is further configured to: after the synthesizing unit 114 generates the final display image, acquire N final display images, where the N final display images are obtained through N image synthesizing processes, and finally display the image and image synthesizing process. One-to-one correspondence, N is greater than or equal to 2;
合成单元114还设置为根据N个最终显示图像生成最终显示视频并播放。The synthesizing unit 114 is also arranged to generate a final display video and play according to the N final display images.
实际应用中,获取单元111、接收单元112、识别单元113和合成单元114可由位于眼戴设备上的处理器实现,具体为中央处理器(CPU)、微处理器(MPU)、数字信号处理器(DSP)或现场可编程门阵列(FPGA)等实现。眼戴设备上还包括存储器,该存储器可以通过系统总线与终端上的处理器连接,其中,存储器用于存储可执行程序代码,该程序代码包括计算机操作指令,存储器可能包含高速RAM存储器,也可能还包括非易失性存储器,例如,至少一个磁盘存储器。In an actual application, the obtaining unit 111, the receiving unit 112, the identifying unit 113, and the synthesizing unit 114 may be implemented by a processor located on the eye-wearing device, specifically a central processing unit (CPU), a microprocessor (MPU), and a digital signal processor. (DSP) or field programmable gate array (FPGA) implementation. The eye-wearing device further includes a memory connectable to the processor on the terminal through the system bus, wherein the memory is used to store executable program code, the program code includes computer operating instructions, and the memory may include high-speed RAM memory, or Also included is a non-volatile memory, such as at least one disk storage.
实施例五 Embodiment 5
图12为本发明实施例提供的一种终端的结构示意图,参考图11所示,该终端12包括获取单元121和发送单元122,其中:FIG. 12 is a schematic structural diagram of a terminal according to an embodiment of the present invention. Referring to FIG. 11, the terminal 12 includes an obtaining unit 121 and a sending unit 122, where:
获取单元121,设置为在处于防偷窥模式时,获取第二图像,第二图像为终端显示屏当前所隐藏显示的真实内容,防偷窥模式为终端的显示屏隐藏真实显示内容的状态;The obtaining unit 121 is configured to acquire a second image when the anti-peep mode is in use, where the second image is the real content hidden by the terminal display screen, and the anti-peep mode is a state in which the display screen of the terminal hides the real display content;
发送单元122,设置为在与眼戴设备处于连接状态时,将获取单元121获取的第二图像发送至眼戴设备。The transmitting unit 122 is configured to transmit the second image acquired by the obtaining unit 121 to the eye-wearing device when the eye-wearing device is in a connected state.
可选的,参考图13所示,终端还包括开启单元123,设置为在获取单元121获取第二图像之前,根据接收的开启指令,开启防偷窥模式。Optionally, as shown in FIG. 13 , the terminal further includes an opening unit 123 configured to enable the anti-peeping mode according to the received opening instruction before the acquiring unit 121 acquires the second image.
可选的,参考图14所示,终端还包括连接单元124,设置为在发送单元122将第二图像发送至眼戴设备之前,通过网络与眼戴设备建立连接。Optionally, referring to FIG. 14, the terminal further includes a connection unit 124 configured to establish a connection with the eye-wearing device through the network before the sending unit 122 sends the second image to the eye-wearing device.
需要说明的是,本发明实施例中的终端包括智能手机、智能家电、平板电脑等。It should be noted that the terminal in the embodiment of the present invention includes a smart phone, a smart home appliance, a tablet computer, and the like.
实际应用中,获取单元121、发送单元12、开启单元123和连接单元124可由位于终端上的处理器实现,具体为中央处理器(CPU)、微处理器(MPU)、数字信号处理器(DSP)或现场可编程门阵列(FPGA)等实现。终端上还包括存储器,该存储器可以通过系统总线与终端上的处理器连接,其中,存储器用于存储可执行程序代码,该程序代码包括计算机操作指令,存储器可能包含高速RAM存储器,也可能还包括非易失性存储器,例如,至少一个磁盘存储器。In an actual application, the obtaining unit 121, the sending unit 12, the opening unit 123, and the connecting unit 124 may be implemented by a processor located on the terminal, specifically a central processing unit (CPU), a microprocessor (MPU), and a digital signal processor (DSP). ) or field programmable gate array (FPGA) implementation. The terminal further includes a memory connectable to the processor on the terminal through the system bus, wherein the memory is used to store executable program code, the program code includes computer operating instructions, the memory may include high speed RAM memory, and may also include A non-volatile memory, such as at least one disk storage.
本领域内的技术人员应明白,本发明的实施例可提供为方法、系统、或计算机程序产品。因此,本发明可采用硬件实施例、软件实施例、或结合软件和硬件方面的实施例的形式。而且,本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器和光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention can take the form of a hardware embodiment, a software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) including computer usable program code.
本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流 程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the invention. It should be understood that the flow can be implemented by computer program instructions Each of the processes and/or blocks in the flowcharts and/or block diagrams, and combinations of the flows and/or blocks in the flowcharts and/or block diagrams. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
以上所述,仅为本发明的较佳实施例而已,并非用于限定本发明的保护范围。The above is only the preferred embodiment of the present invention and is not intended to limit the scope of the present invention.
工业实用性Industrial applicability
本发明实施例提供了一种显示方法及终端,通过在与终端处于连接状态时,眼戴设备获取第一图像,第一图像为包括终端显示屏内容及其当前所处的环境图像,其中,终端显示屏内容为终端处于防偷窥模式下所显示的内容;接收终端发送的第二图像,第二图像为终端显示屏当前所隐藏显示的真实内容;识别第一图像中的显示区域,显示区域为第一图像中终端的屏幕显示区域;对第二图像进行预处理,将预处理后的第二图像合入显示区域,生成最终显示图像,完成图像合成流程,并显示最终显示图像。采用本发明实施例的技术方案,由于通过与终端连接的眼戴设备来生成最终显示图像,因此避免了终端屏幕的显示内容被偷窥,提高了屏幕显示的 安全性。 The embodiment of the present invention provides a display method and a terminal. The eye-wearing device acquires a first image when the terminal device is in a connected state, and the first image is an environment image including the terminal display content and the current environment image thereof. The content of the terminal display is the content displayed by the terminal in the anti-peep mode; the second image sent by the receiving terminal is the real content hidden by the terminal display screen; the display area in the first image is recognized, and the display area is displayed. It is a screen display area of the terminal in the first image; the second image is preprocessed, the preprocessed second image is merged into the display area, the final display image is generated, the image synthesis process is completed, and the final display image is displayed. According to the technical solution of the embodiment of the present invention, since the final display image is generated by the eye-wearing device connected to the terminal, the display content of the terminal screen is prevented from being sneaked, and the screen display is improved. safety.

Claims (14)

  1. 一种显示方法,所述方法应用于眼戴设备,包括:A display method, the method being applied to an eye-wearing device, comprising:
    在与终端处于连接状态时,获取第一图像,所述第一图像为包括终端显示屏内容及其当前所处的环境图像,其中,所述终端显示屏内容为所述终端处于防偷窥模式下所显示的内容;Obtaining a first image when the terminal is in a connection state, where the first image is a content including a terminal display screen and an environment image currently located therein, wherein the terminal display screen content is that the terminal is in an anti-peep mode The content displayed;
    接收所述终端发送的第二图像,所述第二图像为终端显示屏当前所隐藏显示的真实内容;Receiving a second image sent by the terminal, where the second image is real content hidden by the terminal display screen;
    识别所述第一图像中的显示区域,所述显示区域为所述第一图像中所述终端的屏幕显示区域;Identifying a display area in the first image, the display area being a screen display area of the terminal in the first image;
    对所述第二图像进行预处理,将所述预处理后的第二图像合入所述显示区域,生成最终显示图像,完成图像合成流程,并显示所述最终显示图像。Preprocessing the second image, combining the preprocessed second image into the display area, generating a final display image, completing an image synthesis process, and displaying the final display image.
  2. 根据权利要求1所述的方法,其中,所述获取第一图像,具体包括:The method of claim 1, wherein the obtaining the first image comprises:
    通过摄像装置获取所述第一图像,所述摄像装置设置于所述眼戴设备上。The first image is acquired by an imaging device, and the imaging device is disposed on the eye-wearing device.
  3. 根据权利要求1所述的方法,其中,所述识别所述第一图像中的显示区域,具体包括:The method of claim 1, wherein the identifying the display area in the first image comprises:
    利用预设所述终端的图像特征识别所述显示区域。The display area is identified by presetting the image features of the terminal.
  4. 根据权利要求1所述的方法,其中,在所述生成最终显示图像之后,所述方法还包括:The method of claim 1, wherein after the generating the final display image, the method further comprises:
    获取N个所述最终显示图像,所述N个最终显示图像为经过N个所述图像合成流程获得的,所述最终显示图像与所述图像合成流程 一一对应,所述N大于等于2;Acquiring N pieces of the final display image obtained by N image synthesis processes, the final display image and the image composition process One-to-one correspondence, the N is greater than or equal to 2;
    根据所述N个最终显示图像生成最终显示视频并播放。A final display video is generated and played according to the N final display images.
  5. 一种显示方法,所述方法应用于终端,包括:A display method, the method being applied to a terminal, comprising:
    在处于防偷窥模式时,获取第二图像,所述第二图像为所述终端显示屏当前所隐藏显示的真实内容,所述防偷窥模式为所述终端的显示屏隐藏真实显示内容的状态;When in the anti-peep mode, the second image is obtained, and the second image is the real content hidden by the terminal display screen, and the anti-peep mode is a state in which the display screen of the terminal hides the real display content;
    在与眼戴设备处于连接状态时,将所述第二图像发送至所述眼戴设备。The second image is transmitted to the eyewear device while in a connected state with the eyewear device.
  6. 根据权利要求5所述的方法,其中,在所述获取第二图像之前,所述方法还包括:The method of claim 5, wherein before the acquiring the second image, the method further comprises:
    根据接收的开启指令,开启所述防偷窥模式。The anti-peep mode is turned on according to the received open command.
  7. 根据权利要求5所述的方法,其中,在所述将所述第二图像发送至所述眼戴设备之前,所述方法还包括:The method of claim 5, wherein before the sending the second image to the eyewear device, the method further comprises:
    通过网络与所述眼戴设备建立连接。A connection is established with the eye-wearing device via a network.
  8. 一种眼戴设备,所述眼戴设备包括获取单元、接收单元、识别单元和合成单元,其中:An eye wearing device comprising an acquiring unit, a receiving unit, an identifying unit and a synthesizing unit, wherein:
    所述获取单元,设置为在与终端处于连接状态时,获取第一图像,所述第一图像为包括终端显示屏内容及其当前所处的环境图像,其中,所述终端显示屏内容为所述终端处于防偷窥模式下所显示的内容;The acquiring unit is configured to acquire a first image when the terminal is in a connected state, where the first image is an environment image including a terminal display content and a current environment image thereof, wherein the terminal display content is The content displayed by the terminal in the anti-peep mode;
    所述接收单元,设置为接收所述终端发送的第二图像,所述第二图像为所述终端显示屏当前所隐藏显示的真实内容;The receiving unit is configured to receive a second image sent by the terminal, where the second image is real content hidden by the terminal display screen;
    所述识别单元,设置为识别所述获取单元获取的所述第一图像中 的显示区域,所述显示区域为所述第一图像中所述终端的屏幕显示区域;The identification unit is configured to identify the first image acquired by the acquiring unit a display area, where the display area is a screen display area of the terminal in the first image;
    所述合成单元,设置为对所述接收单元接收的所述第二图像进行预处理,将所述预处理后的第二图像合入所述显示区域,生成最终显示图像,完成图像合成流程,并显示所述最终显示图像。The synthesizing unit is configured to preprocess the second image received by the receiving unit, merge the pre-processed second image into the display area, generate a final display image, and complete an image synthesizing process. And displaying the final display image.
  9. 根据权利要求8所述的眼戴设备,其中,所述获取单元具体设置为:The eye-wearing device according to claim 8, wherein the acquiring unit is specifically configured to:
    通过摄像装置获取所述第一图像,所述摄像装置设置于所述眼戴设备上。The first image is acquired by an imaging device, and the imaging device is disposed on the eye-wearing device.
  10. 根据权利要求8所述的眼戴设备,其中,所述识别单元具体设置为:The eye-wearing device according to claim 8, wherein the identification unit is specifically configured to:
    利用预设所述终端的图像特征识别所述显示区域。The display area is identified by presetting the image features of the terminal.
  11. 根据权利要求8所述的眼戴设备,其中,所述获取单元还用于,在所述合成单元生成最终显示图像之后,获取N个所述最终显示图像,所述N个最终显示图像为经过N个所述图像合成流程获得的,所述最终显示图像与所述图像合成流程一一对应,所述N大于等于2;The eye-wearing device according to claim 8, wherein the obtaining unit is further configured to acquire N pieces of the final display image after the synthesizing unit generates a final display image, where the N final display images are Obtained by the N image synthesis processes, the final display image is in one-to-one correspondence with the image synthesis process, and the N is greater than or equal to 2;
    所述合成单元还设置为根据所述N个最终显示图像生成最终显示视频并播放。The synthesizing unit is further configured to generate a final display video and play according to the N final display images.
  12. 一种终端,所述终端包括获取单元和发送单元,其中:A terminal, the terminal comprising an obtaining unit and a sending unit, wherein:
    所述获取单元,设置为在处于防偷窥模式时,获取第二图像,所述第二图像为所述终端显示屏当前所隐藏显示的真实内容,所述防偷窥模式为所述终端的显示屏隐藏真实显示内容的状态;The acquiring unit is configured to acquire a second image when the anti-peeping mode is in use, where the second image is real content hidden by the terminal display screen, and the anti-peeping mode is a display screen of the terminal Hide the state of the actual display content;
    所述发送单元,设置为在与眼戴设备处于连接状态时,将所述获 取单元获取的所述第二图像发送至所述眼戴设备。The sending unit is configured to be in a state of being connected to the eye-wearing device The second image acquired by the fetch unit is sent to the eye-wearing device.
  13. 根据权利要求12所述的终端,其中,所述终端还包括开启单元,设置为在所述获取单元获取所述第二图像之前,根据接收的开启指令,开启所述防偷窥模式。The terminal according to claim 12, wherein the terminal further comprises an opening unit, configured to enable the anti-peeping mode according to the received opening instruction before the acquiring unit acquires the second image.
  14. 根据权利要求12所述的终端,其中,所述终端还包括连接单元,设置为在所述发送单元将所述第二图像发送至所述眼戴设备之前,通过网络与所述眼戴设备建立连接。 The terminal according to claim 12, wherein the terminal further comprises a connection unit configured to establish with the eye-wearing device through a network before the transmitting unit transmits the second image to the eye-wearing device connection.
PCT/CN2017/108874 2017-03-01 2017-11-01 Display method, and terminal WO2018157616A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710116364.X 2017-03-01
CN201710116364.XA CN108537070A (en) 2017-03-01 2017-03-01 A kind of display methods and terminal

Publications (1)

Publication Number Publication Date
WO2018157616A1 true WO2018157616A1 (en) 2018-09-07

Family

ID=63369565

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/108874 WO2018157616A1 (en) 2017-03-01 2017-11-01 Display method, and terminal

Country Status (2)

Country Link
CN (1) CN108537070A (en)
WO (1) WO2018157616A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109543474A (en) * 2018-11-30 2019-03-29 努比亚技术有限公司 A kind of method for controlling mobile terminal and mobile terminal
CN110070015B (en) * 2019-04-12 2021-07-02 西安科芮智盈信息技术有限公司 Image recognition method, device and system
CN116523241B (en) * 2023-05-05 2023-11-24 中清软(北京)科技有限公司 Digital service management system and method based on artificial intelligence

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102779500A (en) * 2011-05-13 2012-11-14 群康科技(深圳)有限公司 Confidential display system, confidential display device, confidential display method and confidential eyeglasses
CN103077361A (en) * 2012-12-28 2013-05-01 东莞宇龙通信科技有限公司 Mobile terminal and anti-spy method thereof
US20130241927A1 (en) * 2011-07-03 2013-09-19 Neorai Vardi Computer device in form of wearable glasses and user interface thereof
CN104122705A (en) * 2014-07-11 2014-10-29 京东方科技集团股份有限公司 Display panel, displayer, display device and driving method
CN104573540A (en) * 2013-10-22 2015-04-29 鸿富锦精密工业(武汉)有限公司 Mobile terminal user privacy protection method and system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102779500A (en) * 2011-05-13 2012-11-14 群康科技(深圳)有限公司 Confidential display system, confidential display device, confidential display method and confidential eyeglasses
US20130241927A1 (en) * 2011-07-03 2013-09-19 Neorai Vardi Computer device in form of wearable glasses and user interface thereof
CN103077361A (en) * 2012-12-28 2013-05-01 东莞宇龙通信科技有限公司 Mobile terminal and anti-spy method thereof
CN104573540A (en) * 2013-10-22 2015-04-29 鸿富锦精密工业(武汉)有限公司 Mobile terminal user privacy protection method and system
CN104122705A (en) * 2014-07-11 2014-10-29 京东方科技集团股份有限公司 Display panel, displayer, display device and driving method

Also Published As

Publication number Publication date
CN108537070A (en) 2018-09-14

Similar Documents

Publication Publication Date Title
CN110766777B (en) Method and device for generating virtual image, electronic equipment and storage medium
US10565763B2 (en) Method and camera device for processing image
US12254544B2 (en) Image-text fusion method and apparatus, and electronic device
CN106682632B (en) Method and device for processing face image
CN109829864B (en) Image processing method, device, equipment and storage medium
KR102265326B1 (en) Apparatus and method for shooting an image in eletronic device havinag a camera
CN116797694A (en) Emotion symbol doll
WO2019052329A1 (en) Facial recognition method and related product
CN111541907A (en) Article display method, apparatus, device and storage medium
WO2018157616A1 (en) Display method, and terminal
KR102409103B1 (en) Method for editing image
CN110807769B (en) Image display control method and device
US11961278B2 (en) Method and apparatus for detecting occluded image and medium
CN110189348B (en) Head portrait processing method and device, computer equipment and storage medium
CN112351093A (en) Screenshot image sharing method, device and equipment and computer readable storage medium
WO2023045961A1 (en) Virtual object generation method and apparatus, and electronic device and storage medium
CN113453027B (en) Live video and virtual make-up image processing method and device and electronic equipment
US20130076792A1 (en) Image processing device, image processing method, and computer readable medium
CN113822798B (en) Method and device for training generation countermeasure network, electronic equipment and storage medium
CN111553865B (en) Image restoration method and device, electronic equipment and storage medium
CN111373409B (en) Method and terminal for obtaining color value change
CN111612875A (en) A dynamic image generation method, device, electronic device and storage medium
CN116361761A (en) Information shielding method, information shielding device and electronic equipment
CN114119413A (en) Image processing method and device, readable medium and mobile terminal
CN113744172A (en) Document image processing method and device and training sample generation method and device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17898947

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17898947

Country of ref document: EP

Kind code of ref document: A1

点击 这是indexloc提供的php浏览器服务,不要输入任何密码和下载