KR20150041939A - A door monitoring system using real-time event detection and a method thereof - Google Patents

Abstract

The present invention relates to a door monitoring system for real-time event detection, and more particularly, to a door monitoring system for real-time event detection connected to the Internet, An event collecting terminal for transmitting or receiving the photographed video and audio input / output, a calling signal, a photographing end signal or an emergency bell signal to / from the main server, and an image pickup terminal for receiving and storing the photographed image, An event corresponding to the stored event is detected after the stored image is analyzed for each object, an alarm is transmitted to the user terminal when a call signal is received from the event collecting terminal, and an event image Emergency alert signal or number of events And a user terminal for receiving an alarm from the main server, requesting an event image sensed by the main server, and transmitting and receiving a video or voice during an event collection terminal period.
The present invention also provides a method for monitoring a door through real-time event detection, the method comprising: detecting an operation or a sound in a space in which an event collecting terminal is installed; The event collecting terminal captures an image, the event collecting terminal transmits the captured image to the main server, the main server stores the image transmitted to the event collecting terminal, and the main server stores the stored image Analyzing and storing the event for each object and searching for whether there is a designated event in which the event stored in the event storage unit coincides with the image stored in the main server, If an alarm is not sent or a specified event is not detected When transmitting a recording end signal to the event collection terminal.

Description

[0001] The present invention relates to a door monitoring system using real-time event detection,

More particularly, the present invention relates to a door monitoring system and method for real-time event detection. More particularly, the present invention relates to a door monitoring system for detecting a situation occurring around a door through an event collecting terminal and transmitting the same to a main server, The present invention relates to a door monitoring system and a method thereof, which detect real-time events so that an emergency situation can be instantly dealt with by notifying a user terminal thereof of an emergency situation.

Generally, an interphone or a videophone is a device installed on the entrance to inform the indoor people that a visitor arrives at the entrance of the house. When the user presses the bell outdoors, the user checks the voice or face of the visitor in the room, Will open. However, the existing interphone or video phone has a problem in that when the visitor is absent, the visitor has a disadvantage that the visitor is inside the house rather than the visitor, and thus there are many vulnerable problems in security. Particularly, in recent years, in case of increasing crime, courier service is universally used, and since many people are visiting the house during the absence, It is true.

Accordingly, in order to solve the above-described security problem, as disclosed in Korean Patent Laid-Open Publication No. 10-2010-0093815 'Door opening and closing system using terminal and method thereof, A system has been proposed in which video data photographed by a camera mounted on the outside is transmitted to a terminal to confirm the identity of an outside person and the door can be opened and closed by controlling the door lock.

Korean Patent Application Publication No. 10-2003-0028063 'Remote visitor identification using a mobile communication terminal and a wireless Internet service and an apparatus and method for controlling door opening and closing' are provided to notify an administrator through a short message when there is a call of a visitor, We proposed a device and a method for opening a door after voice communication when an administrator transmits an image of a visitor who is caught by a camera and wants to communicate with a visitor.

However, the existing system which can confirm the above-mentioned visitor can be confirmed by the visitor or the manager only by the active act such as pressing the bell of the visitor, and for the visitor without active act, the visitor or the manager confirms There was an impossible problem.

On the other hand, when a security is required such as a private house or a business place as described above, a demand for a remote mobile system capable of photographing a specific place with a camera and monitoring it in real time in the absence of the user is increasing, Has been proposed.

Korean Patent Laid-Open Publication No. 10-2012-0140518 'Smartphone-based remote sensing system and control method' discloses a remote sensing system for remote control of a camera by checking a surveillance image provided through a camera at a surveillance site, In addition, Korean Patent Registration No. 10-0853744 discloses a video surveillance device and a situation change detection method that detects a change in a situation of a surveillance site and generates a corresponding event, An image sensing apparatus capable of minimizing the number of judgment errors and the number of monitor personnel, and a situation change sensing method used in the apparatus have been proposed.

However, as described above, the surveillance system using the mobile communication terminal has a problem that the user must constantly monitor the image taken by the camera, and the surveillance camera installed on the field can only check the image There is a problem that it is impossible for a manager who is actually in need of another task to continuously monitor using a mobile communication terminal. In addition, there is a limit to the capacity of an image captured by a surveillance camera installed in the field, and therefore, there is a limit to the use of a certain event after a certain period of time.

Korean Patent Publication No. 10-2010-0093815 (Aug. 26, 2010) Korean Patent Publication No. 10-2003-0028063 (April 08, 2003) Korean Patent Publication No. 10-2012-0140518 (December 31, 2012) Korean Registered Patent No. 10-0853744 (Aug. 18, 2008)

Disclosure of Invention Technical Problem [8] The present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide an event collecting terminal which is capable of providing functions such as a conventional interphone or a video phone, And it is an object of the present invention to provide a system and a method for monitoring the surroundings of a door in real time without a continuous photographing unlike a surveillance camera.

In addition, a system for storing an image captured by an event collecting terminal and a main server connected to the Internet and detecting an operation or a sound in real time, analyzing the stored image by object, detecting only a specific event, The purpose of the method is to provide.

According to another aspect of the present invention, there is provided a door monitoring system for detecting a real-time event connected to an Internet network, the door monitoring system comprising: An event collecting terminal for transmitting or receiving voice input / output, a calling signal, a photographing end signal, or an emergency bell signal to / from a main server, and an image collecting terminal for receiving and storing an image photographed from the event collecting terminal, And stores an event image or an emergency alert signal, which is detected by a request of the user terminal, in response to a request signal from the event collecting terminal Or relaying video or audio between event collecting terminals And a user terminal receiving an alarm from the main server and the main server, requesting an event image sensed by the main server, and transmitting and receiving video or audio during the event acquisition terminal.

In addition, the event collecting terminal may include a sensing sensor unit for sensing the operation or sound, a camera unit for starting image capturing when an operation or sound is sensed by the sensing sensor unit, A voice input / output unit for outputting a voice to be received or outputting an emergency warning voice; a call unit for calling a main server to request transmission / reception of a video or voice to / from the user terminal; A control unit for transmitting / receiving power to / from the main body and for transmitting / receiving input / output of captured images and sounds, a call signal or an image capturing end signal to the main server, And a communication unit for transmitting or receiving the warning signal to the main server.

The main server may further include a reception controller for receiving a video or paging signal photographed from the event collecting terminal or receiving a request for transmitting a voice or video relay request and an emergency alert signal from the user terminal, An object analysis unit for analyzing the type or behavior of the object detected among the stored images, an object analysis database for storing the analyzed object according to the type or behavior of the object, and an event for which an alarm is requested from the user terminal An event search unit for searching for and determining whether a type of an event stored in the event storage unit and an event storage unit match the type or behavior of the object stored in the event storage unit, Or row An alarm is sent to the user terminal when a call signal is received from the event collecting terminal, an emergency alert signal is transmitted to the event collecting terminal at the request of the user terminal, or an event stored in the event storing unit and an object When there is a relay request between the event collecting terminal and the user terminal, if there is a relay request between the event collecting terminal and the user terminal that receives the paging signal or the alarm, Or relaying the image so that transmission and reception of the image can be performed.

According to another aspect of the present invention, there is provided a method for monitoring a door through real-time event detection, the method comprising the steps of: Or sound is detected; when the operation or sound is sensed, the event collecting terminal photographs the image; the event collecting terminal transmits the photographed image to the main server; The main server analyzing and storing the images stored in the main server, the main server analyzing the images and searching for the presence of a designated event matching the events stored in the event storage unit; When the main server detects a designated event, If the transmission of the alarm or the specified event is detected, it is transmitting a recording end signal to the event collection terminal.

In addition, the user terminal having received the alarm may request the main server to transmit the event detection image, the main server may transmit the event detection image requested from the user terminal, and may receive the event detection image from the main server The main server requesting transmission of an emergency alert signal from the user terminal transmits an emergency alert signal to the event collecting terminal, and a step of receiving an emergency alert signal from the main server, The terminal is further characterized by outputting an emergency warning voice.

As described above, according to the present invention, when the operation or sound is detected in real time in the event collecting terminal, the camera does not need to take a continuous photograph like a conventional surveillance camera, The storage capacity of the main server can be minimized by storing the image in the main server only.

In addition, the main server analyzes the stored images by object, searches for events, searches for more efficiently and correctly specified events, and transmits alarms to the user terminals in real time when detecting specified events. Security management can proceed.

In addition, when an event is detected by the main server, an alarm is transmitted to the user terminal in real time, so that it is not necessary to repeatedly monitor the user terminal unlike the existing surveillance camera, Voice connection is possible, emergency warning signal can be transmitted, and security can be further enhanced.

1 is a general schematic view of a door monitoring system through real-time event detection according to the present invention.
2 is a block diagram illustrating a door monitoring system through real-time event detection according to the present invention.
3 is a flowchart illustrating a door monitoring method using real-time event detection according to the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Prior to this, terms and words used in the present specification and claims should not be construed as limited to ordinary or dictionary terms, and the inventor should appropriately interpret the concepts of the terms appropriately It should be interpreted in accordance with the meaning and concept consistent with the technical idea of the present invention based on the principle that it can be defined.

1 is a general schematic view of a door monitoring system through real-time event detection according to the present invention.

Referring to FIG. 1, the configuration of a door surveillance system using real-time event detection according to the present invention is connected to an Internet network and is connected to an Internet network. The door monitoring system includes an input / An event collecting terminal 100 for transmitting or receiving a signal to or from the main server 200, an image capturing terminal 100 for receiving and storing the captured image or transmitting an image capturing end signal, An event corresponding to the stored event is sensed and an alarm signal is received from the event collecting terminal 100 to transmit an alarm to the user terminal 100 and an event image sensed by the user terminal 100 A main server 200 for transmitting an emergency warning signal or relaying an image or voice between the event collecting terminals 100, It consists of a main server 200 requests the event to the image sensing, and the event collection terminal 100, video, audio-enabled user terminal 300, between sending and receiving. At this time, the user terminal 100 includes both a display unit capable of being connected to the Internet through the Internet network or a mobile communication network and capable of displaying a screen such as a smart phone, a mobile phone, a PDA phone, and a tablet PC, and a terminal including a microphone and a speaker.

2 is a block diagram illustrating a door monitoring system through real-time event detection according to the present invention. The event collecting terminal 100 according to the present invention includes a detecting sensor unit 110, a camera unit 120, a voice input / output unit 130, a calling unit 140, a control unit 160, and a communication unit 160. The main server 200 according to the present invention includes a reception control unit 210, an image database 220, an object analysis unit 230, an object analysis database 240, an event search unit 250, an event storage unit 250 A transmission unit 270, and a relay unit 280. [

The detection sensor unit 110 is installed in an area to be monitored in real time according to the present invention, and detects a general operation or a sound. At this time, when the general operation or sound is detected by the detection sensor unit 110, the control unit 160 starts powering on the camera unit 120 and starts shooting the region to be monitored in real time.

The camera unit 120 preferably uses a digital PTZ (Pan Tilt Zoom) camera that realizes an electronic pan and tilt operation rather than a mechanical pan and tilt operation using a built-in camera or a high resolution lens , The lens should be installed so that the widest extended area can be photographed by using a lens having a maximum angle of view of 180 degrees.

The voice input / output unit 130 transmits the voice inputted from the outside to the main server 200 or outputs the voice received from the main server 200 to the outside. At this time, the voice received from the main server 200 and output to the outside is transmitted to the user terminal 300 relayed in real time at the request of the user terminal 300 and to the emergency alert signal received from the main server 200 And outputs an emergency warning voice to be transmitted. Emergency alert voices are sentences or words of various voice formats for real-time situations.

When the calling unit 140 calls the calling unit 140 installed in the event collecting terminal as a means for calling the inside from the outside, the control unit 150 transmits a calling signal to the main server 200, The main server 200 receives an alarm from the user terminal 300 and informs the event collecting terminal 100 of the call. At this time, if there is a relay request from the user terminal 300 to the main server 200, the main server 200 relays the connection between the user terminal 300 and the event collecting terminal 100 so that the user terminal 300 can transmit and receive the image or voice. The calling unit 140 according to the present invention has a function similar to that of a conventional interphone and a video phone, so that the interphone and the videophone can be substituted by the present invention.

As described above, when the controller 150 detects an operation or a sound, the controller 150 controls the power of the camera to be turned on / off. The control unit 150 transmits / receives input and output signals of the captured image and voice to the main server, . In addition, when the controller 150 receives the photographing end signal because the designated event is not detected from the main server 200, the control unit 150 short-circuits the power of the camera unit 120 and stops the photographing.

The communication unit 160 is capable of communicating with the main server 200 by using the Internet network and transmits the photographed video, voice input / output, call signal, photographing end signal, or emergency warning signal directly to the main server 200 Or receive. In this case, the communication unit 160 may include a remote communication module or a local communication module. Depending on the installed location, the communication unit 160 may receive a video signal, voice input / Or transmit or receive an emergency alert signal.

In addition, the event collecting terminal 100 may include a door opening / closing unit 170 that is electrically connected to the door locking device and receives a door opening / closing signal from the main server 200 to open and close the door locking device .

The reception control unit 210 of the main server 200 receives the image or call signal photographed from the event collecting terminal 100. [ In addition, the reception control unit 210 receives a request for relaying a voice or image from the user terminal and a request for opening / closing the door lock device.

The main server 200 stores the photographed image in the image database 220 when the photographed image is received from the event collecting terminal 100 in the reception control unit 210 of the main server 200. [ An image stored in the image database 220 of the main server 200 is stored until all power is turned on and the power source is short-circuited.

Unlike images stored in the object analysis database 240 described later, the images stored in the image database 220 are consecutively stored until the camera unit 120 is powered on and power is short-circuited. It is preferable that the image is stored in the main server 200 for a certain period of time for further searching if there is a detected event despite the search by the event searching unit 250 of the main server 200. [

The reception control unit 210 receives the paging signal from the event collecting terminal 100 and transmits to the user terminal 100 via the transmitting unit 270 an alarm that the paging signal has been transmitted from the paging terminal 100, Receives the relay request from the event collecting terminal 100 from the user terminal 100 and relays voice or video between the event collecting terminal 100 and the user terminal 300 through the relay unit 280. [ And receives an emergency alert signal transmission request for outputting an emergency alert voice to the event collecting terminal 100 from the user terminal 300 receiving the alarm.

The object analyzing unit 230 analyzes the images stored in the image database for each object. The reason for analyzing each object at this time is that it is possible to detect a more accurate event by analyzing each object in order to efficiently search for an event. Accordingly, the object analyzing unit 230 according to the present invention classifies objects into categories such as a person or an animal by classifying them according to the types of objects and the behaviors of the objects, and the behaviors of the objects are classified into door open, cluster, . At this time, the images analyzed by the object analyzing unit 230 are stored in the object analysis database 240 according to the classification for efficient search and transmission to the user terminal.

The event searching unit 250 notifies the user terminal 300 of the occurrence of the event when the image stored in the object analysis database 240 matches the event stored in the event storage unit 260, As shown in FIG. The event stored in the event storage unit 260 may be a moving picture or data including an event specified by the main server 200 or the user terminal 300. The event search unit 250 according to the present invention minimizes the transmission of unnecessary alarms when an image taken by a malfunction of the detection sensor or a situation that is not important for security is generated, thereby minimizing the inconvenience of monitoring by the user terminal 300 There is an effect that can be done.

When the event stored in the event storage 260 matches the type or behavior of the object stored in the object analysis database 240 or the call signal is received from the event collection terminal 100 as described above, (300). At this time, the alarm system can be provided in various forms according to the user terminal 300 receiving the alarm such as short / long message (SMS / MMS), automatic response system, thumbnail system and the like. When an emergency alert signal is sent from the user terminal 300 receiving the alarm, the emergency alert signal is transmitted to the event collecting terminal 100. If the image stored in the object analysis database 240 and the event stored in the event storage unit 260 do not coincide with each other, the image capturing terminal 100 transmits a photographing end signal.

When the relay unit 280 requests the main server 200 to transmit or receive a voice or video to or from the user terminal 300 that has received the alarm, the main server 200 transmits the voice or video to the relay unit 280, A voice or video communication is possible between the earbud collecting terminal 100 and the user terminal 300 through the earbud terminal.

3 is a flowchart illustrating a door monitoring method using real-time event detection according to the present invention.

Referring to FIG. 3, the operation or sound is sensed by the potato sensor unit 110 in a space where the event collecting terminal 100 is installed according to the present invention (S302). When the sensing unit 110 senses an operation or a sound, the control unit 150 applies power to the camera unit 120 to photograph the corresponding image (S304). The control unit 150 transmits the image photographed by the camera unit 120 to the main server 200 through the communication unit 160 (S306).

The reception control unit 210 of the main server 200 stores the image transmitted to the event collecting terminal 100 in the image database 220 (S308). The object analyzer 230 of the main server 200 analyzes the images stored in the image database 220 for each object and stores them in the object database 240 (S310). The image of the stored object database is searched by the event search unit 250 of the main server 200 to see if it matches the event stored in the event storage unit 260. When the events detected by the event detection unit 250 are identical to the events stored in the event storage unit 260 and the images stored in the object database 240, the transmission unit 270 of the main server 200 transmits the event to the user terminal 300 (S316). On the other hand, when the event searching unit 250 does not search for an event stored in the event storage unit 260 and an event matching the image stored in the object database 240, the transmitting unit 270 of the main server 200 searches for an event The controller 150 transmits a photographing end signal to the terminal 100. Upon receiving the photographing end signal from the main server 200, the controller 150 shorts the power of the camera unit 120 and terminates the photographing operation at step S314.

The alarm is transmitted according to the form of the user terminal 300 by SMS / MMS, an automatic response method, a thumbnail method, etc., and the transmitted user terminal 300 confirms an accurate event The main server 200 can request the image information displayed in the alarm (S318). In response to the request of the user terminal 300, the transmission unit 270 of the main server 200 transmits the event occurrence image to the user terminal 300 (S320). The user terminal 300 may request the main server 200 to transmit an emergency alert signal after confirming the event occurrence image transmitted from the main server 200 at step S322. The transmitting unit 270 of the main server 200 that has received the emergency alert signal transmission request from the user terminal 300 transmits an emergency alert signal to the event collecting terminal 100 at step S324. The event collecting terminal 100 receiving the emergency alert signal from the main server 200 outputs an emergency alert voice through the voice input / output unit 130 (S326).

It should be noted that the embodiments described in the present specification and the configurations shown in the drawings are only the most preferred embodiments of the present invention and are not intended to represent all of the technical ideas of the present invention so that various equivalents And variations are possible.

100: Ebb collecting terminal
110: detection sensor unit 120: camera unit
130: voice input / output unit 140:
150: control unit 160:
170: Door opening / closing unit
200: main server
210: suspect control unit 220: image database
230: object analysis unit 240: object analysis database
250: Event search unit 260: Event storage unit
270: Transmission unit 280: Relay unit
300: User terminal

Claims (8)

1. A door monitoring system for detecting a real-time event connected to an Internet network,
An event collecting terminal for receiving an input / output of a photographed image and sound by sensing an operation or a sound, a calling signal, a photographing end signal, or an emergency bell signal to / from a main server;
The image capturing terminal receives and stores the captured image or transmits an image capturing end signal. The captured image is analyzed and stored for each object, and an event corresponding to the stored event is detected. When a call signal is received from the event collecting terminal A main server for transmitting an alarm to a user terminal, transmitting an event image or an emergency alert signal detected by a request of the user terminal, or relaying an image or voice between the event collecting terminals;
And a user terminal for receiving an alarm from the main server, requesting an event image sensed by the main server, and transmitting and receiving video or audio during an event collection terminal. The event collecting terminal of claim 1,
A sensing sensor unit for sensing the operation or sound;
A camera unit for starting image capturing when an operation or sound is sensed by the detection sensor unit;
A voice input / output unit for transmitting the input voice to the main server, outputting voice received from the main server, or outputting an emergency warning voice;
A calling unit for calling a main server to request transmission / reception of video or audio to / from the user terminal;
A control unit for applying / shorting the power of the camera when the operation or sound is sensed by the detection sensor unit, and for transmitting / receiving the photographed image / sound input / output, call signal, or photographing end signal to / from the main server;
And a communication unit for transmitting / receiving the photographed image, sound input / output, call signal, photographing end signal or emergency warning signal to / from the main server. The method according to claim 1 or 2,
Wherein the event collecting terminal is electrically connected to the door locking device and includes a door opening / closing device for opening and closing the door locking device by receiving a door opening / closing signal from the main server. The method according to claim 1 or 2,
Wherein the event collecting terminal transmits or receives video and audio input / output, a call signal, or an image capturing end signal photographed by a camera through a home gateway to a main server. The system according to claim 1,
A reception control unit for receiving a video or paging signal photographed from the event collecting terminal or receiving a request for transmitting a voice or video relay request and an emergency alert signal from a user terminal;
An image database for receiving and storing images photographed from the event collecting terminal;
An object analyzing unit for analyzing the type or behavior of the sensed object among the stored images;
An object analysis database for storing the analyzed objects by type or behavior;
An event storage unit for storing an alarm-requested event from the user terminal;
An event search unit for searching and determining whether the event stored in the event storage unit matches the type or behavior of the object stored in the object analysis database;
An alarm is transmitted to the user terminal when an event stored in the event storage unit matches the type or behavior of the object stored in the object analysis database or a call signal is received from the event collection terminal, A transmitting unit for transmitting an imaging end signal to an event collecting terminal when an event stored in the event storing unit and an object stored in the object analyzing database do not match the type or behavior of the object;
And a relaying unit for relaying the voice or video between the event collecting terminal and the user terminal so that the voice or video can be transmitted and received between the user terminal and the event collecting terminal when the relaying request is received from the user terminal receiving the paging signal or the alarm. Door monitoring system through. The method of claim 5,
Wherein the transmitter transmits an opening / closing signal of the door lock device to the event collecting terminal according to a request to open / close the door lock device from the user terminal, when the transmitter receives a request to open / close the door lock device from the user terminal. Door monitoring system through detection. A method for monitoring a door through real-time event detection connected to the Internet,
(a) detecting an operation or a sound in a space where the event collecting terminal is installed;
(b) capturing an image of the event collecting terminal when the operation or sound is sensed;
(c) the event collecting terminal transmitting the photographed image to a main server;
(d) the main server stores an image transmitted to the event collecting terminal;
(e) analyzing and storing the stored images for each object;
(f) the main server analyzes each of the objects and searches for the presence of a specified event matching the event stored in the event storage unit; And
(g) The main server transmits an alarm to the user terminal when a specified event is detected, or transmits a photographing end signal to the event collecting terminal if a specified event is not detected. . 8. The method as claimed in claim 7, wherein the door monitoring method comprises:
(h) the user terminal having received the alarm requests the main server to transmit an event detection image;
(i) the main server transmits an event detection image requested from a user terminal;
(j) requesting transmission of an emergency alert signal by the user terminal that has received the event detection image from the main server;
(k) the main server, which is requested to transmit the emergency alert signal from the user terminal, transmits an emergency alert signal to the event collecting terminal; And
(l) The event collecting terminal receiving the emergency alert signal from the main server further outputs an emergency alert voice.

Images