Method and system for safely monitoring production process of cylinder equipment
Technical Field
The invention relates to the technical field of industrial safety monitoring, in particular to a safety monitoring method and system for a production process of cylinder equipment.
Background
The cylinder type equipment is widely applied in the industrial field, such as hot air moistening She Jitong can be used for increasing the temperature and humidity of tobacco leaves in the tobacco processing industry, and the drying cylinder of the cut tobacco dryer can be used for uniformly drying cut tobacco.
Meanwhile, the production process of the cylinder equipment is also complex. Specifically, it is first necessary to curl the steel sheet into a roll by a plate bending machine. And then tightly splicing the plurality of reels into a large barrel by welding. And finally, welding required parts in the cylinder. There is a great potential safety risk in this process, and therefore some necessary protective measures need to be taken. For example, the hoisted objects can slide down during hoisting operation, so people cannot stand under the hoisted objects, operators wear goggles to avoid injury caused by splashes during operation of the veneer reeling machine, welding work clothes, protective gloves and protective masks are strictly worn during external welding, sundries are forbidden to be placed on the surface of a reel to prevent injury to people below due to sliding down, safety belts are strictly worn during ascending welding, and fans are required to assist ventilation during internal welding because the operation space is relatively closed, and welding work clothes, protective gloves and protective masks are strictly worn at the same time.
At present, the manual monitoring mode is difficult to realize real-time and accurate monitoring of the whole processing process, the phenomena of missing detection and false detection are easy to occur, and the safety monitoring method and system special for the production process of the cylinder equipment are not available. Meanwhile, most of the current visual detection methods cannot adapt to the requirements of multiple scenes and multiple changes, can only aim at a single scene, and are complex in operation and low in efficiency. For example, patent CN202310818645.5 proposes a safety welding system and method based on Yolov5, which includes a mechanical arm and a control module, wherein a welding gun is installed on the mechanical arm, the control module is connected with a control end of the mechanical arm to control the mechanical arm to weld a workpiece to be welded, a camera shooting input module is used for acquiring video source data of an operation site, a safety helmet detection module is installed on the safety helmet detection module and is used for identifying an operator in the video source data and identifying whether the operator wears a safety helmet or not, a safety helmet detection result is output, a workpiece quality detection module is installed on the workpiece quality detection module and is used for carrying out quality detection on a workpiece in the video source data and outputting a welding quality detection result, and a display module is used for visually displaying the safety helmet detection result and the welding quality detection result.
Therefore, a method dedicated to automatically identifying the safety risk in the whole production process of the cylindrical equipment is needed to improve the production safety and efficiency.
Disclosure of Invention
Aiming at the problems, the invention provides a safety monitoring method and a system special for the production process of cylinder equipment, which can effectively early warn and prevent the occurrence of safety accidents and further improve the overall production safety level and the production efficiency by monitoring the safety behavior of the whole production process of the cylinder equipment in real time in the whole process, and in the monitoring and identification, the process sections are firstly judged, and then the monitoring is further identified and carried out aiming at different safety risks of different process sections, so that the complexity of identification is effectively reduced, and the safety risks in the production process are identified more rapidly and accurately.
The technical scheme of the invention is as follows:
The invention discloses a safety monitoring method for a production process of barrel equipment, which comprises the following steps:
Firstly, collecting video streams of a production area of barrel equipment in real time and uploading the video streams;
Step two, automatically identifying which flow section of the production process the current operation content belongs to according to the video stream information, wherein the flow section comprises a hoisting section, a winding drum forming section, an external welding section and an internal welding section;
And thirdly, outputting the identification result obtained in the second step according to the set risk judging condition, returning to the first step for continuous cycle monitoring if the monitoring result is that the safety risk is not present, triggering safety alarm if the detection monitoring is that the safety risk is present, and returning to the first step for continuous cycle monitoring.
The second step is characterized in that the crane is in hoisting operation and is used for hoisting objects, the reel forming section is characterized in that the plate bending machine is in an operating state and the steel plate is curled, the outer welding section is characterized in that workers are in welding operation outside the reel, and the inner welding section is characterized in that workers are in welding operation inside the reel.
Further, the specific implementation method of the second step includes:
S21, extracting operation videos acquired in the first step, wherein the operation videos comprise hoisting operation, plate rolling of a plate rolling machine, external welding of a winding drum and internal welding of the winding drum;
S22, extracting target images including lifting hooks, winding drums, human bodies, goggles, protective masks, protective gloves, welding work clothes, safety belts, sundries and fans from the video acquired in the first step, marking targets in the target images, generating marking files including target positions and category information, and constructing a target detection data set;
S23, training the action recognition data set and the target detection data set by adopting an action recognition algorithm and a target detection algorithm respectively;
S24, identifying which flow section the current operation content belongs to and the security risk existing in the flow section by using the trained action identification model and the target detection model.
Further, in the second step, if the current flow section is a hoisting section, detecting whether a person stands under the hoisted object, specifically including:
Firstly, identifying a lifting hook and a person, and obtaining coordinate information of a human body detection frame [ X min-p,Ymin-p,Xmax-p,Ymax-p ], wherein the coordinate information of the lifting hook detection frame is [ X min-h,Ymin-h,Xmax-h,Ymaxh ];
secondly, calculating the horizontal Euclidean distance between the lifting hook detection frame and the center point of the human body detection frame,
Finally, if the horizontal Euclidean distance d is smaller than the specified threshold d th, the person under the suspended object is indicated, and if the horizontal Euclidean distance d is larger than the specified threshold d th, the person under the suspended object is indicated.
Further, in the second step, if the current flow section is a roll forming section, whether a veneer reeling machine operator wears goggles is detected, if the current flow section is an external welding section, whether sundries are placed on a roll or not is detected, whether welding personnel wear welding work clothes, protective gloves and protective masks or not is detected, whether safety risks are directly output if sundries are placed on the roll or the welding personnel wear protective equipment is detected, whether the welding personnel wear protective equipment is further judged, whether the safety risks are output if the welding personnel wear the protective equipment is not detected, whether the safety risks are output if the welding personnel do not wear the protective equipment is judged, whether the safety risks are output if the welding personnel do not wear the safety belts is further judged, and whether the safety belts are worn if the welding personnel do not wear the safety belts is judged.
Further, the method for judging and identifying the ascending operation comprises the following steps:
s31, acquiring coordinate information of a human body detection frame as [ X min-p,Ymin-p,Xmax-p,Ymax-p ], and acquiring coordinate information of a reel detection frame as [ X min-r,Ymin-r,Xmax-r,Ymax-r ];
S32, calculating the height difference between the human body and the central point of the winding drum: ;
S33, calculating the intersection ratio of the human body and the winding drum: , wherein, S P and S R are the areas of the human body detection frame and the reel detection frame respectively;
S32, judging whether a person is in ascending operation according to the intersection ratio IOU of the human body detection frame and the reel detection frame and the height difference h of the central point, wherein the judgment conditions of ascending operation of the person on the reel are that h > h th and 0< IOU th,hth are set human body and reel central point height difference threshold values, and IOU th is set human body and reel intersection ratio threshold value.
Further, in the second step, if the current flow section is an internal welding section, whether welding personnel wear welding work clothes, protective gloves and protective masks or not is detected, whether fan auxiliary ventilation is put outside the winding drum or not is judged, the welding work clothes, the protective gloves and the protective masks are worn, and the fans are arranged for parallel detection, and if the welding work clothes, the protective gloves and the protective masks are not detected, a safety alarm is triggered.
In the third step, risk judging conditions include that a person who hangs a object to be placed on the station, a veneer reeling machine operator does not wear goggles, a welder does not wear welding work clothes, protective gloves and protective masks, a welder ascends to work without wearing safety belts, and no fan is used for assisting ventilation during operation in a welder cylinder.
The invention also discloses a safety monitoring system for the production process of the cylinder equipment, which comprises a video acquisition module, a safety monitoring module and an alarm module;
the video acquisition module is used for acquiring the video stream of the production area in real time;
The safety monitoring module is used for identifying which flow section of the production process the current operation content belongs to, and detecting safety risks existing in the production of the flow section by adopting a corresponding method according to different flow sections;
And the alarm module is used for alarming according to the event type triggered by the safety risk.
Further, the safety monitoring module comprises a classification sub-module and a detection sub-module;
The classifying sub-module automatically identifies a current operation flow section, a hoisting section, a winding drum forming section, an external welding section or an internal welding section by adopting a video understanding algorithm;
And the detection submodule invokes a corresponding detection algorithm for each flow section to identify the security risk of different flow sections.
In summary, due to the adoption of the technical scheme, the beneficial effects of the invention are as follows:
1. The invention realizes the real-time and accurate monitoring of the whole production process of the cylinder equipment, is specially used for the production of the cylinder equipment, and solves the problem that no safety monitoring system specially used for the production process of the cylinder equipment exists.
2. The invention can automatically monitor and identify the safety risk existing in the production process, effectively early warn and prevent the occurrence of safety accidents, and solve the problems that the manual monitoring mode is difficult to realize real-time and accurate monitoring of the whole processing process and the phenomena of missing detection and false detection are easy to occur.
3. The invention improves the efficiency of video monitoring and identification, in the video identification process, the method is different from the existing method for judging and identifying all behaviors and characteristics in the production process, based on the characteristics of the production process of cylinder equipment, the process section is judged first, then the specific process section is judged, the whole process is carried out in sections, and the focusing process can be carried out during the analysis and the judgment, so that the judging and identification method is simplified, the pertinence is stronger, and the processing efficiency is higher.
4. The invention designs a detection algorithm special for the production process of the cylinder equipment, and the detection efficiency is obviously improved.
5. According to the invention, different scenes in the whole production process are classified and identified according to the existing risk characteristics, so that the occurrence of safety accidents can be effectively prevented, the false recognition rate is reduced, and the overall production safety level and the production efficiency are improved.
Drawings
The invention will now be described by way of example and with reference to the accompanying drawings in which:
FIG. 1 is a flow chart of a method for monitoring the safety of a production process of a cylinder device according to the present invention.
Fig. 2 is a schematic diagram of an external welding segment security risk identification step in an embodiment of the present invention.
FIG. 3 is a schematic flow chart of a system for monitoring the safety of a production process of a cylinder device according to the present invention.
Detailed Description
All of the features disclosed in this specification, or all of the steps in a method or process disclosed, may be combined in any combination, except for mutually exclusive features and/or steps.
Any feature disclosed in this specification (including any accompanying claims, abstract) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise. That is, each feature is one example only of a generic series of equivalent or similar features, unless expressly stated otherwise.
The features and capabilities of the present invention are described in further detail below in connection with examples.
The invention discloses a safety monitoring method for a production process of cylinder equipment, which comprises the following steps:
Firstly, collecting video streams of a production area of barrel equipment in real time and uploading the video streams;
Step two, automatically identifying which flow section of the production process the current operation content belongs to according to the video stream information, wherein the flow section comprises a hoisting section, a winding drum forming section, an external welding section and an internal welding section;
And thirdly, outputting the identification result obtained in the second step according to the set risk judging condition, returning to the first step for continuous cyclic monitoring if the monitoring result is that the safety risk is not present, triggering safety alarm if the monitoring result is that the safety risk is present, and returning to the first step for continuous cyclic monitoring.
As shown in fig. 1, in one embodiment, a method for monitoring the safety of a production process of a cylinder device is disclosed, which specifically includes the steps of:
step one, a video acquisition module acquires video streams of a production area of barrel equipment in real time and inputs the video streams into a safety monitoring module.
Step two, a classification submodule in the safety monitoring module automatically identifies a flow section of the current operation content according to video stream information, wherein the flow section comprises a hoisting section, a winding drum forming section, an external welding section and an internal welding section, if no classification result exists, the production area does not currently operate, and the step one is returned to for continuous cycle monitoring.
And thirdly, the detection sub-module invokes a detection algorithm corresponding to the current flow section to identify the security risk.
If the current flow section is a hoisting section, detecting whether a person stands under the hoisted object;
If the roll forming section is the roll forming section, detecting whether a veneer reeling machine operator wears goggles or not;
If the welding section is an external welding section, detecting whether sundries are placed on the winding drum, and whether welding personnel wear welding work clothes, protective gloves and protective masks or not;
If the welding section is the internal welding section, whether welding personnel wear welding work clothes, protective gloves and protective masks or not is detected, and whether a fan is arranged outside the winding drum for auxiliary ventilation or not is detected.
Analyzing the identification result output by the step three, outputting a safety monitoring result according to a set risk judging condition, returning to the step one for continuous cycle monitoring if the safety risk is absent, triggering a safety alarm if the safety risk is present, and returning to the step one for continuous cycle monitoring.
The risk judging conditions comprise that a person who hangs a object to get off the station, a veneer reeling machine operator does not wear goggles, a welder does not wear welding work clothes, protective gloves and protective masks, a welder ascends to work without wearing safety belts, and no fan is used for assisting ventilation during operation in a welder cylinder.
And fifthly, the alarm module performs voice broadcasting in a production area in a broadcasting mode according to the triggered event type, and simultaneously sends a notification to workshop management personnel so that the workshop management personnel can take corresponding measures in time.
The specific implementation method of the second step comprises the following steps:
1. and collecting data, namely collecting operation videos during hoisting operation, plate rolling by a plate rolling machine, external welding of a winding drum and internal welding of the winding drum.
2. And (3) data processing, namely dividing the video into a segment every 10 frames, labeling a category for each segment, and constructing an action recognition data set. The category labels of the video clips are a hoisting section, a winding drum forming section, an external welding section and an internal welding section. The hoisting section is characterized in that the crane is in hoisting operation and is hoisted with objects. The roll forming section is characterized in that the plate bending machine is in an operating state, and the steel plate is being curled. The external welding section is characterized by the fact that a worker is working on the outside of the reel. The internal welding section is characterized by the fact that the worker is working for welding inside the reel.
3. Model training, namely training the action recognition data set by adopting a TSM-ResNet action recognition algorithm, and using a weight model trained by a public data set Kinetics as a pre-training model.
4. And (3) identifying the flow section, namely using the trained action identification model to analyze the video stream information acquired in the step one in real time and identifying the flow section of the current operation content.
The specific implementation method of the third step comprises the following steps:
1. And data acquisition, namely extracting images of targets such as lifting hooks, winding drums, human bodies, goggles, protective masks, protective gloves, welding work clothes, safety belts, sundries, fans and the like from the video.
2. And (3) data processing, namely marking targets in the images by using an image marking tool, generating marking files containing target positions and category information, and constructing a target detection data set.
3. Training a target detection data set by adopting yolov n target detection algorithm, and using a weight model trained by a public data set coco128 as a pre-training model to obtain four algorithm models, wherein the four algorithm models comprise a hoisting section algorithm, a reel forming section algorithm, an external welding section algorithm and an internal welding section algorithm. The hoisting section algorithm trains targets such as human bodies, reels, lifting hooks and the like, the reel forming section algorithm trains targets such as goggles, human bodies and the like, and the external welding section algorithm trains targets such as human bodies, protective masks, protective gloves, welding work clothes, safety belts, sundries and the like. The internal welding segment algorithm trains targets such as human body, protective mask, protective glove, welding work clothes, fans and the like.
4. And (3) safety risk identification, namely enabling a corresponding detection algorithm to identify the safety risk existing in the production of the flow section according to the flow section identified in the step two.
As shown in fig. 2, in the external welding section in the third step, if no protective equipment (welding work clothes, protective gloves and protective masks) or sundries are detected to be placed on the winding drum, the safety risk is directly output, if no sundries are placed on the winding drum and the protective equipment is worn by the welding personnel, whether the ascending operation exists is further judged, if no ascending operation exists, the safety risk is output, if the ascending operation exists, whether the safety belt is worn is further judged, and if the safety belt is not worn, the safety risk is output.
And step three, the internal welding section, namely the welding work clothes, the protective gloves, the protective mask and the fan are detected in parallel, and a safety alarm is triggered as long as the detection is not the same.
The method for detecting the person standing under the suspended object in the third step comprises the steps of firstly identifying the hanging hook and the person, obtaining coordinate information of a human body detection frame [ X min-p,Ymin-p,Xmax-p,Ymax-p ], obtaining the coordinate information of the hanging hook detection frame [ X min-h,Ymin-h,Xmax-h,Ymaxh ], and secondly calculating the horizontal Euclidean distance between the center points of the hanging hook detection frame and the human body detection frameIf the horizontal Euclidean distance d is smaller than the specified threshold d th, the person under the suspended object is indicated, and if the horizontal Euclidean distance d is larger than the specified threshold d th, the person under the suspended object is indicated.
The step three, the ascending operation identification method comprises the steps of judging whether a person is in ascending operation according to the intersection ratio IOU of a human body detection frame and a reel detection frame and the height difference of a central point, wherein the coordinate information of the human body detection frame is [ X min-p,Ymin-p,Xmax-p,Ymax-p ], and the coordinate information of the reel detection frame is [ X min-r,Ymin-r,Xmax-r,Ymax-r ];
Height difference between human body and central point of winding drum:
;
The cross-mixing ratio of human body and winding drum:
;
Wherein:
And The areas of the human body detection frame and the reel detection frame are respectively.
The judgment conditions of the work of the person ascending on the winding drum are h > h th and 0< IOU th. The human body is shown above the winding drums, and the winding drums are overlapped to a certain extent, so that the human body is ensured to be in the vicinity of the winding drums, and meanwhile, the person at a distance is prevented from being misjudged to be a climbing operation.
In the embodiment of the present invention, d th=200Px、hth=160Px、IOUth =0.3, and the threshold d th、hth and the IOU th can be adjusted according to the actual engineering environment.
As shown in FIG. 3, the invention also discloses a safety monitoring system for the production process of the cylinder equipment, which comprises a video acquisition module, a safety monitoring module and an alarm module, wherein the safety monitoring module comprises a classification sub-module and a detection sub-module. The video acquisition module acquires the video stream of the production area in real time, the classification submodule in the safety monitoring module automatically identifies the flow sections (the hoisting section, the winding drum forming section, the external welding section and the internal welding section) of the current operation by adopting a video understanding algorithm, the detection submodule invokes a corresponding detection algorithm for each flow section to identify the safety risk of different flow sections, and the alarm module performs corresponding voice broadcasting according to the event type triggered by the safety risk and simultaneously sends a notification to workshop management personnel. Through classifying and identifying different scenes of the whole production process according to the existing risk characteristics, the occurrence of safety accidents can be effectively early warned and prevented, the false recognition rate is reduced, and the whole production safety level and the production efficiency are improved.
The above examples merely illustrate specific embodiments of the application, which are described in more detail and are not to be construed as limiting the scope of the application. It should be noted that it is possible for a person skilled in the art to make several variants and modifications without departing from the technical idea of the application, which fall within the scope of protection of the application.