CN114493375A - Construction Safety Macro Evaluation System and Method - Google Patents
Construction Safety Macro Evaluation System and Method Download PDFInfo
- Publication number
- CN114493375A CN114493375A CN202210339975.1A CN202210339975A CN114493375A CN 114493375 A CN114493375 A CN 114493375A CN 202210339975 A CN202210339975 A CN 202210339975A CN 114493375 A CN114493375 A CN 114493375A
- Authority
- CN
- China
- Prior art keywords
- construction
- value
- worker
- workers
- safety
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/043—Architecture, e.g. interconnection topology based on fuzzy logic, fuzzy membership or fuzzy inference, e.g. adaptive neuro-fuzzy inference systems [ANFIS]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/08—Construction
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Human Resources & Organizations (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Strategic Management (AREA)
- Mathematical Physics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Artificial Intelligence (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Economics (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Entrepreneurship & Innovation (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Marketing (AREA)
- Educational Administration (AREA)
- Development Economics (AREA)
- Pure & Applied Mathematics (AREA)
- Computational Mathematics (AREA)
- Game Theory and Decision Science (AREA)
- Automation & Control Theory (AREA)
- Mathematical Optimization (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Mathematical Analysis (AREA)
- Fuzzy Systems (AREA)
- Primary Health Care (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
本发明是关于一种施工安全宏观评估系统及方法,系统包括:数据处理模块,采集施工现场的数据图像并进行标注和识别处理,以确定施工现场的每个工人和工程机械,及每个工人和工程机械各自对应的中心点坐标和轮廓坐标;安全评测模块,根据施工现场的每个工人和工程机械,以及每个工人和工程机械各自对应的中心点坐标和轮廓坐标确定每日的工人未佩戴安全帽的不安全行为值、工人风险意识值和管理敏捷值;训练模块,根据预设时间段内的不安全行为值、工人风险意识值和管理敏捷值,和对应的预设的施工安全宏观评估值,采用模糊神经网络算法进行训练,得到施工安全宏观评估模型;评估模块,使用施工安全宏观评估模型对目标施工现场进行施工安全宏观评估。
The invention relates to a construction safety macro-evaluation system and method. The system includes: a data processing module, which collects data images of the construction site and performs labeling and identification processing to determine each worker and construction machinery on the construction site, and each worker on the construction site. The center point coordinates and contour coordinates corresponding to the construction machinery; the safety evaluation module determines the daily worker safety according to each worker and construction machinery at the construction site, as well as the center point coordinates and contour coordinates corresponding to each worker and the construction machinery. Unsafe behavior value, worker risk awareness value and management agility value of wearing helmets; training module, according to the unsafe behavior value, worker risk awareness value and management agility value within a preset time period, and the corresponding preset construction safety The macro evaluation value is trained by fuzzy neural network algorithm, and the construction safety macro evaluation model is obtained; the evaluation module uses the construction safety macro evaluation model to carry out the construction safety macro evaluation on the target construction site.
Description
技术领域technical field
本发明涉及施工现场的数据处理技术领域,尤其涉及一种施工安全宏观评估系统及方法。The invention relates to the technical field of data processing on construction sites, in particular to a construction safety macro evaluation system and method.
背景技术Background technique
建筑工地上随处可见的不安全行为是目前建筑业施工阶段面临的最大挑战。根据事故致因理论,人的不安全行为与物的不安全状态是导致资产损失与人员伤亡的直接原因。目前降低施工现场安全事故的主要方法是安全相关人员巡逻,通过人力观测现场的不安全行为与不安全状态从而识别安全隐患对风险加以规避。但是不安全行为与不安全状态的频繁出现背后有着更为深层的系统原因。针对施工中的安全问题,研究人员发现有三个关键要素值得关注,分别是安全力、安全文化和安全行为。The ubiquitous unsafe behavior on construction sites is the biggest challenge facing the construction phase of the construction industry today. According to the accident causation theory, the unsafe behavior of people and the unsafe state of things are the direct causes of asset loss and casualties. At present, the main method to reduce safety accidents on construction sites is to patrol by safety-related personnel, and to identify potential safety hazards and avoid risks by manpower observing unsafe behaviors and unsafe conditions on the site. But there are deeper system reasons behind the frequent occurrence of unsafe behaviors and unsafe states. For safety issues in construction, the researchers found that there are three key elements worth paying attention to, namely safety force, safety culture and safety behavior.
安全决策力被定义为决策者为实现组织安全目标而和下属开展的互动过程,在这个过程中,决策者可以依托组织因素和个人因素的共同作用对追随者施加影响。这一定义受到研究人员的广泛认可。安全决策力被视为决策力的子概念。许多研究证明,积极的变革型或契约型安全决策力可影响下级管理人员或基层工人:主观方面实现他们对上级管理者安全态度和安全承诺的良好感知,塑造正确的安全价值观和对安全目标的积极认同;客观方面通过设定基于安全绩效的奖惩措施和规章程序,促使下属或工人规避不安全的生产活动。Security decision-making is defined as the interaction process between decision-makers and subordinates to achieve organizational security goals. In this process, decision-makers can exert influence on followers by relying on the combined action of organizational and personal factors. This definition is widely accepted by researchers. Security decision-making power is regarded as a sub-concept of decision-making power. Numerous studies have demonstrated that positive transformational or contractual safety decision-making can influence lower-level managers or workers at the lower level: subjectively achieve their good perception of higher-level managers' safety attitudes and commitment to safety, shape correct safety values and attitudes toward safety goals Positive recognition; objectively motivate subordinates or workers to avoid unsafe production activities by setting incentives and punishments based on safety performance and regulatory procedures.
安全文化被定义为组织中全体成员对于组织在生产时所面对的风险、事故和健康等问题的观点与信念。安全文化是组织文化的子概念,从属于组织文化,其主要内涵包括信念、态度和价值观。安全文化可被凝练为“建构在集体中人、事、物上的安全信念和价值观的组合,反映着集体所有人均认同的对生命和安全的看法和行为习惯”。建设项目的安全文化表现在工人的行为、工人的主观感知和工人作业的客观环境等三个方面。Safety culture is defined as the views and beliefs of all members of an organization about the risks, accidents, and health issues that the organization faces during production. Safety culture is a sub-concept of organizational culture, subordinate to organizational culture, and its main connotations include beliefs, attitudes and values. Safety culture can be condensed as "the combination of safety beliefs and values built on people, things and things in the collective, reflecting the views and behavior habits of life and safety agreed by all the people in the collective". The safety culture of construction projects is manifested in three aspects: workers' behavior, workers' subjective perceptions, and the objective environment of workers' operations.
安全行为被定义为人在与人、事、物的交互过程中,受安全目标驱使或安全要求约束而做出的管理行为和操纵行为。传统建筑安全研究表明,工人不安全行为是事故主要致因。现有大量研究对施工现场的不安全行为开展分类、识别工作,许多研究从不同的角度总结了施工现场典型的工人安全行为(或不安全行为)类别。最为常见的施工现场不安全行为为过度接近危险源和个人防护装备的错误穿戴。Safety behaviors are defined as management behaviors and manipulation behaviors made by people in the process of interacting with people, things, and things, driven by safety goals or constrained by safety requirements. Traditional building safety studies have shown that worker unsafe behavior is the main cause of accidents. A large number of existing studies have classified and identified unsafe behaviors on construction sites, and many studies have summarized the categories of typical worker safety behaviors (or unsafe behaviors) on construction sites from different perspectives. The most common construction site unsafe behaviors are excessive proximity to hazards and incorrect wearing of personal protective equipment.
通过研究安全决策力、安全文化和安全行为的内涵及其相互作用关系,提出了以决策驱动文化发展和行为控制为核心的建筑安全决策力-文化-行为(LCB)方法。LCB方法强调安全决策的作用,不仅直接减少不安全行为,而且通过安全文化发展从根本上改变不安全行为的原因,最终实现可持续减少不安全行为和预防事故的目标。By studying the connotation and interaction of safety decision-making power, safety culture and safety behavior, a building safety decision-making power-culture-behavior (LCB) method with decision-driven cultural development and behavior control as the core is proposed. The LCB approach emphasizes the role of safety decision-making, not only directly reducing unsafe behaviors, but also fundamentally changing the causes of unsafe behaviors through safety culture development, ultimately achieving the goal of sustainable reductions in unsafe behaviors and accident prevention.
发明内容SUMMARY OF THE INVENTION
为克服相关技术中存在的问题,本发明提供一种基于LCB理论的施工安全宏观评估系统及方法。In order to overcome the problems existing in the related art, the present invention provides a macro-evaluation system and method for construction safety based on the LCB theory.
根据本发明实施例的第一方面,提供一种施工安全宏观评估系统,包括:According to a first aspect of the embodiments of the present invention, a construction safety macro evaluation system is provided, including:
数据处理模块,用于采集施工现场的数据图像并进行标注和识别处理,以确定施工现场的每个工人和每个工程机械,以及每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标;The data processing module is used to collect data images of the construction site and perform labeling and identification processing to determine each worker and each construction machine on the construction site, as well as the corresponding center point coordinates and contours of each worker and each construction machine coordinate;
安全评测模块,用于根据施工现场的每个工人和每个工程机械,以及每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标确定每日的工人未佩戴安全帽的不安全行为值、工人风险意识值和管理敏捷值;The safety evaluation module is used to determine the daily unsafe behavior of workers without helmets according to each worker and each construction machine on the construction site, as well as the corresponding center point coordinates and outline coordinates of each worker and each construction machine value, worker risk awareness value and management agility value;
训练模块,用于根据预设时间段内的不安全行为值、工人风险意识值和管理敏捷值,和对应的预设的施工安全宏观评估值,采用模糊神经网络算法进行训练,得到施工安全宏观评估模型;The training module is used for training with fuzzy neural network algorithm according to the unsafe behavior value, worker risk awareness value and management agility value within a preset time period, and the corresponding preset macroscopic evaluation value of construction safety to obtain the macroscopic construction safety value. evaluation model;
评估模块,用于使用施工安全宏观评估模型对目标施工现场进行施工安全宏观评估。The assessment module is used to perform macro-assessment of construction safety on the target construction site using the macro-assessment model of construction safety.
在一个实施例中,优选地,数据处理模块包括:In one embodiment, preferably, the data processing module includes:
数据采集单元,用于通过摄像装置采集施工现场的数据图像;The data acquisition unit is used to collect the data images of the construction site through the camera device;
校准单元,用于每日对摄像装置进行校准;Calibration unit for daily calibration of the camera;
标注单元,用于在每日施工前,根据接收到的标记指令,标注工程机械的专用道路和施工作业的高风险区;The marking unit is used to mark the special roads for construction machinery and high-risk areas for construction operations according to the received marking instructions before daily construction;
识别单元,用于通过预先收集和标注的施工图像,基于Mask-RCNN与Deepsort算法对工人、移动式工程机械、塔吊进行训练,以分钟为单位在施工现场的数据图像中分别识别出工人、移动式工程机械与塔吊的轮廓坐标,并对每个识别对象加以追踪;在数据库中,以分钟为单位分别统计识别出的工人、移动式工程机械和塔吊的总数量;其中,当识别出工人的轮廓时,识别工人是否佩戴安全帽,并进行相应的未佩戴安全帽数量的统计,将识别出的每个工人、每个移动式工程机械与每个塔吊进行编号,并将其对应的轮廓坐标与中心点坐标同步存入对应的工人、移动式工程机械与塔吊的数据集中。The identification unit is used to train workers, mobile construction machinery, and tower cranes based on the Mask-RCNN and Deepsort algorithms through pre-collected and labeled construction images, and to identify workers, mobile, and mobile in the data images of the construction site in minutes The outline coordinates of mobile construction machinery and tower cranes are collected, and each identification object is tracked; in the database, the total number of identified workers, mobile construction machinery and tower cranes is counted in minutes; When contouring, identify whether the worker wears a helmet, and count the number of the corresponding number of not wearing a helmet, number each identified worker, mobile construction machinery and tower crane, and set the corresponding contour coordinates. Synchronized with the center point coordinates and stored in the corresponding data sets of workers, mobile construction machinery and tower cranes.
在一个实施例中,优选地,安全评测模块用于:In one embodiment, preferably, the security evaluation module is used to:
将数据库中每分钟出现的未佩戴安全帽人数存为时间序列的数组UB i ,i = 0,1,2...n-1,令W i = UB i+1 - UB i , W 0 = 0,其中n为时间序列的时间长度,如果W i <0则令W i = 0,构建数组W i ,采用以下第一计算公式计算每日的不安全行为值:Store the number of people without helmets in the database as a time series array UB i , i = 0,1,2... n -1, let Wi = UB i +1 - UB i , W 0 = 0, where n is the time length of the time series. If Wi < 0, let Wi = 0, construct an array Wi , and use the following first calculation formula to calculate the daily unsafe behavior value:
其中,N i 为i时刻施工现场工人的总人数;Among them, Ni is the total number of workers on the construction site at time i ;
根据数据库中的每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标,统计各时刻暴露在风险区作业的工人数量,采用以下第二计算公式计算第一工人风险意识分值:According to the corresponding center point coordinates and contour coordinates of each worker and each construction machine in the database, count the number of workers exposed to work in the risk area at each moment, and use the following second calculation formula to calculate the risk awareness score of the first worker:
其中,NW i 代表i时刻暴露在风险区作业的工人数量,N i 为i时刻施工现场工人的总人数,表示每日暴露在风险区作业的工人数量值,即第一工人风险意识分值;Among them, NW i represents the number of workers exposed to the risk area at time i, N i is the total number of workers on the construction site at time i, Represents the value of the number of workers exposed to the risk area every day, that is, the risk awareness score of the first worker;
根据数据库中的每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标,统计各时刻暴露在工人机械专用道路上的工人数量,采用以下第三计算公式计算第二工人风险意识分值:According to the corresponding center point coordinates and contour coordinates of each worker and each construction machine in the database, count the number of workers exposed to the special road for workers and machinery at each moment, and use the following third calculation formula to calculate the second worker's risk awareness score :
其中,NRW i 代表i时刻暴露在工人机械专用道路上的工人数量,N i 为i时刻施工现场工人的总人数,N rw 表示每日暴露在工人机械专用道路上的工人数量值,即第二工人风险意识分值,其中,工人风险意识值包括第一工人风险意识分值和第二工人风险意识分值;Among them, NRW i represents the number of workers exposed on the special road for workers and machinery at time i, Ni is the total number of workers on the construction site at time i, and N rw represents the daily value of the number of workers exposed on the special road for workers and machinery, that is, the second The worker's risk awareness score, wherein the worker's risk awareness value includes the first worker's risk awareness score and the second worker's risk awareness score;
分别统计每日工人未佩戴安全帽时长T wh ,工人进入工程机械专用道路的时长T wr ,工程机械专用道路被占用的时长T r ,时长单位为分钟,最后输出管理敏捷值T=(T wh ,T wr ,T r )。The daily time T wh of workers not wearing helmets, the time T wr of workers entering the special road for construction machinery, the time T r that the special road for construction machinery is occupied, the unit of time is minutes, and the final output management agility value T = ( T wh , T wr , T r ).
在一个实施例中,优选地,训练模块包括:In one embodiment, preferably, the training module includes:
归一化单元,用于采用MinMaxScaler归一化算法,对不安全行为值、工人风险意识值和管理敏捷值进行归一化处理,得到归一化处理后的不安全行为值、工人风险意识值和管理敏捷值The normalization unit is used to use the MinMaxScaler normalization algorithm to normalize the unsafe behavior value, worker risk awareness value, and management agility value, and obtain the normalized unsafe behavior value and worker risk awareness value. and managing agility values
转换单元,用于将不安全行为值、工人风险意识值和管理敏捷值转换为范围在0-1之间的值,并获取专家对施工现场预设的施工安全宏观评估值;The conversion unit is used to convert the unsafe behavior value, worker risk awareness value and management agility value into values in the range of 0-1, and obtain the macro-evaluation value of construction safety preset by experts on the construction site;
训练单元,用于将归一化处理后的不安全行为值、工人风险意识值和管理敏捷值作为模糊神经网络算法的输入x,对应的预设的施工安全宏观评估值作为模糊神经网络算法的输出y,进行训练,得到施工安全宏观评估模型;The training unit is used to use the normalized unsafe behavior value, worker risk awareness value and management agility value as the input x of the fuzzy neural network algorithm, and the corresponding preset macroscopic evaluation value of construction safety as the fuzzy neural network algorithm. Output y, carry out training, and obtain the macroscopic evaluation model of construction safety;
其中,施工安全宏观评估模型包括模糊层、规则层、正则化层、二次模糊计算层和去模糊化层;Among them, the macro-evaluation model of construction safety includes fuzzy layer, rule layer, regularization layer, secondary fuzzy calculation layer and defuzzification layer;
模糊层将每个输入通过三个隶属度函数进行模糊化,计算出对应的隶属度值,并输出给规则层;The fuzzy layer fuzzifies each input through three membership functions, calculates the corresponding membership value, and outputs it to the rule layer;
规则层将各个隶属度值相乘,以输出每个规则的激活程度至正则化层;The rule layer multiplies each membership value to output the activation degree of each rule to the regularization layer;
正则化层对每个规则的激活程度进行正则化计算,以输出正则化后的激活程度至二次模糊计算层;The regularization layer performs regularization calculation on the activation degree of each rule to output the regularized activation degree to the secondary fuzzy calculation layer;
二次模糊计算层通过正则化后的激活程度计算出新的隶属度值,以输出至去模糊化层;The secondary fuzzy calculation layer calculates the new membership value through the regularized activation degree to output to the defuzzification layer;
去模糊化层将新的隶属度值重新映射回讲点集合中的精确值,以输出施工安全宏观评估值。The defuzzification layer remaps the new membership value back to the exact value in the set of lecture points to output the construction safety macro assessment value.
在一个实施例中,优选地,评估模块用于:In one embodiment, preferably, the evaluation module is used to:
采集目标施工现场的目标数据图像并进行标注和识别处理,以确定目标施工现场的每个工人和每个工程机械,以及每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标;Collect target data images of the target construction site and perform labeling and identification processing to determine each worker and each construction machine at the target construction site, as well as the corresponding center point coordinates and outline coordinates of each worker and each construction machine;
根据目标施工现场的每个工人和每个工程机械,以及每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标确定每日的工人未佩戴安全帽的目标不安全行为值、目标工人风险意识值和目标管理敏捷值;According to each worker and each construction machine at the target construction site, as well as the corresponding center point coordinates and outline coordinates of each worker and each construction machine, determine the daily target unsafe behavior value of workers without helmets, target workers Risk awareness value and target management agility value;
根据目标不安全行为值、目标工人风险意识值和目标管理敏捷值和施工安全宏观评估模型,计算得到目标施工现场对应的目标施工安全宏观评估值。According to the target unsafe behavior value, the target worker's risk awareness value, the target management agility value and the construction safety macro evaluation model, the target construction safety macro evaluation value corresponding to the target construction site is calculated.
根据本发明实施例的第二方面,提供一种施工安全宏观评估方法,用于施工安全宏观评估系统,方法包括:According to a second aspect of the embodiments of the present invention, a construction safety macro evaluation method is provided for use in a construction safety macro evaluation system, the method comprising:
采集施工现场的数据图像并进行标注和识别处理,以确定施工现场的每个工人和每个工程机械,以及每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标;Collect data images of the construction site and perform labeling and identification processing to determine each worker and each construction machine on the construction site, as well as the corresponding center point coordinates and outline coordinates of each worker and each construction machine;
根据施工现场的每个工人和每个工程机械,以及每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标确定每日的工人未佩戴安全帽的不安全行为值、工人风险意识值和管理敏捷值;According to each worker and each construction machine on the construction site, as well as the corresponding center point coordinates and outline coordinates of each worker and each construction machine, the daily unsafe behavior value and worker risk awareness value of workers without helmets are determined and managing agility values;
根据预设时间段内的不安全行为值、工人风险意识值和管理敏捷值,和对应的预设的施工安全宏观评估值,采用模糊神经网络算法进行训练,得到施工安全宏观评估模型;According to the unsafe behavior value, worker risk awareness value and management agility value within the preset time period, and the corresponding preset construction safety macro evaluation value, the fuzzy neural network algorithm is used for training, and the construction safety macro evaluation model is obtained;
使用施工安全宏观评估模型对目标施工现场进行施工安全宏观评估。Use the construction safety macro-evaluation model to perform a construction safety macro-evaluation on the target construction site.
在一个实施例中,优选地,采集施工现场的数据图像并进行标注和识别处理,以确定施工现场的每个工人和每个工程机械,以及每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标,包括:In one embodiment, preferably, a data image of the construction site is collected and marked and identified, so as to determine each worker and each construction machine on the construction site, as well as the corresponding center point of each worker and each construction machine Coordinates and contour coordinates, including:
通过摄像装置采集施工现场的数据图像;Collect the data images of the construction site through the camera device;
每日对摄像装置进行校准;daily calibration of the camera;
在每日施工前,根据接收到的标记指令,标注工程机械的专用道路和施工作业的高风险区;Before daily construction, according to the received marking instructions, mark the dedicated roads for construction machinery and high-risk areas for construction operations;
通过预先收集和标注的施工图像,基于Mask-RCNN与Deepsort算法对工人、移动式工程机械、塔吊进行训练,以分钟为单位在施工现场的数据图像中分别识别出工人、移动式工程机械与塔吊的轮廓坐标,并对每个识别对象加以追踪;在数据库中,以分钟为单位分别统计识别出的工人、移动式工程机械和塔吊的总数量;其中,当识别出工人的轮廓时,识别工人是否佩戴安全帽,并进行相应的未佩戴安全帽数量的统计,将识别出的每个工人、移动式工程机械与塔吊编号,并将其对应的轮廓坐标与中心点坐标存入该时刻对应的工人、移动式工程机械与塔吊的数据集中。Through pre-collected and labeled construction images, workers, mobile construction machinery, and tower cranes are trained based on the Mask-RCNN and Deepsort algorithms, and workers, mobile construction machinery, and tower cranes are identified in the data images of the construction site in minutes. The coordinates of the contours of the identified objects are tracked, and each identified object is tracked; in the database, the total number of identified workers, mobile construction machinery and tower cranes is counted in minutes; among them, when the contours of the workers are identified, the workers are identified. Whether to wear a safety helmet, and the corresponding statistics of the number of not wearing a safety helmet, number each worker, mobile construction machinery and tower crane identified, and store their corresponding contour coordinates and center point coordinates in the corresponding moment. A dataset of workers, mobile construction machinery and tower cranes.
在一个实施例中,优选地,根据施工现场的每个工人和每个工程机械,以及每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标确定每日的工人未佩戴安全帽的不安全行为值、工人风险意识值和管理敏捷值,包括:In one embodiment, preferably, according to each worker and each construction machine on the construction site, and the corresponding center point coordinates and outline coordinates of each worker and each construction machine, the daily number of workers not wearing helmets is determined. Unsafe Behavior Values, Worker Risk Awareness Values, and Management Agility Values, including:
将数据库中每分钟出现的未佩戴安全帽人数存为时间序列的数组UB i ,i = 0,1,2...n-1,令W i = UB i+1 - UB i , W 0 = 0,其中n为时间序列的时间长度,如果W i <0则令W i = 0,构建数组W i ,采用以下第一计算公式计算每日的不安全行为值:Store the number of people without helmets in the database as a time series array UB i , i = 0,1,2... n -1, let Wi = UB i +1 - UB i , W 0 = 0, where n is the time length of the time series. If Wi < 0, let Wi = 0, construct an array Wi , and use the following first calculation formula to calculate the daily unsafe behavior value:
其中,N i 为i时刻施工现场工人的总人数;Among them, Ni is the total number of workers on the construction site at time i ;
根据数据库中的每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标,统计各时刻暴露在风险区作业的工人数量,采用以下第二计算公式计算第一工人风险意识分值:According to the corresponding center point coordinates and contour coordinates of each worker and each construction machine in the database, count the number of workers exposed to work in the risk area at each moment, and use the following second calculation formula to calculate the risk awareness score of the first worker:
其中,NW i 代表i时刻暴露在风险区作业的工人数量,N i 为i时刻施工现场工人的总人数,表示每日暴露在风险区作业的工人数量值,即第一工人风险意识分值;Among them, NW i represents the number of workers exposed to the risk area at time i, N i is the total number of workers on the construction site at time i, Represents the value of the number of workers exposed to the risk area every day, that is, the risk awareness score of the first worker;
根据数据库中的每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标,统计各时刻暴露在工人机械专用道路上的工人数量,采用以下第三计算公式计算第二工人风险意识分值:According to the corresponding center point coordinates and contour coordinates of each worker and each construction machine in the database, count the number of workers exposed to the special road for workers and machinery at each moment, and use the following third calculation formula to calculate the second worker's risk awareness score :
其中,NRW i 代表i时刻暴露在工人机械专用道路上的工人数量,N i 为i时刻施工现场工人的总人数,N rw 表示每日暴露在工人机械专用道路上的工人数量值,即第二工人风险意识分值,其中,工人风险意识值包括第一工人风险意识分值和第二工人风险意识分值;Among them, NRW i represents the number of workers exposed on the special road for workers and machinery at time i, Ni is the total number of workers on the construction site at time i, and N rw represents the daily value of the number of workers exposed on the special road for workers and machinery, that is, the second The worker's risk awareness score, wherein the worker's risk awareness value includes the first worker's risk awareness score and the second worker's risk awareness score;
分别统计每日工人未佩戴安全帽时长T wh ,工人进入工程机械专用道路的时长T wr ,工程机械专用道路被占用的时长T r ,时长单位为分钟,最后输出管理敏捷值T=(T wh ,T wr ,T r )。The daily time T wh of workers not wearing helmets, the time T wr of workers entering the special road for construction machinery, the time T r that the special road for construction machinery is occupied, the unit of time is minutes, and the final output management agility value T = ( T wh , T wr , T r ).
在一个实施例中,优选地,根据预设时间段内的不安全行为值、工人风险意识值和管理敏捷值,和对应的预设的施工安全宏观评估值,采用模糊神经网络算法进行训练,得到施工安全宏观评估模型,包括:In one embodiment, preferably, according to the unsafe behavior value, worker risk awareness value and management agility value within a preset time period, and the corresponding preset macroscopic evaluation value of construction safety, a fuzzy neural network algorithm is used for training, Obtain a construction safety macro assessment model, including:
采用MinMaxScaler归一化算法,对不安全行为值、工人风险意识值和管理敏捷值进行归一化处理,得到归一化处理后的不安全行为值、工人风险意识值和管理敏捷值The MinMaxScaler normalization algorithm is used to normalize the unsafe behavior value, worker risk awareness value and management agility value to obtain the normalized unsafe behavior value, worker risk awareness value and management agility value.
将不安全行为值、工人风险意识值和管理敏捷值转换为范围在0-1之间的值,并获取专家对施工现场预设的施工安全宏观评估值;Convert the unsafe behavior value, worker risk awareness value and management agility value into values ranging from 0 to 1, and obtain the macro evaluation value of construction safety preset by experts on the construction site;
将归一化处理后的不安全行为值、工人风险意识值和管理敏捷值作为模糊神经网络算法的输入x,对应的预设的施工安全宏观评估值作为模糊神经网络算法的输出y,进行训练,得到施工安全宏观评估模型;The normalized unsafe behavior value, worker risk awareness value and management agility value are used as the input x of the fuzzy neural network algorithm, and the corresponding preset macroscopic evaluation value of construction safety is used as the output y of the fuzzy neural network algorithm for training. , to obtain the macroscopic assessment model of construction safety;
其中,施工安全宏观评估模型包括模糊层、规则层、正则化层、二次模糊计算层和去模糊化层;Among them, the macro-evaluation model of construction safety includes fuzzy layer, rule layer, regularization layer, secondary fuzzy calculation layer and defuzzification layer;
模糊层将每个输入通过三个隶属度函数进行模糊化,计算出对应的隶属度值,并输出给规则层;The fuzzy layer fuzzifies each input through three membership functions, calculates the corresponding membership value, and outputs it to the rule layer;
规则层将各个隶属度值相乘,以输出每个规则的激活程度至正则化层;The rule layer multiplies each membership value to output the activation degree of each rule to the regularization layer;
正则化层对每个规则的激活程度进行正则化计算,以输出正则化后的激活程度至二次模糊计算层;The regularization layer performs regularization calculation on the activation degree of each rule to output the regularized activation degree to the secondary fuzzy calculation layer;
二次模糊计算层通过正则化后的激活程度计算出新的隶属度值,以输出至去模糊化层;The secondary fuzzy calculation layer calculates the new membership value through the regularized activation degree to output to the defuzzification layer;
去模糊化层将新的隶属度值重新映射回讲点集合中的精确值,以输出施工安全宏观评估值。The defuzzification layer remaps the new membership value back to the exact value in the set of lecture points to output the construction safety macro assessment value.
在一个实施例中,优选地,使用施工安全宏观评估模型对目标施工现场进行施工安全宏观评估,包括:In one embodiment, preferably, a macro-assessment of construction safety is performed on the target construction site using a macro-assessment model of construction safety, including:
采集目标施工现场的目标数据图像并进行标注和识别处理,以确定目标施工现场的每个工人和每个工程机械,以及每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标;Collect target data images of the target construction site and perform labeling and identification processing to determine each worker and each construction machine at the target construction site, as well as the corresponding center point coordinates and outline coordinates of each worker and each construction machine;
根据目标施工现场的每个工人和每个工程机械,以及每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标确定每日的工人未佩戴安全帽的目标不安全行为值、目标工人风险意识值和目标管理敏捷值;According to each worker and each construction machine at the target construction site, as well as the corresponding center point coordinates and outline coordinates of each worker and each construction machine, determine the daily target unsafe behavior value of workers without helmets, target workers Risk awareness value and target management agility value;
根据目标不安全行为值、目标工人风险意识值和目标管理敏捷值和施工安全宏观评估模型,计算得到目标施工现场对应的目标施工安全宏观评估值。According to the target unsafe behavior value, the target worker's risk awareness value, the target management agility value and the construction safety macro evaluation model, the target construction safety macro evaluation value corresponding to the target construction site is calculated.
根据本发明实施例的第三方面,提供一种施工安全宏观评估装置,装置包括:According to a third aspect of the embodiments of the present invention, a construction safety macro evaluation device is provided, the device comprising:
处理器;processor;
用于存储处理器可执行指令的存储器;memory for storing processor-executable instructions;
其中,处理器被配置为:where the processor is configured as:
采集施工现场的数据图像并进行标注和识别处理,以确定施工现场的每个工人和每个工程机械,以及每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标;Collect data images of the construction site and perform labeling and identification processing to determine each worker and each construction machine on the construction site, as well as the corresponding center point coordinates and outline coordinates of each worker and each construction machine;
根据施工现场的每个工人和每个工程机械,以及每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标确定每日的工人未佩戴安全帽的不安全行为值、工人风险意识值和管理敏捷值;According to each worker and each construction machine on the construction site, as well as the corresponding center point coordinates and outline coordinates of each worker and each construction machine, the daily unsafe behavior value and worker risk awareness value of workers without helmets are determined and managing agility values;
根据预设时间段内的不安全行为值、工人风险意识值和管理敏捷值,和对应的预设的施工安全宏观评估值,采用模糊神经网络算法进行训练,得到施工安全宏观评估模型;According to the unsafe behavior value, worker risk awareness value and management agility value within the preset time period, and the corresponding preset construction safety macro evaluation value, the fuzzy neural network algorithm is used for training, and the construction safety macro evaluation model is obtained;
使用施工安全宏观评估模型对目标施工现场进行施工安全宏观评估。Use the construction safety macro-evaluation model to perform a construction safety macro-evaluation on the target construction site.
本发明的实施例提供的技术方案可以包括以下有益效果:The technical solutions provided by the embodiments of the present invention may include the following beneficial effects:
本发明从基于LCB理论,从安全决策力、安全文化、安全行为三个角度对工地现场、人的不安全行为和物的不安全状态的识别结果加以分类,通过模糊神经网络的方法将专家评估刻画为自动化算法,从而实现施工项目的宏观安全水平自动化评测,通过客观数据反映工地的实际安全水平。在安全决策力维度,基于计算机视觉技术通过测量人的不安全行为和物的不安全状态持续时长表征施工现场的安全管理层管理水平,最后结果为T。在安全文化维度,基于计算机视觉技术通过测量暴露在风险中作业工人数量来体现施工工人群体的风险意识值从而反映施工现场的安全文化水平,最后结果N。在安全行为维度,通过基于深度学习的计算机视觉技术识别不安全行为发生的频次来刻画施工现场的安全行为水平,最后结果为F。将管理时效值T、工人风险意识值N和不安全行为值F作为输入构建模糊神经网络,最终形成施工现场的宏观安全水平S。Based on the LCB theory, the invention classifies the identification results of the construction site, the unsafe behavior of people and the unsafe state of objects from the three perspectives of safety decision-making power, safety culture and safety behavior, and evaluates experts through the method of fuzzy neural network. It is described as an automatic algorithm, so as to realize the automatic evaluation of the macro safety level of the construction project, and reflect the actual safety level of the construction site through objective data. In the dimension of safety decision-making power, based on computer vision technology, the safety management level of the construction site is characterized by measuring the unsafe behavior of people and the duration of unsafe state of objects, and the final result is T. In the dimension of safety culture, based on computer vision technology, the risk awareness value of the construction worker group is reflected by measuring the number of workers exposed to risks, thereby reflecting the safety culture level of the construction site, and the final result is N. In the dimension of safety behavior, the frequency of unsafe behaviors is identified by deep learning-based computer vision technology to characterize the safety behavior level of the construction site, and the final result is F. Taking the management time value T, the worker's risk awareness value N, and the unsafe behavior value F as input, a fuzzy neural network is constructed, and finally the macroscopic safety level S of the construction site is formed.
故本发明基于决策力-文化-行为LCB理论,结合计算机视觉与模糊神经网络方法,构建施工现场宏观安全评估系统。通过施工现场的全局图像数据,从不安全行为、工人风险意识和管理敏捷值等三方面评估施工项目的安全管理状态。通过客观采集施工现场的数据,结合专家的知识,提升施工项目管理者、业主方等利益相关者项目的安全管理能力。Therefore, the present invention is based on the decision-making-culture-behavior LCB theory, combined with computer vision and fuzzy neural network methods, to construct a construction site macro safety assessment system. Through the global image data of the construction site, the safety management status of the construction project is evaluated from three aspects: unsafe behavior, worker risk awareness and management agility value. Through the objective collection of construction site data, combined with expert knowledge, the project safety management capabilities of construction project managers, owners and other stakeholders can be improved.
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本发明。It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention.
附图说明Description of drawings
此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本发明的实施例,并与说明书一起用于解释本发明的原理。The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description serve to explain the principles of the invention.
图1是根据一示例性实施例示出的一种施工安全宏观评估系统的框图。Fig. 1 is a block diagram of a macro-evaluation system for construction safety according to an exemplary embodiment.
图2是根据一示例性实施例示出的一种施工安全宏观评估系统中数据处理模块的框图。Fig. 2 is a block diagram of a data processing module in a construction safety macro-evaluation system according to an exemplary embodiment.
图3是根据一示例性实施例示出的一种施工安全宏观评估系统中数据处理模块的框图。Fig. 3 is a block diagram of a data processing module in a construction safety macro-evaluation system according to an exemplary embodiment.
图4是根据一示例性实施例示出的一种施工安全宏观评估方法的流程图。Fig. 4 is a flow chart of a macro-evaluation method for construction safety according to an exemplary embodiment.
具体实施方式Detailed ways
这里将详细地对示例性实施例进行说明,其示例表示在附图中。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本发明相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本发明的一些方面相一致的装置和方法的例子。Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. Where the following description refers to the drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with some aspects of the invention as recited in the appended claims.
图1是根据一示例性实施例示出的一种施工安全宏观评估系统的框图。Fig. 1 is a block diagram of a macro-evaluation system for construction safety according to an exemplary embodiment.
如图1所示,根据本发明实施例的第一方面,提供一种施工安全宏观评估系统,包括:As shown in FIG. 1 , according to a first aspect of an embodiment of the present invention, a macro-evaluation system for construction safety is provided, including:
数据处理模块11,用于采集施工现场的数据图像并进行标注和识别处理,以确定施工现场的每个工人和每个工程机械,以及每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标;The
安全评测模块12,用于根据施工现场的每个工人和每个工程机械,以及每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标确定每日的工人未佩戴安全帽的不安全行为值、工人风险意识值和管理敏捷值;The
训练模块13,用于根据预设时间段内的不安全行为值、工人风险意识值和管理敏捷值,和对应的预设的施工安全宏观评估值,采用模糊神经网络算法进行训练,得到施工安全宏观评估模型;The
评估模块14,用于使用施工安全宏观评估模型对目标施工现场进行施工安全宏观评估。The
图2是根据一示例性实施例示出的一种施工安全宏观评估系统中数据处理模块的框图。Fig. 2 is a block diagram of a data processing module in a construction safety macro-evaluation system according to an exemplary embodiment.
如图2所示,在一个实施例中,优选地,数据处理模块11包括:As shown in FIG. 2, in one embodiment, preferably, the
数据采集单元21,用于通过摄像装置采集施工现场的数据图像;具体地,数据采集单元包含系留飞艇、高清相机、云台、图传模块和遥控模块五大子模块。为了保证画面覆盖施工现场,高清相机安装在至少200米的高处,相机倾角以画面覆盖整体施工现场为准。为了保证画面的清晰度,本发明选择6K及以上的高清相机对施工现场进行实时监控。云台模块采用三轴自稳云台,主要通过IMU(惯性测量单元)和电机磁编码器对云台上的相机镜头做姿态校准,保证镜头的稳定。遥控模块用于遥控镜头的朝向。图传模块用于实时传输高清相机采集的图片到地面工控机中。The
施工现场缺少安装相机的高空位置,因此选择系留飞艇提供相机安装的位置。此处选择系留飞艇的主要原因是考虑其能不间断供电从而在高空长时间作业,价格相对无人机更加经济(无人机、工业气球等设备配合系留系统同样可以满足此处的要求)。在具体实施时,首先基于施工图纸,在现场选择合适的位置将飞艇升空,通过系留系统在稳定供电的前提下将飞艇升到100米的高度。然后在地面通过工控机连接遥控模块和图传模块,调整高清相机的朝向。图传模块将高清相机拍摄的照片实时传输到地面工控机中。此外为了保证数据采集模块的长时间工作,系留飞艇连接工地电源(可以是生活区电源)并为整体数据采集模块供电。The construction site lacked a high-altitude location for installing cameras, so the tethered airship was chosen to provide a location for camera installation. The main reason for choosing a tethered airship here is that it can operate uninterruptedly at high altitudes for a long time, and the price is more economical than UAVs (UAVs, industrial balloons and other equipment combined with the tethered system can also meet the requirements here. ). In the specific implementation, firstly, based on the construction drawings, select a suitable location on the site to lift the airship into the air, and lift the airship to a height of 100 meters through the mooring system under the premise of stable power supply. Then connect the remote control module and the image transmission module through the industrial computer on the ground to adjust the orientation of the high-definition camera. The image transmission module transmits the photos taken by the high-definition camera to the ground industrial computer in real time. In addition, in order to ensure the long-term work of the data acquisition module, the tethered airship is connected to the power supply of the construction site (which can be the power supply of the living area) and supplies power to the overall data acquisition module.
校准单元22,用于每日对摄像装置进行校准;The
在系留飞艇首次升空后,通过地面工控机调整高清摄像机拍摄区域,使得画面能够覆盖全部施工现场,此时将IMU传感器的数值归零。IMU传感器的作用是测量高清摄像机的姿态,IMU传感模块通过3个加速度计和3个陀螺仪组C成的组合单元形成笛卡尔坐标系。具有x轴、y轴和z轴,传感器能够测量各轴方向的线性运动,以及围绕各轴的旋转运动。在归零后,每半小时对线性运动与旋转角度进行调整,使得各数值再次为0。由于IMU存在累计误差,每日的早晨7点经过人工校准后对IMU值归零。在使用前需要将一块2000mm×2000mm的紫色正方形塑料板作为校准色块放在现场,在高清摄像机中确认色块的完整存在。遍历一帧图像中的像素,找符合如下要求的像素块:After the tethered airship takes off for the first time, the high-definition camera shooting area is adjusted through the ground industrial computer so that the picture can cover the entire construction site. At this time, the value of the IMU sensor is reset to zero. The role of the IMU sensor is to measure the attitude of the high-definition camera. The IMU sensor module forms a Cartesian coordinate system through a combination unit consisting of three accelerometers and three gyroscopes. With an x-axis, y-axis, and z-axis, the sensor can measure linear motion along each axis, as well as rotational motion around each axis. After zeroing, the linear motion and rotation angle are adjusted every half hour so that each value is zero again. Due to the accumulated error of the IMU, the IMU value is reset to zero after manual calibration at 7:00 every morning. Before use, a 2000mm×2000mm purple square plastic plate should be placed on site as a calibration color block, and the complete existence of the color block should be confirmed in a high-definition camera. Traverse the pixels in a frame of image to find pixel blocks that meet the following requirements:
H ∈ [125,155],S ∈ [43,255],V ∈[46,255]H ∈ [125,155], S ∈ [43,255], V ∈ [46,255]
并记录其水平方向的最大值和最小值对应的像素块坐标与竖直方向的最大值和最小值对应的像素块坐标,将竖直方向的两个像素点与水平方向的两个像素点分别两两计算欧氏距离,将获得的4段距离加和计算算数平均,其对应的真实距离为2米,获得摄像画面的比例尺。And record the pixel block coordinates corresponding to the maximum and minimum values in the horizontal direction and the pixel block coordinates corresponding to the maximum and minimum values in the vertical direction. Calculate the Euclidean distance in pairs, add the obtained 4 distances and calculate the arithmetic average, the corresponding real distance is 2 meters, and obtain the scale of the camera image.
标注单元23,用于在每日施工前,根据接收到的标记指令,标注工程机械的专用道路和施工作业的高风险区;The marking
由于工地环境复杂,高处坠落作为最常出现的事故类型,其直接发生的原因是工人在高处边缘作业,因此在复杂环境中标定真实的风险边缘是标注单元需要解决的问题。在进行标注前,使用人需要充分巡视现场,记录待标注的风险边缘。在进行标注时,需要先用直线或曲线描绘风险边缘,然后描绘风险区域涉及的范围。具体步骤如下,首先用鼠标点选风险区的方向,从而判断是向内还是向外生成风险区,然后输入风险区真实宽度,例如5米,接着根据比例尺换算成图像中的距离,以描绘的风险边缘为基准,向选定的方向做平行线,距离为换算得到的距离,最后在图中突出显示风险区涉及的区域。Due to the complex construction site environment, falling from a height is the most common accident type, and the direct cause is that workers work on the edge of a high place. Therefore, calibrating the real risk edge in a complex environment is a problem that the labeling unit needs to solve. Before marking, the user needs to fully inspect the site and record the risk edge to be marked. When labeling, it is necessary to first draw the risk edge with a straight line or curve, and then draw the scope of the risk area. The specific steps are as follows. First, click the direction of the risk area with the mouse to determine whether the risk area is generated inward or outward, then enter the real width of the risk area, such as 5 meters, and then convert it into the distance in the image according to the scale to describe the distance in the image. The risk edge is used as the benchmark, parallel lines are drawn in the selected direction, and the distance is the converted distance. Finally, the area involved in the risk area is highlighted in the figure.
人机碰撞类事故作为主要的施工事故来源,其本质原因在于工人出现在了施工作业的风险区内,因此工程机械的风险区需要提前被标定。工程机械的风险区包括其周围的风险区与预先设置的工程机械道路。在标定模块,需要在施工开始阶段标定具体的工程机械移动道路,包括承受重型工程机械的运输道路,行走正常工程机械的施工道路与临时道路,填充颜色算法使用OpenCV中的fillPoly算法。标定方式类似与标定风险边缘相同,注意要保证标定的区域的完整与闭合。最后,每日需要在施工前,用多边形线框描绘当天施工的区域。Human-machine collision accidents are the main source of construction accidents. The essential reason is that workers appear in the risk area of construction operations. Therefore, the risk area of construction machinery needs to be demarcated in advance. The risk area of construction machinery includes the surrounding risk area and the preset construction machinery road. In the calibration module, specific construction machinery moving roads need to be calibrated at the beginning of construction, including haul roads for heavy construction machinery, construction roads and temporary roads for normal construction machinery, and the fill color algorithm uses the fillPoly algorithm in OpenCV. The calibration method is similar to that of the calibration risk edge. Pay attention to ensure the integrity and closure of the calibrated area. Finally, each day needs to use a polygonal wireframe to delineate the area to be constructed on that day before construction.
识别单元24,用于通过预先收集和标注的施工图像,基于Mask-RCNN与Deepsort算法对工人、移动式工程机械、塔吊进行训练,以分钟为单位在施工现场的数据图像中分别识别出工人、移动式工程机械与塔吊的轮廓坐标,并对每个识别对象加以追踪;在数据库中,以分钟为单位分别统计识别出的工人、移动式工程机械和塔吊的总数量;其中,当识别出工人的轮廓时,识别工人是否佩戴安全帽,并进行相应的未佩戴安全帽数量的统计,将识别出的每个工人、移动式工程机械与塔吊编号,并将其对应的轮廓坐标与中心点坐标存入该时刻对应的工人、移动式工程机械与塔吊的数据集中。The
识别单元主要用于识别施工现场的工人和工程机械并获得其外轮廓所对应的图像坐标点。本发明通过预先收集施工现场数据并进行标注,基于Mask-RCNN与Deepsort算法对施工人员、典型移动式工程机械(挖掘机、移动式吊车、叉车、打桩机等)、塔吊进行训练,以分钟为单位在图像中分割出施工人员、移动式工程机械与塔吊的轮廓,并对识别对象加以追踪。对于每一个识别出的对象,在数据库中该分钟的位置将该类别的数量加1。对于识别出是施工人员的轮廓,对其进行安全帽识别,如果未识别出安全帽,则将在数据库中在该时刻对应的未带安全帽人数中加1。将识别出的每个工人、移动式工程机械与塔吊编号,并将其对应的轮廓坐标与中心点坐标存入该时刻对应的工人、移动式工程机械与塔吊的数据集中,数据库中各要素轮廓存储示意如表1所示。其中w代表工人,c代表移动式吊车,f代表叉车,e代表挖掘机,t代表塔吊,tr代表卡车。The identification unit is mainly used to identify the workers and construction machinery on the construction site and obtain the image coordinate points corresponding to their outer contours. The present invention collects and labels construction site data in advance, and trains construction personnel, typical mobile construction machinery (excavators, mobile cranes, forklifts, pile drivers, etc.) and tower cranes based on the Mask-RCNN and Deepsort algorithms. The unit segmented the outlines of construction workers, mobile construction machinery and tower cranes in the images, and tracked the identified objects. For each identified object, the number of that category is incremented by one at the minute's position in the database. For the silhouette identified as a construction worker, carry out helmet identification, if no helmet is identified, add 1 to the number of people without helmets corresponding to that moment in the database. Number each identified worker, mobile construction machinery and tower crane, and store its corresponding contour coordinates and center point coordinates in the data set of workers, mobile construction machinery and tower cranes corresponding to that moment, and the outline of each element in the database The storage schematic is shown in Table 1. Where w stands for workers, c stands for mobile cranes, f stands for forklifts, e stands for excavators, t stands for tower cranes, and tr stands for trucks.
表1Table 1
在一个实施例中,优选地,安全评测模块用于:In one embodiment, preferably, the security evaluation module is used to:
将数据库中每分钟出现的未佩戴安全帽人数存为时间序列的数组UB i ,i = 0,1,2...n-1,令W i = UB i+1 - UB i , W 0 = 0,其中n为时间序列的时间长度,如果W i <0则令W i = 0,构建数组W i ,采用以下第一计算公式计算每日的不安全行为值:Store the number of people without helmets in the database as a time series array UB i , i = 0,1,2... n -1, let Wi = UB i +1 - UB i , W 0 = 0, where n is the time length of the time series. If Wi < 0, let Wi = 0, construct an array Wi , and use the following first calculation formula to calculate the daily unsafe behavior value:
其中,N i 为i时刻施工现场工人的总人数;Among them, Ni is the total number of workers on the construction site at time i ;
根据数据库中的每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标,统计各时刻暴露在风险区作业的工人数量,采用以下第二计算公式计算第一工人风险意识分值:According to the corresponding center point coordinates and contour coordinates of each worker and each construction machine in the database, count the number of workers exposed to work in the risk area at each moment, and use the following second calculation formula to calculate the risk awareness score of the first worker:
其中,NW i 代表i时刻暴露在风险区作业的工人数量,N i 为i时刻施工现场工人的总人数,表示每日暴露在风险区作业的工人数量值,即第一工人风险意识分值;Among them, NW i represents the number of workers exposed to the risk area at time i, N i is the total number of workers on the construction site at time i, Represents the value of the number of workers exposed to the risk area every day, that is, the risk awareness score of the first worker;
根据数据库中的每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标,统计各时刻暴露在工人机械专用道路上的工人数量,采用以下第三计算公式计算第二工人风险意识分值:According to the corresponding center point coordinates and contour coordinates of each worker and each construction machine in the database, count the number of workers exposed to the special road for workers and machinery at each moment, and use the following third calculation formula to calculate the second worker's risk awareness score :
其中,NRW i 代表i时刻暴露在工人机械专用道路上的工人数量,N i 为i时刻施工现场工人的总人数,N rw 表示每日暴露在工人机械专用道路上的工人数量值,即第二工人风险意识分值,其中,工人风险意识值包括第一工人风险意识分值和第二工人风险意识分值;Among them, NRW i represents the number of workers exposed on the special road for workers and machinery at time i, Ni is the total number of workers on the construction site at time i, and N rw represents the daily value of the number of workers exposed on the special road for workers and machinery, that is, the second The worker's risk awareness score, wherein the worker's risk awareness value includes the first worker's risk awareness score and the second worker's risk awareness score;
在该实施例中,风险包括高处坠落风险和人机碰撞风险。由于工作的需要工人有时必须在高风险区作业,此类暴露在高风险区域的工人并不代表施工项目的宏观安全水平低下,因此在计算数量时需要将此类工人数量排除。工人原则上不应出现在专门为工程机械所规划的道路上,因此工人出现在运输道路、施工道路与临时道路的数量反应了其对自身风险的意识。综上,工人风险意识值算法计算两类工人数量,分别是暴露在高峰区域的工人数量与暴露在工程机械专用道路上的工人数量,具体算法如下。In this embodiment, the risks include a fall from height risk and a human-machine collision risk. Due to the need of work, workers sometimes have to work in high-risk areas. Such workers exposed to high-risk areas do not represent a low level of macro safety in the construction project. Therefore, the number of such workers needs to be excluded from the calculation of the number. In principle, workers should not be present on roads specially planned for construction machinery, so the number of workers present on haul roads, construction roads and temporary roads reflects their awareness of their own risks. To sum up, the algorithm of worker risk awareness value calculates the number of two types of workers, namely, the number of workers exposed to the peak area and the number of workers exposed to the road dedicated to construction machinery. The specific algorithm is as follows.
将5米设定为人机碰撞的风险距离,通过校准模块的比例尺将5米换算成图中的像素点距离。暴露在高风险区的工人数量首先通过调取识别单元识别的每分钟工程机械轮廓数据与中心点数据计算该工程机械(本处以移动式吊车为例)的轮廓数据中每个轮廓点坐标与中心点坐标的差值,并取最大值与5米对应像素点距离加和获得半径R ctkm , k = 1,2,...n,m = 1,2,...n,其中ct代表移动式吊车,k代表吊车编号,m代表第m分钟,然后以识别出的工程机械中心点坐标为圆心,R ctkm 为半径画圆,接着统计该分钟暴露在工程机械圆圈与标定模块边缘风险区坐标内的工人数量,减去该分钟暴露在施工区域的工人的数量得到时间序列的数组(UNW i ), i = 1,2...n,之后在数据库中统计在风险区连续留存时间小于等于5分钟的工人数量,统计每分钟存在此类工人的数量对(UNW i ), i = 1,2...n加以修订(加上每分钟在风险区域停留时间不超过5分钟的工人数量),得到修订后的时间序列(NW i ), i = 1,2...n,NW i 代表i时刻暴露在风险区作业的工人数量,最后计算该日暴露在风险区工人数量值,其中N i 为i时刻工地的总人数。Set 5 meters as the risk distance of human-machine collision, and convert 5 meters into the pixel distance in the figure through the scale bar of the calibration module. The number of workers exposed to the high-risk area is first calculated by calling the contour data and center point data of the construction machine per minute identified by the identification unit to calculate the coordinates and center of each contour point in the contour data of the construction machine (a mobile crane is used here as an example). The difference of the point coordinates, and the maximum value and the distance between the corresponding pixel points of 5 meters are added to obtain the radius R ctkm , k = 1,2,...n, m = 1,2,...n, where ct represents the movement type crane, k represents the number of the crane, m represents the mth minute, then draw a circle with the coordinates of the identified construction machinery center point as the center, R ctkm as the radius, and then count the exposure to the construction machinery circle and the coordinates of the risk area at the edge of the calibration module in this minute. The number of workers in the area, subtract the number of workers exposed to the construction area in this minute to get an array of time series ( UNW i ), i = 1,2... n , and then count in the database the continuous retention time in the risk area is less than or equal to Number of workers at 5 minutes, counting the number of such workers per minute, revised for ( UNW i ), i = 1,2... n (plus the number of workers per minute who stay in the risk area for no more than 5 minutes) , get the revised time series ( NW i ), i = 1,2... n , NW i represents the number of workers exposed to the risk area at time i, and finally calculate the value of the number of workers exposed to the risk area on that day , where Ni is the total number of people on the construction site at time i .
暴露在工程机械专用道路上的工人数量通过统计每分钟出现在工程机械专用道路(标定模块标定)的工人数量计算,如下;The number of workers exposed on the special road for construction machinery is calculated by counting the number of workers who appear on the special road for construction machinery (calibration module calibration) per minute, as follows ;
其中N i 为i时刻工地的总人数,NRW i 为i时刻出现在工程机械专用道路上的工人数量。最后输出每日的N=(N hw ,N rw )。Among them, Ni is the total number of workers at the construction site at time i, and NRW i is the number of workers on the road dedicated to construction machinery at time i . Finally output the daily N=( N hw , N rw ).
分别统计每日工人未佩戴安全帽时长T wh ,工人进入工程机械专用道路的时长T wr ,工程机械专用道路被占用的时长T r ,时长单位为分钟,最后输出管理敏捷值T=(T wh ,T wr ,T r )。The daily time T wh of workers not wearing helmets, the time T wr of workers entering the special road for construction machinery, the time T r that the special road for construction machinery is occupied, the unit of time is minutes, and the final output management agility value T = ( T wh , T wr , T r ).
管理敏捷值主要统计物的不安全状态与人的不安全行为持续的时间,包括未佩戴安全帽,工人出现在工程机械专用道和工程机械专用道路被堵塞的时间。The main statistics of management agility are the unsafe state and the duration of unsafe behavior of people, including the time when workers are not wearing safety helmets, and when workers appear in the lanes dedicated to construction machinery and the lanes dedicated to construction machinery are blocked.
施工过程中经常出现施工物料占用工程机械道路的情况,导致工程机械的进出处于不安全状态。本发明首先对高清摄像机每分钟采集画面中提取标定的工程机械专用道路范围,然后减去识别单元识别出的工程机械与工人对应的范围,接着对剩余画面采用背景差分算法统计变前景中对象点坐标,之后对前景中的点聚类,用轮廓系数最大值确定类别数,统计聚类中心点坐标与该类别各点坐标距离的最大值并与1米对应像素距离做比较,如果大于1米,则将该类别记录为对工程机械专用道路的占用。During the construction process, construction materials often occupy the road of construction machinery, resulting in unsafe entry and exit of construction machinery. The invention first extracts the range of the special road for construction machinery that is calibrated from the pictures collected by the high-definition camera every minute, then subtracts the range corresponding to the construction machinery and the worker identified by the recognition unit, and then uses the background difference algorithm to count the object points in the foreground for the remaining pictures. Coordinates, then cluster the points in the foreground, use the maximum silhouette coefficient to determine the number of categories, count the maximum distance between the coordinates of the cluster center point and the coordinates of each point in the category and compare it with the distance of the corresponding pixel of 1 meter, if it is greater than 1 meter , the category shall be recorded as occupation of special roads for construction machinery.
分别统计每日工人未佩戴安全帽时长T wh ,工人进入工程机械专用道路的时长T wr ,工程机械专用道路被占用的时长T r ,时长单位为分钟,最后输出管理敏捷值T=(T wh ,T wr ,T r )。The daily time T wh of workers not wearing helmets, the time T wr of workers entering the special road for construction machinery, the time T r that the special road for construction machinery is occupied, the unit of time is minutes, and the final output management agility value T = ( T wh , T wr , T r ).
图3是根据一示例性实施例示出的一种施工安全宏观评估系统中数据处理模块的框图。Fig. 3 is a block diagram of a data processing module in a construction safety macro-evaluation system according to an exemplary embodiment.
如图3所示,在一个实施例中,优选地,训练模块13包括:As shown in FIG. 3, in one embodiment, preferably, the
归一化单元31,用于采用MinMaxScaler归一化算法,对不安全行为值、工人风险意识值和管理敏捷值进行归一化处理,得到归一化处理后的不安全行为值、工人风险意识值和管理敏捷值;The
转换单元32,用于将不安全行为值、工人风险意识值和管理敏捷值转换为范围在0-1之间的值,并获取专家对施工现场预设的施工安全宏观评估值;The
训练单元33,用于将归一化处理后的不安全行为值、工人风险意识值和管理敏捷值作为模糊神经网络算法的输入x,对应的预设的施工安全宏观评估值作为模糊神经网络算法的输出y,进行训练,得到施工安全宏观评估模型;训练算法采用使用混合训练算法,使用matlab的ANFIS工具箱中的hybrid训练方法,例如,可以从20个样本中随机选择15个数据点作为训练数据,另外5个数据点作为测试集,训练误差接受范围设为0.001,而最大训练次数设置为1000次。The
其中,施工安全宏观评估模型包括模糊层、规则层、正则化层、二次模糊计算层和去模糊化层;Among them, the macro-evaluation model of construction safety includes fuzzy layer, rule layer, regularization layer, secondary fuzzy calculation layer and defuzzification layer;
模糊层将每个输入通过三个隶属度函数进行模糊化,计算出对应的隶属度值,并输出给规则层;The fuzzy layer fuzzifies each input through three membership functions, calculates the corresponding membership value, and outputs it to the rule layer;
模型共有(F,N hw ,N rw ,T wh ,T wr ,T r )六个输入,输出单个数值S,每个输入通过三个隶属度函数A 1i , A 2i , A 3i 进行模糊化,分别代表了施工现场该天在某项安全表现上的高、中、低三个水平,其中第一个下标表示三个隶属度函数的顺序,第二个i表示六个输入的顺序。ANFIS可以通过(F,N,T,S)的数据集自适应学习出与人类进行推理时类似的模糊逻辑:The model has a total of six inputs ( F , N hw , N rw , T wh , T wr , T r ) and outputs a single value S, each input is processed by three membership functions A 1 i , A 2 i , A 3 i Fuzzy, representing the high, medium and low levels of a certain safety performance at the construction site on that day, where the first subscript represents the order of the three membership functions, and the second i represents the six inputs. order. ANFIS can adaptively learn fuzzy logic similar to human reasoning through the (F, N, T, S) data set:
隶属度函数将经典的集合理论进行模糊化,表示了该输入对于某一集合要求的数学性质所满足的程度。常用的隶属度函数有三角形以及高斯型,本发明采取高斯型的隶属度函数,模糊层输出的计算公式为:The membership function fuzzifies the classical set theory and expresses the degree to which the input satisfies the required mathematical properties of a set. Commonly used membership functions are triangular and Gaussian. The present invention adopts a Gaussian membership function, and the calculation formula of the output of the fuzzy layer is:
。 .
其中c i 和σ i 是隶属度函数形状参数,x是模糊层接收的原始数据,即输入数据。使用matlab的ANFIS工具箱,先加载进收集好的数据集,再将每个输入对应的隶属度函数个数设置为3,并选定隶属度函数种类为gaussmf。ANFIS的结构设计需要在matlab的ANFIS工具箱中设计隶属度函数的个数以及种类。where c i and σ i are the membership function shape parameters, and x is the original data received by the fuzzy layer, that is, the input data. Using the ANFIS toolbox of matlab, first load the collected data set, then set the number of membership functions corresponding to each input to 3, and select the type of membership function as gaussmf. The structural design of ANFIS needs to design the number and types of membership functions in the ANFIS toolbox of matlab.
规则层将各个隶属度值相乘,以输出每个规则的激活程度至正则化层;其中,规则层的计算公式为:The rule layer multiplies each membership value to output the activation degree of each rule to the regularization layer; the calculation formula of the rule layer is:
, ,
其输出代表了每个if规则的激活程度。Its output represents the activation level of each if rule.
正则化层对每个规则的激活程度进行正则化计算,以输出正则化后的激活程度至二次模糊计算层;计算公式为:。The regularization layer performs regularization calculation on the activation degree of each rule to output the regularized activation degree to the secondary fuzzy calculation layer; the calculation formula is: .
二次模糊计算层通过正则化后的激活程度计算出新的隶属度值,以输出至去模糊化层;其计算公式为:,The secondary fuzzy calculation layer calculates the new membership value through the regularized activation degree to output to the defuzzification layer; its calculation formula is: ,
其中x i 为第i个输入,p i 为对应权重。where x i is the ith input and pi is the corresponding weight.
去模糊化层将新的隶属度值重新映射回讲点集合中的精确值,以输出施工安全宏观评估值。其计算公式为:。The defuzzification layer remaps the new membership value back to the exact value in the set of lecture points to output the construction safety macro assessment value. Its calculation formula is: .
在一个实施例中,优选地,评估模块14用于:In one embodiment, the
采集目标施工现场的目标数据图像并进行标注和识别处理,以确定目标施工现场的每个工人和每个工程机械,以及每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标;Collect target data images of the target construction site and perform labeling and identification processing to determine each worker and each construction machine at the target construction site, as well as the corresponding center point coordinates and outline coordinates of each worker and each construction machine;
根据目标施工现场的每个工人和每个工程机械,以及每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标确定每日的工人未佩戴安全帽的目标不安全行为值、目标工人风险意识值和目标管理敏捷值;According to each worker and each construction machine at the target construction site, as well as the corresponding center point coordinates and outline coordinates of each worker and each construction machine, determine the daily target unsafe behavior value of workers without helmets, target workers Risk awareness value and target management agility value;
根据目标不安全行为值、目标工人风险意识值和目标管理敏捷值和施工安全宏观评估模型,计算得到目标施工现场对应的目标施工安全宏观评估值。According to the target unsafe behavior value, the target worker's risk awareness value, the target management agility value and the construction safety macro evaluation model, the target construction safety macro evaluation value corresponding to the target construction site is calculated.
本发明从基于LCB理论,从安全决策力、安全文化、安全行为三个角度对工地现场、人的不安全行为和物的不安全状态的识别结果加以分类,通过模糊神经网络的方法将专家评估刻画为自动化算法,从而实现施工项目的宏观安全水平自动化评测,通过客观数据反映工地的实际安全水平。在安全决策力维度,基于计算机视觉技术通过测量人的不安全行为和物的不安全状态持续时长表征施工现场的安全管理层管理水平,最后结果为T。在安全文化维度,基于计算机视觉技术通过测量暴露在风险中作业工人数量来体现施工工人群体的风险意识值从而反映施工现场的安全文化水平,最后结果N。在安全行为维度,通过基于深度学习的计算机视觉技术识别不安全行为发生的频次来刻画施工现场的安全行为水平,最后结果为F。将管理时效值T、工人风险意识值N和不安全行为值F作为输入构建模糊神经网络,最终形成施工现场的宏观安全水平S。Based on the LCB theory, the invention classifies the identification results of the construction site, the unsafe behavior of people and the unsafe state of objects from the three perspectives of safety decision-making power, safety culture and safety behavior, and evaluates experts through the method of fuzzy neural network. It is described as an automatic algorithm, so as to realize the automatic evaluation of the macro safety level of the construction project, and reflect the actual safety level of the construction site through objective data. In the dimension of safety decision-making power, based on computer vision technology, the safety management level of the construction site is characterized by measuring the unsafe behavior of people and the duration of unsafe state of objects, and the final result is T. In the dimension of safety culture, based on computer vision technology, the risk awareness value of the construction worker group is reflected by measuring the number of workers exposed to risks, thereby reflecting the safety culture level of the construction site, and the final result is N. In the dimension of safety behavior, the frequency of unsafe behaviors is identified by deep learning-based computer vision technology to characterize the safety behavior level of the construction site, and the final result is F. Taking the management time value T, the worker's risk awareness value N and the unsafe behavior value F as input, a fuzzy neural network is constructed, and finally the macroscopic safety level S of the construction site is formed.
故本发明基于决策力-文化-行为LCB理论,结合计算机视觉与模糊神经网络方法,构建施工现场宏观安全评估系统。通过施工现场的全局图像数据,从不安全行为、工人风险意识和管理敏捷值等三方面评估施工项目的安全管理状态。通过客观采集施工现场的数据,结合专家的知识,提升施工项目管理者、业主方等利益相关者项目的安全管理能力。Therefore, the present invention is based on the decision-making-culture-behavior LCB theory, combined with computer vision and fuzzy neural network methods, to construct a construction site macro safety assessment system. Through the global image data of the construction site, the safety management status of the construction project is evaluated from three aspects: unsafe behavior, worker risk awareness and management agility value. Through the objective collection of construction site data, combined with expert knowledge, the project safety management capabilities of construction project managers, owners and other stakeholders can be improved.
图4是根据一示例性实施例示出的一种施工安全宏观评估方法的流程图。Fig. 4 is a flow chart of a macro-evaluation method for construction safety according to an exemplary embodiment.
如图4所示,根据本发明实施例的第二方面,提供一种施工安全宏观评估方法,用于施工安全宏观评估系统,方法包括:As shown in FIG. 4 , according to a second aspect of the embodiments of the present invention, a construction safety macro evaluation method is provided, which is used in a construction safety macro evaluation system, and the method includes:
步骤S401,采集施工现场的数据图像并进行标注和识别处理,以确定施工现场的每个工人和每个工程机械,以及每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标;Step S401, collecting data images of the construction site and performing labeling and identification processing to determine each worker and each construction machine on the construction site, as well as the center point coordinates and outline coordinates corresponding to each worker and each construction machine;
步骤S402,根据施工现场的每个工人和每个工程机械,以及每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标确定每日的工人未佩戴安全帽的不安全行为值、工人风险意识值和管理敏捷值;Step S402, according to each worker and each construction machine on the construction site, and the corresponding center point coordinates and outline coordinates of each worker and each construction machine, determine the daily unsafe behavior value of the worker without a helmet, the worker Risk awareness value and management agility value;
步骤S403,根据预设时间段内的不安全行为值、工人风险意识值和管理敏捷值,和对应的预设的施工安全宏观评估值,采用模糊神经网络算法进行训练,得到施工安全宏观评估模型;Step S403, according to the unsafe behavior value, worker risk awareness value and management agility value within the preset time period, and the corresponding preset construction safety macro evaluation value, use fuzzy neural network algorithm to train, and obtain the construction safety macro evaluation model ;
步骤S404,使用施工安全宏观评估模型对目标施工现场进行施工安全宏观评估。Step S404, using the construction safety macro-evaluation model to perform a construction safety macro-evaluation on the target construction site.
在一个实施例中,优选地,上述步骤S401包括以下步骤:In one embodiment, preferably, the above step S401 includes the following steps:
通过摄像装置采集施工现场的数据图像;Collect the data images of the construction site through the camera device;
每日对摄像装置进行校准;daily calibration of the camera;
在每日施工前,根据接收到的标记指令,标注工程机械的专用道路和施工作业的高风险区;Before daily construction, according to the received marking instructions, mark the dedicated roads for construction machinery and high-risk areas for construction operations;
通过预先收集和标注的施工图像,基于Mask-RCNN与Deepsort算法对工人、移动式工程机械、塔吊进行训练,以分钟为单位在施工现场的数据图像中分别识别出工人、移动式工程机械与塔吊的轮廓坐标,并对每个识别对象加以追踪;在数据库中,以分钟为单位分别统计识别出的工人、移动式工程机械和塔吊的总数量;其中,当识别出工人的轮廓时,识别工人是否佩戴安全帽,并进行相应的未佩戴安全帽数量的统计,将识别出的每个工人、移动式工程机械与塔吊编号,并将其对应的轮廓坐标与中心点坐标存入该时刻对应的工人、移动式工程机械与塔吊的数据集中。Through pre-collected and labeled construction images, workers, mobile construction machinery, and tower cranes are trained based on the Mask-RCNN and Deepsort algorithms, and workers, mobile construction machinery, and tower cranes are identified in the data images of the construction site in minutes. The coordinates of the contours of the identified objects are tracked, and each identified object is tracked; in the database, the total number of identified workers, mobile construction machinery and tower cranes is counted in minutes; among them, when the contours of the workers are identified, the workers are identified. Whether to wear a safety helmet, and the corresponding statistics of the number of not wearing a safety helmet, number each worker, mobile construction machinery and tower crane identified, and store their corresponding contour coordinates and center point coordinates in the corresponding moment. A dataset of workers, mobile construction machinery and tower cranes.
在一个实施例中,优选地,所步骤S402包括:In one embodiment, preferably, step S402 includes:
将数据库中每分钟出现的未佩戴安全帽人数存为时间序列的数组UB i ,i = 0,1,2...n-1,令W i = UB i+1 - UB i , W 0 = 0,其中n为时间序列的时间长度,如果W i <0则令W i = 0,构建数组W i ,采用以下第一计算公式计算每日的不安全行为值:Store the number of people without helmets in the database as a time series array UB i , i = 0,1,2... n -1, let Wi = UB i +1 - UB i , W 0 = 0, where n is the time length of the time series. If Wi < 0, let Wi = 0, construct an array Wi , and use the following first calculation formula to calculate the daily unsafe behavior value:
其中,N i 为i时刻施工现场工人的总人数;Among them, Ni is the total number of workers on the construction site at time i ;
根据数据库中的每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标,统计各时刻暴露在风险区作业的工人数量,采用以下第二计算公式计算第一工人风险意识分值:According to the corresponding center point coordinates and contour coordinates of each worker and each construction machine in the database, count the number of workers exposed to work in the risk area at each moment, and use the following second calculation formula to calculate the risk awareness score of the first worker:
其中,NW i 代表i时刻暴露在风险区作业的工人数量,N i 为i时刻施工现场工人的总人数,表示每日暴露在风险区作业的工人数量值,即第一工人风险意识分值;Among them, NW i represents the number of workers exposed to the risk area at time i, N i is the total number of workers on the construction site at time i, Represents the value of the number of workers exposed to the risk area every day, that is, the risk awareness score of the first worker;
根据数据库中的每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标,统计各时刻暴露在工人机械专用道路上的工人数量,采用以下第三计算公式计算第二工人风险意识分值:According to the corresponding center point coordinates and contour coordinates of each worker and each construction machine in the database, count the number of workers exposed to the special road for workers and machinery at each moment, and use the following third calculation formula to calculate the second worker's risk awareness score :
其中,NRW i 代表i时刻暴露在工人机械专用道路上的工人数量,N i 为i时刻施工现场工人的总人数,N rw 表示每日暴露在工人机械专用道路上的工人数量值,即第二工人风险意识分值,其中,工人风险意识值包括第一工人风险意识分值和第二工人风险意识分值;Among them, NRW i represents the number of workers exposed on the special road for workers and machinery at time i, Ni is the total number of workers on the construction site at time i, and N rw represents the daily value of the number of workers exposed on the special road for workers and machinery, that is, the second The worker's risk awareness score, wherein the worker's risk awareness value includes the first worker's risk awareness score and the second worker's risk awareness score;
分别统计每日工人未佩戴安全帽时长T wh ,工人进入工程机械专用道路的时长T wr ,工程机械专用道路被占用的时长T r ,时长单位为分钟,最后输出管理敏捷值T=(T wh ,T wr ,T r )。The daily time T wh of workers not wearing helmets, the time T wr of workers entering the special road for construction machinery, the time T r that the special road for construction machinery is occupied, the unit of time is minutes, and the final output management agility value T = ( T wh , T wr , T r ).
在一个实施例中,优选地,步骤S403包括:In one embodiment, preferably, step S403 includes:
采用MinMaxScaler归一化算法,对不安全行为值、工人风险意识值和管理敏捷值进行归一化处理,得到归一化处理后的不安全行为值、工人风险意识值和管理敏捷值The MinMaxScaler normalization algorithm is used to normalize the unsafe behavior value, worker risk awareness value and management agility value to obtain the normalized unsafe behavior value, worker risk awareness value and management agility value.
将不安全行为值、工人风险意识值和管理敏捷值转换为范围在0-1之间的值,并获取专家对施工现场预设的施工安全宏观评估值;Convert unsafe behavior value, worker risk awareness value and management agility value into values ranging from 0 to 1, and obtain the macro evaluation value of construction safety preset by experts on the construction site;
将归一化处理后的不安全行为值、工人风险意识值和管理敏捷值作为模糊神经网络算法的输入x,对应的预设的施工安全宏观评估值作为模糊神经网络算法的输出y,进行训练,得到施工安全宏观评估模型;The normalized unsafe behavior value, worker risk awareness value and management agility value are used as the input x of the fuzzy neural network algorithm, and the corresponding preset macroscopic evaluation value of construction safety is used as the output y of the fuzzy neural network algorithm for training. , to obtain the macroscopic assessment model of construction safety;
其中,施工安全宏观评估模型包括模糊层、规则层、正则化层、二次模糊计算层和去模糊化层;Among them, the macro-evaluation model of construction safety includes fuzzy layer, rule layer, regularization layer, secondary fuzzy calculation layer and defuzzification layer;
模糊层将每个输入通过三个隶属度函数进行模糊化,计算出对应的隶属度值,并输出给规则层;The fuzzy layer fuzzifies each input through three membership functions, calculates the corresponding membership value, and outputs it to the rule layer;
规则层将各个隶属度值相乘,以输出每个规则的激活程度至正则化层;The rule layer multiplies each membership value to output the activation degree of each rule to the regularization layer;
正则化层对每个规则的激活程度进行正则化计算,以输出正则化后的激活程度至二次模糊计算层;The regularization layer performs regularization calculation on the activation degree of each rule to output the regularized activation degree to the secondary fuzzy calculation layer;
二次模糊计算层通过正则化后的激活程度计算出新的隶属度值,以输出至去模糊化层;The secondary fuzzy calculation layer calculates the new membership value through the regularized activation degree to output to the defuzzification layer;
去模糊化层将新的隶属度值重新映射回讲点集合中的精确值,以输出施工安全宏观评估值。The defuzzification layer remaps the new membership value back to the exact value in the set of lecture points to output the construction safety macro assessment value.
在一个实施例中,优选地,步骤S404包括:In one embodiment, preferably, step S404 includes:
采集目标施工现场的目标数据图像并进行标注和识别处理,以确定目标施工现场的每个工人和每个工程机械,以及每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标;Collect target data images of the target construction site and perform labeling and identification processing to determine each worker and each construction machine at the target construction site, as well as the corresponding center point coordinates and outline coordinates of each worker and each construction machine;
根据目标施工现场的每个工人和每个工程机械,以及每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标确定每日的工人未佩戴安全帽的目标不安全行为值、目标工人风险意识值和目标管理敏捷值;According to each worker and each construction machine at the target construction site, as well as the corresponding center point coordinates and outline coordinates of each worker and each construction machine, determine the daily target unsafe behavior value of workers without helmets, target workers Risk awareness value and target management agility value;
根据目标不安全行为值、目标工人风险意识值和目标管理敏捷值和施工安全宏观评估模型,计算得到目标施工现场对应的目标施工安全宏观评估值。According to the target unsafe behavior value, the target worker's risk awareness value, the target management agility value and the construction safety macro evaluation model, the target construction safety macro evaluation value corresponding to the target construction site is calculated.
根据本发明实施例的第三方面,提供一种施工安全宏观评估装置,装置包括:According to a third aspect of the embodiments of the present invention, a construction safety macro evaluation device is provided, the device comprising:
处理器;processor;
用于存储处理器可执行指令的存储器;memory for storing processor-executable instructions;
其中,处理器被配置为:where the processor is configured as:
采集施工现场的数据图像并进行标注和识别处理,以确定施工现场的每个工人和每个工程机械,以及每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标;Collect data images of the construction site and perform labeling and identification processing to determine each worker and each construction machine on the construction site, as well as the corresponding center point coordinates and outline coordinates of each worker and each construction machine;
根据施工现场的每个工人和每个工程机械,以及每个工人和每个工程机械各自对应的中心点坐标和轮廓坐标确定每日的工人未佩戴安全帽的不安全行为值、工人风险意识值和管理敏捷值;According to each worker and each construction machine on the construction site, as well as the corresponding center point coordinates and outline coordinates of each worker and each construction machine, the daily unsafe behavior value and worker risk awareness value of workers without helmets are determined and managing agility values;
根据预设时间段内的不安全行为值、工人风险意识值和管理敏捷值,和对应的预设的施工安全宏观评估值,采用模糊神经网络算法进行训练,得到施工安全宏观评估模型;According to the unsafe behavior value, worker risk awareness value and management agility value within the preset time period, and the corresponding preset construction safety macro evaluation value, the fuzzy neural network algorithm is used for training, and the construction safety macro evaluation model is obtained;
使用施工安全宏观评估模型对目标施工现场进行施工安全宏观评估。Use the construction safety macro-evaluation model to perform a construction safety macro-evaluation on the target construction site.
进一步可以理解的是,本发明中“多个”是指两个或两个以上,其它量词与之类似。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。字符“/”一般表示前后关联对象是一种“或”的关系。单数形式的“一种”、“”和“该”也旨在包括多数形式,除非上下文清楚地表示其他含义。It can be further understood that, in the present invention, "a plurality" refers to two or more than two, and other measure words are similar. "And/or", which describes the association relationship of the associated objects, means that there can be three kinds of relationships, for example, A and/or B, which can mean that A exists alone, A and B exist at the same time, and B exists alone. The character "/" generally indicates that the associated objects are an "or" relationship. The singular forms "a," "" and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise.
进一步可以理解的是,术语“第一”、“第二”等用于描述各种信息,但这些信息不应限于这些术语。这些术语仅用来将同一类型的信息彼此区分开,并不表示特定的顺序或者重要程度。实际上,“第一”、“第二”等表述完全可以互换使用。例如,在不脱离本发明范围的情况下,第一信息也可以被称为第二信息,类似地,第二信息也可以被称为第一信息。It is further understood that the terms "first", "second", etc. are used to describe various information, but the information should not be limited to these terms. These terms are only used to distinguish the same type of information from one another, and do not imply a particular order or level of importance. In fact, the expressions "first", "second" etc. are used completely interchangeably. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present invention.
进一步可以理解的是,本发明实施例中尽管在附图中以特定的顺序描述操作,但是不应将其理解为要求按照所示的特定顺序或是串行顺序来执行这些操作,或是要求执行全部所示的操作以得到期望的结果。在特定环境中,多任务和并行处理可能是有利的。It should be further understood that, although the operations in the embodiments of the present invention are described in a specific order in the drawings, it should not be construed as requiring that the operations be performed in the specific order shown or the serial order, or requiring Perform all operations shown to obtain the desired result. In certain circumstances, multitasking and parallel processing may be advantageous.
本领域技术人员在考虑说明书及实践这里公开的发明后,将容易想到本发明的其它实施方案。本申请旨在涵盖本发明的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本发明的一般性原理并包括本发明未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的,本发明的真正范围和精神由下面的权利要求指出。Other embodiments of the invention will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses or adaptations of the invention which follow the general principles of the invention and which include common knowledge or conventional techniques in the art not disclosed by the invention . The specification and examples are to be regarded as exemplary only, with the true scope and spirit of the invention being indicated by the following claims.
应当理解的是,本发明并不局限于上面已经描述并在附图中示出的精确结构,并且可以在不脱离其范围进行各种修改和改变。本发明的范围仅由所附的权利要求来限制。It should be understood that the present invention is not limited to the precise structures described above and illustrated in the accompanying drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210339975.1A CN114493375B (en) | 2022-04-02 | 2022-04-02 | Construction Safety Macro Evaluation System and Method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210339975.1A CN114493375B (en) | 2022-04-02 | 2022-04-02 | Construction Safety Macro Evaluation System and Method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114493375A true CN114493375A (en) | 2022-05-13 |
| CN114493375B CN114493375B (en) | 2022-07-22 |
Family
ID=81488938
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210339975.1A Active CN114493375B (en) | 2022-04-02 | 2022-04-02 | Construction Safety Macro Evaluation System and Method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114493375B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115063056A (en) * | 2022-08-18 | 2022-09-16 | 西南交通大学 | Improved construction behavior safety risk dynamic analysis method based on graph topology analysis |
| CN115796388A (en) * | 2023-01-29 | 2023-03-14 | 北京迈道科技有限公司 | Risk prediction method, device, equipment and medium for construction safety |
| CN116562824A (en) * | 2023-05-25 | 2023-08-08 | 闽通数智安全顾问(杭州)有限公司 | Highway engineering full life cycle project management method and system |
| WO2024066039A1 (en) * | 2022-09-27 | 2024-04-04 | 深圳先进技术研究院 | Construction risk assessment method and apparatus based on multi-source data fusion |
| CN119204686A (en) * | 2024-10-09 | 2024-12-27 | 三峡高科信息技术有限责任公司 | A construction worker safety risk assessment and early warning method, device and equipment |
| CN119625647A (en) * | 2025-02-12 | 2025-03-14 | 广东智云城建科技有限公司 | A training and verification method for construction scope intrusion risk determination model |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110969244A (en) * | 2019-12-18 | 2020-04-07 | 长安大学 | A construction safety monitoring method based on convolutional neural network |
| AU2020100711A4 (en) * | 2020-05-05 | 2020-06-11 | Chang, Cheng Mr | The retrieval system of wearing safety helmet based on deep learning |
| WO2020191004A1 (en) * | 2019-03-18 | 2020-09-24 | Georgia Tech Research Corporation | Tracking and alert method and system for worker productivity and safety |
| CN112258049A (en) * | 2020-10-26 | 2021-01-22 | 西南交通大学 | A safety control method for regional tunnels with complex geological conditions |
| CN112799339A (en) * | 2020-12-31 | 2021-05-14 | 西南石油大学 | A method for early warning workers and dynamic hazards based on machine vision technology |
| CN114240259A (en) * | 2022-02-11 | 2022-03-25 | 深圳中核普达测量科技有限公司 | Dynamic grading method, device and equipment for scaffold operation risks |
-
2022
- 2022-04-02 CN CN202210339975.1A patent/CN114493375B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020191004A1 (en) * | 2019-03-18 | 2020-09-24 | Georgia Tech Research Corporation | Tracking and alert method and system for worker productivity and safety |
| CN110969244A (en) * | 2019-12-18 | 2020-04-07 | 长安大学 | A construction safety monitoring method based on convolutional neural network |
| AU2020100711A4 (en) * | 2020-05-05 | 2020-06-11 | Chang, Cheng Mr | The retrieval system of wearing safety helmet based on deep learning |
| CN112258049A (en) * | 2020-10-26 | 2021-01-22 | 西南交通大学 | A safety control method for regional tunnels with complex geological conditions |
| CN112799339A (en) * | 2020-12-31 | 2021-05-14 | 西南石油大学 | A method for early warning workers and dynamic hazards based on machine vision technology |
| CN114240259A (en) * | 2022-02-11 | 2022-03-25 | 深圳中核普达测量科技有限公司 | Dynamic grading method, device and equipment for scaffold operation risks |
Non-Patent Citations (4)
| Title |
|---|
| DONGPING FANG等: "LCB approach for construction safety", 《SAFETY SCIENCE》 * |
| 刘相池: "对2-基于计算机视觉的建筑施工安全监控方法", 《中国优秀博硕士学位论文全文数据库(硕士)工程科技Ⅰ辑》 * |
| 李子博: "对1-基于T-S网络的建筑施工安全预警体系研究", 《中国优秀博硕士学位论文全文数据库(硕士)工程科技Ⅱ辑》 * |
| 郭红领等: "集成BIM和PT的工人不安全行为预警系统研究", 《中国安全科学学报》 * |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115063056A (en) * | 2022-08-18 | 2022-09-16 | 西南交通大学 | Improved construction behavior safety risk dynamic analysis method based on graph topology analysis |
| CN115063056B (en) * | 2022-08-18 | 2022-11-18 | 西南交通大学 | Improved Dynamic Analysis Method of Construction Behavior Safety Risk Based on Graph Topology Analysis |
| WO2024066039A1 (en) * | 2022-09-27 | 2024-04-04 | 深圳先进技术研究院 | Construction risk assessment method and apparatus based on multi-source data fusion |
| CN115796388A (en) * | 2023-01-29 | 2023-03-14 | 北京迈道科技有限公司 | Risk prediction method, device, equipment and medium for construction safety |
| CN116562824A (en) * | 2023-05-25 | 2023-08-08 | 闽通数智安全顾问(杭州)有限公司 | Highway engineering full life cycle project management method and system |
| CN116562824B (en) * | 2023-05-25 | 2023-11-24 | 闽通数智安全顾问(杭州)有限公司 | Highway engineering full life cycle project management method and system |
| CN119204686A (en) * | 2024-10-09 | 2024-12-27 | 三峡高科信息技术有限责任公司 | A construction worker safety risk assessment and early warning method, device and equipment |
| CN119625647A (en) * | 2025-02-12 | 2025-03-14 | 广东智云城建科技有限公司 | A training and verification method for construction scope intrusion risk determination model |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114493375B (en) | 2022-07-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114493375B (en) | Construction Safety Macro Evaluation System and Method | |
| Jiang et al. | Cyber physical system for safety management in smart construction site | |
| CN110502965A (en) | A Construction Helmet Wearing Monitoring Method Based on Computer Vision Human Pose Estimation | |
| CN110602449A (en) | Intelligent construction safety monitoring system method in large scene based on vision | |
| CN111815158A (en) | Horizontal transportation scheduling system for container terminal | |
| CN114727063B (en) | Path safety monitoring system, method and device on construction site | |
| CN119251761B (en) | A construction monitoring method | |
| CN117575550B (en) | BIM technology-based three-dimensional visual management system for wind farm data | |
| CN117575170B (en) | Intelligent management system | |
| CN115278542A (en) | Ultra-wideband technology-based construction site personnel positioning management system and method | |
| CN118333403B (en) | Transformer substation field operation control method based on three-dimensional dynamic modeling | |
| CN118279833A (en) | Engineering supervision safety supervision system based on three-dimensional visualization | |
| CN113905215B (en) | Bus safe driving monitoring system | |
| CN114419547A (en) | Vehicle detection method and system based on monocular vision and deep learning | |
| CN116912551A (en) | Expressway equipment monitoring system based on Internet of vehicles | |
| CN114067287A (en) | A foreign object recognition and early warning system based on vehicle-side roadside data perception fusion | |
| CN116361682A (en) | Early warning system based on driver image prediction bus driving risk | |
| CN118898892A (en) | A parallel monitoring and early warning method for highway slopes | |
| CN118540666A (en) | Intelligent production safety management system based on industrial Internet | |
| CN117808241A (en) | Construction management system and method based on unmanned aerial vehicle technology | |
| CN110705854A (en) | Driving level evaluation method and system | |
| CN118537887A (en) | Method and system for detecting and identifying panoramic personnel of transformer substation in non-inductive positioning manner | |
| CN116882670A (en) | BIM-based smart construction site management system for water transportation projects | |
| CN114663818A (en) | Based on visual self-supervision learning airport operation core area monitoring and early warning system and method | |
| Luo et al. | Multi-sensor Fusion Based Inspection Robotic Dog Safety Guardian and Navigation Application |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |