CN114448094A - A data sharing system based on edge computing of intelligent service terminals in Taiwan area - Google Patents
A data sharing system based on edge computing of intelligent service terminals in Taiwan area Download PDFInfo
- Publication number
- CN114448094A CN114448094A CN202210101965.4A CN202210101965A CN114448094A CN 114448094 A CN114448094 A CN 114448094A CN 202210101965 A CN202210101965 A CN 202210101965A CN 114448094 A CN114448094 A CN 114448094A
- Authority
- CN
- China
- Prior art keywords
- data
- layer
- module
- intelligent service
- time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J13/00—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network
- H02J13/00001—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by the display of information or by user interaction, e.g. supervisory control and data acquisition systems [SCADA] or graphical user interfaces [GUI]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J13/00—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network
- H02J13/00002—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by monitoring
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J13/00—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network
- H02J13/00004—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by the power network being locally controlled
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J13/00—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network
- H02J13/00006—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by information or instructions transport means between the monitoring, controlling or managing units and monitored, controlled or operated power network element or electrical equipment
- H02J13/00022—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by information or instructions transport means between the monitoring, controlling or managing units and monitored, controlled or operated power network element or electrical equipment using wireless data transmission
- H02J13/00026—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by information or instructions transport means between the monitoring, controlling or managing units and monitored, controlled or operated power network element or electrical equipment using wireless data transmission involving a local wireless network, e.g. Wi-Fi, ZigBee or Bluetooth
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J13/00—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network
- H02J13/00006—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by information or instructions transport means between the monitoring, controlling or managing units and monitored, controlled or operated power network element or electrical equipment
- H02J13/00028—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by information or instructions transport means between the monitoring, controlling or managing units and monitored, controlled or operated power network element or electrical equipment involving the use of Internet protocols
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J2203/00—Indexing scheme relating to details of circuit arrangements for AC mains or AC distribution networks
- H02J2203/20—Simulating, e g planning, reliability check, modelling or computer assisted design [CAD]
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02B—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
- Y02B70/00—Technologies for an efficient end-user side electric power management and consumption
- Y02B70/30—Systems integrating technologies related to power network operation and communication or information technologies for improving the carbon footprint of the management of residential or tertiary loads, i.e. smart grids as climate change mitigation technology in the buildings sector, including also the last stages of power distribution and the control, monitoring or operating management systems at local level
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y04—INFORMATION OR COMMUNICATION TECHNOLOGIES HAVING AN IMPACT ON OTHER TECHNOLOGY AREAS
- Y04S—SYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS
- Y04S20/00—Management or operation of end-user stationary applications or the last stages of power distribution; Controlling, monitoring or operating thereof
- Y04S20/20—End-user application control systems
- Y04S20/242—Home appliances
Landscapes
- Engineering & Computer Science (AREA)
- Power Engineering (AREA)
- Software Systems (AREA)
- Computer Networks & Wireless Communication (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Medical Informatics (AREA)
- Evolutionary Computation (AREA)
- Data Mining & Analysis (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Artificial Intelligence (AREA)
- Human Computer Interaction (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
一种基于台区智能业务终端边缘计算的数据共享系统,从数据驱动的角度出发,结合容器技术和APP开发技术,打通云中心与智能业务终端的数据壁垒,将智能业务终端从下至上分为数据接入层、数据集成层、边缘数据共享层、数据集市层、数据应用层和云端数据存储层,在边缘侧整合配电台区各类信息资源,降低云计算中心带宽的压力,减缓智能业务终端的计算资源需求,提高数据处理能力,使得诊断业务能快速响应,实现数据汇集和共享,便于实现云端和边缘侧的信息协同、计算资源协同、业务协同,实现终端业务的动态调整,适应性更强,提升数据价值创造能力,提高电网生产管理精益化水平。
A data sharing system based on edge computing of intelligent service terminals in the Taiwan area. From a data-driven perspective, combined with container technology and APP development technology, it breaks through the data barriers between cloud centers and intelligent service terminals, and divides intelligent service terminals from bottom to top. Data access layer, data integration layer, edge data sharing layer, data mart layer, data application layer and cloud data storage layer, integrate various information resources in the power distribution station area on the edge side, reduce the pressure of cloud computing center bandwidth, slow down The computing resource requirements of intelligent service terminals, improve data processing capabilities, enable rapid response of diagnostic services, realize data collection and sharing, facilitate the realization of information collaboration, computing resource collaboration, and business collaboration on the cloud and edge sides, and realize dynamic adjustment of terminal services. It is more adaptable, enhances the ability to create data value, and improves the level of lean production and management of power grids.
Description
技术领域technical field
本发明属于配电自动化技术领域,具体涉及一种基于台区智能业务终端边缘计算的数据共享系统。The invention belongs to the technical field of power distribution automation, and in particular relates to a data sharing system based on edge computing of intelligent service terminals in station areas.
背景技术Background technique
泛在电力物联网将人工智能和移动互联等现代化信息通讯手段应用于电力系统运行的每一环节,从而构建一个物与物间,人与物间,人与人之间相互联通的智能化网络。配电物联网是泛在电力物联网的重要组成部分,目前主要采用“云管边端”的建设模式。边缘侧负责数据采集和就地处理,满足实时业务的延时要求。部署在边缘侧的智能业务终端作为边缘节点,具备交采能力,满足配电台区的各种信息接入需求,同时部署基于轻量化的Linux容器技术,根据各种业务场景灵活配置各类APP软件。云中心负责数据深度挖掘和高级业务的处理,对多个智能融合终端进行协同管理实现云边数据协同、业务协同、计算资源协同。The ubiquitous power Internet of Things applies modern information and communication methods such as artificial intelligence and mobile Internet to every link of the operation of the power system, so as to build an intelligent network that is interconnected between things, people and things, and people. . The power distribution Internet of Things is an important part of the ubiquitous power Internet of Things. At present, the construction mode of "cloud pipe edge terminal" is mainly adopted. The edge side is responsible for data collection and on-site processing to meet the latency requirements of real-time services. The intelligent service terminal deployed on the edge side acts as an edge node, which has the ability to exchange and purchase, and meets various information access requirements in the distribution station area. At the same time, the lightweight Linux container technology is deployed to flexibly configure various APPs according to various business scenarios. software. The cloud center is responsible for deep data mining and advanced business processing, and performs collaborative management of multiple intelligent fusion terminals to achieve cloud-side data collaboration, business collaboration, and computing resource collaboration.
随着深入应用“云大物移智”等先进的配电物联网技术,从本质上可以助推配电网建设、运维、管理水平的提升,实现跨越式发展。配电物联网是传统工业技术与物联网技术深度融合产生的一种新型电力网络形态,通过配电网设备间的全面互联、互通、互操作,具有能量流、信息流与业务流交互耦合的特征,能够实现配电网的全面感知、数据融合和智能应用,满足配电网精益化、智能化管理需求。但是,当前我国配电物联网建设正处于起步阶段,存在以下关键技术挑战:①传感器的覆盖不充分,电网仍存在监测盲区;②数据模型和通信标准没有统一,信息孤岛难以消除;③数据分析智能化程度低,供用电数据价值尚未被有效挖掘;④尚未建立有效的协作模型,多主体间协作机制尚未成熟等。With the in-depth application of advanced distribution Internet of Things technologies such as "cloud, big things, and intelligence", it can essentially boost the level of distribution network construction, operation and maintenance, and management, and achieve leapfrog development. Distribution Internet of Things is a new type of power network form produced by the deep integration of traditional industrial technology and Internet of Things technology. It can realize the comprehensive perception, data fusion and intelligent application of the distribution network, and meet the needs of lean and intelligent management of the distribution network. However, at present, the construction of the distribution Internet of things in my country is in its infancy, and there are the following key technical challenges: (1) the coverage of sensors is insufficient, and there are still monitoring blind spots in the power grid; (2) the data model and communication standards are not unified, and information islands are difficult to eliminate; (3) data analysis The degree of intelligence is low, and the value of power supply and consumption data has not been effectively tapped; (4) an effective collaboration model has not yet been established, and the multi-agent collaboration mechanism has not yet matured.
随着配电台区下的综合能源设备不断增加,智能业务终端积累了配用电环节产生的海量数据。由于这些数据具有处理逻辑复杂、结构多样、存储周期长等特点,造成云中心和边缘节点数据集成和共享的难度增加,降低了云边协同和监测运维的效率。数据共享成了电网实现资源集中管控、提升数据应用价值以及完善信息化建设进程中首要考虑的问题。当前电网企业虽然已经建成面向不同应用需求的业务数据中心,但在配电物联网云边协同治理台区典型业务的场景中,还未建立统一的信息模型机制,实现数据层面的集中管控、高度共享、协同治理,因此,需要在配电物联网中构建一套完善的数据共享体系。With the continuous increase of comprehensive energy equipment under the distribution station area, the intelligent service terminal has accumulated massive data generated by the power distribution and consumption links. Due to the complex processing logic, diverse structure, and long storage period of these data, the difficulty of data integration and sharing between cloud centers and edge nodes increases, which reduces the efficiency of cloud-edge collaboration and monitoring, operation and maintenance. Data sharing has become the primary consideration in the process of realizing centralized resource management and control, enhancing data application value and improving information construction in the power grid. At present, although power grid companies have built business data centers for different application requirements, in the scenario of typical business scenarios of power distribution IoT cloud-side collaborative governance platform area, a unified information model mechanism has not yet been established to achieve centralized management and control at the data level. Sharing and collaborative governance, therefore, it is necessary to build a complete data sharing system in the distribution Internet of Things.
发明内容SUMMARY OF THE INVENTION
为提高电力物联网云中心和智能业务终端的数据处理效率,实现对物联网架构下配电台区异常工况的及时精细化诊断,本发明公开了一种基于台区智能业务终端边缘计算的数据共享系统,基于“云管边端”的配电物联网系统架构,使用轻量级的数据传输协议,建立智能业务终端内外数据交换规范,构建基于台区智能业务终端边缘计算的数据共享系统,并结合低压台区异常工况的业务场景,完成基于数据共享体系的配电台区异常工况诊断案例。In order to improve the data processing efficiency of the power Internet of Things cloud center and the intelligent service terminal, and realize the timely and refined diagnosis of abnormal working conditions in the distribution station area under the Internet of Things architecture, the invention discloses an edge computing based on the intelligent service terminal of the station area. The data sharing system, based on the "cloud-pipe-side-end" power distribution IoT system architecture, uses lightweight data transmission protocols, establishes internal and external data exchange specifications for intelligent service terminals, and builds a data sharing system based on edge computing of intelligent service terminals in the station area , and combined with the business scenarios of abnormal working conditions in the low-voltage station area, to complete the diagnosis case of abnormal working conditions in the distribution station area based on the data sharing system.
本发明遵循云中心和智能业务终端“集中管控、分类存储、统一应用”的原则,将智能业务终端从下至上分为数据接入层、数据集成层、边缘数据共享层、数据集市层、数据应用层和云端数据存储层,打通云中心与智能业务终端的数据壁垒,在边缘侧整合配电台区各类信息资源,降低云计算中心带宽的压力,减缓智能业务终端的计算资源需求,提高数据处理能力,使得诊断业务能快速响应,实现数据汇集和共享,提升数据价值创造能力,提高电网生产管理精益化水平。The invention follows the principle of "centralized management and control, classified storage, and unified application" of the cloud center and the intelligent service terminal, and divides the intelligent service terminal into a data access layer, a data integration layer, an edge data sharing layer, a data mart layer, The data application layer and the cloud data storage layer break through the data barriers between the cloud center and smart service terminals, integrate various information resources in the distribution station area on the edge side, reduce the pressure on the bandwidth of the cloud computing center, and ease the computing resource requirements of smart service terminals. Improve data processing capabilities, enable diagnosis services to respond quickly, realize data collection and sharing, enhance data value creation capabilities, and improve the level of lean production management of power grids.
本发明采用如下的技术方案。本发明提供了一种基于台区智能业务终端边缘计算的数据共享系统,包括:数据接入层、数据集成层、边缘数据共享层、数据集市层、数据应用层和云端数据存储层,其特征在于:The present invention adopts the following technical solutions. The present invention provides a data sharing system based on the edge computing of intelligent service terminals in the station area, including: a data access layer, a data integration layer, an edge data sharing layer, a data mart layer, a data application layer and a cloud data storage layer. It is characterized by:
所述数据接入层包括实时数据接入模块、离线数据接入模块、设备参数接入模块,数据接入层与智能业务终端相连,采集配变、分支箱、户表、充电桩、分布式能源电网设备运行数据和设备参数,将采集的电网设备运行数据和设备参数分为实时数据、离线数据、设备参数,然后分别接入实时数据接入模块、离线数据接入模块和设备参数接入模块。The data access layer includes a real-time data access module, an offline data access module, and an equipment parameter access module. The data access layer is connected to the intelligent service terminal, collecting and distributing transformers, branch boxes, household meters, charging piles, distributed Energy grid equipment operation data and equipment parameters. The collected power grid equipment operation data and equipment parameters are divided into real-time data, offline data, and equipment parameters, and then connected to the real-time data access module, offline data access module, and equipment parameter access respectively. module.
优选地,采用MQTT协议来完成各层级间数据的发送、接收操作,Preferably, the MQTT protocol is used to complete the sending and receiving operations of data between levels,
所述MQTT协议包括三个角色:消息发布者、消息订阅者和MQTT服务器,前一层级的功能模块作为消息发布者通过MQTT服务器向数据中心发送格式统一的数据模型,同时,后一层级的功能模块作为消息订阅者配置好订阅接口信息,MQTT服务器匹配到订阅服务信息后,将数据中心共享的数据模型转发给消息订阅者,完成数据的共享过程,实现数据交互流程。The MQTT protocol includes three roles: a message publisher, a message subscriber, and an MQTT server. The functional modules of the previous level serve as message publishers to send a data model with a unified format to the data center through the MQTT server. At the same time, the functions of the latter level As a message subscriber, the module configures the subscription interface information. After the MQTT server matches the subscription service information, it forwards the data model shared by the data center to the message subscriber to complete the data sharing process and realize the data interaction process.
所述数据集成层包括数据溯源模块、多源汇集数据清洗模块、统计计算模块;整个数据集成层通过MQTT协议将多源汇集数据清洗模块进行后,以JSON发送到边缘数据共享层托管。The data integration layer includes a data traceability module, a multi-source collection data cleaning module, and a statistical calculation module; the entire data integration layer performs the multi-source collection data cleaning module through the MQTT protocol, and then sends JSON to the edge data sharing layer for hosting.
所述边缘数据共享层包括数据中心模块,数据中心模块用于实现数据短期存储,在数据中心模块中,将数据集成层上传的量测类对象、统计量类对象、参变量类对象、控制类对象以统一格式的数据模型表征,采用MQTT协议,将数据模型以接口的形式区分,按类别发布并储存在数据中心,实现数据共享交换。The edge data sharing layer includes a data center module, and the data center module is used to realize short-term data storage. In the data center module, the measurement class objects, statistics class objects, parameter class objects, and control class objects uploaded by the data integration layer are Objects are represented by a data model in a unified format, using the MQTT protocol to differentiate the data models in the form of interfaces, publish them by category and store them in the data center to realize data sharing and exchange.
所述数据集市层向边缘共享层发送所需的数据接口,接收边缘共享层发送的该接口下的数据,将接收到的实时数据和特征数据组合,上传到数据应用层。The data mart layer sends the required data interface to the edge sharing layer, receives the data under the interface sent by the edge sharing layer, combines the received real-time data and feature data, and uploads it to the data application layer.
所述数据应用层的功能模块根据业务需要,获取数据集市层对应的数据模型,对业务面向的场景进行决策分析,基于台区智能业务终端本地化计算和处置优势,实现边缘测就地的异常工况状态监测和快速响应治理。The functional module of the data application layer obtains the data model corresponding to the data mart layer according to the needs of the business, makes decision-making analysis on the business-oriented scenario, and realizes the localized computing and processing advantages of the intelligent business terminal in the Taiwan area to realize the edge measurement and localization. Abnormal working condition monitoring and rapid response management.
所述云端数据存储层负责数据深度挖掘和高级业务的处理,智能业务终端将基于业务功能模块组装的数据集上传云端数据存储层存储,结合智能业务终端的业务实时数据,通过机器学习和深度学习算法进行异常工况的分类和预测。The cloud data storage layer is responsible for in-depth data mining and advanced business processing. The intelligent business terminal uploads the data set assembled based on the business function modules to the cloud data storage layer for storage, combined with the business real-time data of the intelligent business terminal, through machine learning and deep learning. The algorithm performs the classification and prediction of abnormal operating conditions.
所述实时数据包括传感器监测的实时环境数据:温度、湿度,以及智能电网设备采集到的实时电气数据:电压、电流、电能质量、有功功率、无功功率;The real-time data includes real-time environmental data monitored by sensors: temperature, humidity, and real-time electrical data collected by smart grid equipment: voltage, current, power quality, active power, reactive power;
所述离线数据包括智能业务终端外部人为定时导入的未接入终端前的历史电气、环境数据和智能业务终端内部文件系统储存的接入终端后历史电气、环境数据日志;The offline data includes the historical electrical and environmental data before the terminal that is not connected to the terminal that is artificially imported from the outside of the intelligent service terminal and the historical electrical and environmental data logs after the terminal is accessed and stored in the internal file system of the intelligent service terminal;
所述设备参数包括电网设备参数信息和传感器参数信息。The device parameters include grid device parameter information and sensor parameter information.
所述数据溯源模块借鉴序列化存储的思想,将数据接入层收集到的各设备的实时数据、离线数据重排序,附上该设备本身的性能参数,再根据时间戳的大小储存在各自的表中;The data traceability module draws on the idea of serialized storage, reorders the real-time data and offline data of each device collected by the data access layer, attaches the performance parameters of the device itself, and then stores it in the respective device according to the size of the timestamp. table;
所述多源汇集数据清洗模块基于数据溯源模块重排序后的时间序列数据进行数据清洗,应用数据挖掘中数据缺失值填补和异常值处理的相关方法,将数据进一步补充完整,提高数据准确性;The multi-source pooled data cleaning module performs data cleaning based on the time series data reordered by the data traceability module, and applies the related methods of data missing value filling and outlier processing in data mining to further supplement and complete the data and improve data accuracy;
所述统计计算模块是根据专家常识,在数据溯源模块和多源汇集数据清洗模块模块整理完善好的数据表中人为地从时域和频域抽取出业务特征:异常持续时间和异常发生频率,通过统计学习的算法计算得到相关业务特征。The statistical calculation module artificially extracts business characteristics from the time domain and the frequency domain from the data tables organized by the data traceability module and the multi-source aggregated data cleaning module according to the common knowledge of experts: abnormal duration and abnormal occurrence frequency, Relevant business characteristics are obtained through statistical learning algorithm calculation.
所述数据中心模块包括数据格式统一单元、数据短期存储单元、数据分类管理单元,其中:The data center module includes a data format unification unit, a data short-term storage unit, and a data classification management unit, wherein:
所述数据格式统一单元将数据集成层传来的各数据以统一规则命名,标注数据类型,数据产生时间,连同数据的值,组成一个JSON字符串;The data format unification unit names each data transmitted from the data integration layer with a unified rule, annotates the data type, the data generation time, together with the value of the data, to form a JSON string;
所述数据短期存储单元是在数据格式统一后,非实时数据的JSON字符串进行集中存储,将数据按时间排序;The data short-term storage unit is to centrally store the JSON strings of non-real-time data after the data format is unified, and sort the data by time;
所述数据分类管理单元是将各实时数据和存储单元中的历史数据组合,赋予一个接口,供数据集市层调用。The data classification management unit is to combine the real-time data and the historical data in the storage unit to give an interface for the data mart layer to call.
本发明的有益效果在于,与现有技术相比,本申请关键点为从数据驱动的角度出发,结合容器技术,遵循云中心和智能业务终端“集中管控、分类存储、统一应用”的原则,将智能业务终端从下至上分为数据接入层、数据集成层、边缘数据共享层、数据集市层、数据应用层和云端数据存储层,打通云中心与智能业务终端的数据壁垒,在边缘侧整合配电台区各类信息资源,降低云计算中心带宽的压力,减缓智能业务终端的计算资源需求,提高数据处理能力,使得诊断业务能快速响应,实现数据汇集和共享,提升数据价值创造能力,提高电网生产管理精益化水平。The beneficial effect of the present invention is that, compared with the prior art, the key point of the present application is to start from the data-driven point of view, combine the container technology, and follow the principle of "centralized management and control, classified storage, and unified application" of the cloud center and the intelligent business terminal, The intelligent business terminal is divided into data access layer, data integration layer, edge data sharing layer, data mart layer, data application layer and cloud data storage layer from bottom to top, so as to break through the data barriers between the cloud center and the intelligent business terminal. The side integrates various information resources in the distribution station area, reduces the pressure on the bandwidth of the cloud computing center, reduces the computing resource demand of the intelligent service terminal, improves the data processing capability, enables the diagnosis service to respond quickly, realizes the collection and sharing of data, and enhances the creation of data value. capacity, and improve the lean level of power grid production management.
附图说明Description of drawings
图1为基于台区智能业务终端边缘计算的数据共享系统。Figure 1 shows a data sharing system based on edge computing of intelligent service terminals in the station area.
图2为数据接入层流程图。Figure 2 is a flow chart of the data access layer.
图3为数据集成层流程图。Figure 3 is a flow chart of the data integration layer.
图4为数据交互流程图。Figure 4 is a flow chart of data interaction.
图5为数据集市工作流程图。Figure 5 shows the workflow of the data mart.
图6为三相不平衡数据集市结果图。Figure 6 shows the results of the three-phase unbalanced data mart.
图7为三相不平衡异常诊断结果图。FIG. 7 is a diagram showing the results of diagnosis of abnormal three-phase unbalance.
具体实施方式Detailed ways
下面结合附图对本申请作进一步描述。以下实施例仅用于更加清楚地说明本发明的技术方案,而不能以此来限制本申请的保护范围。The present application will be further described below with reference to the accompanying drawings. The following examples are only used to more clearly illustrate the technical solutions of the present invention, and cannot be used to limit the protection scope of the present application.
本发明提到的术语解释如下:The terms mentioned in the present invention are explained as follows:
1、MQTT(Message Queuing Telemetry Transport,消息队列遥测传输协议),是一种基于发布/订阅(publish/subscribe)模式的"轻量级"通讯协议,该协议构建于TCP/IP协议上,由IBM在1999年发布。MQTT最大优点在于,可以以极少的代码和有限的带宽,为连接远程设备提供实时可靠的消息服务。作为一种低开销、低带宽占用的即时通讯协议,使其在物联网、小型设备、移动应用等方面有较广泛的应用。它具有以下主要的几项特性:1. MQTT (Message Queuing Telemetry Transport, Message Queuing Telemetry Transport Protocol), is a "lightweight" communication protocol based on the publish/subscribe mode, which is built on the TCP/IP protocol and is developed by IBM Released in 1999. The biggest advantage of MQTT is that it can provide real-time and reliable message services for connecting remote devices with very little code and limited bandwidth. As a low-overhead, low-bandwidth instant messaging protocol, it has a wide range of applications in the Internet of Things, small devices, and mobile applications. It has the following main characteristics:
(1)使用发布/订阅消息模式,提供一对多的消息发布,解除应用程序耦合。这一点很类似于XMPP,但是MQTT的信息冗余远小于XMPP,因为XMPP使用XML格式文本来传递数据。(1) Use the publish/subscribe message mode to provide one-to-many message publishing and decouple the application. This is very similar to XMPP, but the information redundancy of MQTT is much less than that of XMPP, because XMPP uses XML formatted text to pass data.
(2)对负载内容屏蔽的消息传输。(2) Message transmission that shields the payload content.
(3)使用TCP/IP提供网络连接。主流的MQTT是基于TCP连接进行数据推送的,但是同样有基于UDP的版本,叫做MQTT-SN。这两种版本由于基于不同的连接方式,优缺点自然也就各有不同了。(3) Use TCP/IP to provide network connection. The mainstream MQTT is based on TCP connection for data push, but there is also a UDP-based version called MQTT-SN. The advantages and disadvantages of these two versions are naturally different due to different connection methods.
(4)有三种消息发布服务质量:(4) There are three kinds of message publishing service quality:
"至多一次",消息发布完全依赖底层TCP/IP网络。会发生消息丢失或重复。这一级别可用于如下情况,环境传感器数据,丢失一次读记录无所谓,因为不久后还会有第二次发送。"At most once", message publishing relies entirely on the underlying TCP/IP network. Message loss or duplication can occur. This level can be used in the case of environmental sensor data, it doesn't matter if one read record is lost, because there will be a second transmission soon.
"至少一次",确保消息到达,但消息重复可能会发生。"At least once" ensures that messages arrive, but message duplication may occur.
"只有一次",确保消息到达一次。在一些要求比较严格的计费系统中,可以使用此级别。在计费系统中,消息重复或丢失会导致不正确的结果。"Only Once" ensures that the message arrives once. This level can be used in some more demanding billing systems. In billing systems, duplicate or lost messages can lead to incorrect results.
(5)小型传输,开销很小(固定长度的头部是2字节),协议交换最小化,以降低网络流量。这使得它非常适合"在物联网领域,传感器与服务器的通信,信息的收集,嵌入式设备的运算能力和带宽都相对薄弱,使用这种协议来传递消息再适合不过。(5) Small transmission, small overhead (fixed-length header is 2 bytes), and protocol exchanges are minimized to reduce network traffic. This makes it very suitable for "In the field of the Internet of Things, the communication between sensors and servers, the collection of information, the computing power and bandwidth of embedded devices are relatively weak, and the use of this protocol to transmit messages is perfect.
(6)使用Last Will和Testament特性通知有关各方客户端异常中断的机制。(6) A mechanism for notifying all parties involved of client abnormal interruption using Last Will and Testament features.
2、mosquitto服务器2. mosquitto server
Mosquitto是一款实现了消息推送协议MQTT v3.1的开源消息代理软件,提供轻量级的,支持可发布/可订阅的的消息推送模式,使设备对设备之间的短消息通信变得简单,可移植到Linux虚拟机和Linux开发板中,比如现在应用广泛的低功耗传感器,手机、嵌入式计算机、微型控制器等移动设备。一个典型的应用案例就是Andy Stanford-ClarkMosquitto(MQTT协议创始人之一)在家中实现的远程监控和自动化。Mosquitto项目还提供了一个C库,用于实现MQTT客户端,以及非常受欢迎的mosquitto_pub和mosquitto_sub指挥线MQTT客户端。Mosquitto is an open source message broker software that implements the message push protocol MQTT v3.1. It provides a lightweight, publishable/subscribeable message push mode, making short message communication between devices simple. , can be ported to Linux virtual machines and Linux development boards, such as low-power sensors, mobile phones, embedded computers, microcontrollers and other mobile devices that are widely used now. A typical application case is the remote monitoring and automation implemented at home by Andy Stanford-ClarkMosquitto (one of the founders of the MQTT protocol). The Mosquitto project also provides a C library for implementing MQTT clients, as well as the very popular mosquitto_pub and mosquitto_sub line of command MQTT clients.
针对配电台区下现有数据共享体系的不足,从数据驱动的角度出发,结合容器技术和APP开发技术,本发明提出了基于台区智能业务终端边缘计算的数据共享系统,该系统遵循云中心和智能业务终端“集中管控、分类存储、统一应用”的原则,保证简单通用、高效可控、低功耗,减少共享体系嵌套层级,减少冗余信息描述,便于快速开发与成型,最大限度地减少通信资源占用,实现数据快速上传与下发。Aiming at the shortcomings of the existing data sharing system in the distribution station area, from the perspective of data driving, combined with the container technology and APP development technology, the present invention proposes a data sharing system based on the edge computing of the intelligent service terminal in the station area. The system follows the cloud The principle of "centralized management and control, classified storage, and unified application" of the center and intelligent business terminals ensures simplicity and generality, high efficiency and controllability, and low power consumption, reduces the nesting level of the shared system, reduces redundant information description, and facilitates rapid development and formation. Minimize the occupancy of communication resources and realize fast data upload and delivery.
本发明实施例1提供了一种基于台区智能业务终端边缘计算的数据共享系统。如图1所示,从下至上具体包括数据接入层、数据集成层、边缘数据共享层、数据集市层、数据应用层和云端数据存储层。
1,数据接入层包括实时数据接入模块、离线数据接入模块、设备参数接入模块,数据接入层与智能业务终端相连,采集配变、分支箱、户表、充电桩、分布式能源电网设备运行数据和设备参数,将采集的电网设备运行数据和设备参数分为实时数据、离线数据、设备参数,然后分别接入实时数据接入模块、离线数据接入模块和设备参数接入模块。1. The data access layer includes a real-time data access module, an offline data access module, and an equipment parameter access module. The data access layer is connected to intelligent service terminals, collecting distribution transformers, branch boxes, household meters, charging piles, distributed Energy grid equipment operation data and equipment parameters. The collected power grid equipment operation data and equipment parameters are divided into real-time data, offline data, and equipment parameters, and then connected to the real-time data access module, offline data access module, and equipment parameter access respectively. module.
其中,实时数据是指传感器监测的实时环境数据,例如温度、湿度等,以及多功能电表等智能电网设备采集到的实时电气数据,例如电压、电流、电能质量、有功功率、无功功率等,离线数据是指智能业务终端外部人为定时导入的未接入终端前的历史电气、环境数据和智能业务终端内部文件系统储存的接入终端后历史电气、环境数据日志。设备参数是指电网设备参数信息和传感器参数信息;数据接入层将实时数据、离线数据、设备参数上传至数据集成层,数据接入层流程如图2所示。Among them, real-time data refers to real-time environmental data monitored by sensors, such as temperature, humidity, etc., and real-time electrical data collected by smart grid devices such as multi-function meters, such as voltage, current, power quality, active power, reactive power, etc., Offline data refers to the historical electrical and environmental data before the terminal that is not connected to the terminal that is manually imported from the outside of the smart service terminal, and the historical electrical and environmental data logs after the terminal is connected to the internal file system of the smart service terminal. Device parameters refer to grid device parameter information and sensor parameter information; the data access layer uploads real-time data, offline data, and device parameters to the data integration layer, and the data access layer process is shown in Figure 2.
2,数据集成层包括数据溯源模块、多源汇集数据清洗模块、统计计算模块;数据溯源模块借鉴序列化存储的思想,将数据接入层收集到的各设备的实时数据、离线数据重排序,附上该设备本身的性能参数,再根据时间戳的大小储存在各自的表中;多源汇集数据清洗模块基于数据溯源模块重排序后的时间序列数据进行数据清洗,应用数据挖掘中数据缺失值填补和异常值处理的相关方法,例如平均值填补等,将数据进一步补充完整,提高数据准确性;统计计算模块是根据专家常识,在数据溯源模块和多源汇集数据清洗模块整理完善好的数据表中人为地从时域和频域抽取出业务特征,例如异常持续时间和异常发生频率等,通过统计学习的算法计算得到相关业务特征;最后数据集成层通过MQTT协议将溯源、汇集清洗后数据表中的量测类数据(实时数据)、设备本身参数(参变量数据)和统计计算模块进行后的特征数据(统计量数据)一起,以JSON发送到边缘数据共享层托管,数据集成层流程如图3所示。2. The data integration layer includes a data traceability module, a multi-source collection data cleaning module, and a statistical calculation module; the data traceability module draws on the idea of serialized storage and reorders the real-time data and offline data of each device collected by the data access layer. Attach the performance parameters of the device itself, and then store them in their respective tables according to the size of the timestamp; the multi-source aggregated data cleaning module performs data cleaning based on the time series data reordered by the data traceability module, and applies data missing values in data mining. The related methods of filling and outlier processing, such as mean filling, etc., further complement the data and improve the accuracy of the data; the statistical calculation module is based on the common knowledge of experts, in the data traceability module and multi-source collection data cleaning module. In the table, business features are artificially extracted from the time domain and frequency domain, such as abnormal duration and abnormal occurrence frequency, etc., and relevant business features are calculated through statistical learning algorithms; finally, the data integration layer traces the source and collects the cleaned data through the MQTT protocol. The measurement data (real-time data) in the table, the parameters of the device itself (parameter data) and the characteristic data (statistical data) after the statistical calculation module are sent together with JSON to the edge data sharing layer for hosting, the data integration layer process As shown in Figure 3.
作为处理原始数据的层级,主要通过数据的多源汇集、初步清洗、实时计算提取业务系统数据,基于时间尺度的业务系统数据需要通过数据溯源和统计计算完成业务系统数据提取。As the level of processing raw data, business system data is extracted mainly through multi-source collection of data, preliminary cleaning, and real-time calculation. For business system data based on time scale, business system data extraction needs to be completed through data traceability and statistical calculation.
3,边缘数据共享层包括数据中心模块,所述数据中心模块用于实现数据短期存储,在数据中心模块中,将数据集成层上传的量测类对象、统计量类对象、参变量类对象、控制类对象以统一格式的数据模型表征,采用基于发布/订阅的轻量级通信协议——MQTT协议,将数据模型以接口的形式区分,按类别发布并储存在数据中心,实现数据共享交换。3. The edge data sharing layer includes a data center module, which is used to realize short-term data storage. In the data center module, the measurement objects, statistical objects, parameter objects, The control class object is represented by a data model in a unified format, and adopts the MQTT protocol, a lightweight communication protocol based on publish/subscribe.
数据中心模块进一步包括数据格式统一单元、数据短期存储单元、数据分类管理单元,数据格式统一单元将数据集成层传来的各数据以统一规则命名,标注数据类型,数据产生时间,连同数据的值,组成一个JSON字符串;数据短期存储单元是在数据格式统一后,非实时数据的JSON字符串进行集中存储,将数据按时间排序;数据分类管理单元是将各实时数据和存储单元中的历史数据组合,赋予一个接口,供数据集市层调用;例如将实时电压、电流、有功功率、无功功率、温度、湿度等组成原始数据JSON字符串整合,作为实时研判业务需调用的基本通用接口;将A相重载率、B相重载率、C相重载率、A相重载累计时间、B相重载累计时间、C相重载累计时间等重过载相关的特征数据JSON字符串整合,作为重过载业务所需调用的特征接口。The data center module further includes a data format unification unit, a data short-term storage unit, and a data classification management unit. The data format unification unit names each data transmitted from the data integration layer with a unified rule, and marks the data type, the data generation time, and the value of the data. , form a JSON string; the data short-term storage unit is to store the JSON strings of non-real-time data centrally after the data format is unified, and the data is sorted by time; the data classification management unit is to store the real-time data and historical data in the storage unit. The data combination is given an interface for the data mart layer to call; for example, the real-time voltage, current, active power, reactive power, temperature, humidity, etc., composed of raw data JSON strings, are integrated as the basic general interface that needs to be called for real-time research and judgment services. ;A JSON string of overload-related characteristic data such as A-phase overload rate, B-phase overload rate, C-phase overload rate, A-phase overload accumulation time, B-phase overload accumulation time, C-phase overload accumulation time, etc. Integration, as a characteristic interface that needs to be called by overloaded services.
本系统采用MQTT协议来完成各层级间数据的发送、接收操作,每个层级内安装有一个或多个处理数据业务的功能模块。该协议主要有三个角色,分别是消息发布者、消息订阅者和MQTT服务器。前一层级的功能模块作为消息发布者通过MQTT服务器向数据中心发送格式统一的数据模型,同时,后一层级的功能模块作为消息订阅者配置好订阅接口信息,MQTT服务器匹配到订阅服务信息后,将数据中心共享的数据模型转发给消息订阅者,完成数据的共享过程,数据交互流程如图4。The system uses the MQTT protocol to complete the data transmission and reception operations between various levels, and each level is installed with one or more functional modules for processing data services. The protocol has three main roles, namely message publisher, message subscriber and MQTT server. The function module at the previous level, as a message publisher, sends a data model with a unified format to the data center through the MQTT server. At the same time, the function module at the latter level, as a message subscriber, configures the subscription interface information. After the MQTT server matches the subscription service information, The data model shared by the data center is forwarded to the message subscribers to complete the data sharing process. The data interaction process is shown in Figure 4.
4,数据集市层向边缘共享层发送所需的数据接口,接收边缘共享层发送的该接口下的数据,数据集市层包括无功补偿数据集市模块、漏保检测数据集市模块等,无功补偿数据集市向边缘数据共享层发送订阅实时研判业务的基本通用接口,通过MQTT协议接收接口所包含数据,包括功率因数、A相有功功率、B相有功功率、C相有功功率;同时再订阅无功补偿业务所需的特征接口,接收特征接口的数据,包括15分钟冻结正向有功电能、15分钟冻结正向无功电能、15分钟冻结反向有功电能、15分钟冻结反向无功电能等特征,再将上述实时数据和特征数据组合,上传到数据应用层的无功补偿模块。漏保检测数据集市同理,向边缘数据共享层发送订阅实时研判业务的基本通用接口,通过MQTT协议接收接口所包含数据,包括三相电压、三相电流、总功率损耗、空载功率损耗;同时订阅漏保检测业务所需的特征接口,接收特征接口的数据,包括漏电保护时间、漏电保护使能等特征;再将上述实时数据和特征数据组合,上传到数据应用层的漏保检测模块。4. The data mart layer sends the required data interface to the edge sharing layer, and receives the data under the interface sent by the edge sharing layer. The data mart layer includes the reactive power compensation data mart module, the leakage detection data mart module, etc. , the reactive power compensation data mart sends a basic general interface for subscribing to real-time research and judgment services to the edge data sharing layer, and receives the data contained in the interface through the MQTT protocol, including power factor, A-phase active power, B-phase active power, and C-phase active power; At the same time, subscribe to the feature interface required by the reactive power compensation service, and receive the data of the feature interface, including freezing forward active energy for 15 minutes, freezing forward reactive energy for 15 minutes, freezing reverse active energy for 15 minutes, and freezing reverse power for 15 minutes. Reactive power and other characteristics, and then combine the above real-time data and characteristic data, and upload them to the reactive power compensation module of the data application layer. In the same way, the leakage detection data mart sends the basic general interface for subscribing to real-time research and judgment services to the edge data sharing layer, and receives the data contained in the interface through the MQTT protocol, including three-phase voltage, three-phase current, total power loss, and no-load power loss. ;At the same time, subscribe to the feature interface required by the leakage protection detection business, and receive the data of the feature interface, including the leakage protection time, leakage protection enable and other characteristics; then combine the above real-time data and feature data and upload it to the leakage protection detection of the data application layer module.
数据集市面向具体边缘业务,分析能表征业务的数据特征,动态组建所需的数据模型,基于数据中心的数据集群,进行数据灵活加载。数据集市层更加偏向于业务方面的战术性需求,目标在于满足智能融合终端内特定应用分析的即时性和高效性。数据集市层工作流程图如图5。The data mart is oriented to specific edge services, analyzes the data characteristics that can characterize the service, dynamically builds the required data model, and flexibly loads data based on the data cluster of the data center. The data mart layer is more inclined to the tactical requirements of the business, and the goal is to meet the immediacy and efficiency of the analysis of specific applications in the intelligent fusion terminal. The workflow of the data mart layer is shown in Figure 5.
5,数据应用层5. Data application layer
数据应用层的功能模块根据业务需要,获取数据集市层对应的数据模型,对业务面向的场景进行决策分析,基于台区智能业务终端本地化计算和处置优势,实现边缘测就地的异常工况状态监测和快速响应治理。The functional module of the data application layer obtains the data model corresponding to the data mart layer according to the business needs, makes decision-making analysis on the business-oriented scenarios, and realizes the edge detection and local abnormal work based on the localized computing and processing advantages of the intelligent business terminal in the Taiwan area. Condition monitoring and rapid response governance.
6,云端数据存储层6. Cloud data storage layer
云中心负责数据深度挖掘和高级业务的处理,智能业务终端将基于业务功能模块组装的数据集上传云中心存储,结合智能业务终端的业务实时数据,通过机器学习和深度学习算法进行异常工况的分类和预测。The cloud center is responsible for in-depth data mining and advanced business processing. The intelligent business terminal uploads data sets assembled based on business function modules to the cloud center for storage. Combined with the business real-time data of the intelligent business terminal, machine learning and deep learning algorithms are used to detect abnormal conditions. Classification and prediction.
本发明实施例2以一台智能业务终端作为边缘端,采用mosquitto作为MQTT协议中的代理者,选择华为云作为云端,选用华为物联网平台实现边缘端与云端的通信,创建产品的device_id为5fed8387aaafca02dba396b2_123456,本发明具体以台区配电变压器三相不平衡异常诊断的典型业务为例,通过搭建的数据共享体系实现业务的快速响应。In the second embodiment of the present invention, an intelligent service terminal is used as the edge terminal, mosquitto is used as the agent in the MQTT protocol, Huawei cloud is selected as the cloud, and the Huawei IoT platform is selected to realize the communication between the edge terminal and the cloud, and the device_id of the created product is 5fed8387aaafca02dba396b2_123456 , the present invention specifically takes the typical business of abnormal diagnosis of three-phase unbalance of distribution transformers in the station area as an example, and realizes the rapid response of the business by building a data sharing system.
1、数据接入层功能模块设计1. Functional module design of data access layer
智能业务终端连接配变、分支箱、户表、充电桩、分布式能源等配电网关键设备,对其进行数据采集和监控管理,业务庞杂、数据海量异构,根据数据类型将其分为实时数据(传感器数据和智能电网设备数据)、离线数据(外部定时导入数据和内部文件系统储存的数据)及设备参数(电网设备参数信息和传感器参数信息),故本发明根据包括104协议、Modbus协议在内的智能业务终端交流采集板接口通信协议,设计数据接入层功能模块,提供终端对基本交流模拟量采集功能,采集得到的原始数据通过mosquitto代理以JSON格式发布给数据集成层,JSON模型如表3。The intelligent service terminal is connected to the key equipment of the distribution network such as distribution transformers, branch boxes, household meters, charging piles, distributed energy sources, etc., and performs data collection, monitoring and management on them. The business is complex and the data is massive and heterogeneous. Real-time data (sensor data and smart grid equipment data), offline data (external timing import data and data stored in the internal file system) and equipment parameters (grid equipment parameter information and sensor parameter information), so the present invention includes 104 protocol, Modbus The intelligent business terminal communication acquisition board interface communication protocol including the protocol, designed the data access layer function module, provides the terminal to the basic communication analog acquisition function, and the collected raw data is released to the data integration layer in JSON format through the mosquitto agent. The model is shown in Table 3.
表3数据接入层数据发布格式Table 3 Data release format of data access layer
2、数据集成层功能模块设计2. Functional module design of data integration layer
数据集成层作为处理原始数据的层级,主要通过数据的多源汇集、初步清洗、实时计算提取业务系统数据,基于时间尺度的业务系统数据需要通过数据溯源和统计计算,通过对数据接入层原始数据的计算,数据集成层得到所有上层应用功能模块业务所需的特征,其中包括三相不平衡异常诊断所需的特征,如下:The data integration layer, as the layer for processing raw data, mainly extracts business system data through multi-source collection of data, preliminary cleaning, and real-time calculation. The time scale-based business system data needs to be traced through data and statistical calculation. For data calculation, the data integration layer obtains all the features required by the upper-layer application function module business, including the features required for three-phase unbalanced abnormal diagnosis, as follows:
①三相电压不平衡度ε①Three-phase voltage unbalance ε
式中:Umax为最大相电流,Umin为最小相电流。Where: U max is the maximum phase current, U min is the minimum phase current.
②三相不平衡持续时间Dtpu ② Three-phase unbalance duration D tpu
式中:Dtpu-1为配电变压器上一时刻的三相不平衡持续时间,ε为当前时刻配电变压器的三相不平衡度;In the formula: D tpu-1 is the three-phase unbalance duration of the distribution transformer at the previous moment, and ε is the three-phase unbalance degree of the distribution transformer at the current moment;
③三相不平衡频次Ftpu ③ Three-phase unbalance frequency F tpu
式中:Dtpu为第i时刻配电变压器的三相不平衡持续时间,Dtpu(i-1)为第i-1时刻的配电变压器三相不平衡持续时间,ki为第i时刻配电变压器发生三相不平衡事件标志,t为统计时间尺度。In the formula: D tpu is the three-phase unbalanced duration of the distribution transformer at the i-th time, D tpu(i-1) is the three-phase unbalanced duration of the distribution transformer at the i-1-th time, and k i is the i-th time. The three-phase unbalanced event occurs in the distribution transformer, and t is the statistical time scale.
④三相不平衡累计时间Ctpu ④ Three-phase unbalance cumulative time C tpu
式中:mi为第i时刻配电变压器发生三相不平衡状态,t为统计时间尺度。In the formula: m i is the three-phase unbalanced state of the distribution transformer at the i-th moment, and t is the statistical time scale.
数据集成层的功能模块计算得到所有特征后,通过mosquitto代理以JSON格式发布给边缘数据共享层,JSON模型如表4。After the functional modules of the data integration layer calculate all the features, they are published to the edge data sharing layer in JSON format through the mosquitto agent. The JSON model is shown in Table 4.
表4数据集成层数据发布格式Table 4 Data release format of data integration layer
3、边缘数据共享层功能模块设计3. Functional module design of edge data sharing layer
数据中心是作为数据短期存储的功能模块,为了减少数据共享体系的嵌套层级,将数据集成层的量测类对象、统计量类对象、参变量类对象、控制类对象以统一格式的数据模型表征,采用基于发布/订阅的轻量级通信协议——MQTT协议,将模型发布储存在数据中心,实现数据共享交换。The data center is a functional module for short-term data storage. In order to reduce the nesting level of the data sharing system, the measurement class objects, statistics class objects, parameter class objects, and control class objects of the data integration layer are in a unified format. Characterization, using the MQTT protocol, a lightweight communication protocol based on publish/subscribe, to publish and store the model in the data center to realize data sharing and exchange.
本架构采用MQTT协议来完成各层级间数据的发送、接收操作,每个层级内安装有一个或多个处理数据业务的功能模块。该协议主要有三个角色,分别是消息发布者、消息订阅者和MQTT服务器。前一层级的APP作为消息发布者通过MQTT服务器向数据中心发送格式统一的数据模型,同时,后一层级的功能模块作为消息订阅者配置好订阅接口信息,MQTT服务器匹配到订阅服务信息后,将数据中心共享的数据模型转发给消息订阅者,完成数据的共享过程,数据交互流程如图4。This architecture uses the MQTT protocol to complete the data transmission and reception operations between various levels, and each level is installed with one or more functional modules for processing data services. The protocol has three main roles, namely message publisher, message subscriber and MQTT server. The APP at the previous level, as the message publisher, sends the data model in a unified format to the data center through the MQTT server. At the same time, the function module at the latter level, as the message subscriber, configures the subscription interface information. After the MQTT server matches the subscription service information, the The data model shared by the data center is forwarded to the message subscribers to complete the data sharing process. The data interaction process is shown in Figure 4.
4、数据集市层功能模块设计4. Data mart layer functional module design
数据集市面向具体边缘业务,分析能表征业务的数据特征,动态组建所需的数据模型,基于数据中心的数据集群,进行数据灵活加载。数据集市层更加偏向于业务方面的战术性需求,目标在于满足智能融合终端内特定应用分析的即时性和高效性。数据集市层工作流程图如图5。针对三相不平衡异常诊断场景,有相应的三相不平衡数据集市功能模块,用于从边缘数据共享层存储的特征中提取三相不平衡异常诊断所需特征如图6。得到所需特征后,通过mosquitto代理以JSON格式发布给数据应用层的三相不平衡异常诊断功能模块,JSON模型如表5。The data mart is oriented to specific edge services, analyzes the data characteristics that can characterize the service, dynamically builds the required data model, and flexibly loads data based on the data cluster of the data center. The data mart layer is more inclined to the tactical requirements of the business, and the goal is to meet the immediacy and efficiency of the analysis of specific applications in the intelligent fusion terminal. The workflow of the data mart layer is shown in Figure 5. For the three-phase unbalanced abnormal diagnosis scenario, there is a corresponding three-phase unbalanced data mart function module, which is used to extract the features required for three-phase unbalanced abnormal diagnosis from the features stored in the edge data sharing layer, as shown in Figure 6. After obtaining the required characteristics, it is published to the three-phase unbalance abnormality diagnosis function module of the data application layer in JSON format through the mosquitto agent. The JSON model is shown in Table 5.
表5数据集市层数据发布格式Table 5 Data Mart Layer Data Publishing Format
5、数据应用层功能模块设计5. Data application layer functional module design
数据应用层的各业务功能模块根据自身业务需要,获取数据集市层对应的数据模型,对业务面向的场景进行决策分析,基于台区智能业务终端本地化计算和处置优势,实现边缘测就地的异常工况状态监测和快速响应治理。本实例中在数据应用层中设计三相不平衡异常诊断功能模块,根据交互机制订阅云端的模型参数,即每个程度的阈值,建立三相不平衡异常诊断模型,再通过数据共享机制提取当前特征数据,根据诊断规则就地诊断当前三相不平衡异常程度,异常程度使用平方和误差衡量,平方和误差dk是用来衡量观测值同真实值之间的偏差,其公式为Each business function module of the data application layer obtains the data model corresponding to the data mart layer according to its own business needs, makes decision analysis on the business-oriented scenarios, and realizes the edge measurement on the spot based on the localized computing and processing advantages of the intelligent business terminal in the Taiwan area. Abnormal working condition status monitoring and rapid response management. In this example, a three-phase unbalance abnormality diagnosis function module is designed in the data application layer. According to the interactive mechanism, the model parameters of the cloud, that is, the threshold value of each level, are subscribed to, and a three-phase unbalance abnormality diagnosis model is established, and then the current data sharing mechanism is used to extract the current Characteristic data, according to the diagnosis rules, the current abnormal degree of three-phase unbalance is diagnosed on the spot. The abnormal degree is measured by the square sum error. The square sum error d k is used to measure the deviation between the observed value and the real value. The formula is
式中:k为程度级数,本文中个数k=4,n为该程度的特征个数,本实例中为特征个数n=4。In the formula: k is the degree series, the number k=4 in this paper, n is the number of features of this degree, and in this example, the number of features n=4.
将所有程度阈值的平方和误差对比,选择平方和误差最小的程度阈值,该程度阈值代表的程度即为当前场景的三相不平衡异常程度。采用level表示当前台区三相不平衡异常程度,分为4级(正常、注意、异常、严重),分别表示为1、2、3、4,计算公式如下:Compare the square sum errors of all degree thresholds, and select the degree threshold with the smallest square sum error. The degree represented by the degree threshold is the abnormal degree of three-phase imbalance in the current scene. The level is used to indicate the abnormal degree of three-phase imbalance in the current station area, which is divided into 4 levels (normal, attention, abnormal, serious), which are respectively expressed as 1, 2, 3, and 4. The calculation formula is as follows:
诊断结果如图7,从上述实例可以看出,当前台区三相不平衡异常程度为1,属于正常状态,云端运维人员接收到当前台区处于正常状态的信息,确认台区运转正常;根据上述方法诊断,可以减缓智能业务终端的计算资源需求,提高数据处理能力,使得诊断业务能快速响应,从而为降低运维成本、提高配电设备可靠性提供保障。The diagnosis result is shown in Figure 7. From the above example, it can be seen that the abnormal degree of three-phase imbalance in the current station area is 1, which is a normal state. The cloud operation and maintenance personnel receive the information that the current station area is in a normal state and confirm that the station area is operating normally; Diagnosis according to the above method can reduce the computing resource demand of the intelligent service terminal, improve the data processing capability, and enable the diagnosis service to respond quickly, thereby providing guarantee for reducing operation and maintenance costs and improving the reliability of power distribution equipment.
6、云端数据存储层6. Cloud data storage layer
云中心负责数据深度挖掘和高级业务的处理,智能业务终端将基于业务APP组装的数据集上传云中心存储,结合智能业务终端的业务实时数据,通过机器学习和深度学习算法进行异常工况的分类和预测。The cloud center is responsible for in-depth data mining and advanced business processing. The intelligent business terminal uploads the data set assembled based on the business APP to the cloud center for storage, and combines the real-time business data of the intelligent business terminal to classify abnormal conditions through machine learning and deep learning algorithms. and forecast.
本发明的有益效果在于,与现有技术相比,该发明可以在“云管边端”的配电物联网系统架构下,遵循云中心和智能业务终端“集中管控、分类存储、统一应用”的原则,将智能业务终端从下至上分为据接入层、数据集成层、边缘数据共享层、数据集市层、数据应用层和云端数据存储层,打通云中心与智能业务终端的数据壁垒,在边缘侧整合配电台区各类信息资源,降低云计算中心带宽的压力,减缓智能业务终端的计算资源需求,提高数据处理能力,使得诊断业务能快速响应,实现数据汇集和共享,提升数据价值创造能力,提高电网生产管理精益化水平。The beneficial effect of the present invention is that, compared with the prior art, the present invention can follow the "centralized management and control, classified storage, and unified application" of the cloud center and the intelligent service terminal under the "cloud-pipe-side-terminal" power distribution Internet of Things system architecture. The principle of intelligent business terminal is divided into data access layer, data integration layer, edge data sharing layer, data mart layer, data application layer and cloud data storage layer from bottom to top, so as to break through the data barriers between cloud center and intelligent business terminal. Integrate various information resources in the power distribution station area on the edge side, reduce the pressure on the bandwidth of the cloud computing center, reduce the computing resource demand of the intelligent service terminal, improve the data processing capability, enable the diagnosis service to respond quickly, realize data collection and sharing, improve The ability to create data value and improve the lean level of power grid production management.
本发明申请人结合说明书附图对本发明的实施示例做了详细的说明与描述,但是本领域技术人员应该理解,以上实施示例仅为本发明的优选实施方案,详尽的说明只是为了帮助读者更好地理解本发明精神,而并非对本发明保护范围的限制,相反,任何基于本发明的发明精神所作的任何改进或修饰都应当落在本发明的保护范围之内。The applicant of the present invention has described and described the embodiments of the present invention in detail with reference to the accompanying drawings, but those skilled in the art should understand that the above embodiments are only preferred embodiments of the present invention, and the detailed description is only to help readers better Rather, any improvement or modification based on the spirit of the present invention should fall within the protection scope of the present invention.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210101965.4A CN114448094A (en) | 2022-01-27 | 2022-01-27 | A data sharing system based on edge computing of intelligent service terminals in Taiwan area |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210101965.4A CN114448094A (en) | 2022-01-27 | 2022-01-27 | A data sharing system based on edge computing of intelligent service terminals in Taiwan area |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114448094A true CN114448094A (en) | 2022-05-06 |
Family
ID=81370623
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210101965.4A Pending CN114448094A (en) | 2022-01-27 | 2022-01-27 | A data sharing system based on edge computing of intelligent service terminals in Taiwan area |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114448094A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115314532A (en) * | 2022-07-05 | 2022-11-08 | 国网上海能源互联网研究院有限公司 | A method and device for information interaction between a power distribution terminal and an Internet of Things master station |
| CN115941426A (en) * | 2023-03-10 | 2023-04-07 | 北京智芯微电子科技有限公司 | Multi-service resource cooperation method, system and computer equipment |
| CN116112518A (en) * | 2022-12-15 | 2023-05-12 | 漳州立达信光电子科技有限公司 | Method, system, and storage medium for cloud-edge collaborative message exchange of Internet of Things |
| CN117251825A (en) * | 2023-11-20 | 2023-12-19 | 浙江大学 | Multi-sensor data fusion platform for new energy power station |
| CN117811217A (en) * | 2024-02-28 | 2024-04-02 | 浪潮软件科技有限公司 | Power grid digital fusion system, method, equipment and medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106339509A (en) * | 2016-10-26 | 2017-01-18 | 国网山东省电力公司临沂供电公司 | Power grid operation data sharing system based on large data technology |
| CN110797975A (en) * | 2018-08-01 | 2020-02-14 | 中国电力科学研究院有限公司 | An intelligent station area system and management method |
| CN110933118A (en) * | 2020-02-20 | 2020-03-27 | 深圳市城市交通规划设计研究中心股份有限公司 | Edge computing gateway secure communication method, system, terminal equipment and server |
| CN111131480A (en) * | 2019-12-30 | 2020-05-08 | 南京德赛尔信息技术有限公司 | Cloud edge cooperative service system for smart power plant |
| US10986173B1 (en) * | 2019-04-25 | 2021-04-20 | Edjx, Inc. | Systems and methods for locating server nodes for edge devices using latency-based georouting |
| CN113094174A (en) * | 2021-04-09 | 2021-07-09 | 贵州电网有限责任公司 | Method for coordination control of power distribution network terminal autonomous networking based on edge computing technology |
| CN113708974A (en) * | 2021-09-03 | 2021-11-26 | 南方电网数字电网研究院有限公司 | Edge cloud network system based on self-adaptive networking and cooperation method |
| CN113836796A (en) * | 2021-09-08 | 2021-12-24 | 清华大学 | A data monitoring system and scheduling method for power distribution Internet of Things based on cloud-edge collaboration |
-
2022
- 2022-01-27 CN CN202210101965.4A patent/CN114448094A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106339509A (en) * | 2016-10-26 | 2017-01-18 | 国网山东省电力公司临沂供电公司 | Power grid operation data sharing system based on large data technology |
| CN110797975A (en) * | 2018-08-01 | 2020-02-14 | 中国电力科学研究院有限公司 | An intelligent station area system and management method |
| US10986173B1 (en) * | 2019-04-25 | 2021-04-20 | Edjx, Inc. | Systems and methods for locating server nodes for edge devices using latency-based georouting |
| CN111131480A (en) * | 2019-12-30 | 2020-05-08 | 南京德赛尔信息技术有限公司 | Cloud edge cooperative service system for smart power plant |
| CN110933118A (en) * | 2020-02-20 | 2020-03-27 | 深圳市城市交通规划设计研究中心股份有限公司 | Edge computing gateway secure communication method, system, terminal equipment and server |
| CN113094174A (en) * | 2021-04-09 | 2021-07-09 | 贵州电网有限责任公司 | Method for coordination control of power distribution network terminal autonomous networking based on edge computing technology |
| CN113708974A (en) * | 2021-09-03 | 2021-11-26 | 南方电网数字电网研究院有限公司 | Edge cloud network system based on self-adaptive networking and cooperation method |
| CN113836796A (en) * | 2021-09-08 | 2021-12-24 | 清华大学 | A data monitoring system and scheduling method for power distribution Internet of Things based on cloud-edge collaboration |
Non-Patent Citations (1)
| Title |
|---|
| XIANGFU GUO ETAL.: "Abnormal Working Conditions Judgment Based on Data Sharing System for Power Distribution Station Area", 《2021 IEEE 15TH INTERNATIONAL CONFERENCE ON ELECTRONIC MEASUREMENT & INSTRUMENTS (ICEMI)》, 21 January 2022 (2022-01-21), pages 247 - 252 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115314532A (en) * | 2022-07-05 | 2022-11-08 | 国网上海能源互联网研究院有限公司 | A method and device for information interaction between a power distribution terminal and an Internet of Things master station |
| CN116112518A (en) * | 2022-12-15 | 2023-05-12 | 漳州立达信光电子科技有限公司 | Method, system, and storage medium for cloud-edge collaborative message exchange of Internet of Things |
| CN115941426A (en) * | 2023-03-10 | 2023-04-07 | 北京智芯微电子科技有限公司 | Multi-service resource cooperation method, system and computer equipment |
| CN115941426B (en) * | 2023-03-10 | 2023-05-23 | 北京智芯微电子科技有限公司 | Multi-service resource coordination method, system and computer equipment |
| CN117251825A (en) * | 2023-11-20 | 2023-12-19 | 浙江大学 | Multi-sensor data fusion platform for new energy power station |
| CN117251825B (en) * | 2023-11-20 | 2024-02-09 | 浙江大学 | A multi-sensor data fusion platform for new energy power stations |
| CN117811217A (en) * | 2024-02-28 | 2024-04-02 | 浪潮软件科技有限公司 | Power grid digital fusion system, method, equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114448094A (en) | A data sharing system based on edge computing of intelligent service terminals in Taiwan area | |
| CN109638964B (en) | Multi-element power grid information interaction system and method based on edge computing architecture | |
| CN202009267U (en) | Integrated intelligent transformer substation equipment state monitoring and analysis system | |
| CN201957060U (en) | Monitoring and managing system for electricity energy quality | |
| CN114244679B (en) | Virtual power plant communication network layered control method under cloud-side-end architecture | |
| CN112398946A (en) | Source network load storage scheduling control system and configuration method | |
| CN112580957A (en) | Smart energy management and control system based on cloud platform | |
| CN118505437B (en) | Distributed micro measurement and control system based on comprehensive energy system | |
| CN104751280A (en) | Petrochemical enterprise electric energy consumption monitoring system and data management method thereof | |
| CN102263436A (en) | On-line monitoring system for energy-saving scheduling and real-time coal consumption of power grid | |
| CN113922505A (en) | Edge computing intelligent gateway suitable for building comprehensive energy management | |
| CN103715771B (en) | Auto generation coordination control platform | |
| Xiaojin et al. | Research on data standardization and unified data interface based on digital station system | |
| CN116090665A (en) | Source network lotus stores up integrated management and control system | |
| CN114565250B (en) | Ordered electricity utilization intelligent monitoring method and system based on big data | |
| CN111711651A (en) | A new energy data sharing method and system | |
| Zhang et al. | Distribution network distributed resources application framework and key technologies based on cloud-edge-device collaboration | |
| CN101729342B (en) | Realization method of real-time memory calculation data structure of mixed mobile power system | |
| CN107394893A (en) | A kind of photovoltaic power station monitoring system and its method | |
| CN202094700U (en) | Real-time coal consumption on-line monitoring system for energy-saving dispatch of power grid | |
| CN103532233B (en) | Based on the power information acquisition abnormity Precise Position System of GPRS technology | |
| Wang et al. | Research on distributed PV monitoring system based on ubiquitous power IOT architecture | |
| CN111198548B (en) | Joint dispatching system of power system and information system based on intelligent node overlay network | |
| CN205247187U (en) | Urine power station cloud monitoring system | |
| CN102611103A (en) | Method for automatically transforming outside-the-station electric topology to tidal topology of power distribution network |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |