+

WO2019004859A1 - Procédé de surveillance d'un système analytique pour données de flux - Google Patents

Procédé de surveillance d'un système analytique pour données de flux Download PDF

Info

Publication number
WO2019004859A1
WO2019004859A1 PCT/RU2017/000476 RU2017000476W WO2019004859A1 WO 2019004859 A1 WO2019004859 A1 WO 2019004859A1 RU 2017000476 W RU2017000476 W RU 2017000476W WO 2019004859 A1 WO2019004859 A1 WO 2019004859A1
Authority
WO
WIPO (PCT)
Prior art keywords
test
analytical system
content
test datum
datum
Prior art date
Application number
PCT/RU2017/000476
Other languages
English (en)
Inventor
Alexander Leonidovich PYAYT
Sergey Valerievich Vinogradov
Original Assignee
Siemens Aktiengesellschaft
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens Aktiengesellschaft filed Critical Siemens Aktiengesellschaft
Priority to PCT/RU2017/000476 priority Critical patent/WO2019004859A1/fr
Publication of WO2019004859A1 publication Critical patent/WO2019004859A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Prevention of errors by analysis, debugging or testing of software
    • G06F11/3668—Testing of software
    • G06F11/3672—Test management
    • G06F11/3688—Test management for test execution, e.g. scheduling of test suites

Definitions

  • the invention relates to a method for monitoring an analytical system for stream data, wherein the analytical system comprises software components for processing the stream data that are received by the analytical system.
  • Uninterrupted monitoring of a technical system e.g. the vibration monitoring of a machine, during operation of said machine produces a continuous data stream that represents a time-dependent signal.
  • the continuous data stream which comprises what are known as stream data, is processed by means of what is known as an analytical system.
  • the processing of the continuous data stream allows monitoring of the functions of the technical system in real time. Furthermore, it is expedient for the intended operation of the analytical system used for evaluating the stream data to be ensured too.
  • Such an analytical system consists of a multiplicity of different software components that are each developed and tested on their own. These are then combined with one another in the analytical system in a manner provided for in advance. Problems frequently arise in this case, such as e.g. poor connections, erroneous processing in real time or a loss of data. To be able to ensure reliable operation of the analytical system, it is therefore also necessary to monitor operation thereof.
  • a method for monitoring intended operation of an analytical system for stream data comprises software components for processing stream data that are received by the analytical system.
  • the method involves a test component being integrated into the analytical system.
  • the test component can be integrated as a one-off.
  • the test component can remain in the analytical system for the life thereof .
  • the test component performs the following steps at the runtime of the analytical system: transmission of at least one test datum having a prescribed, respectively explicit content to the analytical system for processing by the analytical system.
  • the test datum corresponds to the stream data processed by the analytical system in terms of type and/or in terms of format.
  • the at least one test datum is integrated into the stream data, i.e.
  • the at least one test datum is received by the test component and the content of the at least one test datum is read. Subsequently, the content of the at least one received test datum is evaluated by means of a comparison with the prescribed content during transmission of the at least one test datum.
  • the steps of the method according to the invention that are indicated above can be performed in real time during the runtime of the analytical system. This allows the analytical system to be monitored during realtime operation too. Such monitoring particularly allows errors that are attributable to cross-component processing operations on the stream data to be detected.
  • the method is suitable regardless of whether the analytical system is compiled from proprietary software components or standardized components.
  • the approach of the method according to the invention is based on having at least one test datum transmitted by the test component and processed by the analytical system, particularly at periodic or irregular intervals of time.
  • the result of the processing of the analytical system is evaluated by the test component.
  • On the basis of the evaluation result it is then possible to infer the presence of a problem for the analytical system.
  • This approach is comparable with what are known as "healthy checks", as a result of which the monitoring can be provided online, continually and in a manner integrated into the analytical system.
  • the method is distinguished in that despite the provision of the test component the operating sequence of the analytical system is not impaired during the monitoring .
  • the method particularly allows the monitoring of losses of data and of data consistency.
  • a log of the content of the at least one received test datum and/or of the prescribed content of the at least one test datum for transmission is stored for a later evaluation.
  • This configuration variant allows temporally independent evaluation of the test data independently of reception thereof by the test component .
  • the evaluation of the content comprises whether a change in the prescribed, respectively explicit content that results from the processing by the analytical system matches a result, ascertained by the test component, from the prescribed, respectively explicit content.
  • the result ascertained by the test component can be ascertained thereby prior to the transmission in a manner determined in advance, for example. This particularly easily allows the behavior of the analytical system to be monitored, since it is merely necessary to perform a comparison of the content contained in the received test datum with the result ascertained by the test component from the prescribed, respectively explicit content .
  • a hash value for the prescribed, explicit content of the at least one test datum for transmission is ascertained by means of a prescribed hash function, and the ascertained hash value is stored together with an identifier of the test datum for transmission.
  • a further hash value is ascertained for the read content of the at least one received test datum and is compared with the stored hash value whose associated identifier matches the identifier of the received test datum. If the hash value and the further hash value do not match, then the presence of a loss of data is inferred. In this case, the loss of data consists not in the complete loss of the test datum but rather in a loss of at least one portion of the content with which the test datum has been transmitted .
  • a first timestamp or a first sequence number is coded into the prescribed, explicit content of the at least one test datum or is stored together with an identifier of the at least one test datum before the at least one test datum is transmitted.
  • the at least one test datum may be provided to prompt the read content of the at least one test datum now to be augmented by a second timestamp or a second sequence and stored or to prompt the second timestamp or the second sequence number to be stored together with the identifier of the at least one test datum.
  • the order of the first timestamps or first sequence numbers of a plurality of test data sent in succession may particularly be compared with the order of the second timestamps or second sequence numbers of the test data received in chronological succession.
  • This allows a consistency check on the analytical system with regard to the processing of the test data and generally the stream data in the correct order.
  • the period of time that results for a test datum from the difference between the second and first timestamps must always be constant for all test data.
  • the invention further proposes a computer program product that can be loaded directly into the internal memory of a signal processing unit and comprises software code sections that are used to carry out the steps of the method described herein when the product runs on the signal processing unit.
  • the computer program product may be realized in the shape of a DVD, a CD-ROM, a USB memory stick and the like.
  • the computer program product may also be present as a stored program, however, that can be loaded wirelessly or via a wired connection.
  • Fig. 1 shows a schematic depiction of an analytical system that is augmented in a manner according to the invention by a test component for monitoring the intended operation of the analytical system;
  • Fig. 2 shows a flowchart for identifying a loss of data
  • Fig. 3 shows a flowchart for identifying a data inconsistency .
  • An analytical system 10 shown in fig. 1 comprises a data access layer 11, a transport layer 12, one or more stream data service components 13 and one or more processing engines 14. Said components of the analytical system 10 are software components for processing stream data that are provided continuously e.g. by a monitored technical system.
  • the stream data supplied to the analytical system 10 are processed in a manner prescribed by the configuration of the components of the analytical system 10.
  • the processing in this case is dependent, by way of example, on the design of the stream data service component (s) 13 and/or the processing engine 14 or generally the components 11-14.
  • the respective properties of the individual components 11-14, regardless of whether proprietary or standardized (i.e. "off-the-shelf") components are involved, are known on the basis of preceding individual tests on the components 11-14.
  • transfer of the stream data from one component 11-14 to the next for example, can cause an unforeseen behavior to occur, such as e.g. a (partial) loss of data or a data inconsistency.
  • the latter is caused by temporally delayed processing of individual data packets of the stream data, for example, as a result of which the chronological order of the stream data for processing may be undesirably modified.
  • An analytical system 10 Components known to a person skilled in the art in such an analytical system 10 are Apache Kafka as a message queue component or Apache Spark or Apache Store as processing engines 14, for example. These components are used, as is known to a person skilled in the art, for load equalization and for distribution in order to ensure realtime data processing .
  • the exact design of the analytical system 10 described in this respect is of secondary significance to the method according to the invention described below, since said method can be used in an analytical system of any form.
  • the analytical system 10 further comprises a test component 20.
  • the test component 20 like the components of the analytical system 10, is a software component that is integrated in the analytical system 10 as a separate component. In this case, there may be provision for the test component 20 to be integrated into the analytical system 10 during the actual design of the analytical system 10.
  • the task of the test component 20 is to produce test data TD at periodic or irregular intervals of time and to transmit them to the components 11-14 at the runtime of the analytical system 10, so that said test data are processed as conventional stream data.
  • the test data processed by the components 11-14 of the analytical system 10, which can be monitored for operation as intended using the test component 20, are then in turn received by the test component 20 as processed test data TD 1 and the content thereof is read.
  • the processed test data TD ' correspond to the received test data TD'.
  • the content of the received test data TD 1 is evaluated by means of a comparison with the prescribed, respectively explicit content of the test data TD transmitted to the analytical system 10. In this case, the comparison is each time effected between a transmitted test datum TD and a received test datum TD 1 that have a matching identifier (e.g. in the header) .
  • test data TD transmitted by the test component 20 correspond in terms of type and/or in terms of format to the stream data produced by the system to be monitored.
  • the test data TD can, to this end, be channeled into the stream data g 0476 of the technical system, i.e. integrated into the data stream .
  • Each test datum from the test data TD transmitted by the test component 20 comprises a prescribed, respectively explicit content.
  • This prescribed, respectively explicit content is produced or provided by the test component 20.
  • the monitoring is generally based on the evaluation of the content of the test data TD transmitted by the test component 20 and of the content of the (modified) test data TD ' processed and received by the components of the analytical system 10.
  • the evaluation of the content comprises whether a change in the prescribed, respectively explicit content that results from the processing by the components of the analytical system 10 matches a result from the prescribed, respectively explicit content that is ascertained by the test component 20.
  • Figs. 2 and 3 describe flowcharts for two aspects of the monitoring performed by the method.
  • the cycle shown in fig. 2 is used to check whether a loss of data occurs as a result of the components 11-14 of the analytical system 10.
  • a loss of data is intended to be understood to mean the loss of a portion of the information sent in the test datum. When such a loss of data occurs in a test datum, it can be assumed that a loss of data takes place when the stream data are processed too. In this case, the cycle described in fig. 2 is repeated at periodic intervals. The description is provided with reference to a single test datum TD.
  • a test datum TD having a prescribed, respectively explicit content is provided by the test component 20.
  • the test datum TD is, on the one hand, transmitted to the transport layer 11 of the analytical system 10 in order to be integrated into the stream data and processed by the further components 12 to 14 of the analytical system 10 in step 210.
  • a processing logic unit of the test component 20 ascertains and stores a hash value for the content of the transmitted test datum TD by means of a prescribed hash function.
  • the hash value can be stored particularly together with an identifier of the transmitted test datum TD in order to be able to associate the read content with the transmitted test datum TD on reception of the test datum TD ' from the components 11-14 of the analytical system 10.
  • the content of the received test datum TD ' is read in step 230.
  • a further hash value is ascertained for the content of the received test datum TD ' , this being effected by the processing logic unit of the test component 20.
  • Data consistency comprises particularly the check to determine whether the order of a plurality of transmitted ⁇ ⁇ 17 000476 test data matches the order of the test data TD' processed by the components 11-14 and received by the test component 20.
  • the test data are prepared by the coding of a first timestamp or of a first sequence number in the prescribed, explicit content of the test data for transmission, this information being able to be stored together with an identifier of the test data for transmission before the test data TD are transmitted.
  • test data TD are transmitted to the components 11-14 of the analytical system 10, and processed by said components, sequentially, at regular or irregular intervals of time.
  • test data TD 1 that were processed by the components 11-14 of the analytical system 10 are received.
  • the read content is augmented by a second timestamp or a second sequence number and stored.
  • the second timestamp or the second sequence number can be stored together with the identifier of the test datum just received.
  • step 330 the order of the first timestamps or first sequence numbers of the plurality of successively sent test data TD is now compared with the order of the second timestamps or second sequence numbers of the test data received in chronological succession.
  • the proposed method creates a high level of confidence in the correct operation of the analytical system 10 at runtime. This is achieved by the regular transmission of prescribed test data that are integrated into the stream data. On the basis of the identifiers, the test data processed by the components of the analytical system can be identified by the test component and picked out from the stream data for further analysis.
  • Hash values and timestamps can therefore be used to establish losses of data and data inconsistencies during operation of the analytical system. This monitoring can take place at the runtime of the analytical system.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Maintenance And Management Of Digital Transmission (AREA)

Abstract

L'invention concerne un procédé de surveillance du fonctionnement prévu d'un système analytique (10) pour des données de flux, le système analytique (10) comprenant des composants logiciels pour traiter des données de flux qui sont reçues par le système analytique (10). Un composant de test (20) est intégré dans le système analytique (10). Le procédé effectue les étapes suivantes au moment de l'exécution du système analytique : la transmission d'au moins une donnée de test (TD) ayant un contenu prédéfini, respectivement explicite, au système analytique (10) pour un traitement par le système analytique (10), la donnée de test (TD) correspondant aux données de flux traitées par le système analytique (10) en termes de type et/ou en termes de format ; la réception de l'au moins une donnée de test (TD) et la lecture du contenu de l'au moins une donnée de test (TD) ; l'évaluation du contenu de l'au moins une donnée de test (TD) reçue au moyen d'une comparaison avec le contenu prescrit lors de la transmission de l'au moins une donnée de test (TD).
PCT/RU2017/000476 2017-06-30 2017-06-30 Procédé de surveillance d'un système analytique pour données de flux WO2019004859A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/RU2017/000476 WO2019004859A1 (fr) 2017-06-30 2017-06-30 Procédé de surveillance d'un système analytique pour données de flux

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/RU2017/000476 WO2019004859A1 (fr) 2017-06-30 2017-06-30 Procédé de surveillance d'un système analytique pour données de flux

Publications (1)

Publication Number Publication Date
WO2019004859A1 true WO2019004859A1 (fr) 2019-01-03

Family

ID=59858758

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/RU2017/000476 WO2019004859A1 (fr) 2017-06-30 2017-06-30 Procédé de surveillance d'un système analytique pour données de flux

Country Status (1)

Country Link
WO (1) WO2019004859A1 (fr)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2000007312A1 (fr) * 1998-07-31 2000-02-10 Gte Government Systems Corporation Systeme de detection d'intrusion et d'analyse de vulnerabilite dans un reseau de telecommunications semaphore
US20050251298A1 (en) * 2004-04-27 2005-11-10 The Boeing Company Automatic generation of telemetry flight software, accompanying specifications, and decode files

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2000007312A1 (fr) * 1998-07-31 2000-02-10 Gte Government Systems Corporation Systeme de detection d'intrusion et d'analyse de vulnerabilite dans un reseau de telecommunications semaphore
US20050251298A1 (en) * 2004-04-27 2005-11-10 The Boeing Company Automatic generation of telemetry flight software, accompanying specifications, and decode files

Similar Documents

Publication Publication Date Title
CN108563214B (zh) 车辆诊断方法、装置及设备
CN111506489B (zh) 测试方法、系统、设备、服务器及存储介质
US11762761B2 (en) Generating synthetic test cases for network fuzz testing
US11075927B2 (en) Fraud detection electronic control unit, electronic control unit, and non-transitory recording medium in which computer program is described
CN111221807B (zh) 一种面向云服务的工业设备大数据质量的测试方法及架构
JP7006622B2 (ja) 抽出装置、抽出方法と抽出プログラム、ならびに、異常検知装置、異常検知方法
TW201826203A (zh) 收集裝置、收集方法、程式及收集系統
US20130031532A1 (en) Method, computer, and device for validating execution of tasks in adaptable computer systems
CN107632909B (zh) 用于自动测试设备功能的方法及系统
US20210089010A1 (en) Method and system for providing process protocols for physical objects
CN111309584B (zh) 数据处理方法、装置、电子设备及存储介质
CN113342650B (zh) 分布式系统的混沌工程方法及装置
KR20200023882A (ko) 스마트 공장의 공정 데이터의 가공방법
WO2019004859A1 (fr) Procédé de surveillance d'un système analytique pour données de flux
CN117332412B (zh) 一种针对数据安全系统的检测方法、装置及电子设备
CN113836539A (zh) 基于精准测试的电力工控系统漏洞全流程处置系统及方法
CN112398672B (zh) 一种报文检测方法及装置
CN109086185B (zh) 一种存储集群的故障检测方法、装置、设备及存储介质
JP4257364B2 (ja) 通信エラー情報出力プログラム、通信エラー情報出力方法および通信エラー情報出力装置
CN113419885B (zh) 一种数据完整性处理方法、装置及电子设备
CN112184493A (zh) 基于大数据和装配式建筑平台的数据处理方法、系统及存储介质
CN114629690A (zh) 设备安全基线合规检测方法、装置和计算机设备
CN114490361A (zh) 测试脚本质量获取方法、装置、计算机设备和存储介质
JP4816169B2 (ja) グローバルプロセス生成方法、装置、システム、およびプログラム
CN101086713A (zh) 总线监视电路

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17765493

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17765493

Country of ref document: EP

Kind code of ref document: A1

点击 这是indexloc提供的php浏览器服务，不要输入任何密码和下载