Download as pdf
Download as pdf
You are on page 1of 29
EP 2 957 073 B1 “! MOON (1) EP 2 957 073 B41 (12) EUROPEAN PATENT SPECIFICATION (45) Date of publication and mention (51) Inte ofthe grant of the patent GosF 16/2000 24.06.2020 Bulletin 2020126 (86) International application number: (21) Applicaton number: 14751848.4 PcTiusz014/015771 (22) Date offing: 11.02.2014 (87) International pubicaon number: ‘Wo 2014/126909 (21.08.2014 Gazette 2014/34) (54) QUEUE MONITORING AND VISUALIZATION WARTESCHLANGENUBERWACHUNG UND -VISUALISIERUNG SURVEILLANCE ET VISUALISATION DE FILE D’ATTENTE, (84) Designated Contracting States: (74) Representative: Appelt, Christian W. ALAT BE BG CH CY GZ DE DK EE ES FIFRGB Bochmert & Bochmert GRHRHUIEISITLILTLULVMGMKMTNLNO | Anwaltspartnerschaft mbB PL PT RO RS SE SISK SMR Pettenkoferstrasse 22 ‘80336 Munchen (DE) (30) Priority: 14.02.2013 us 201361764794 P 18.03.2013 US 201313834491 (56) References cited US.A- 5 826 104 US.A1- 2003 120 681 (43) Date of publication of application: US.A1-2010 180092 US-A1-2011 055 388 23.12.2018 Bulletin 2015/52 US.A1-2012 275 307 US-B2-6 772.202 US.B2- 7 467 383 (73) Proprietor: AB Initio Technology LLC Lexington, Massachusetts 02421 (US) + 80.192.25.230: "Producer-consumer problem”, , 7 February 2013 (2013-02-07), XPO55530812, (72) Inventors: Retrieved from the Internet: + BUXBAUM, Mark URL:https:/ien.wikipedia.orgiwiindex.php7t ‘Acton, Massachusetts 01720 (US) itle=Producer’4E2%80%93consumer_problem&. + WAKELING, Tim old id=537111527 [retrieved on 2018-12-06] Lexington, MA 02421 (US) Note: Within nine months of the publication ofthe mention ofthe grant of the European patent in the European Patent Bulletin, any person may give notice to the European Patent Office of opposition to that patent, in accordance with the Implementing Regulations. Notice of oppostion shall not be deemed to have been fled until the opposition ee has been, paid, (Art 99(1) European Patent Convention) Py Se, 75001 PARE FR) 1 EP 2.957 073 B1 2 Description CLAIM OF PRIORITY [0004] This application claims priority to U.S. Patent Application Serial No. 61/764,794, fled on February 14, 2013, and to U.S. Patent Application Serial No 15/834,491, fled March 15, 2013, BACKGROUND [0002] This description relates to queue monitoring ‘and visualization, for instance in a data processing envi- ronment [0003] Enterprises use complex data processing sys tems, such as data warehousing, customer relationship management, and data mining, tomanage data. Inmany data processing systems, data are pulled from many ai ferent data sources, such as database files, operational systems, fat files, the Internet, ete into a central repos- itory, Often, data are transformed before being loaded in the data system, Transformation may include cleansing, integration, and extraction, To keep track of data, its sources, and the transformations that have happened to the data stored ina data system, metadata can be used Metadata (sometimes called “data about data’) are data that describe other data's attributes, format, origins, his tories, inter-relaionships, etc. Metadata management can play a central role in complex data processing sys tems. [0004] Sometimes a database user may wantto inves- ligate how certain data are derived from diferent data sources. For example, a database user may wanttoknow how adatasetordata object was generated or from which source a dataset or data object was imported. Tracing a ‘dataset back to sources from which itis derived is called {data lineage tracing (or ‘upstream data lineage tracing") Sometimes a database user may want investigate how certain datasets have been used (called “downstream {ala lineage tracing” or "impact analysis"), for example, which application has read a given dataset. A database User may also be interested in knowing how a datasetis related to other datasets. For example, a user may want to know if a dataset is modified, what tables willbe af- fected, ete [0005] Us 2010/180092 At describes a method and a system of visualization of changes in entities and their relationships in a vitual data center through a log fl, In ‘one embodiment, a machine-readable medium embod ying asetof instructions is disclosed. Periodically a snap: shot is captured from an application programming inter face of a management server. The snapshot comprises of entities and relationships of a virtual datacenter. An information of the snapshot is identifed. The identified information is relevant to visualization of a state of the virtual datacenter in a log file. An activity of a change in ‘entities and relationships of the virtual datacenter is tracked. An event is registered with the management 10 2» » 6 6 server through the application programming interface. Based on the event a corresponding delta operation is, created and added to the log file. ‘SUMMARY {0006} The present invention relates to computer-im- plemented method according to independent claim 1, to ‘a computer-readable medium according to independent claim 12, and to a computing system according to inde- pendent claim 13, Preferred embodiments described in the dependent claims 2to 11 and 14. {0007} In @ general aspect, a computer-implemented ‘method includes receivinginformation providedby a data processing application during execution of the data processing application. The information is indicative of at least one of a source of data forthe data processing application and a destination of data from the data processing application. The method includes dynamical- ly analyzing the information during execution of the data processing application to identify a queue in communi- cation withthe data processing application. The method includes dynamically analyzing the information during ‘execution ofthe data processing application to identity a relationship between the data processing application ang the queve, including at least one of identifying that the queue is the source of data for the data processing ap- plication and identifying that the queue isthe destination (of data from the data processing application. {0008} Embodiments may include one or more of the following. [0009] The information indicative of at least one of the source of data and the destination of data includes an identifier of the queue. [0010] The method includes dynamically determining 2 stalus of the queue during execution of the data processing application. In some cases, the method in- ‘ludes providing 2 notfication based on the status ofthe ‘queue. in some cases, the status includes at least one ‘of number of records in the queue and an elapsed time associated with the queue. [0011] The method includes determining @ status of the data processing application, [0012] The method includes receiving an input identi- fying the queue. In some cases, the method includes identifying the data processing application based on the processing and based on the input identifying the queue, [0013] The one or more data processing applications include computation graphs. [0014] The method includes generating a visual rep- resentation ofthe data processing application, the queue, {and the relationships between the data processing ap- plication and the queue. In some cases, the method in- Cludes displaying the visual representation on a user in- terface. In some cases, the visual representation in- Cludes a representation of a status of the queue. [0015] Ina general aspect, sofware stored on a com= puter-readable medium includes instructions for causing 3 EP 2.957 073 B1 4 ‘a computer system to receive information provided by a data processing application during execution of the data processing application. The information is indicative of at least one of a source of data for the data processing ‘pplication and a destination of data from the data processing application. The software includes instruc tions for causing the computer system to dynamically an. alyze the information during execution of the data processing application to identity a queue in communi- cation withthe data processing application; and dynam- ically analyze the information during execution ofthe data processing application to identity a relationship between the data processing application and the queue, including atleast one of identifying thatthe queue is the source of

You might also like